Rr 114 expose metadata

[ryanraaschCDC]

No description provided.

[Copilot]

Pull request overview

This PR adds support for exposing dataset/version metadata when fetching dataframes from the catalog, and introduces a new dependency to store metadata on Polars objects.

Changes:

• Add with_metadata and print_version parameters to BlobEndpoint.get_dataframe() to optionally attach metadata and control version logging.
• Add polars-config-meta as a project dependency and lock it in uv.lock.
• Introduce a new resolve_version() helper intended to return resolved version/blob URL metadata.

Reviewed changes

Copilot reviewed 2 out of 3 changed files in this pull request and generated 7 comments.

File	Description
uv.lock	Locks the new polars-config-meta dependency.
pyproject.toml	Adds polars-config-meta to runtime dependencies.
cfa/dataops/catalog.py	Adds metadata/printing options to get_dataframe and introduces resolve_version.

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[Copilot]

Pull request overview

Copilot reviewed 3 out of 4 changed files in this pull request and generated 4 comments.

[Copilot]

Pull request overview

Copilot reviewed 6 out of 7 changed files in this pull request and generated 4 comments.

[Copilot]

Pull request overview

Copilot reviewed 8 out of 9 changed files in this pull request and generated 2 comments.

Comments suppressed due to low confidence (2)

cfa/dataops/catalog.py:510

• get_dataframe() calls _get_version_blobs() and then calls resolve_version(), which calls _get_version_blobs() again. This is both redundant and can be inconsistent if available versions change between calls; it also breaks ledger endpoints because resolve_version() may yield blob_url=None. Derive file_ext/fullpath directly from the already-fetched version_blobs instead of re-resolving.

        version_blobs, _ = self._get_version_blobs(
            version_spec=version_spec, selection=selection, print_version=print_version
        )
        version_meta = self.resolve_version(
            version_spec=version_spec, selection=selection

cfa/dataops/catalog.py:489

• The get_dataframe() signature restricts selection to Literal["newest", "oldest"], but the docstring still mentions "all". This makes the public API docs inconsistent with the actual callable surface.

            version_spec (str, optional): the version of the data to get.
                Defaults to "latest".
            selection (Literal["newest", "oldest", "all"], optional): whether to get the newest, oldest, or all matching versions. Defaults to "newest".
            print_version (bool, optional): whether to print the version being used. Defaults to False.

[damonbayer]

I'm pretty confused about _get_version_blobs. Left a comment.

[damonbayer]

This still needs to be added to the stubs.

[damonbayer]

Thanks so much @ryanraaschCDC!