Draft
Conversation
SQL Generation Speed: Store pickled query AST
Update dependencies based on python >=3.10
This reverts commit fd5d215.
Add custom metadata field to node revision.
* Add caching for node SQL * Move system SQL over to use the query cache manager * Move all final stage SQL builders to a single file for cleaner organization * Add caching for various data endpoints * Remove now unused QueryRequest logic * Fix client with query service fixture
Co-authored-by: GitHub Actions Bot <>
* Add service account support * Make service account expiration window configurable * Clean up test user fixtures and fix tests * Convert to principal kind enum to distinguish between users and service accounts * Rename to created_by * Add check where only users can create service accounts * Add checks for service account when requesting token * Add check for invalid service account creds * Fix alembic revision
* Move the various node API CRUD calls to separate functions so that they can be reused elsewhere * Move upserting reference dimension link to separate function * Move create source API call to separate function
Co-authored-by: GitHub Actions Bot <>
…sed in (DataJunction#1492) * Enable session context without request * Background tasks should not have request-bound sessions or objects passed into them, so we pass along identifiers rather than sessions and ORM objects and use a session factory to ensure that the task is fully self-contained * Handle materialization jobs run through background tasks and run directly via diff sessions
* Speed up the hard deletion of namespaces, along with cascading hard deletion of nodes * Clean up hard delete response
* Speed up creating a node by pushing some tasks async * Add further optimizations to AST * Fix * Fix test after background tasks override * Update node.py
Co-authored-by: GitHub Actions Bot <>
…tion#1501) When running client tests, print the missing coverage lines Fix client tests to work with async pg connection
* Background tasks should not have request-bound sessions or objects passed into them, so we pass along identifiers rather than sessions and ORM objects and use a session factory to ensure that the task is fully self-contained * Handle materialization jobs run through background tasks and run directly via diff sessions * Add bulk deployment endpoint for a namespace that takes a set of node specifications Add setup for upserting and change detection Add check for dimension link dependencies and fix tests * Save deployment state to database * Configure a unique session per pytest-xdist worker to fix tests * Add support for exporting and better operations management * Add support for partitions * Add attributes deployment * Add test coverage for deploy * Remove extraneous load options * When hard-deleting, we should raise if a node doesn't exist * Add broader test coverage for setting column properties, partitions, dimension links etc
✅ Deploy Preview for thriving-cassata-78ae72 canceled.
|
shangyian
force-pushed
the
pydantic_v2
branch
from
d44ae77 to
acb38be
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
6 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
This sets up an MCP server for DJ. It depends on #1509, which I'll rebase on top of once that's in.
Test Plan
make checkpassesmake testshows 100% unit test coverageDeployment Plan