Skip to content

Add Databricks API support for notebooks, jobs, and clusters #1243

Description

@anusha-sharma

No Databricks APIs are currently available for managing notebooks, jobs, or clusters. Specifically requested capabilities:

  • Create/manage Databricks Notebooks (Workspace REST API)
  • Create/manage Databricks Jobs/Workflows (Jobs API) for scheduling and orchestration
  • Create/manage Delta Live Tables (DLT) pipelines
  • Manage clusters/compute (Cluster API)

Currently, altimate-code can only interact with Databricks via SQL warehouse connections (sql_execute, schema_inspect, dbt models, cost/finops analysis, lineage). There's no way to programmatically create or manage notebooks, jobs, or clusters directly — users must generate the content as text and manually apply it via the Databricks UI or CLI. Native API integration for these would let altimate-code build and orchestrate full Databricks pipelines, not just SQL-layer transformations.


Metadata

Field Value
CLI Version 0.9.7
Platform darwin
Architecture arm64
OS Release 25.5.0
Category feature

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requestfrom-cliFeedback submitted via CLIuser-feedbackFeedback submitted by users

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions