dataproduct-builder-databricks

Plugin dataproduct-builder-databricks in entropy-data/dataproduct-builder-databricks. Commands read from the repo's manifest — 1 month ago.

Skills (9)

• datacontract-edit

  Edit an output-port ODCS file under src/output_ports/v<N>/, run the contract test against the live data, and classify any failures as breaking or non-breaking changes — with suggested fixes. Only edits output-port contracts (the spec this data product commits to); input-port contracts under src/inpu

• datacontract-test

  Run the Data Contract CLI (`datacontract test`) against ODCS contracts in the project to verify the live data still conforms — schema, quality rules, and freshness. Handles two kinds of contracts with different semantics: output-port contracts under `src/output_ports/**/*.odcs.yaml` (tested against

• dataproduct-deploy

  Validate, deploy, and run the Declarative Automation Bundle's Lakeflow pipeline against a chosen Databricks target. Wraps `databricks bundle validate`, `databricks bundle deploy`, and `databricks bundle run`, then polls `databricks pipelines get` for completion and surfaces any failed expectations o

• dataproduct-exampledata

  Extract a small sample of rows from a Databricks output port via a non-production SQL warehouse, scrub anything classified as PII or sensitive in the data contract, and upload the scrubbed sample to Entropy Data via the entropy-data CLI. Trigger when the user asks to "upload example data", "publish

• dataproduct-implement

  Given an Entropy Data data product URL or id, fetch its data contracts (output port ODCS files written next to the Python under src/output_ports/v<N>/, input port ODCS files cached next to their Spark reader under src/input_ports/), translate the schema into Lakeflow @dp.materialized_view / @dp.tabl

• dataproduct-init

  Initialize a brand-new Databricks data product from scratch — create databricks.yml (Declarative Automation Bundle with `dev` and `prod` targets), a serverless Lakeflow Spark Declarative Pipeline resource, a Lakeflow Job that schedules it, the src/{input_ports,transformations,output_ports/v1}/ layou

• dataproduct-share

  Sync approved Entropy Data access agreements to Unity Catalog grants (internal consumers) or Delta Shares (external consumers). Reads `entropy-data access list --provider-dataproduct <id>`, filters to active agreements, and applies `GRANT SELECT` on the output port's table or creates a Delta Share w

• entropy-data-publish

  Audit a Declarative Automation Bundle against the Entropy Data reference layout and add anything missing — Open Data Product Specification (ODPS), Open Data Contract Standard (ODCS), and the GitHub Actions publish workflow that deploys the bundle, runs the Lakeflow pipeline, runs the contract test,

• entropy-data-teams

  List the teams configured in Entropy Data so the user can pick one as the owner (`team.name` in ODPS) of a data product. Useful when initializing a new data product, integrating an existing Databricks bundle, or just exploring who owns what. Trigger when the user asks "what teams are there", "who ca

Hooks (1)

• PostToolUse

  ${CLAUDE_PLUGIN_ROOT}/hooks/datacontract_lint.sh

Similar plugins