mozilla-bigquery-etl-skills

Plugin mozilla-bigquery-etl-skills from marketplace cascade-data-storage in joshuarweaver/cascade-data-storage. Commands read from the repo's manifest — 1 month ago.

Skills (13)

• base-schema-audit

  Use this skill to audit tables for missing column descriptions and classify each missing column into the correct base schema promotion target (global.yaml, app_<product>.yaml, or <dataset_name>.yaml). Accepts a dataset name and an optional table filter — omit the filter to audit all tables in the da

• bigconfig-generator

  Use this skill when creating or updating Bigeye monitoring configurations (bigconfig.yml files) for BigQuery tables. Works with metadata-manager skill.

• bigquery-etl-core

  The core skill for working within the bigquery-etl repository. Use this skill when understanding project structure, conventions, and common patterns. Works with model-requirements, query-writer, metadata-manager, sql-test-generator, and bigconfig-generator skills.

• column-description-finder

  Use this skill when looking up, auditing, or managing column descriptions from global, application-specific, and dataset-specific column definition YAML files (bigquery_etl/schema/global.yaml, bigquery_etl/schema/app_<name>.yaml, and bigquery_etl/schema/<dataset>.yaml). Use it to find a description

• create-pr

  Use this skill when the prompt asks to create, open, or submit a pull request in the bigquery-etl repository. Handles branch creation, staging, committing, pushing, and opening a draft PR with a structured description. Triggered by phrases like "create a PR", "open a PR", "submit a PR", "push and op

• glean-description-lookup

  Use this skill when looking up field descriptions for Mozilla Glean telemetry tables (tables ending in _live or _stable, e.g. <app>_stable.<ping>_v1). Fetches descriptions from the Glean Dictionary (dictionary.telemetry.mozilla.org) using WebFetch with targeted field extraction — only the fields ref

• metadata-manager

  Use this skill when creating or updating DAG configurations (dags.yaml), schema.yaml, and metadata.yaml files for BigQuery tables. Handles creating new DAGs when needed and coordinates test updates when queries are modified (invokes sql-test-generator as needed). Works with bigquery-etl-core, query-

• model-requirements

  Use this skill when gathering requirements for new BigQuery data models OR when asked to edit existing queries in bqetl. For new models, guides structured requirements interviews. For existing queries, understands current model, checks downstream dependencies, and gathers requirements for changes. W

• query-writer

  Use this skill when writing or updating SQL queries (query.sql) or Python ETL scripts (query.py) following Mozilla BigQuery ETL conventions. ALWAYS checks for and updates existing tests when modifying queries. Coordinates downstream updates to schemas and tests. Works with bigquery-etl-core, metadat

• schema-enricher

  Use this skill to enrich schema.yaml files for BigQuery tables in the bigquery-etl repository. Handles creating schema.yaml when it doesn't exist, finding and filling missing column descriptions (from base schemas, upstream source schema, query context, or application context), validating columns ag

• schema-readme-generator

  Use this skill to create or update README.md files for BigQuery ETL tables in the mozilla bigquery-etl repository. Follows layout conventions derived from comparing README files across the repo — rich style with emoji headings, Mermaid data flow diagram, graduated example queries, and concise metada

• skill-creator

  ALWAYS use this skill when users ask to "create a skill", "make a skill for...", "add a new skill", or similar requests. This skill guides the creation of effective skills in the bigquery-etl repository that extend Claude's capabilities with specialized knowledge for BigQuery ETL workflows, Mozilla

• sql-test-generator

  ALWAYS use this skill when users ask to create, generate, or write UNIT TESTS for BigQuery SQL queries. Invoke proactively whenever the request includes "test" or "tests" with a query/table name. This skill is for unit testing ONLY (not data quality checks - use bigconfig-generator for Bigeye monito

Subagents (4)

• base-schema-curator

  Autonomously audits and updates all base schema files in bigquery_etl/schema/. Fixes type mismatches, missing descriptions, missing modes, and cross-file duplicates. Promotes fields from dataset tables into the correct base schema file (global.yaml, app_<product>.yaml, <dataset_name>.yaml) and creat

• etl-orchestrator

  Autonomously builds complete BigQuery data models from provided requirements through testing and monitoring. Use when you have clear requirements and need full ETL pipelines, new tables, or complex multi-step data workflows implemented end-to-end.

• missing-metadata-schema-curator

  Autonomously picks up pre-generated _missing_metadata.yaml files from bigquery_etl/schema/missing_metadata/ and updates the base schema files in bigquery_etl/schema/ — fixing type mismatches, adding missing mode and description fields, removing cross-file duplicates, promoting commonly-used fields i

• schema-creation-agent

  Generates or enriches the schema and README for query files in the bigquery-etl repository.

Similar plugins