data-messaging-skills

Plugin data-messaging-skills from marketplace ops-engineering-skills in selvarajmurugesan90/ops-engineering-skills. Commands read from the repo's manifest — 1 month ago.

Skills (13)

• airflow-dag-authoring-and-validation

  Authors Apache Airflow DAGs — task dependencies, operator choice, sensors, idempotency — and validates them with `airflow dags test`, import-time checks, and DAG linting before they reach a production scheduler. Use when the user asks to "write an Airflow DAG," "add a task dependency," "use a sensor

• airflow-scheduler-and-dag-troubleshooting

  Diagnoses a stuck or failed Airflow DAG run, scheduler-health problems (slow parsing, stuck queued tasks), and plans safe task-retry/backfill strategy. Use when the user reports "Airflow DAG is stuck," "task stuck in queued state," "scheduler seems unhealthy," "DAG run failed and I need to retry it,

• dagster-and-prefect-pipeline-authoring

  Authors data pipelines with Dagster's asset-based model or Prefect's Pythonic flow/task model as modern alternatives to Airflow, and gives a decision framework for when each fits better than task-based DAG orchestration. Use when the user asks to "write a Dagster asset," "define a Prefect flow," "sh

• kafka-cluster-configuration

  Designs Apache Kafka broker configuration, topic/partition layout, replication factor, and cluster metadata mode (ZooKeeper vs. KRaft). Use when the user asks to "size a Kafka cluster," "set replication factor," "design topic partitions," "configure Kafka brokers," "migrate from ZooKeeper to KRaft,"

• kafka-configuration-validation

  Validates Kafka topic configuration (retention, cleanup policy, replication, min.insync.replicas) and consumer group settings before a production rollout. Use when the user asks to "review a Kafka topic config before deploying," "validate retention/compaction settings," "check consumer group config

• kafka-consumer-lag-and-partition-troubleshooting

  Diagnoses growing Kafka consumer lag, rebalance storms, and under-replicated partitions in a running cluster. Use when the user reports "consumer lag keeps growing," "consumer group stuck rebalancing," "under-replicated partitions," "Kafka consumers keep dropping out of the group," or asks to troubl

• kafka-schema-registry-and-compatibility-management

  Manages Avro/Protobuf/JSON Schema in a schema registry for Kafka topics, including compatibility mode selection (backward/forward/full) and schema evolution that doesn't break existing consumers. Use when the user asks to "register a Kafka schema," "change compatibility mode," "evolve an Avro schema

• nats-and-pulsar-lightweight-messaging-configuration

  Configures NATS core pub/sub and JetStream persistence, and Apache Pulsar topics/subscriptions, as lighter-weight alternatives to Kafka or RabbitMQ, and gives a decision framework for when each fits better. Use when the user asks to "set up NATS," "configure JetStream streams and consumers," "set up

• rabbitmq-configuration-validation

  Validates RabbitMQ queue durability, mirroring/quorum configuration, and resource limits before production use. Use when the user asks to "review a RabbitMQ queue config before deploying," "check queue durability settings," "validate quorum/mirroring config," "audit RabbitMQ for production readiness

• rabbitmq-configuration

  Designs RabbitMQ exchange/queue/binding topology, virtual host separation, and clustering for high availability. Use when the user asks to "design a RabbitMQ exchange," "set up queue bindings," "create a virtual host," "cluster RabbitMQ nodes," "choose exchange type," or set up a new RabbitMQ deploy

• rabbitmq-queue-and-dead-letter-troubleshooting

  Diagnoses RabbitMQ message pileup, growing queue depth, and dead-letter queues filling up unexpectedly, including poison-message patterns that make a consumer redeliver-then-fail in a loop. Use when the user reports "RabbitMQ queue depth keeps growing," "consumers aren't draining a queue," "dead-let

• temporal-configuration-validation

  Validates Temporal worker task queue configuration, activity timeout/retry policy settings, and namespace configuration (retention, visibility archival) before a workflow goes to production. Use when the user asks to "review this Temporal worker config before deploy," "check our activity timeout/ret

• temporal-durable-workflow-orchestration

  Guides authoring Temporal workflows and activities using the durable execution model — deterministic workflow code that automatically replays from event history after a crash, activities that retry independently with their own backoff policy, and signals/queries for interacting with a long-running w

Similar plugins