Apache Airflow

Build, debug, and operate Apache Airflow pipelines. Writes DAGs and TaskGroups, triggers and monitors runs via the CLI, reads task logs, diagnoses import and parse errors, and manages connections, variables, and pools.

Maintained by Astronomer, this skill makes Claude fluent in Apache Airflow. It scaffolds idempotent DAGs and TaskGroups, triggers and backfills runs, reads task logs to diagnose failures, debugs DAG import/parse errors, and manages connections, variables, pools, and health checks. Routes to sub-skills for writing, deploying, and migrating Airflow 2 to 3.

When to use

Use when authoring or debugging Airflow DAGs, triggering or backfilling pipeline runs, diagnosing broken DAGs and import errors, or managing Airflow connections, variables, and pools.

Examples

Author an ETL DAG

Scaffold a scheduled pipeline

Write an Airflow DAG that extracts daily orders from Postgres, transforms them with a TaskGroup, and loads them into BigQuery with retries and idempotent backfills

Debug a broken DAG

Diagnose an import error

My Airflow DAG fails to parse with an import error. Read the logs, find the root cause, and fix the DAG so it appears in the UI

Trigger and monitor a run

Operate via the CLI

Trigger the sales_pipeline DAG, watch the task logs, and tell me which task failed and why