Home / Stacks / Data Engineering Stack
🔁

Data Engineering Stack

Build and orchestrate modern data pipelines — Airflow and Dagster orchestration, dbt and SQLMesh transformations, Great Expectations quality gates, and battle-tested ETL patterns

10 skills · Works with Claude Code, Codex, Cursor & more

📊 Data
RARE

Apache Airflow

Build, debug, and operate Apache Airflow pipelines. Writes DAGs and TaskGroups, triggers and monitors runs via the CLI, reads task logs, diagnoses import and parse errors, and manages connections, variables, and pools.

Community 3.2K
Scanned
airflow orchestration dag
mkdir -p ~/.claude/skills/apache-airflow && curl -fsSL https://raw.githubusercontent.com/astronomer/agents/HEAD/skills/airflow/SKILL.md -o ~/.claude/skills/apache-airflow/SKILL.md
📊 Data
RARE

Dagster

Build asset-based data pipelines with Dagster and the dg CLI. Creates projects, defines software-defined assets, schedules, sensors, and components, then debugs materializations and project structure.

Community 2.6K
Scanned
dagster orchestration data-assets
mkdir -p ~/.claude/skills/dagster-orchestration && curl -fsSL https://raw.githubusercontent.com/dagster-io/skills/HEAD/skills/dagster-expert/skills/dagster-expert/SKILL.md -o ~/.claude/skills/dagster-orchestration/SKILL.md
📊 Data
RARE

dbt (Data Build Tool)

Build, test, and ship analytics-engineering projects with dbt. Scaffolds projects, generates models and sources, writes data tests and documentation, manages packages, and deploys to dbt Cloud or Core.

Community 2.9K
Scanned
dbt analytics-engineering sql
mkdir -p ~/.claude/skills/dbt-analytics && curl -fsSL https://raw.githubusercontent.com/DipakMandlik/Pi-Skills/HEAD/src/skills/dbt-developer.skill.md -o ~/.claude/skills/dbt-analytics/SKILL.md
📊 Data
RARE

Great Expectations Data Quality

Add automated data-quality gates with Great Expectations. Profiles datasets, generates expectation suites, runs validations and checkpoints, and wires quality gates into pipelines to catch bad data early.

Community 1.7K
Scanned
great-expectations data-quality validation
mkdir -p ~/.claude/skills/great-expectations && curl -fsSL https://raw.githubusercontent.com/jamiojala/skillforge/HEAD/skills/data-quality-gatekeeper/SKILL.md -o ~/.claude/skills/great-expectations/SKILL.md
📊 Data
RARE

Data Pipeline & ETL

Build data pipelines and ETL workflows. Generates extraction scripts, transformation logic, loading procedures, and scheduling for moving data between APIs, databases, warehouses, and file systems.

Community 1.9K
Scanned
etl data-pipeline data-engineering
mkdir -p ~/.claude/skills/data-pipeline-etl && curl -fsSL https://raw.githubusercontent.com/Jeffallan/claude-skills/HEAD/skills/spark-engineer/SKILL.md -o ~/.claude/skills/data-pipeline-etl/SKILL.md
📊 Data
RARE

Kestra Orchestration

Orchestrate data workflows with Kestra's declarative YAML. Writes flows with schedule, webhook, and flow triggers, script tasks, and parallel or conditional logic, adds retries, timeouts, and error handling, and migrates DAGs from Airflow or Prefect.

Community 1.3K
Scanned
kestra orchestration workflows
mkdir -p ~/.claude/skills/kestra-orchestration && curl -fsSL https://raw.githubusercontent.com/lemig/kestra-template/main/.claude/skills/kestra/SKILL.md -o ~/.claude/skills/kestra-orchestration/SKILL.md
📊 Data
RARE

Airbyte Data Integration

Move data with Airbyte ELT. Configures sources and destinations, builds and tests custom connectors with the CDK, sets up incremental and CDC replication, schedules syncs, and wires failure alerting across 300+ APIs and databases.

Community 2.1K
Scanned
airbyte elt data-integration
mkdir -p ~/.claude/skills/airbyte-connectors && curl -fsSL https://raw.githubusercontent.com/TerminalSkills/skills/main/skills/airbyte/SKILL.md -o ~/.claude/skills/airbyte-connectors/SKILL.md
📊 Data
RARE

Soda Data Quality

Catch bad data before it hits dashboards with Soda. Writes SodaCL checks for freshness, completeness, uniqueness, validity, and custom business rules, profiles datasets, and wires quality gates into pipelines and CI to stop bad data early.

Community 1.5K
Scanned
soda data-quality testing
mkdir -p ~/.claude/skills/soda-data-quality && curl -fsSL https://raw.githubusercontent.com/TerminalSkills/skills/main/skills/soda/SKILL.md -o ~/.claude/skills/soda-data-quality/SKILL.md

More Stacks

🤝

Agent Engineering Kit

Engineer reliable AI agents — build on the Claude Agent SDK, coordinate teams with multi-agent patterns, give them memory, and keep them safe with mechanical guardrails and evaluation
🕹️

AI Agent Frameworks

Pick the right framework and ship agents fast — type-safe Python with Pydantic AI, multi-agent orchestration with OpenAI Agents SDK, Agno, and CrewAI, TypeScript graphs with LangGraph.js, and typed workflows with Mastra
🤖

AI Builder Stack

Build AI-powered applications with RAG, multi-agent systems, prompt engineering, and MCP integrations

View all stacks →

Added to wishlist