Airbyte ELT

Move data between 400+ sources and destinations with Airbyte. Generates connector configs, custom Python CDK connectors, sync schedules, and Terraform-managed deployments for Airbyte Cloud and OSS.

This skill builds production Airbyte pipelines: connection configs with stream selection and sync modes (full refresh, incremental, CDC), custom source connectors using the Python CDK or low-code YAML, Terraform-managed Airbyte Cloud workspaces, and PyAirbyte for embedded extraction in notebooks. Covers Airbyte OSS, Cloud, and self-hosted Kubernetes.

When to use

Use when replicating SaaS data into a warehouse, building custom connectors for internal APIs, managing Airbyte at scale via IaC, or embedding extraction logic in Python.

Examples

Custom low-code connector

Build a connector for an internal REST API

Build an Airbyte low-code YAML connector for our internal billing API: paginated, OAuth2 bearer auth, incremental sync keyed on updated_at, with three streams

Terraform-managed sync

Provision sources, destinations, and connections via IaC

Write Terraform using the airbyte provider to declare a Stripe source, a Snowflake destination, and a daily incremental sync between them