Skills / Data / Prefect Workflows

Prefect Workflows

Orchestrate Python data workflows with Prefect. Writes flows and tasks, configures retries and caching, creates deployments, and monitors runs through the Prefect UI and CLI.

This skill builds and operates Prefect 3 workflows. It writes flows and tasks with retries, caching, and concurrency limits, creates deployments and schedules, configures work pools, and monitors runs via the Prefect UI and CLI — turning ordinary Python functions into observable, resilient pipelines.

prefect orchestration python workflows etl

When to use

Use when building Prefect flows and tasks, adding retries or caching, creating deployments and schedules, or monitoring workflow runs.

Examples

Build an ETL flow

Compose tasks into a flow

Write a Prefect flow with extract, transform, and load tasks, adding retries with exponential backoff and caching on the extract step

Create a deployment

Schedule a flow

Create a Prefect deployment for my etl flow that runs every hour from a process work pool

Monitor a run

Inspect failures

My Prefect flow run failed mid-way. Show me which task failed and recommend a retry strategy
Added to wishlist