Redpanda Streaming

Run Kafka-compatible streaming on Redpanda with rpk. Creates and configures topics, manages clusters, profiles, and connections, wires SASL and TLS and the schema registry, and operates tiered storage — a drop-in Kafka replacement with no ZooKeeper.

This skill operates Redpanda, the Kafka-compatible streaming platform, through the rpk CLI: installing and configuring rpk, creating profiles for self-hosted and Redpanda Cloud clusters, managing topics, partitions, and consumer groups, wiring SASL and TLS credentials and the schema registry, and enabling enterprise features like tiered storage and Iceberg topics — all without ZooKeeper.

When to use

Use when creating or configuring Redpanda topics, setting up rpk profiles and connections, managing clusters or consumer groups, wiring SASL/TLS or schema registry, or enabling tiered storage.

Examples

Create a topic

Configure with rpk

Use rpk to create a Redpanda topic with 12 partitions, a 7-day retention, and a compaction cleanup policy

Connect to a cluster

rpk profile setup

Set up an rpk profile that connects to my Redpanda Cloud cluster with SASL credentials and TLS

Enable tiered storage

Offload to object storage

Configure tiered storage on my Redpanda cluster so older log segments offload to S3