Kafka Streaming Architect

Expert guidance for designing, deploying, and operating Apache Kafka streaming platforms, covering topic architecture, producer/consumer patterns, stream processing, schema governance, cluster sizing, and disaster recovery.

Gold

v1.0.00 activationsDevOps & InfrastructureEngineeringexpert

SupaScore

84.25

Research Quality (15%)

8.5

Prompt Engineering (25%)

8.5

Practical Utility (15%)

8.5

Completeness (10%)

8.5

User Satisfaction (20%)

8.5

Decision Usefulness (15%)

Best for

▸Designing topic partitioning strategies for multi-tenant SaaS platforms
▸Implementing exactly-once semantics for financial transaction processing
▸Building schema evolution governance with Confluent Schema Registry
▸Architecting disaster recovery with cross-region cluster replication
▸Optimizing Kafka Connect pipelines for real-time CDC from PostgreSQL

What you'll get

●Comprehensive topic architecture with naming conventions, partition counts, replication factors, and retention policies tailored to specific use cases
●Producer and consumer configuration templates with batching, compression, and error handling patterns optimized for throughput and reliability
●Schema governance framework with compatibility rules, version migration strategies, and breaking change management processes

Not designed for ↓

×General message queue setup like RabbitMQ or AWS SQS
×Batch processing frameworks like Apache Spark or Hadoop
×Simple pub/sub implementations without streaming requirements
×Database design or SQL query optimization

Expects

Specific throughput requirements, latency targets, data retention needs, consistency guarantees, and existing infrastructure constraints.

Returns

Detailed architecture recommendations with partition strategies, producer/consumer configurations, schema governance patterns, and operational playbooks.

Evidence Policy

Enabled: this skill cites sources and distinguishes evidence from opinion.

kafkaevent-streamingdistributed-systemsstream-processingevent-driven-architectureschema-registrykafka-connectreal-time-datamessagingmicroservicesdata-integrationcdc

Research Foundation: 8 sources (3 official docs, 3 books, 1 industry frameworks, 1 academic)

This skill was developed through independent research and synthesis. SupaSkills is not affiliated with or endorsed by any cited author or organisation.

Version History

v1.0.02/16/2026

Initial release

Prerequisites

Use these skills first for best results.

Distributed Tracing EngineerGold

Works well with

Event-Driven Architecture DesignerGold Event Schema ArchitectGold Observability Pipeline DesignerGold Real-Time Analytics ArchitectGold Streaming Analytics SpecialistGold

Need more depth?

Specialist skills that go deeper in areas this skill touches.

Kubernetes Operations AdvisorGold Monitoring & Observability DesignerGold Disaster Recovery PlannerPlatinum

Common Workflows

Event-Driven Microservices Architecture

Design and implement a complete event-driven architecture from Kafka infrastructure through service design to monitoring and incident response

kafka-streaming-architect→Event-Driven Architecture Designer→Observability Pipeline Designer→incident-response-playbook-builder

Activate this skill in Claude Code

Start Free to Activate This Skill