← Back to Skills
DevOps & InfrastructureEngineeringPlatinum

Need expert help with Apache Kafka streaming platforms.

Kafka Streaming Architect

Apache Kafka, Confluent, Schema Registry

intermediatev6.1

Best for

  • Designing topic partitioning strategies for multi-tenant SaaS platforms
  • Implementing exactly-once semantics for financial transaction processing
  • Building schema evolution governance with Confluent Schema Registry
  • Architecting disaster recovery with cross-region cluster replication

What you'll get

  • Comprehensive topic architecture with naming conventions, partition counts, replication factors, and retention policies tailored to specific use cases
  • Producer and consumer configuration templates with batching, compression, and error handling patterns optimized for throughput and reliability
  • Schema governance framework with compatibility rules, version migration strategies, and breaking change management processes
Expects

Specific throughput requirements, latency targets, data retention needs, consistency guarantees, and existing infrastructure constraints.

Returns

Detailed architecture recommendations with partition strategies, producer/consumer configurations, schema governance patterns, and operational playbooks.

What's inside

You are a Kafka Streaming Architect. You design, deploy, and operate Apache Kafka-based streaming platforms for mission-critical production workloads. - **Partition-first thinking.** Every architecture decision traces back to partition count, because it sets the ceiling on parallelism, consumer scal...

Covers

What You Do DifferentlyMethodologyWatch For
Not designed for ↓
  • ×General message queue setup like RabbitMQ or AWS SQS
  • ×Batch processing frameworks like Apache Spark or Hadoop
  • ×Simple pub/sub implementations without streaming requirements
  • ×Database design or SQL query optimization

SupaScore

88.58
Research Quality (15%)
9.1
Prompt Engineering (25%)
8.95
Practical Utility (15%)
8.65
Completeness (10%)
8.85
User Satisfaction (20%)
8.8
Decision Usefulness (15%)
8.75

Evidence Policy

Standard: no explicit evidence policy.

kafkaevent-streamingdistributed-systemsstream-processingevent-driven-architectureschema-registrykafka-connectreal-time-datamessagingmicroservicesdata-integrationcdc

Research Foundation: 8 sources (3 official docs, 3 books, 1 industry frameworks, 1 academic)

This skill was developed through independent research and synthesis. SupaSkills is not affiliated with or endorsed by any cited author or organisation.

Version History

v6.17/3/2026

content refresh 2026-07: freshness review findings fixed (stale APIs, retired tooling, invented precision)

v6.06/16/2026

v6.0 wave-1 repair: re-distilled from masterfile/v2 (truncation incident 2026-06, delta-first rules)

v5.03/25/2026

v5.5 distilled from v2 via Claude Sonnet

v2.02/23/2026

Pipeline v4: rebuilt with 3 helper skills

v1.0.02/16/2026

Initial release

Prerequisites

Use these skills first for best results.

Works well with

Need more depth?

Specialist skills that go deeper in areas this skill touches.

Common Workflows

Event-Driven Microservices Architecture

Design and implement a complete event-driven architecture from Kafka infrastructure through service design to monitoring and incident response

kafka-streaming-architectEvent-Driven Architecture DesignerObservability Pipeline Designerincident-response-playbook-builder

© 2026 Kill The Dragon GmbH. This skill and its system prompt are protected by copyright. Unauthorised redistribution is prohibited. Terms of Service · Legal Notice