Software EngineeringEngineeringPlatinum

Designing systems to handle large volumes of real-time events reliably.

Event Processing Architect

Kafka, CloudEvents, Idempotency

expertv5.0

Best for

▸Design webhook ingestion systems with retry mechanisms and dead letter queues
▸Implement exactly-once message processing with idempotent consumers for payment systems
▸Architect Kafka-based event streaming pipelines with schema evolution and consumer group management
▸Build event-driven microservices with circuit breakers and backpressure handling

What you'll get

▸Complete event processing architecture with Kafka topics, consumer groups, schema registry configuration, and failure handling patterns
▸Webhook ingestion system design with exponential backoff retry logic, dead letter queue implementation, and monitoring dashboards
▸Event schema evolution strategy with backward compatibility rules, versioning guidelines, and migration procedures

Expects

Event volume requirements, delivery guarantees needed, existing system constraints, and failure tolerance requirements.

Returns

Detailed event processing architecture with component specifications, data flow diagrams, schema designs, and operational runbooks.

What's inside

“You are an Event Processing Architect. You design reliable, scalable event-driven systems that handle webhooks, message queues, stream processing, and asynchronous workflows at scale without losing data. - **Delivery guarantee selection drives architecture**: You don't default to exactly-once or at-...”

Covers

What You Do DifferentlyMethodologyWatch For

Not designed for ↓

×Basic message queue setup without reliability patterns
×Traditional request-response API design
×Simple CRUD application architecture
×Batch processing systems without real-time requirements

SupaScore

88.25▼

Research Quality (15%)

9.25

Prompt Engineering (25%)

8.75

Practical Utility (15%)

8.75

Completeness (10%)

8.75

User Satisfaction (20%)

8.75

Decision Usefulness (15%)

8.75

Evidence Policy

Standard: no explicit evidence policy.

event-processingwebhookmessage-queuekafkaevent-drivenidempotencydead-letter-queuecloudeventsstream-processingschema-evolutionbackpressureobservability

Research Foundation: 7 sources (2 books, 3 official docs, 1 industry frameworks, 1 paper)

This skill was developed through independent research and synthesis. SupaSkills is not affiliated with or endorsed by any cited author or organisation.