MetisField Guide

Practical notes for understanding and building modern software systems.

Sections
HomeKnowledgeMetis Coach
Topics10
00Java06
01JavaScript11
02React09
03Next.js09
04Spring WebFlux06
05Kafka06
Fundamentals & InternalsProducers & ConsumersKafka StreamsEvent-Driven ArchitectureCustom ConnectorsData Pipelines
06Architecture12
07Patterns11
08Fundamentals26
09AI Engineering06
indexed102 entries · 10 topics
field guide / knowledge / kafka
Metis
~/knowledge/kafka

Topic / 6 published entries

Kafka

Apache Kafka fundamentals, Kafka Streams, event-driven architecture, and custom connectors.

Track
kafka
00

Kafka Connect & Custom Connectors

Kafka Connect architecture, source vs sink connectors, SMTs (Single Message Transforms), Debezium CDC, and building custom connectors.

#kafka#kafka-connect#debezium#cdc
01

Kafka Data Pipelines

Building high-volume data pipelines with Kafka — partitioning strategy, consumer lag monitoring, dead letter queues, schema evolution, and exactly-once ETL patterns.

#kafka#data-pipeline#etl#consumer-lag
02

Event-Driven Architecture with Kafka

Event sourcing, CQRS, outbox pattern, domain events vs integration events, event schema evolution with Avro/Schema Registry.

#kafka#event-driven#event-sourcing#cqrs
03

Kafka Fundamentals & Internals

Topics, partitions, offsets, brokers, replication, ISR, log compaction, and how Kafka achieves durability and high throughput.

#kafka#partitions#replication#isr
04

Kafka Streams: Stateful Processing

Building idempotent, exactly-once data pipelines with Kafka Streams — topology design, state stores, and windowed aggregations.

#kafka#streams#java#eda
05

Kafka Producers & Consumers

Producer batching, acks, idempotence, consumer groups, partition assignment, rebalancing, and at-least-once vs exactly-once delivery semantics.

#kafka#producer#consumer#consumer-group