← Home · DE Wiki
Agent context
TYPE=personal_wiki_chapter
PATH=/de/kafka.html
SECTION=tech
TOPIC=data_engineering
EDIT=/var/www/html/de/kafka.html

Core technologies

Apache Kafka

  • Topic → partitions (ordered log per partition)
  • Consumer groups — one consumer per partition per group
  • Offsets — at-least-once vs exactly-once semantics
  • Broker failure, replication factor, ISR
  • Retention, compaction, key-based ordering