Gem 1

Spring for Apache Kafka (spring-kafka) maps core Apache Kafka concepts into familiar Spring Framework programming models, using high-level abstractions and annotations. [1]

Core Apache Kafka Vocabulary

Broker: An individual Kafka server running in a cluster that stores data and serves client requests.
Producer: An application or service that publishes (sends) records or events to a Kafka topic.
Consumer: An application or service that subscribes to and reads records from topics.
Topic: A category, channel, or feed name to which records are published.
Partition: A physical subdivision of a topic across multiple logs, enabling horizontal scaling and parallel processing.
Offset: A sequential ID number assigned to a message within a specific partition, acting as a read progress bookmark.
Consumer Group: A collection of independent consumer instances working together to consume a topic, ensuring each partition is read by only one consumer in the group. [2, 3, 4, 5]

Spring-Specific Vocabulary & Abstractions

KafkaTemplate: A high-level Spring abstraction and helper class that simplifies sending messages to topics with methods like send(). [1, 6]
@KafkaListener: A method-level annotation used to turn a Plain Old Java Object (POJO) method into a message-driven event consumer. [1, 6]
Listener Container: The underlying runtime engine managed by Spring that handles the message-listening lifecycle, creation of message loops, multi-threading, and offset commits. [6]
Consumer Record (ConsumerRecord): A wrapper object passed into listener methods that exposes the raw payload alongside rich metadata (such as topic, partition, timestamp, and offset). [6]
Kafka Properties (spring.kafka.*): Configuration keys utilized inside Spring Boot’s application.yml or application.properties to auto-configure producers, consumers, and bootstrap servers. [6, 7]