Kafka 프로듀서 입문

In modern applications, systems often need to react to events as they happen, rather than just waiting for requests. This is the core idea behind Event-Driven Architecture (EDA).

EDA helps build flexible and scalable systems by allowing different parts of your application to communicate asynchronously through events.

Apache Kafka is a powerful, distributed streaming platform often used to build event-driven microservices. It's designed for high-throughput, low-latency processing of real-time data feeds.

Think of it as a super-fast, durable message queue that can handle huge amounts of data.

Kafka revolves around a few key ideas:

• Producers: Applications that send data (messages/records) to Kafka.
• Consumers: Applications that read data from Kafka.
• Topics: Categories or feeds to which records are published. Consumers subscribe to topics.
• Brokers: Kafka servers that store the published data.

A Kafka Producer is responsible for creating and sending data records to Kafka topics. These records are often key-value pairs, though the key is optional.

Producers don't wait for acknowledgements from consumers; they just publish messages to the topic and move on, making the communication asynchronous.

To integrate Kafka into your Spring Boot application, you'll need the spring-kafka dependency. This module provides convenient abstractions for interacting with Kafka.

Add this to your pom.xml:

Spring Kafka producers need configuration, typically in application.properties. The most important settings are the Kafka broker addresses and the serializers for your message keys and values.

Serializers convert your Java objects into bytes for transmission over the network.

Here's a basic configuration for a Kafka producer:

spring.kafka.producer.bootstrap-servers=localhost:9092
spring.kafka.producer.key-serializer=org.apache.kafka.common.serialization.StringSerializer
spring.kafka.producer.value-serializer=org.apache.kafka.common.serialization.StringSerializer

bootstrap-servers points to your Kafka broker. We're using StringSerializer for both key and value.

KafkaTemplate is the central class in Spring Kafka for sending messages. It simplifies the process of interacting with Kafka brokers.

You can inject it into your Spring components and use its send() methods to publish messages to specified topics.

Let's see how to send a basic 'Hello Kafka!' message to a topic named 'my-topic' using KafkaTemplate.

Run this example (ensure a Kafka broker is running on localhost:9092 and 'my-topic' exists).

Messages can also be sent with a key. Kafka uses keys to ensure messages with the same key go to the same partition within a topic, maintaining order for related data.

This is crucial for scenarios where message order matters, like user events or stock updates for a specific product.

Which of the following are essential components or concepts when setting up a Spring Kafka producer?

You've taken your first steps into event-driven architecture with Kafka! We learned that Kafka is a distributed streaming platform, and producers are applications that send messages to topics.

We also covered setting up Spring Kafka, configuring producer properties, and using KafkaTemplate to send messages, including those with keys. This forms the foundation for building event-publishing microservices!