Advanced Spring Boot 4: Event-Driven Architecture (Kafka) · 课时

Kafka Streams 简介

概览 Kafka Streams 库及其用途，了解它如何支持构建持续进行数据处理的应用。

Kafka Streams 简介 是 CoddyKit 上的免费 Advanced Spring Boot 4: Event-Driven Architecture (Kafka) 课时。这是第 1 节课，共 4 节。你可以在下方免费阅读本课时的完整内容 — 然后在浏览器中使用内置代码编辑器和全天候 AI 导师进行实践。这是 Advanced Spring Boot 4: Event-Driven Architecture (Kafka) 学习路径的一部分，你的进度在网页和 CoddyKit 应用中同步。 Advanced Spring Boot 4: Event-Driven Architecture (Kafka) 课程共包含 4 节课。

本课时的部分内容尚未翻译，以英文显示。

Real-time Data: Stream Processing

Imagine data as a continuous flow, like a river. Stream processing is about analyzing and reacting to this data as it arrives, in real-time.

Unlike batch processing, which handles data in large, fixed groups (like a lake), stream processing works on individual data points or small windows of data as they are generated.

Meet Kafka Streams

Kafka Streams is a client library for building powerful stream processing applications. It's an integral part of the Apache Kafka ecosystem.

It allows you to process data stored in Kafka topics, perform transformations, aggregations, and then write the results back to Kafka or external systems.

Benefits of Kafka Streams

Kafka Streams simplifies building stream processing apps by:

No Separate Cluster: It runs directly within your application, not on a dedicated processing cluster.
Scalability: Inherits Kafka's distributed nature, scaling effortlessly with partitions.
Fault Tolerance: Automatically handles failures and recovers state.
Developer Friendly: Provides a high-level API for common operations.

Streams and Records Explained

In Kafka Streams, data flows as a stream, which is an unbounded, ordered, and re-playable sequence of data records.

Each record is a simple key-value pair. For example, a user ID could be the key, and a user action (like "logged in") could be the value.

Building Stream Applications

An application built with Kafka Streams is often called a stream processor. It reads input streams from one or more Kafka topics, processes the data, and can produce output streams to other Kafka topics.

These applications can perform various operations, from simple filtering to complex stateful aggregations.

Basic Streams Setup

Let's look at the absolute minimum to get a Kafka Streams application running. You'll need a few configurations and a StreamsBuilder.

This example sets up the basic structure but doesn't perform any actual data processing yet. It just defines the "blueprint" of your stream application.

import org.apache.kafka.streams.KafkaStreams;
import org.apache.kafka.streams.StreamsBuilder;
import org.apache.kafka.streams.StreamsConfig;
import org.apache.kafka.common.serialization.Serdes;

import java.util.Properties;

public class BasicStreamApp {
  public static void main(String[] args) {
    Properties props = new Properties();
    props.put(StreamsConfig.APPLICATION_ID_CONFIG, "intro-app");
    props.put(StreamsConfig.BOOTSTRAP_SERVERS_CONFIG, "localhost:9092");
    props.put(StreamsConfig.DEFAULT_KEY_SERDE_CLASS_CONFIG, Serdes.String().getClass());
    props.put(StreamsConfig.DEFAULT_VALUE_SERDE_CLASS_CONFIG, Serdes.String().getClass());

    StreamsBuilder builder = new StreamsBuilder();
    // No actual processing logic here yet for simplicity

    KafkaStreams streams = new KafkaStreams(builder.build(), props);
    streams.start();

    // Add shutdown hook to close the stream gracefully
    Runtime.getRuntime().addShutdownHook(new Thread(streams::close));
    System.out.println("Kafka Streams application started. Press Ctrl+C to stop.");
  }
}

Key Stream Configurations

The Properties object holds crucial settings for your Kafka Streams application:

APPLICATION_ID_CONFIG: Unique ID for your app within the Kafka cluster.
BOOTSTRAP_SERVERS_CONFIG: List of Kafka brokers to connect to.
DEFAULT_KEY_SERDE_CLASS_CONFIG: How keys are serialized/deserialized.
DEFAULT_VALUE_SERDE_CLASS_CONFIG: How values are serialized/deserialized.

Understanding Serdes

Serdes (Serializer/Deserializer) are vital. Kafka only understands bytes, so your application needs to convert Java objects (like Strings or Integers) into bytes before sending them to Kafka, and convert bytes back into objects when consuming.

Kafka Streams provides built-in Serdes for common types like String, Long, and Integer via Serdes.String(), Serdes.Long(), etc.

Where Kafka Streams Shines

Kafka Streams is ideal for many real-time scenarios:

Real-time Analytics: Monitoring dashboards, fraud detection.
Data Transformation: Cleaning, enriching, and restructuring data streams.
Event-Driven Microservices: Building reactive services that communicate via events.
ETL Pipelines: Continuous extraction, transformation, and loading of data.

Quick Check

Based on what you've learned, which of the following is a key characteristic of Kafka Streams?

Recap & Next Steps

Great job! You've taken your first steps into Kafka Streams.

We defined stream processing and introduced Kafka Streams as a powerful library.
We explored its benefits like scalability and fault tolerance.
You saw the fundamental concepts of streams, records, and essential configurations, including Serdes.

Next, we'll dive deeper into the core APIs: KStream and KTable, to start building actual data transformations!

常见问题解答

「Kafka Streams 简介」课时是免费的吗？

是的 — 「Kafka Streams 简介」的完整文本可在网页上免费阅读。要进行交互式练习（内置代码编辑器和全天候 AI 导师）并解锁 Advanced Spring Boot 4: Event-Driven Architecture (Kafka) 课程的其余内容，请升级到 CoddyKit PRO。 Advanced Spring Boot 4: Event-Driven Architecture (Kafka) 课程共包含 4 节课。

「Kafka Streams 简介」这节课中我会学到什么？

概览 Kafka Streams 库及其用途，了解它如何支持构建持续进行数据处理的应用。你通过在浏览器中直接运行的动手代码来练习 Advanced Spring Boot 4: Event-Driven Architecture (Kafka)，全天候 AI 导师会在你学习这节课的过程中回答你的问题。

学习 Advanced Spring Boot 4: Event-Driven Architecture (Kafka) 需要有经验吗？

无需任何先前经验。CoddyKit 上的 Advanced Spring Boot 4: Event-Driven Architecture (Kafka) 课程适合初学者到高级学习者，你可以从这里开始或从头开始，按照自己的节奏学习。这是第 1 节课，共 4 节。

「Kafka Streams 简介」课时需要多长时间？

大多数 CoddyKit 课程大约需要 5–10 分钟。每节课都很精短且互动，所以你能稳步进步，并在网页和应用中从离开的地方继续。

我能在这节 Advanced Spring Boot 4: Event-Driven Architecture (Kafka) 课中编写并运行代码吗？

能。每节 Advanced Spring Boot 4: Event-Driven Architecture (Kafka) 课都包含内置代码编辑器，你可以在浏览器中直接编写并运行真实代码，并获得即时 AI 反馈 — 无需本地设置。

此课程中的所有课时

← 返回 Advanced Spring Boot 4: Event-Driven Architecture (Kafka)