Avro & Protobuf Schemas
Learn about popular serialization formats like Avro and Protobuf and how they are used with Schema Registry.
Data Formats for Kafka
When sending data through Kafka, it's just bytes. To make sense of these bytes, both the sender (producer) and receiver (consumer) need to agree on a common structure.
This is where data serialization formats and schemas come in, providing a blueprint for your data.
Meet Apache Avro
Apache Avro is a popular, language-agnostic data serialization system. It relies heavily on schemas to define the structure of data.
- Compactness: Data is serialized into a compact binary format.
- Schema Evolution: Avro handles schema changes gracefully, allowing producers and consumers with different schema versions to communicate.
- Language Agnostic: Tools exist for many programming languages.