Node.js Backend Development Bootcamp · Lekcja

Ewolucja Proto i zgodność wsteczna

Bezpiecznie rozwijaj kontrakty usług, stosując zasady numerowania pól i pola zarezerwowane.

Lekcja 4 z 413 kroki

Ewolucja Proto i zgodność wsteczna to bezpłatna lekcja Node.js Backend Development Bootcamp na CoddyKit. To lekcja 4 z 4. Możesz przeczytać całą lekcję poniżej za darmo — a potem ćwiczyć ją interaktywnie w przeglądarce z wbudowanym edytorem kodu i tutorem AI dostępnym 24/7. To część ścieżki edukacyjnej Node.js Backend Development Bootcamp, a Twój postęp synchronizuje się między webem a aplikacją CoddyKit. Kurs Node.js Backend Development Bootcamp zawiera 4 lekcji w sumie.

Części tej lekcji nie zostały jeszcze przetłumaczone i są wyświetlane po angielsku.

Why Proto Evolution Matters

In a gRPC microservice world, your .proto files are a contract shared between independently deployed services. A producer service and its many consumers rarely upgrade at the exact same moment.

During a rolling deploy you will have old clients talking to new servers and new clients talking to old servers simultaneously. Evolution rules exist so neither side crashes or silently corrupts data.

  • Backward compatible: new code can read data written by old code.
  • Forward compatible: old code can read data written by new code (Protobuf gives this for free if you follow the rules).

Break the rules and you get mismatched fields, lost data, or deserialization that maps bytes to the wrong field.

Field Numbers Are the Real Identity

The single most important idea: on the wire, Protobuf does not send field names. It sends field numbers. The name email is just a label for humans and generated code.

Each encoded field is a tag built from (field_number << 3) | wire_type followed by its value. That means:

  • Renaming a field is harmless on the wire (number unchanged).
  • Changing a field's number is a breaking change — old data for number 2 will be read as a different field.
// Decode a Protobuf tag byte to see how (number, wireType) are packed.
function decodeTag(tagByte) {
  const fieldNumber = tagByte >> 3;
  const wireType = tagByte & 0x07;
  return { fieldNumber, wireType };
}

// 0x12 = 18 = (2 << 3) | 2  => field 2, length-delimited (string/bytes)
console.log(decodeTag(0x12)); // { fieldNumber: 2, wireType: 2 }
// 0x08 = 8 = (1 << 3) | 0   => field 1, varint (int/bool/enum)
console.log(decodeTag(0x08)); // { fieldNumber: 1, wireType: 0 }

A Starting Contract

Here is a v1 message for a user service. Notice every field has an explicit, stable number. In a Node.js backend you typically load this with @grpc/proto-loader and @grpc/grpc-js.

The golden rule going forward: once a field number ships to production, it is permanent. Treat numbers like database primary keys — never reuse, never repurpose.

// user.proto (v1)
// syntax = "proto3";
// package user.v1;
//
// message User {
//   string id    = 1;
//   string name  = 2;
//   string email = 3;
// }

// Loading it in Node.js:
const protoLoader = require('@grpc/proto-loader');
const grpc = require('@grpc/grpc-js');

const pkgDef = protoLoader.loadSync('user.proto', {
  keepCase: true,
  longs: String,
  defaults: true,
});
const userProto = grpc.loadPackageDefinition(pkgDef).user.v1;

Adding Fields Safely

The safest evolution is adding a new field with a brand-new number. Old clients simply ignore tags they do not recognize, and new clients reading old data see the field's default value.

  • In proto3, an unset string defaults to "", numbers to 0, bools to false.
  • So always design new fields so that the default value is a safe, meaningful state.

Below, phone (field 4) is added. A v1 client ignores it; a v2 client reading a v1 payload gets "".

// user.proto (v2) — additive change
// message User {
//   string id    = 1;
//   string name  = 2;
//   string email = 3;
//   string phone = 4;   // NEW, never-before-used number
// }

// New server filling the new field:
function buildUserV2(row) {
  return {
    id: row.id,
    name: row.name,
    email: row.email,
    phone: row.phone ?? '', // safe default if missing
  };
}

module.exports = { buildUserV2 };

Forward Compatibility: Unknown Fields

When an old server receives a message containing fields it does not know about, Protobuf preserves them as unknown fields (in many runtimes) rather than erroring. This is what makes forward compatibility work.

The practical consequence: a service in the middle of a pipeline can receive a newer message, and as long as it does not re-serialize destructively, the new data can pass through untouched.

You should never rely on a field not existing. Always tolerate extra data.

The Danger of Reusing Numbers

Suppose you delete email = 3 and later add country = 3. Disaster: an old client still sends an email string tagged with field 3. The new server happily decodes those bytes as if they were country.

Because field numbers are the wire identity, reuse causes silent data corruption — no exception, just wrong values flowing through your system.

The fix is to permanently retire deleted numbers so no future engineer can accidentally recycle them.

// Simulate the bug: bytes meant for field 3 = 'email'
// get reinterpreted by a schema that now calls field 3 'country'.
const wire = { '1': 'u-1', '2': 'Ada', '3': 'ada@mail.com' };

const v1Schema = { '1': 'id', '2': 'name', '3': 'email' };
const badV2Schema = { '1': 'id', '2': 'name', '3': 'country' }; // reused 3!

function applySchema(wireMsg, schema) {
  const out = {};
  for (const [num, val] of Object.entries(wireMsg)) out[schema[num]] = val;
  return out;
}

console.log(applySchema(wire, v1Schema));
// { id: 'u-1', name: 'Ada', email: 'ada@mail.com' }
console.log(applySchema(wire, badV2Schema));
// { id: 'u-1', name: 'Ada', country: 'ada@mail.com' }  <-- corrupted!

Reserved Fields to the Rescue

Protobuf's answer is the reserved keyword. When you remove a field, you reserve its number and its name. The compiler then refuses to let anyone reuse them.

  • reserved 3; — blocks reusing field number 3.
  • reserved "email"; — blocks reusing the name email (helps if old generated code or JSON mapping relies on it).

This turns a silent runtime corruption into a compile-time error, which is exactly where you want failures to happen.

// user.proto (v3) — email removed safely
// message User {
//   reserved 3;            // number can never be reused
//   reserved "email";      // name can never be reused
//
//   string id      = 1;
//   string name    = 2;
//   string phone   = 4;
//   string country = 5;    // new field gets a FRESH number
// }

Reserving Ranges

When you remove several fields at once, reserve them all in one statement. Ranges use to, and max covers the upper bound.

  • reserved 2, 15, 9 to 11; reserves individual numbers and a contiguous block.
  • You can reserve numbers and names in separate statements, but not mix them in a single one.

Keep a running 'graveyard' comment so the history of retired fields is visible to reviewers.

// Reserving multiple removed fields
// message Order {
//   reserved 2, 15, 9 to 11;        // numbers
//   reserved "coupon", "legacy_sku"; // names
//
//   string id        = 1;
//   string status    = 3;
//   int64  total_cents = 16;
// }

Type Changes: What Is and Isn't Safe

Some type changes preserve wire compatibility because the wire type stays the same; others silently break.

  • Safe: int32 ↔ int64 ↔ uint32 ↔ uint64 ↔ bool — all varints (just mind value ranges/truncation).
  • Safe: string ↔ bytes when bytes are valid UTF-8 (both length-delimited).
  • Unsafe: int32 → string, or changing between fixed32 and int32 — different wire types, garbled decode.

When in doubt, add a new field instead of mutating an existing one.

// Wire-type families: a quick reference table.
const wireTypes = {
  0: 'varint  (int32/int64/uint/bool/enum)',
  1: '64-bit  (fixed64/sfixed64/double)',
  2: 'length  (string/bytes/messages/packed)',
  5: '32-bit  (fixed32/sfixed32/float)',
};

// Changing a field is wire-safe only within the SAME family.
function sameFamily(aWire, bWire) {
  return aWire === bWire;
}
console.log(sameFamily(0, 0)); // int32 -> int64  => true (safe)
console.log(sameFamily(0, 2)); // int32 -> string => false (UNSAFE)

Evolving Enums Carefully

Enums evolve too. In proto3 every enum must have a zero value (the default), conventionally *_UNSPECIFIED = 0. You can append new values safely — old clients receiving an unknown enum number keep the raw integer and treat it as unrecognized.

  • Always handle the default/unknown case in your Node.js switch logic.
  • Never renumber existing enum values; reserve removed ones just like fields.
// enum Status { STATUS_UNSPECIFIED = 0; ACTIVE = 1; SUSPENDED = 2; }
// v2 appends CLOSED = 3.

function describeStatus(status) {
  switch (status) {
    case 1: return 'active';
    case 2: return 'suspended';
    case 3: return 'closed';
    default:
      // Covers 0 (UNSPECIFIED) AND any future value an old
      // build doesn't know about yet — forward compatible.
      return 'unknown';
  }
}

console.log(describeStatus(1)); // active
console.log(describeStatus(99)); // unknown (future value)

A Safe-Evolution Checklist in CI

Teams enforce these rules automatically. Tools like buf run breaking-change detection in CI, but you can also encode simple invariants yourself. The core invariants:

  • No field number is ever removed without a matching reserved.
  • No field number changes its type family.
  • New fields use numbers higher than any previously used or reserved.

Below is a tiny guard you might run against two parsed schema snapshots in a Node.js pipeline step.

// Detect a reused/removed number that wasn't reserved.
function checkBreaking(oldFields, newFields, reserved) {
  const issues = [];
  for (const [num, type] of Object.entries(oldFields)) {
    const stillPresent = newFields[num];
    if (!stillPresent && !reserved.includes(Number(num))) {
      issues.push(`field ${num} removed but not reserved`);
    } else if (stillPresent && stillPresent !== type) {
      issues.push(`field ${num} changed type ${type} -> ${stillPresent}`);
    }
  }
  return issues;
}

const oldF = { 1: 'string', 2: 'string', 3: 'string' };
const newF = { 1: 'string', 2: 'string' }; // dropped 3
console.log(checkBreaking(oldF, newF, []));
// [ 'field 3 removed but not reserved' ]
console.log(checkBreaking(oldF, newF, [3])); // []

Quick Check

You are removing the email field (number 3) from a deployed proto message. What is the correct way to keep the contract evolvable and prevent future corruption?

Recap

You now know how to evolve gRPC contracts without breaking running services:

  • Field numbers, not names, are the wire identity — they are permanent once shipped.
  • Add fields with fresh numbers; old clients ignore them and new clients see safe defaults.
  • Protobuf preserves unknown fields, giving you forward compatibility for free.
  • Reserve removed numbers and names (reserved 3; reserved "email";) to prevent silent corruption from reuse.
  • Change types only within the same wire-type family; otherwise add a new field.
  • Append enum values, always handle the unknown/UNSPECIFIED case, and enforce all of this in CI.

Follow these rules and old and new versions of your services can coexist safely through every rolling deploy.

Bezpłatny start

Ucz się JavaScript dzięki korepetycjom AI — za darmo

Pisz i uruchamiaj kod w przeglądarce, otrzymuj natychmiastową pomoc od korepetytora AI dostępnego 24/7 i kontynuuj naukę w sieci lub w aplikacji.

Kursy
22
Lekcje
92

Często zadawane pytania

Czy lekcja „Ewolucja Proto i zgodność wsteczna” jest bezpłatna?

Tak — pełny tekst „Ewolucja Proto i zgodność wsteczna” jest dostępny za darmo tutaj w sieci. Aby ćwiczyć ją interaktywnie (wbudowany edytor kodu i tutor AI dostępny 24/7) i odblokować resztę kursu Node.js Backend Development Bootcamp, przejdź na CoddyKit PRO. Kurs Node.js Backend Development Bootcamp zawiera 4 lekcji w sumie.

Co nauczysz się w „Ewolucja Proto i zgodność wsteczna”?

Bezpiecznie rozwijaj kontrakty usług, stosując zasady numerowania pól i pola zarezerwowane. Ćwiczysz Node.js Backend Development Bootcamp z praktycznym kodem, który uruchamiasz bezpośrednio w przeglądarce, a tutor AI dostępny 24/7 odpowiada na Twoje pytania podczas pracy nad lekcją.

Czy potrzebuję doświadczenia, aby zacząć Node.js Backend Development Bootcamp?

Nie wymagamy żadnego doświadczenia. Node.js Backend Development Bootcamp w CoddyKit jest strukturyzowany dla początkujących i zaawansowanych użytkowników, więc możesz zacząć tutaj lub od początku i uczyć się w swoim tempie. To lekcja 4 z 4.

Ile czasu zajmuje lekcja „Ewolucja Proto i zgodność wsteczna”?

Większość lekcji CoddyKit trwa około 5–10 minut. Każda lekcja to mały, interaktywny krok, dzięki czemu robisz systematyczne postępy i zawsze wracasz dokładnie do tego samego miejsca — na webie i w aplikacji.

Czy mogę pisać i uruchamiać kod w tej lekcji Node.js Backend Development Bootcamp?

Tak. Każda lekcja Node.js Backend Development Bootcamp zawiera wbudowany edytor kodu, więc piszesz i uruchamiasz prawdziwy kod bezpośrednio w przeglądarce i od razu otrzymujesz sprzężenie zwrotne od AI — bez konfiguracji na komputerze.

Wszystkie lekcje w tym kursie

  1. Definiowanie usług i komunikatów za pomocą Protobuf IDL
  2. Jednoargumentowe, serwerowe, klienckie i dwukierunkowe strumieniowanie RPC
  3. Interceptory, terminy i metadane
  4. Ewolucja Proto i zgodność wsteczna
← Powrót do Node.js Backend Development Bootcamp