带关联 ID 的结构化日志
输出机器可解析的 JSON 日志,并通过异步上下文传递关联 ID 以跟踪请求。
带关联 ID 的结构化日志 是 CoddyKit 上的免费 Node.js Backend Development Bootcamp 课时。 这是第 1 节课,共 4 节。 你可以在下方免费阅读本课时的完整内容 — 然后在浏览器中使用内置代码编辑器和全天候 AI 导师进行实践。 这是 Node.js Backend Development Bootcamp 学习路径的一部分,你的进度在网页和 CoddyKit 应用中同步。 Node.js Backend Development Bootcamp 课程共包含 4 节课。
本课时的部分内容尚未翻译,以英文显示。
Why Structured Logging
In production, logs are read by machines before humans. A line like console.log('User ' + id + ' failed login') is a free-form string: to find it later you must write brittle regex and you cannot aggregate or filter reliably.
Structured logging emits each log as a JSON object with consistent fields. Log aggregators (Loki, Elasticsearch, Datadog, CloudWatch) index those fields so you can query level="error" AND userId=42 instantly.
- Free-form: easy to write, painful to query.
- Structured: one JSON object per line (NDJSON), trivially parseable.
A Minimal JSON Logger
The core idea is small: build a plain object, stamp it with a level and timestamp, and write one JSON string per line to stdout. The runtime or container collects stdout and ships it to your aggregator.
Each log is a single line of valid JSON. This format is called NDJSON (newline-delimited JSON) and every modern log backend understands it.
function log(level, message, fields = {}) {
const entry = {
level,
time: new Date().toISOString(),
message,
...fields,
};
process.stdout.write(JSON.stringify(entry) + '\n');
}
log('info', 'server started', { port: 3000 });
log('error', 'login failed', { userId: 42, reason: 'bad_password' });Use a Real Logger: pino
Hand-rolling works for learning, but production apps use a battle-tested logger. pino is the de-facto choice for Node.js: it is extremely fast because it serializes JSON in a worker-friendly way and writes asynchronously.
logger.info(obj, msg)— the first arg is the object of fields, the second is the message string.- Levels:
trace, debug, info, warn, error, fatal. - In production you pipe stdout to
pino-prettyonly in dev; raw JSON goes to prod.
const pino = require('pino');
const logger = pino({ level: 'info' });
logger.info({ port: 3000 }, 'server started');
logger.error({ userId: 42, reason: 'bad_password' }, 'login failed');
// Child loggers bind fields onto every subsequent log:
const reqLog = logger.child({ requestId: 'abc-123' });
reqLog.info('handling request');The Problem: Tracing One Request
Under load, hundreds of requests interleave their logs. When user 42 reports an error, you need to see every log line that belongs to their request — across middleware, services, and database calls.
The solution is a correlation ID (also called request ID or trace ID): a unique identifier generated once per request and attached to every log emitted while handling that request.
- Query
correlationId="7f3a..."and the aggregator reconstructs the whole request timeline. - If the ID arrives in an incoming header, you can correlate logs across services.
Generating and Accepting the ID
At the edge of your system, read an incoming correlation header if a caller (gateway, upstream service) already set one; otherwise generate a fresh UUID. Always echo it back in the response so clients and proxies can record it too.
Standard header names are x-request-id or x-correlation-id. Reusing an inbound ID is what makes tracing work across service boundaries.
const { randomUUID } = require('crypto');
function correlationMiddleware(req, res, next) {
const incoming = req.headers['x-correlation-id'];
const correlationId = incoming || randomUUID();
req.correlationId = correlationId;
res.setHeader('x-correlation-id', correlationId);
next();
}
module.exports = { correlationMiddleware };The Naive Approach and Its Pain
The obvious move is to pass req.correlationId as an argument into every function and every log call. This works but does not scale: a deep call stack (controller → service → repository → helper) forces you to thread the ID through functions that otherwise have no reason to know about it.
This is prop drilling for the backend. You want the ID available implicitly to any code running during the request — without changing every function signature.
AsyncLocalStorage to the Rescue
Node.js ships AsyncLocalStorage (in the async_hooks module). It creates a store that stays bound to the current asynchronous execution context — surviving across await, callbacks, timers, and promises — without being shared between concurrent requests.
Think of it as request-scoped thread-local storage. You call als.run(store, callback) once per request; anywhere inside that callback (no matter how deep or how many awaits later) als.getStore() returns the same store.
const { AsyncLocalStorage } = require('async_hooks');
const als = new AsyncLocalStorage();
async function deep() {
await new Promise((r) => setTimeout(r, 10));
// Same store, even after awaits and timers:
return als.getStore().correlationId;
}
async function main() {
await als.run({ correlationId: 'req-1' }, async () => {
console.log('inside:', await deep());
});
console.log('outside:', als.getStore());
}
main();Wiring AsyncLocalStorage into the Request
Replace the naive middleware: instead of attaching the ID to req, run the rest of the request inside als.run() with the ID in the store. Now every line of code executed for this request — controllers, services, DB callbacks — can reach the ID via getStore().
Crucially, you must call next() inside the run callback so the downstream handlers inherit the context.
const { AsyncLocalStorage } = require('async_hooks');
const { randomUUID } = require('crypto');
const als = new AsyncLocalStorage();
function context() {
return als.getStore() || {};
}
function correlationMiddleware(req, res, next) {
const correlationId = req.headers['x-correlation-id'] || randomUUID();
res.setHeader('x-correlation-id', correlationId);
als.run({ correlationId }, () => next());
}
module.exports = { als, context, correlationMiddleware };Auto-Injecting the ID into Every Log
The payoff: wrap your logger so it reads the correlation ID from AsyncLocalStorage automatically. Application code calls log.info('saved order') with no ID argument, yet every emitted line carries the right correlationId.
With pino you express this declaratively using the mixin option, which merges extra fields into every log record at write time.
const pino = require('pino');
const { als } = require('./context');
const logger = pino({
level: 'info',
mixin() {
const store = als.getStore();
return store ? { correlationId: store.correlationId } : {};
},
});
// Anywhere deep in the request, no ID passed explicitly:
function saveOrder(order) {
logger.info({ orderId: order.id }, 'order saved');
}
module.exports = { logger, saveOrder };Propagating the ID to Downstream Calls
Correlation only spans services if you forward the ID on outbound requests. When your service calls another HTTP API, read the ID from context and set it as a header. The downstream service's middleware will reuse it, so both services' logs share one ID.
The same principle applies to message queues (put the ID in message metadata) and background jobs (store it on the job payload).
const { context } = require('./context');
async function callInventoryService(sku) {
const { correlationId } = context();
const res = await fetch('https://inventory.internal/check', {
method: 'POST',
headers: {
'content-type': 'application/json',
'x-correlation-id': correlationId,
},
body: JSON.stringify({ sku }),
});
return res.json();
}
module.exports = { callInventoryService };Production Hygiene
A few rules keep your structured logs clean and safe:
- Never log secrets or PII — passwords, tokens, full card numbers. Configure pino
redactpaths (e.g.['req.headers.authorization', '*.password']). - Log at the right level —
infofor business events,warnfor recoverable issues,errorwith the serialized error object for failures. - Keep field names stable —
correlationIdalways means the same thing; dashboards and alerts depend on it. - One JSON object per line — do not pretty-print in production; it breaks NDJSON parsing.
const pino = require('pino');
const logger = pino({
level: process.env.LOG_LEVEL || 'info',
redact: ['req.headers.authorization', 'password', '*.password', 'creditCard'],
});
logger.info({ user: { id: 7, password: 'hunter2' } }, 'login');
// -> password is replaced with [Redacted] in the outputQuick Check
You need the correlation ID available to every function in a deep call stack during a request, without passing it as an argument and without leaking it between concurrent requests. What is the correct mechanism in Node.js?
Recap
You learned how to make logs both machine-parseable and traceable:
- Structured logging emits one JSON object per line (NDJSON) so aggregators can index and query fields.
- pino is the standard fast Node.js logger; the field object comes first, the message second.
- A correlation ID is generated or reused from an inbound header once per request and echoed in the response.
- AsyncLocalStorage threads that ID through the whole async call stack without changing function signatures, and isolates concurrent requests.
- Pino's mixin auto-injects the ID into every log; forwarding it as an outbound header extends tracing across services.
- Practice good hygiene: redact secrets, use correct levels, keep field names stable, never pretty-print in production.
常见问题解答
「带关联 ID 的结构化日志」课时是免费的吗?
是的 — 「带关联 ID 的结构化日志」的完整文本可在网页上免费阅读。要进行交互式练习(内置代码编辑器和全天候 AI 导师)并解锁 Node.js Backend Development Bootcamp 课程的其余内容,请升级到 CoddyKit PRO。 Node.js Backend Development Bootcamp 课程共包含 4 节课。
「带关联 ID 的结构化日志」这节课中我会学到什么?
输出机器可解析的 JSON 日志,并通过异步上下文传递关联 ID 以跟踪请求。 你通过在浏览器中直接运行的动手代码来练习 Node.js Backend Development Bootcamp,全天候 AI 导师会在你学习这节课的过程中回答你的问题。
学习 Node.js Backend Development Bootcamp 需要有经验吗?
无需任何先前经验。CoddyKit 上的 Node.js Backend Development Bootcamp 课程适合初学者到高级学习者,你可以从这里开始或从头开始,按照自己的节奏学习。 这是第 1 节课,共 4 节。
「带关联 ID 的结构化日志」课时需要多长时间?
大多数 CoddyKit 课程大约需要 5–10 分钟。每节课都很精短且互动,所以你能稳步进步,并在网页和应用中从离开的地方继续。
我能在这节 Node.js Backend Development Bootcamp 课中编写并运行代码吗?
能。每节 Node.js Backend Development Bootcamp 课都包含内置代码编辑器,你可以在浏览器中直接编写并运行真实代码,并获得即时 AI 反馈 — 无需本地设置。