Load Balancing WebSockets
Configure load balancers (e.g., Nginx, HAProxy) to correctly handle sticky sessions and WebSocket upgrades.
Load Balancing WebSockets is a free WebSockets & Realtime Systems Programming lesson on CoddyKit — lesson 2 of 4. You can read the complete lesson below for free — then practise it hands-on in the browser with a built-in code editor and a 24/7 AI tutor. It is part of the WebSockets & Realtime Systems Programming learning path, one of 4 lessons in the course, and your progress syncs across the web and the CoddyKit app.
Scaling WebSockets with Load Balancers
When your WebSocket application grows, a single server might not handle all connections efficiently. Load balancing helps by distributing these connections across multiple servers.
This improves performance, reliability, and allows your application to handle more users. It's a crucial step for high-traffic realtime systems to ensure availability and responsiveness.
The WebSocket Handshake
Unlike regular HTTP connections, WebSockets begin with a special "handshake" process that uses HTTP. Your client sends an initial HTTP request to the server, asking to "upgrade" the connection.
This request includes specific HTTP headers that signal the intent to switch protocols. If the server agrees, it responds with an HTTP 101 Switching Protocols status, and the connection then becomes a full-duplex WebSocket.
Load Balancers & Upgrade Headers
A standard HTTP load balancer might not correctly process the WebSocket upgrade request. It needs specific configuration to properly forward the special HTTP headers essential for the handshake. These headers include:
Connection: UpgradeUpgrade: websocketSec-WebSocket-KeySec-WebSocket-Version
Without proper forwarding, the WebSocket handshake will fail, preventing the connection from establishing.
Sticky Sessions: Essential for WebSockets
Once a WebSocket connection is established, it's persistent. It's often critical that all subsequent messages from a client go to the same backend server that handled the initial handshake and established the connection.
This is known as a "sticky session" or "session persistence." If a client's messages are routed to a different server, the connection will break or behave unexpectedly, as the new server won't recognize the existing WebSocket session.
How Sticky Sessions Work
Load balancers use different methods to ensure sticky sessions:
- IP Hash: The load balancer uses the client's IP address to consistently route them to the same backend server. This is simple but less effective if many users share an IP (e.g., behind a NAT).
- Cookie-Based: The load balancer sets a special cookie in the client's browser. Subsequent requests include this cookie, allowing the load balancer to route them to the correct server. This method is generally more robust.
Nginx: Proxying WebSocket Upgrades
Nginx is a popular, high-performance web server that also excels as a reverse proxy and load balancer. To handle WebSockets, Nginx needs configuration to correctly forward the upgrade headers, ensuring the initial HTTP handshake completes successfully.
The proxy_set_header directives for Upgrade and Connection are crucial. Also, a long proxy_read_timeout is recommended for persistent WebSocket connections.
http {
upstream websocket_backend {
server backend1.example.com;
server backend2.example.com;
}
server {
listen 80;
server_name example.com;
location /ws/ {
proxy_pass http://websocket_backend;
proxy_http_version 1.1;
proxy_set_header Upgrade $http_upgrade;
proxy_set_header Connection "upgrade";
proxy_read_timeout 86400s; # Long timeout for WebSockets
}
}
}Nginx: Implementing Sticky Sessions
To ensure sticky sessions with Nginx, you can use the ip_hash directive in your upstream block. This directive ensures that requests from the same client IP address are consistently routed to the same backend server.
While straightforward, remember that IP hash might not be ideal for all scenarios, especially when multiple users share a single public IP address.
http {
upstream websocket_backend {
ip_hash; # Enables sticky sessions by client IP
server backend1.example.com;
server backend2.example.com;
}
server {
listen 80;
server_name example.com;
location /ws/ {
proxy_pass http://websocket_backend;
proxy_http_version 1.1;
proxy_set_header Upgrade $http_upgrade;
proxy_set_header Connection "upgrade";
proxy_read_timeout 86400s;
}
}
}HAProxy: Basic WebSocket Configuration
HAProxy is another powerful and widely used open-source load balancer, especially known for its high availability and advanced routing capabilities. Configuring HAProxy for WebSockets involves setting the correct operating mode (mode http) and creating rules to identify and route WebSocket traffic.
An Access Control List (ACL) is often used to detect the Upgrade: websocket header and direct traffic to a specific backend server pool.
frontend http_front
bind *:80
mode http
default_backend ws_backend
backend ws_backend
mode http
option http-server-close
acl is_websocket hdr(Upgrade) -i websocket
use_backend ws_servers if is_websocket
default-server inter 1s fall 2 rise 5
backend ws_servers
mode http
balance roundrobin
server web1 192.168.1.1:8000 check
server web2 192.168.1.2:8000 checkHAProxy: Cookie-Based Sticky Sessions
For more robust sticky sessions, HAProxy can insert a cookie into the client's browser that identifies the specific backend server the client is connected to. The client then sends this cookie with all subsequent requests, ensuring they are consistently routed to the same server.
This method provides better stickiness than IP hash, especially in environments where client IPs might change or be shared.
backend ws_servers
mode http
balance roundrobin
cookie SERVERID insert indirect nocache # Insert a cookie
server web1 192.168.1.1:8000 check cookie s1
server web2 192.168.1.2:8000 check cookie s2Check Your Understanding
Which of the following are essential considerations when configuring a load balancer for WebSocket traffic?
Load Balancing WebSockets Recap
In this lesson, we explored the critical aspects of load balancing WebSocket applications:
- WebSockets initiate with an HTTP upgrade handshake, requiring specific headers to be properly forwarded by the load balancer.
- Sticky sessions are vital to ensure a client maintains its persistent connection with the same backend server throughout its lifecycle.
- Load balancers like Nginx and HAProxy can be configured to handle WebSocket upgrades and implement sticky sessions using methods such as IP hash or cookie-based routing.
Mastering these configurations is key to building scalable, resilient, and high-performance realtime systems.
Frequently asked questions
Is the “Load Balancing WebSockets” lesson free?
Yes — the full text of “Load Balancing WebSockets” is free to read here on the web, and the WebSockets & Realtime Systems Programming course includes 4 lessons in total. To practise it interactively (a built-in code editor and a 24/7 AI tutor) and unlock the rest of the WebSockets & Realtime Systems Programming course, upgrade to CoddyKit PRO.
What will I learn in “Load Balancing WebSockets”?
Configure load balancers (e.g., Nginx, HAProxy) to correctly handle sticky sessions and WebSocket upgrades. You practise WebSockets & Realtime Systems Programming with hands-on code you run directly in the browser, and a 24/7 AI tutor answers your questions as you work through the lesson.
Do I need any experience to start WebSockets & Realtime Systems Programming?
No prior experience is required. WebSockets & Realtime Systems Programming on CoddyKit is structured for beginners through advanced learners; this is — lesson 2 of 4, so you can start here or from the beginning and move at your own pace.
How long does the “Load Balancing WebSockets” lesson take?
Most CoddyKit lessons take about 5–10 minutes. Each one is bite-sized and interactive, so you make steady progress and pick up exactly where you left off across the web and the app.
Can I write and run code in this WebSockets & Realtime Systems Programming lesson?
Yes. Every WebSockets & Realtime Systems Programming lesson includes a built-in code editor, so you write and run real code right in your browser and get instant AI feedback — no local setup required.
All lessons in this course
- Horizontal Scaling Strategies
- Load Balancing WebSockets
- Distributed State Management
- Pub/Sub Backplane with Redis