WebSockets & Realtime Systems Programming · Lezione

Bilanciamento del carico per WebSocket

Configuri i bilanciatori di carico (ad esempio Nginx e HAProxy) per gestire correttamente le sessioni persistenti e gli upgrade a WebSocket.

Lezione 2 di 411 passaggi

Bilanciamento del carico per WebSocket è una lezione WebSockets & Realtime Systems Programming gratuita su CoddyKit. Questa è la lezione 2 di 4. Puoi leggere la lezione completa qui gratuitamente — poi esercitati direttamente nel browser con un editor di codice integrato e un tutor IA disponibile 24/7. Fa parte del percorso di apprendimento WebSockets & Realtime Systems Programming, e i tuoi progressi si sincronizzano tra il web e l'app CoddyKit. Il corso WebSockets & Realtime Systems Programming include 4 lezioni in totale.

Parti di questa lezione non sono ancora state tradotte e vengono mostrate in inglese.

Scaling WebSockets with Load Balancers

When your WebSocket application grows, a single server might not handle all connections efficiently. Load balancing helps by distributing these connections across multiple servers.

This improves performance, reliability, and allows your application to handle more users. It's a crucial step for high-traffic realtime systems to ensure availability and responsiveness.

The WebSocket Handshake

Unlike regular HTTP connections, WebSockets begin with a special "handshake" process that uses HTTP. Your client sends an initial HTTP request to the server, asking to "upgrade" the connection.

This request includes specific HTTP headers that signal the intent to switch protocols. If the server agrees, it responds with an HTTP 101 Switching Protocols status, and the connection then becomes a full-duplex WebSocket.

Load Balancers & Upgrade Headers

A standard HTTP load balancer might not correctly process the WebSocket upgrade request. It needs specific configuration to properly forward the special HTTP headers essential for the handshake. These headers include:

  • Connection: Upgrade
  • Upgrade: websocket
  • Sec-WebSocket-Key
  • Sec-WebSocket-Version

Without proper forwarding, the WebSocket handshake will fail, preventing the connection from establishing.

Sticky Sessions: Essential for WebSockets

Once a WebSocket connection is established, it's persistent. It's often critical that all subsequent messages from a client go to the same backend server that handled the initial handshake and established the connection.

This is known as a "sticky session" or "session persistence." If a client's messages are routed to a different server, the connection will break or behave unexpectedly, as the new server won't recognize the existing WebSocket session.

How Sticky Sessions Work

Load balancers use different methods to ensure sticky sessions:

  • IP Hash: The load balancer uses the client's IP address to consistently route them to the same backend server. This is simple but less effective if many users share an IP (e.g., behind a NAT).
  • Cookie-Based: The load balancer sets a special cookie in the client's browser. Subsequent requests include this cookie, allowing the load balancer to route them to the correct server. This method is generally more robust.

Nginx: Proxying WebSocket Upgrades

Nginx is a popular, high-performance web server that also excels as a reverse proxy and load balancer. To handle WebSockets, Nginx needs configuration to correctly forward the upgrade headers, ensuring the initial HTTP handshake completes successfully.

The proxy_set_header directives for Upgrade and Connection are crucial. Also, a long proxy_read_timeout is recommended for persistent WebSocket connections.

http {
    upstream websocket_backend {
        server backend1.example.com;
        server backend2.example.com;
    }

    server {
        listen 80;
        server_name example.com;

        location /ws/ {
            proxy_pass http://websocket_backend;
            proxy_http_version 1.1;
            proxy_set_header Upgrade $http_upgrade;
            proxy_set_header Connection "upgrade";
            proxy_read_timeout 86400s; # Long timeout for WebSockets
        }
    }
}

Nginx: Implementing Sticky Sessions

To ensure sticky sessions with Nginx, you can use the ip_hash directive in your upstream block. This directive ensures that requests from the same client IP address are consistently routed to the same backend server.

While straightforward, remember that IP hash might not be ideal for all scenarios, especially when multiple users share a single public IP address.

http {
    upstream websocket_backend {
        ip_hash; # Enables sticky sessions by client IP
        server backend1.example.com;
        server backend2.example.com;
    }

    server {
        listen 80;
        server_name example.com;

        location /ws/ {
            proxy_pass http://websocket_backend;
            proxy_http_version 1.1;
            proxy_set_header Upgrade $http_upgrade;
            proxy_set_header Connection "upgrade";
            proxy_read_timeout 86400s;
        }
    }
}

HAProxy: Basic WebSocket Configuration

HAProxy is another powerful and widely used open-source load balancer, especially known for its high availability and advanced routing capabilities. Configuring HAProxy for WebSockets involves setting the correct operating mode (mode http) and creating rules to identify and route WebSocket traffic.

An Access Control List (ACL) is often used to detect the Upgrade: websocket header and direct traffic to a specific backend server pool.

frontend http_front
    bind *:80
    mode http
    default_backend ws_backend

backend ws_backend
    mode http
    option http-server-close
    acl is_websocket hdr(Upgrade) -i websocket
    use_backend ws_servers if is_websocket
    default-server inter 1s fall 2 rise 5

backend ws_servers
    mode http
    balance roundrobin
    server web1 192.168.1.1:8000 check
    server web2 192.168.1.2:8000 check

HAProxy: Cookie-Based Sticky Sessions

For more robust sticky sessions, HAProxy can insert a cookie into the client's browser that identifies the specific backend server the client is connected to. The client then sends this cookie with all subsequent requests, ensuring they are consistently routed to the same server.

This method provides better stickiness than IP hash, especially in environments where client IPs might change or be shared.

backend ws_servers
    mode http
    balance roundrobin
    cookie SERVERID insert indirect nocache # Insert a cookie
    server web1 192.168.1.1:8000 check cookie s1
    server web2 192.168.1.2:8000 check cookie s2

Check Your Understanding

Which of the following are essential considerations when configuring a load balancer for WebSocket traffic?

Load Balancing WebSockets Recap

In this lesson, we explored the critical aspects of load balancing WebSocket applications:

  • WebSockets initiate with an HTTP upgrade handshake, requiring specific headers to be properly forwarded by the load balancer.
  • Sticky sessions are vital to ensure a client maintains its persistent connection with the same backend server throughout its lifecycle.
  • Load balancers like Nginx and HAProxy can be configured to handle WebSocket upgrades and implement sticky sessions using methods such as IP hash or cookie-based routing.

Mastering these configurations is key to building scalable, resilient, and high-performance realtime systems.

Gratis per iniziare

Impara WebSockets & Realtime Systems Programming con un tutor IA — gratis

Scrivi ed esegui vero codice nel tuo browser, ricevi aiuto istantaneo da un tutor IA disponibile 24/7, e riprendi da dove hai lasciato sul web o nell'app.

Corsi
12
Lezioni
47

Domande Frequenti

La lezione «Bilanciamento del carico per WebSocket» è gratuita?

Sì — il testo completo di «Bilanciamento del carico per WebSocket» è gratuito qui sul web. Per esercitarvi in modo interattivo (un editor di codice integrato e un tutor IA 24/7) e sbloccare il resto del corso WebSockets & Realtime Systems Programming, passa a CoddyKit PRO. Il corso WebSockets & Realtime Systems Programming include 4 lezioni in totale.

Cosa imparerò in «Bilanciamento del carico per WebSocket»?

Configuri i bilanciatori di carico (ad esempio Nginx e HAProxy) per gestire correttamente le sessioni persistenti e gli upgrade a WebSocket. Eserciti WebSockets & Realtime Systems Programming con codice pratico che esegui direttamente nel browser, e un tutor IA 24/7 risponde alle tue domande mentre lavori sulla lezione.

Ho bisogno di esperienza per iniziare WebSockets & Realtime Systems Programming?

Non è richiesta alcuna esperienza precedente. WebSockets & Realtime Systems Programming su CoddyKit è strutturato per principianti e studenti avanzati, quindi puoi iniziare da qui o dall'inizio e procedere al tuo ritmo. Questa è la lezione 2 di 4.

Quanto tempo richiede la lezione «Bilanciamento del carico per WebSocket»?

La maggior parte delle lezioni CoddyKit richiede circa 5–10 minuti. Ogni lezione è breve e interattiva, quindi fai progressi costanti e riprendi esattamente da dove hai lasciato su web e app.

Posso scrivere ed eseguire codice in questa lezione WebSockets & Realtime Systems Programming?

Sì. Ogni lezione WebSockets & Realtime Systems Programming include un editor di codice integrato, quindi scrivi ed esegui codice reale direttamente nel tuo browser e ricevi feedback istantaneo dall'IA — nessuna configurazione locale necessaria.

Tutte le lezioni di questo corso

  1. Strategie di scalabilità orizzontale
  2. Bilanciamento del carico per WebSocket
  3. Gestione distribuita dello stato
  4. Backplane Pub/Sub con Redis
← Torna a WebSockets & Realtime Systems Programming