0Pricing
Redis Caching & Messaging (Pub/Sub, Streams) · レッスン

シャーディングのための Redis Cluster

Redis Cluster を実装して複数のノードにデータを分散し、水平スケーリングと耐障害性を実現します。

「シャーディングのための Redis Cluster」はCoddyKit上の無料Redis Caching & Messaging (Pub/Sub, Streams)レッスンです。 これはレッスン3/4です。 下記で完全なレッスンを無料で読むことができます。その後、ブラウザ内の組み込みコードエディタと24時間対応のAIチューターでハンズオン演習できます。 これはRedis Caching & Messaging (Pub/Sub, Streams)学習パスの一部であり、ウェブとCoddyKitアプリ全体で進捗が同期されます。 Redis Caching & Messaging (Pub/Sub, Streams)コースには全4レッスンが含まれています。

このレッスンの一部はまだ翻訳されておらず、英語で表示されています。

Scaling Beyond a Single Node

So far, we've learned about Redis replication and Sentinel for high availability. These are great for redundancy and read scaling, but what about write scaling or handling datasets larger than a single server's memory?

This is where Redis Cluster comes in. It's designed to provide horizontal scaling and fault tolerance by distributing your data across multiple Redis instances.

What is Sharding?

At its core, Redis Cluster uses sharding (also known as data partitioning). Imagine you have a massive library of books.

  • Instead of one giant shelf, you split the books across many smaller shelves.
  • Each shelf holds a portion of the books, and a librarian manages that shelf.

In Redis Cluster, each Redis instance (or node) acts like a 'librarian' managing a 'shelf' of your data. This allows you to scale both memory and CPU.

Redis Cluster Architecture

A Redis Cluster is a collection of interconnected Redis instances. Each instance can be a master or a replica.

  • Master Nodes: These nodes hold and manage a portion of the dataset.
  • Replica Nodes: These are copies of master nodes, providing high availability. If a master fails, one of its replicas can be promoted to take its place.

The cluster ensures data is distributed, and it can continue operating even if some nodes fail.

Hash Slots: How Data is Distributed

How does Redis know which node stores which piece of data? It uses hash slots.

  • The entire dataset is divided into 16,384 logical slots (from 0 to 16383).
  • Each master node in the cluster is responsible for a subset of these hash slots.
  • When you store a key, Redis calculates a hash of the key to determine which slot it belongs to.
  • This slot then maps to a specific master node.

This system allows for flexible data distribution and easy rebalancing.

Creating a Redis Cluster

To create a cluster, you need at least three master nodes for a fault-tolerant setup (each master can have replicas). Here's a conceptual CLI command using redis-cli:

redis-cli --cluster create 127.0.0.1:7000 127.0.0.1:7001 127.0.0.1:7002 --cluster-replicas 1

  • This command creates a cluster with 3 masters (on ports 7000, 7001, 7002).
  • --cluster-replicas 1 means each master will have one replica node.

The redis-cli tool automatically assigns hash slots to the master nodes.

Client Interaction & Redirection

When a client wants to interact with Redis Cluster, it can connect to any node. If the key the client requests doesn't belong to the connected node's hash slots, the node will respond with a MOVED redirection error.

Modern Redis client libraries (like Jedis for Java) are cluster-aware. They automatically handle these redirections by:

  • Learning the cluster topology (which node owns which hash slots).
  • Directly connecting to the correct node for a given key.

This makes interacting with a cluster surprisingly seamless for developers.

Connecting with a Java Client

Let's see how a Java client (using the Jedis library) connects to a Redis Cluster. The client needs to know at least one node in the cluster to discover the full topology.

Try running this example:

import redis.clients.jedis.HostAndPort;
import redis.clients.jedis.JedisCluster;
import java.util.HashSet;
import java.util.Set;

public class RedisClusterClient {
    public static void main(String[] args) {
        // Provide at least one node to connect to the cluster
        Set<HostAndPort> jedisClusterNodes = new HashSet<>();
        jedisClusterNodes.add(new HostAndPort("127.0.0.1", 7000)); // Example node

        try (JedisCluster jc = new JedisCluster(jedisClusterNodes)) {
            System.out.println("Connected to Redis Cluster!");

            String key = "user:100:name";
            String value = "Alice";
            jc.set(key, value);
            System.out.println("Set: " + key + " = " + value);

            String retrievedValue = jc.get(key);
            System.out.println("Get: " + key + " = " + retrievedValue);

            // Client automatically handles sharding for different keys
            jc.set("product:5:price", "99.99");
            System.out.println("Set: product:5:price = " + jc.get("product:5:price"));

        } catch (Exception e) {
            System.err.println("Error connecting to Redis Cluster: " + e.getMessage());
            System.err.println("Ensure a Redis Cluster is running on 127.0.0.1:7000");
        }
    }
}

Resharding & Rebalancing

One of the powerful features of Redis Cluster is its ability to reshard. This means you can dynamically add or remove nodes from the cluster while it's running.

  • When you add new master nodes, you can migrate hash slots from existing masters to the new ones.
  • When you remove nodes, their hash slots can be moved to other remaining masters.

This allows for flexible scaling up or down of your cluster resources without downtime.

Fault Tolerance in Cluster

Redis Cluster provides robust fault tolerance:

  • If a master node fails, its assigned replica is automatically promoted to become the new master.
  • The cluster continues to operate, as the hash slots previously managed by the failed master are now handled by its promoted replica.

However, if a master and all its replicas fail, the portion of the data managed by that master's hash slots becomes unavailable, and the cluster might cease to operate unless configured otherwise (cluster-require-full-coverage no).

Check Your Cluster Knowledge

Which of the following are primary benefits or characteristics of Redis Cluster?

Recap: Redis Cluster for Scale

In this lesson, we explored Redis Cluster, a powerful solution for scaling Redis horizontally. We learned:

  • Cluster uses sharding to distribute data across multiple master nodes.
  • Hash slots determine which node stores which key.
  • Client libraries are cluster-aware, handling redirections automatically.
  • It offers fault tolerance by promoting replicas upon master failure.
  • The ability to reshard allows for dynamic scaling.

Redis Cluster is your go-to when a single Redis instance can no longer meet your application's data size or throughput demands.

よくある質問

「シャーディングのための Redis Cluster」レッスンは無料ですか？

はい。「シャーディングのための Redis Cluster」の完全なテキストはこのウェブで無料で読めます。インタラクティブに演習し（組み込みコードエディタと24時間対応のAIチューター）、Redis Caching & Messaging (Pub/Sub, Streams)コースの残りをアンロックするには、CoddyKit PROにアップグレードしてください。 Redis Caching & Messaging (Pub/Sub, Streams)コースには全4レッスンが含まれています。

「シャーディングのための Redis Cluster」で何を学びますか？

Redis Cluster を実装して複数のノードにデータを分散し、水平スケーリングと耐障害性を実現します。 ブラウザで直接実行するハンズオンコードでRedis Caching & Messaging (Pub/Sub, Streams)を演習し、24時間対応のAIチューターがレッスンを進める中での質問に答えます。

Redis Caching & Messaging (Pub/Sub, Streams)を始めるのに経験は必要ですか？

事前経験は必要ありません。CoddyKitのRedis Caching & Messaging (Pub/Sub, Streams)は初級者から上級者向けに構成されているため、ここから始めるか最初から始めて、自分のペースで進むことができます。 これはレッスン3/4です。

「シャーディングのための Redis Cluster」レッスンにはどのくらい時間がかかりますか？

ほとんどのCoddyKitレッスンは約5～10分かかります。各レッスンはコンパクトでインタラクティブなので、着実に進歩し、ウェブとアプリ全体で正確に前回の場所から再開できます。

このRedis Caching & Messaging (Pub/Sub, Streams)レッスンでコードを書いて実行できますか？

はい。すべてのRedis Caching & Messaging (Pub/Sub, Streams)レッスンに組み込みコードエディタが含まれているため、ブラウザでリアルコードを書いて実行し、即座のAIフィードバックを取得できます。ローカル設定は不要です。

このコースのすべてのレッスン

  1. 冗長性確保のための Redis レプリケーション
  2. 高可用性のための Redis Sentinel
  3. シャーディングのための Redis Cluster
  4. クライアント側の接続レジリエンス
← Redis Caching & Messaging (Pub/Sub, Streams)に戻る