To use a client library with Redis Cluster, the client libraries need to be cluster-aware. Clients that support Redis Cluster typically feature a special connection module for managing connections to the cluster. The process that some of the better client libraries follow usually goes like this:
The client connects to any shard in the cluster and gets the addresses of the rest of the shards. The client also fetches a mapping of hash slots to shards so it can know where to look for a key in a specific hash slot. This hash slot map is cached locally.
When the client needs to read/write a key, it first runs the hashing function (crc16)
on the key name and then modulo divides by 16384, which results in the key’s hash slot number.
In the example below the hash slot number for the key “foo” is 12182. Then the client checks the hash slot number against the hash slot map to determine which shard it should connect to. In our example, the hash slot number 12182 lives on shard 127.0.0.1:7002
.
Finally, the client connects to the shard and finds the key it needs to work with.
If the topology of the cluster changes for any reason and the key has been moved, the shard will respond with an (error) MOVED 15495 127.0.0.1:7006
error, returning the address of the new shard responsible for that key. This indicates to the client that it needs to re-query the cluster for its topology and hash slot allocation, so it will do that and update its local hash slot map for future queries.
Not every client library has this extra logic built in, so when choosing a client library, make sure to look for ones with cluster support.
Another detail to check is if the client stores the hash slot map locally. If it doesn’t, and it relies on the (error) MOVED
response to get the address of the right shard, you can expect to have a much higher latency than usual because your client may have to make two network requests instead of one for a big part of the requests.
Examples of clients that support Redis cluster:
Here's a list of Redis Clients: https://redis.io/clients