Redis cluster deployment process
Prerequisite: K8s+helm installation is completed
1. Install the NFS server
1.1 Installing the NFS Toolkit
Install on NFS servernfs-utilsBag:
1.2 Create a shared directory
Create a directory as an NFS shared directory and set permissions:
1.3 Configuring NFS Export
edit/etc/exportsFile, define shared directories and access permissions:
Add the following:
-
/nfs_share: Shared directory. -
*: Allow all clients to access. Can be replaced with a specific IP or network segment (such as192.168.1.0/24）。 -
rw: Reading and writing are allowed. -
sync: Synchronous writes to ensure data consistency. -
no_root_squash: Allow the client root user to have server root permissions. -
no_all_squash: No compression of permissions for all users.
After saving and exiting, start the NFS service:
2. Deploy NFS Provisioner
NFS Provisioner is a dynamic storage provider that provides NFS storage for Kubernetes clusters.
2.1 Adding Helm Repository
Add the Helm repository for NFS Provisioner:
2.2 Installing NFS Provisioner
Use Helm to install NFS Provisioner. Assume that the NFS server address is192.168.1.100, the shared directory is/nfs_share：
Parameter description：
-
: The IP address of the NFS server. -
: NFS shared directory. -
: The StorageClass name created (nfs-client）。 -
: Set as the default StorageClass. -
and: Specify the NFS Provisioner image (domestic mirror address).
3. Deploy Redis Cluster
Use Helm to deploy a Redis cluster and configure its storage to use NFS Provisioner.
3.1 Adding Helm Repository
Add Bitnami's Helm repository:
3.2 Installing Redis cluster
Use Helm to install the Redis cluster and configure storage provided by NFS Provisioner:
Parameter description：
-
=true: Enable Redis cluster mode. -
=nfs-client: Use StorageClass provided by NFS Provisioner. -
=1Gi: The storage size of each Redis node. -
password=password: Set Redis password. -
and: Specify the Redis image.
4. Deploy Redis-cluster-proxy
Redis-cluster-proxy is used to solve Redis clustersMOVEDandASKProblem and provide a unified access portal.
4.1 Download the source code
Clone Redis-cluster-proxy source code:
4.2 Create a Dockerfile
CreateDockerfile, the content is as follows:
# Use the official Ubuntu as the basic image
FROM ubuntu:22.04
# Install compile dependencies
RUN apt-get update && apt-get install -y \
build-essential \
gcc-11 \
g++-11 \
libssl-dev \
libhiredis-dev \
git \
&& rm -rf /var/lib/apt/lists/*
# Set GCC 11 as the default compiler
RUN update-alternatives --install /usr/bin/gcc gcc /usr/bin/gcc-11 100 \
&& update-alternatives --install /usr/bin/g++ g++ /usr/bin/g++-11 100
# Copy the local redis-cluster-proxy source code into the mirror
COPY . /redis-cluster-proxy
# Set up the working directory
WORKDIR /redis-cluster-proxy
# Build redis-cluster-proxy
RUN make CFLAGS="-fPIC -std=c11"
# Copy the executable file to /usr/local/bin
RUN cp ./src/redis-cluster-proxy /usr/local/bin/
# Set the default value of environment variables
ENV PROXY_PORT="7777" \
PROXY_BIND="0.0.0.0" \
CLUSTER_NODES=":6379" \ # Redis cluster address
CLUSTER_PASSWORD="zsfund" \ # Redis cluster password
THREADS="8" \
MAX_CLIENTS="10000"
# Expose the proxy port
EXPOSE 7777
# Set the default startup command
CMD exec redis-cluster-proxy \
--port ${PROXY_PORT} \
--bind ${PROXY_BIND} \
--threads ${THREADS} \
--maxclients ${MAX_CLIENTS} \
--auth ${CLUSTER_PASSWORD} \
${CLUSTER_NODES} \
"$@"
4.3 Generate mirrors
Building a Docker image:
4.4 Modify the source code
Modify the source code according to requirements (such as supporting authentication, etc.), refer to:PR #98。
4.5 Creating a YAML file
Create, the content is as follows:
apiVersion: apps/v1
kind: Deployment
metadata:
name: redis-cluster-proxy
spec:
replicas: 1
selector:
matchLabels:
app: redis-cluster-proxy
template:
metadata:
labels:
app: redis-cluster-proxy
spec:
containers:
- name: redis-cluster-proxy
image: redis-cluster-proxy:latest
imagePullPolicy: IfNotPresent
env:
- name: CLUSTER_NODES
value: ":6379" # Redis cluster address
- name: CLUSTER_PASSWORD
value: "zsfund" # Redis cluster password
ports:
- containerPort: 7777
---
apiVersion: v1
kind: Service
metadata:
name: redis-cluster-proxy
spec:
type: NodePort
selector:
app: redis-cluster-proxy
ports:
- protocol: TCP
port: 7777
targetPort: 7777
nodePort: 31777 # External access port
Run the YAML file:
5. Verify deployment
5.1 Check service status
Ensure all services are running properly:
5.2 External access
passNodePortVisit Redis-cluster-proxy:
5.3 Using client tools
Use Redis client tools (e.g.redis-cli) Connect Redis-cluster-proxy: