k8s部署redis一主二从.md · 钟贵贤/技术文档

[TOC]

### k8s部署redis一主二从

#### 1 集群节点

|  节点名称   |  节点IP地址  |
| :---------: | :----------: |
| k8s-master  | 192.168.0.10 |
| k8s-worker1 | 192.168.0.11 |
| k8s-worker2 | 192.168.0.12 |

#### 2 部署redis一主二从

```
注释：redis是有状态服务，master和slave之间也有着一定的差距，数据也需持久化，所以在此Deployment控制器无法满足。使用StatefulSet控制器配合PV、PVC、NFS即可实现集群状态保存
```

##### 2.1 准备redis配置文件

```
# 以下是master的配置文件
bind 0.0.0.0
protected-mode no
port 6379
tcp-backlog 511
timeout 0
tcp-keepalive 300
daemonize no
supervised no
pidfile /var/run/redis_6379.pid
loglevel notice
logfile ""
databases 16
always-show-logo yes
save 900 1
save 300 10
save 60 10000
stop-writes-on-bgsave-error yes
rdbcompression yes
rdbchecksum yes
dbfilename dump.rdb
dir ./
slave-serve-stale-data yes
slave-read-only yes
repl-diskless-sync no
repl-diskless-sync-delay 5
repl-disable-tcp-nodelay no
slave-priority 100
lazyfree-lazy-eviction no
lazyfree-lazy-expire no
lazyfree-lazy-server-del no
slave-lazy-flush no
appendonly yes
appendfilename "appendonly.aof"
appendfsync everysec
no-appendfsync-on-rewrite no
auto-aof-rewrite-percentage 100
auto-aof-rewrite-min-size 64mb
aof-load-truncated yes
aof-use-rdb-preamble no
lua-time-limit 5000
slowlog-log-slower-than 10000
slowlog-max-len 128
latency-monitor-threshold 0
notify-keyspace-events ""
hash-max-ziplist-entries 512
hash-max-ziplist-value 64
list-max-ziplist-size -2
list-compress-depth 0
set-max-intset-entries 512
zset-max-ziplist-entries 128
zset-max-ziplist-value 64
hll-sparse-max-bytes 3000
activerehashing yes
client-output-buffer-limit normal 0 0 0
client-output-buffer-limit slave 256mb 64mb 60
client-output-buffer-limit pubsub 32mb 8mb 60
hz 10
aof-rewrite-incremental-fsync yes

# slave的配置文件和以上一样，不过需要添加多一条slave加入master的配置，如下
slaveof redis-app-0.redis-service 6379
# 以上这条可以通过集群内dns解析为正确的pod的ip和无头服务
# 格式为$(podname).$(headless service name)
```

#### 3 搭建NFS

```
# 在master上搭建nfs-server
yum -y install nfs-utils rpcbind

# 为redis所有节点创建存放配置文件的nfs目录
mkdir /redis_share/redis{1..3}

cat > /etc/exports << EOF
/redis_share/redis1 192.168.0.0/24(rw,sync,no_root_squash)
/redis_share/redis2 192.168.0.0/24(rw,sync,no_root_squash)
/redis_share/redis3 192.168.0.0/24(rw,sync,no_root_squash)

# 开启nfs服务
systemctl start nfs

# 查看共享目录状态
exportfs -v

# 将上面的redis.conf放入对应的目录内
tree /redis_share/
/redis_share/
├── redis1
│   └── redis.conf   #放的是master的配置文件
├── redis2
│   └── redis.conf   #放的是slave的配置文件
└── redis3
    └── redis.conf   #放的是slave的配置文件

# 在其他节点下载nfs服务
yum -y install nfs-utils && systemctl enable nfs --now

# 在任意节点检测
showmount -e 192.168.0.10
```

#### 4 构建PV的yaml

```
# 分别为master和slave准备两个PV，分别启动才能保证节点能找到正确的配置文件
# 构建master的pv
cat > pv-master-redis.yaml << EOF
---
apiVersion: v1
kind: PersistentVolume
metadata:
  name: redis-pv1
spec:
  storageClassName: redis
  capacity:
    storage: 1Gi
  accessModes:
  - ReadWriteOnce
  nfs:
    server: 192.168.0.10
    path: /redis_share/redis1
EOF

# 构建slave的pv
cat > pv-slave-redis.yaml << EOF
---
apiVersion: v1
kind: PersistentVolume
metadata:
  name: redis-pv2
spec:
  storageClassName: redis
  capacity:
    storage: 1Gi
  accessModes:
  - ReadWriteOnce
  nfs:
    server: 192.168.0.10
    path: /redis_share/redis2

---
apiVersion: v1
kind: PersistentVolume
metadata:
  name: redis-pv3
spec:
  storageClassName: redis
  capacity:
    storage: 1Gi
  accessModes:
  - ReadWriteOnce
  nfs:
    server: 192.168.0.10
    path: /redis_share/redis3
EOF
```

#### 5 构建StatefulSet的yaml

```
# 编写redis的StatefulSet的yaml文件
cat > redis-app.yaml << EOF
---
apiVersion: apps/v1
kind: StatefulSet
metadata:
  name: redis-app
spec:
  serviceName: redis-service
  replicas: 3
  selector:
    matchLabels:
      name: redis
  template:
    metadata:
      labels:
        name: reids
    spec:
      containers:
      - name: redis-latest
        image: redis
        command:["redis-server","/data/redis.conf"]
        ports:
        - containerPort: 6379
          name: redisport
        volumeMounts:
        - name: redis-pvc
          mountPath: /data
  volumeClaimTemplates:
  - metadata:
      name: redis-pvc
    spec:
      storageClassName: redis
      accessModes:
      - ReadWriteOnce
      resources:
        requests:
          storage: 1Gi
          
---
apiVersion: v1
kind: Service
metadata:
  name: redis-service
  labels:
    name: redis
spec:
  ports:
  - port: 6379
    name: redis
  clusterIP: None
  selector:
    name: redis
```

#### 6 生效所有yaml文件

```
# 启用StatefulSet
kubectl apply -f redis-app.yaml

# 启用master和slave的pv
kubectl apply -f pv-master-redis.yaml
kubectl apply -f pv-slave-redis.yaml

# 查看启用情况
kubectl get pods,pv,pvc,svc -o wide

# 检验redis集群状态
kubectl exec -it pod/redis-app-0 -- /bin/bash
# root@redis-app-0:/data# redis-cli
# 127.0.0.1:6379> info replication
role: master
connected_slaves: 2
......

# 检测同步情况
# 127.0.0.1:6379> mset vian 2023 myfellas 2023 veminar 2023
# 去到其他pod查看redis同步状态
kubectl exec -it pod/redis-app-1 -- /bin/bash
# root@redis-app-1:/data# redis-cli
# 127.0.0.1:6379> keys *
# 查看到数据时则说明成功
# 接下来删除pod重新建pod查看持久化状态，能看到数据说明整个redis一主二从已经部署好了
```

钟贵贤/技术文档

简介

发行版

贡献者

近期动态

钟贵贤/技术文档 .gitee-modal { width: 500px !important; }

简介

发行版

贡献者

近期动态

搜索帮助

钟贵贤/技术文档