我的编程空间，编程开发者的网络收藏夹
学习永远不晚
位置：首页-资讯-数据库

使用redis-shake迁移redis cluster实操

2017-06-01 14:09

短信预约 信息系统项目管理师 报名、考试、查分时间动态提醒
省份

北京

  • 北京
  • 上海
  • 天津
  • 重庆
  • 河北
  • 山东
  • 辽宁
  • 黑龙江
  • 吉林
  • 甘肃
  • 青海
  • 河南
  • 江苏
  • 湖北
  • 湖南
  • 江西
  • 浙江
  • 广东
  • 云南
  • 福建
  • 海南
  • 山西
  • 四川
  • 陕西
  • 贵州
  • 安徽
  • 广西
  • 内蒙
  • 西藏
  • 新疆
  • 宁夏
  • 兵团
手机号
获取短信验证
立即预约

请填写图片验证码后获取短信验证码

看不清楚，换张图片

免费获取短信验证码

使用redis-shake迁移redis cluster实操

使用redis-shake迁移redis cluster实操

     使用参考：https://help.aliyun.com/knowledge_detail/111066.html

校验工具：redis-full-check   版本1.4.8

    使用参考：https://help.aliyun.com/document_detail/116887.html?spm=a2c4g.11186623.2.16.2d245d3eAoHLGq#concept-221787

源redis cluster 版本3.2.0，目标redis cluster 版本3.2.0

[STG-rmytest01_C00:rd01:5717:M ~]$./redis-shake.linux -conf=redis-shake.conf -type=sync

测试步骤与配置信息
[STG-rmytest01_C00:rd01:5717:M ~]$cat redis-shake.conf
#conf.version = 1
id = redis-shake
log.file =/u/redis/home/redis/hzy/redis-shake-v1.6.28/redis-shake.log
log.level = info
pid_path =/u/redis/home/redis/hzy/redis-shake-v1.6.28/redis-shake.pid 
system_profile = 9310
http_profile = 9320
parallel = 32
source.type = cluster

#可使用以下命令，获取源或目标ip 端口
#redis-cli -p 5717 -a pass1234  cluster nodes |awk "{print $2}" |awk  -F "@" "{print $1}" |awk -F":" "{print $1 ":"$2   }" |tr " " ";"  
#说明： -type=sync 在sync模式下，redis-shake使用SYNC或PSYNC命令将数据从源端Redis同步到目的端Redis，支持全量数据同步和增量数据同步，增量同步#在全量同步完成后自动开始
source.address = 192.168.0.100:5719;192.168.0.101:5718;192.168.0.100:5723;192.168.0.100:5721;192.168.0.101:5720;192.168.0.101:5722;192.168.0.100:5717
source.password_raw = world5555
source.auth_type = auth
source.tls_enable = false
source.rdb.input = local
source.rdb.parallel = 0
#source.rdb.special_cloud = 
target.type = cluster
target.address = 192.168.1.1:5970;192.168.1.2:5971;192.168.1.3:5972
target.password_raw = word1234
target.auth_type = auth
target.db = -1   #cluster 模式下不支持select 0 ,所以这里指定具体的db 会报错
target.tls_enable = false
target.rdb.output = local_dump
target.version = 4.0.10
#fake_time =
rewrite = true
#filter.db.whitelist =
#filter.db.blacklist =
#filter.key.whitelist =
#filter.key.blacklist =
#filter.slot =""
filter.lua = false
big_key_threshold = 524288000
metric = true
metric.print_log = false
sender.size = 104857600
sender.count = 4095
sender.delay_channel_size = 65535
keep_alive = 0
scan.key_number = 50
#scan.special_cloud =
#scan.key_file =
qps = 200000
#resume_from_break_point = false
replace_hash_tag = false
[STG-rmytest01_C00:rd01:5717:M ~]$


[redis@rd01 redis-shake-v1.6.28]$ less  redis-shake-2020-05-08T08-52-47.257.log
2020/05/08 16:41:14 [WARN] source.auth_type[auth] != auth
2020/05/08 16:41:14 [WARN] target.auth_type[auth] != auth
2020/05/08 16:41:14 [INFO] the target redis type is cluster, only pass db0
2020/05/08 16:41:14 [WARN] target version[4.0.10] given, set big_key_threshold = 1. see #173%!(EXTRA string=)
2020/05/08 16:41:14 [WARN] 
______________________________
                                      _         ______ |
                                     /   \___-=O"/|O"/__|
    RedisShake, here we go !! \_______          / | /    )
  /                             /        "/-==__ _/__|/__=-|  -GM
 /        Alibaba Cloud        /         *             | |
/                             /                        (o)
------------------------------
if you have any problem, please visit https://github.com/alibaba/RedisShake/wiki/FAQ

2020/05/08 16:41:14 [INFO] redis-shake configuration: {"Id":"redis-shake","LogFile":"/u/redis/home/redis/hzy/redis-shake-v1.6.28/redis-shake.log","LogLevel":"info","SystemProfile":9310,"HttpProfile":9320,"Parallel":32,"SourceType":"cluster","SourceAddress":"192.168.0.100:5719;192.168.0.101:5718;192.168.0.100:5723;192.168.0.100:5721;192.168.0.101:5720;192.168.0.101:5722;192.168.0.100:5717","SourcePasswordRaw":"fY1_6f.Psv","SourcePasswordEncoding":"","SourceAuthType":"auth","SourceTLSEnable":false,"SourceRdbInput":["local"],"SourceRdbParallel":7,"SourceRdbSpecialCloud":"","TargetAddress":"30.10.0.77:5970;30.10.0.248:5971;30.10.0.77:5972","TargetPasswordRaw":"bO16t~.Vxp","TargetPasswordEncoding":"","TargetDBString":"-1","TargetAuthType":"auth","TargetType":"cluster","TargetTLSEnable":false,"TargetRdbOutput":"local_dump","TargetVersion":"4.0.10","FakeTime":"","KeyExists":"rewrite","FilterDBWhitelist":["0"],"FilterDBBlacklist":[],"FilterKeyWhitelist":null,"FilterKeyBlacklist":null,"FilterSlot":null,"FilterLua":false,"BigKeyThreshold":1,"Psync":false,"Metric":true,"MetricPrintLog":false,"SenderSize":104857600,"SenderCount":4095,"SenderDelayChannelSize":65535,"KeepAlive":0,"PidPath":"/u/redis/home/redis/hzy/redis-shake-v1.6.28/redis-shake.pid","ScanKeyNumber":50,"ScanSpecialCloud":"","ScanKeyFile":"","Qps":200000,"NCpu":0,"HeartbeatUrl":"","HeartbeatInterval":10,"HeartbeatExternal":"","HeartbeatNetworkInterface":"","ReplaceHashTag":false,"ExtraInfo":false,"SockFileName":"","SockFileSize":0,"FilterKey":null,"FilterDB":"","Rewrite":true,"SourceAddressList":["192.168.0.100:5719","192.168.0.101:5718","192.168.0.100:5723","192.168.0.100:5721","192.168.0.101:5720","192.168.0.101:5722","192.168.0.100:5717"],"TargetAddressList":["30.10.0.77:5970","30.10.0.248:5971","30.10.0.77:5972"],"SourceVersion":"4.0.10","HeartbeatIp":"127.0.0.1","ShiftTime":0,"TargetReplace":true,"TargetDB":-1,"Version":"improve-1.6.28,ee2b853354b0cbaad2829d041ea72e106b2f46ec,go1.10.3,2020-04-21_13:17:55","Type":"sync"}
2020/05/08 16:41:14 [INFO] routine[0] starts syncing data from 192.168.0.100:5719 to [30.10.0.77:5970 30.10.0.248:5971 30.10.0.77:5972] with http[9327]
2020/05/08 16:41:14 [INFO] routine[2] starts syncing data from 192.168.0.100:5723 to [30.10.0.77:5970 30.10.0.248:5971 30.10.0.77:5972] with http[9327]
2020/05/08 16:41:14 [INFO] routine[1] starts syncing data from 192.168.0.101:5718 to [30.10.0.77:5970 30.10.0.248:5971 30.10.0.77:5972] with http[9327]
2020/05/08 16:41:14 [INFO] routine[3] starts syncing data from 192.168.0.100:5721 to [30.10.0.77:5970 30.10.0.248:5971 30.10.0.77:5972] with http[9327]
2020/05/08 16:41:14 [INFO] routine[4] starts syncing data from 192.168.0.101:5720 to [30.10.0.77:5970 30.10.0.248:5971 30.10.0.77:5972] with http[9327]
2020/05/08 16:41:14 [INFO] routine[6] starts syncing data from 192.168.0.100:5717 to [30.10.0.77:5970 30.10.0.248:5971 30.10.0.77:5972] with http[9327]
2020/05/08 16:41:14 [INFO] routine[5] starts syncing data from 192.168.0.101:5722 to [30.10.0.77:5970 30.10.0.248:5971 30.10.0.77:5972] with http[9327]
2020/05/08 16:41:14 [INFO] dbSyncer[3] rdb file size = 58452
2020/05/08 16:41:14 [INFO] Aux information key:redis-ver value:4.0.10
2020/05/08 16:41:14 [INFO] Aux information key:redis-bits value:64
2020/05/08 16:41:14 [INFO] Aux information key:ctime value:1588927274
2020/05/08 16:41:14 [INFO] Aux information key:used-mem value:72869304
2020/05/08 16:41:14 [INFO] Aux information key:repl-stream-db value:0
2020/05/08 16:41:14 [INFO] Aux information key:repl-id value:a7cf158b627a74d41273c39f01f531ff74a919b8
2020/05/08 16:41:14 [INFO] Aux information key:repl-offset value:0
2020/05/08 16:41:14 [INFO] Aux information key:aof-preamble value:0
2020/05/08 16:41:14 [INFO] db_size:136 expire_size:136
2020/05/08 16:41:14 [INFO] dbSyncer[5] rdb file size = 46583
2020/05/08 16:41:14 [INFO] Aux information key:redis-ver value:4.0.10
2020/05/08 16:41:14 [INFO] Aux information key:redis-bits value:64
2020/05/08 16:41:14 [INFO] Aux information key:ctime value:1588927274
2020/05/08 16:41:14 [INFO] Aux information key:used-mem value:72692584
2020/05/08 16:41:14 [INFO] Aux information key:repl-stream-db value:0
2020/05/08 16:41:14 [INFO] Aux information key:repl-id value:a8695cff787a9e644cac6f4e28598868fa6b9f36
2020/05/08 16:41:14 [INFO] Aux information key:repl-offset value:0
...skipping...
2020/05/08 16:41:14 [INFO] dbSyncer[3] sync rdb done
2020/05/08 16:41:14 [INFO] Aux information key:lua value:if redis.call("get",KEYS[1]) == ARGV[1]
then
    return redis.call("del",KEYS[1])
else
    return 0
end
2020/05/08 16:41:14 [INFO] dbSyncer[5] total = 45.491KB -     45.491KB [100%]  entry=115         
2020/05/08 16:41:14 [WARN] dbSyncer[3] GetFakeSlaveOffset not enable when psync == false
2020/05/08 16:41:14 [INFO] dbSyncer[5] sync rdb done
2020/05/08 16:41:14 [INFO] dbSyncer[3] FlushEvent:IncrSyncStart Id:redis-shake  
2020/05/08 16:41:14 [WARN] dbSyncer[5] GetFakeSlaveOffset not enable when psync == false
2020/05/08 16:41:14 [INFO] dbSyncer[5] FlushEvent:IncrSyncStart Id:redis-shake  
2020/05/08 16:41:14 [INFO] dbSyncer[0] rdb file size = 76875
2020/05/08 16:41:14 [INFO] Aux information key:redis-ver value:4.0.10
2020/05/08 16:41:14 [INFO] Aux information key:redis-bits value:64
2020/05/08 16:41:14 [INFO] Aux information key:ctime value:1588927274
2020/05/08 16:41:14 [INFO] Aux information key:used-mem value:72795264
2020/05/08 16:41:14 [INFO] Aux information key:repl-stream-db value:0
2020/05/08 16:41:14 [INFO] Aux information key:repl-id value:d3cb9c14f46128be69e023fa244437b3d5236cf3
2020/05/08 16:41:14 [INFO] Aux information key:repl-offset value:0
2020/05/08 16:41:14 [INFO] Aux information key:aof-preamble value:0
2020/05/08 16:41:14 [INFO] db_size:146 expire_size:144
2020/05/08 16:41:14 [INFO] dbSyncer[6] rdb file size = 39889
2020/05/08 16:41:14 [INFO] Aux information key:redis-ver value:4.0.10
2020/05/08 16:41:14 [INFO] Aux information key:redis-bits value:64
2020/05/08 16:41:14 [INFO] Aux information key:ctime value:1588927274
2020/05/08 16:41:14 [INFO] Aux information key:used-mem value:72723304
2020/05/08 16:41:14 [INFO] Aux information key:repl-stream-db value:0
2020/05/08 16:41:14 [INFO] Aux information key:repl-id value:832caebe279fee74c07e7f3de74f7a2ecf38cece
2020/05/08 16:41:14 [INFO] Aux information key:repl-offset value:0
2020/05/08 16:41:14 [INFO] Aux information key:aof-preamble value:0
2020/05/08 16:41:14 [INFO] db_size:113 expire_size:110
2020/05/08 16:41:14 [INFO] dbSyncer[1] rdb file size = 52446
2020/05/08 16:41:14 [INFO] Aux information key:redis-ver value:4.0.10
2020/05/08 16:41:14 [INFO] Aux information key:redis-bits value:64
2020/05/08 16:41:14 [INFO] Aux information key:ctime value:1588927274
2020/05/08 16:41:14 [INFO] Aux information key:used-mem value:72974984
2020/05/08 16:41:14 [INFO] Aux information key:repl-stream-db value:0
2020/05/08 16:41:14 [INFO] Aux information key:repl-id value:204bcc5426c073045fb23e2238a799f254bb3e68
2020/05/08 16:41:14 [INFO] Aux information key:repl-offset value:0
2020/05/08 16:41:14 [INFO] Aux information key:aof-preamble value:0
2020/05/08 16:41:14 [INFO] db_size:124 expire_size:123
2020/05/08 16:41:14 [INFO] Aux information key:lua value:if redis.call("get",KEYS[1]) == ARGV[1]
then
    return redis.call("del",KEYS[1])
else
    return 0
end
2020/05/08 16:41:14 [INFO] dbSyncer[4] rdb file size = 43693
2020/05/08 16:41:14 [INFO] Aux information key:redis-ver value:4.0.10
2020/05/08 16:41:14 [INFO] Aux information key:redis-bits value:64
2020/05/08 16:41:14 [INFO] Aux information key:ctime value:1588927274
2020/05/08 16:41:14 [INFO] Aux information key:used-mem value:72694296
2020/05/08 16:41:14 [INFO] Aux information key:repl-stream-db value:0
2020/05/08 16:41:14 [INFO] Aux information key:repl-id value:526c738d267cb69a7eb613dae2bb49f491f273d0
2020/05/08 16:41:14 [INFO] Aux information key:repl-offset value:0
2020/05/08 16:41:14 [INFO] Aux information key:aof-preamble value:0
2020/05/08 16:41:14 [INFO] db_size:128 expire_size:128
2020/05/08 16:41:14 [INFO] Aux information key:lua value:if redis.call("get",KEYS[1]) == ARGV[1]
...skipping...
2020/05/08 16:41:14 [INFO] dbSyncer[6] sync rdb done
2020/05/08 16:41:14 [INFO] dbSyncer[4] total = 42.669KB -     42.669KB [100%]  entry=129         
2020/05/08 16:41:14 [INFO] dbSyncer[4] sync rdb done
2020/05/08 16:41:14 [INFO] dbSyncer[6] FlushEvent:IncrSyncStart Id:redis-shake  
2020/05/08 16:41:14 [WARN] dbSyncer[6] GetFakeSlaveOffset not enable when psync == false
2020/05/08 16:41:14 [INFO] dbSyncer[1] total = 51.217KB -     51.217KB [100%]  entry=125         
2020/05/08 16:41:14 [INFO] dbSyncer[1] sync rdb done
2020/05/08 16:41:14 [INFO] dbSyncer[4] FlushEvent:IncrSyncStart Id:redis-shake  
2020/05/08 16:41:14 [WARN] dbSyncer[4] GetFakeSlaveOffset not enable when psync == false
2020/05/08 16:41:14 [INFO] dbSyncer[1] FlushEvent:IncrSyncStart Id:redis-shake  
2020/05/08 16:41:14 [WARN] dbSyncer[1] GetFakeSlaveOffset not enable when psync == false
2020/05/08 16:41:14 [INFO] dbSyncer[0] total = 75.073KB -     75.073KB [100%]  entry=146         
2020/05/08 16:41:14 [INFO] dbSyncer[0] sync rdb done
2020/05/08 16:41:14 [INFO] dbSyncer[0] FlushEvent:IncrSyncStart Id:redis-shake  
2020/05/08 16:41:14 [WARN] dbSyncer[0] GetFakeSlaveOffset not enable when psync == false
2020/05/08 16:41:14 [INFO] dbSyncer[2] rdb file size = 43062
2020/05/08 16:41:14 [INFO] Aux information key:redis-ver value:4.0.10
2020/05/08 16:41:14 [INFO] Aux information key:redis-bits value:64
2020/05/08 16:41:14 [INFO] Aux information key:ctime value:1588927274
2020/05/08 16:41:14 [INFO] Aux information key:used-mem value:72775184
2020/05/08 16:41:14 [INFO] Aux information key:repl-stream-db value:0
2020/05/08 16:41:14 [INFO] Aux information key:repl-id value:86726928fcc7bbccc46ccc67cd98c8cc96273c81
2020/05/08 16:41:14 [INFO] Aux information key:repl-offset value:0
2020/05/08 16:41:14 [INFO] Aux information key:aof-preamble value:0
2020/05/08 16:41:14 [INFO] db_size:125 expire_size:121
2020/05/08 16:41:14 [INFO] dbSyncer[2] total = 42.053KB -     42.053KB [100%]  entry=125         
2020/05/08 16:41:14 [INFO] dbSyncer[2] sync rdb done
2020/05/08 16:41:14 [WARN] dbSyncer[2] GetFakeSlaveOffset not enable when psync == false
2020/05/08 16:41:14 [INFO] dbSyncer[2] FlushEvent:IncrSyncStart Id:redis-shake  
2020/05/08 16:41:15 [INFO] dbSyncer[3] sync:  +forwardCommands=0      +filterCommands=0      +writeBytes=0
2020/05/08 16:41:15 [INFO] dbSyncer[5] sync:  +forwardCommands=0      +filterCommands=0      +writeBytes=0
2020/05/08 16:41:15 [INFO] dbSyncer[6] sync:  +forwardCommands=0      +filterCommands=0      +writeBytes=0
2020/05/08 16:41:15 [INFO] dbSyncer[4] sync:  +forwardCommands=0      +filterCommands=0      +writeBytes=0
2020/05/08 16:41:15 [INFO] dbSyncer[1] sync:  +forwardCommands=0      +filterCommands=0      +writeBytes=0
2020/05/08 16:41:15 [INFO] dbSyncer[0] sync:  +forwardCommands=0      +filterCommands=0      +writeBytes=0
2020/05/08 16:41:15 [INFO] dbSyncer[2] sync:  +forwardCommands=0      +filterCommands=0      +writeBytes=0
2020/05/08 16:41:16 [INFO] dbSyncer[3] sync:  +forwardCommands=0      +filterCommands=0      +writeBytes=0
2020/05/08 16:41:16 [INFO] dbSyncer[5] sync:  +forwardCommands=1      +filterCommands=0      +writeBytes=4
2020/05/08 16:41:16 [INFO] dbSyncer[6] sync:  +forwardCommands=0      +filterCommands=0      +writeBytes=0
2020/05/08 16:41:16 [INFO] dbSyncer[4] sync:  +forwardCommands=0      +filterCommands=0      +writeBytes=0
2020/05/08 16:41:16 [INFO] dbSyncer[1] sync:  +forwardCommands=1      +filterCommands=0      +writeBytes=4
2020/05/08 16:41:16 [INFO] dbSyncer[0] sync:  +forwardCommands=0      +filterCommands=0      +writeBytes=0
2020/05/08 16:41:16 [INFO] dbSyncer[2] sync:  +forwardCommands=0      +filterCommands=0      +writeBytes=0
2020/05/08 16:41:17 [INFO] dbSyncer[3] sync:  +forwardCommands=0      +filterCommands=0      +writeBytes=0
2020/05/08 16:41:17 [INFO] dbSyncer[5] sync:  +forwardCommands=0      +filterCommands=0      +writeBytes=0
2020/05/08 16:41:17 [INFO] dbSyncer[6] sync:  +forwardCommands=0      +filterCommands=0      +writeBytes=0
2020/05/08 16:41:17 [INFO] dbSyncer[4] sync:  +forwardCommands=0      +filterCommands=0      +writeBytes=0
2020/05/08 16:41:17 [INFO] dbSyncer[1] sync:  +forwardCommands=0      +filterCommands=0      +writeBytes=0
2020/05/08 16:41:17 [INFO] dbSyncer[0] sync:  +forwardCommands=0      +filterCommands=0      +writeBytes=0
2020/05/08 16:41:17 [INFO] dbSyncer[2] sync:  +forwardCommands=1      +filterCommands=0      +writeBytes=4
2020/05/08 16:41:18 [INFO] dbSyncer[3] sync:  +forwardCommands=0      +filterCommands=0      +writeBytes=0
2020/05/08 16:41:18 [INFO] dbSyncer[5] sync:  +forwardCommands=0      +filterCommands=0      +writeBytes=0
2020/05/08 16:41:18 [INFO] dbSyncer[6] sync:  +forwardCommands=0      +filterCommands=0      +writeBytes=0
2020/05/08 16:41:18 [INFO] dbSyncer[4] sync:  +forwardCommands=0      +filterCommands=0      +writeBytes=0
2020/05/08 16:41:18 [INFO] dbSyncer[1] sync:  +forwardCommands=0      +filterCommands=0      +writeBytes=0
2020/05/08 16:41:18 [INFO] dbSyncer[0] sync:  +forwardCommands=0      +filterCommands=0      +writeBytes=0
2020/05/08 16:41:18 [INFO] dbSyncer[2] sync:  +forwardCommands=0      +filterCommands=0      +writeBytes=0
[redis@rd01 redis-shake-v1.6.28]$ 
"
---------------------
--校验：
--./redis-full-check -s "" -p -t -a --comparemode=1 --comparetimes=1 --qps=10 --batchcount=100 --sourcedbtype=1 --targetdbfilterlist=0

 

./redis-full-check -s "192.168.0.100:5719;192.168.0.101:5718;192.168.0.100:5723;192.168.0.100:5721;192.168.0.101:5720;192.168.0.101:5722;192.168.0.100:5717"
-p  world5555
-t   "192.168.1.1:5970;192.168.1.2:5971;192.168.1.3:5972"
-a  word1234
--comparemode=1
--comparetimes=1
--qps=10 --batchcount=100
--sourcedbtype=1 --targetdbfilterlist=0  --targetdbtype=1


[STG-rmytest01_C00:rd01:5717:M ~]$./redis-full-check -s "192.168.0.100:5719;192.168.0.101:5718;192.168.0.100:5723;192.168.0.100:5721;192.168.0.101:5720;192.168.0.101:5722;192.168.0.100:5717" -p  fY1_6f.Psv  -t   "30.10.0.77:5970;30.10.0.248:5971;30.10.0.77:5972" -a  bO16t~.Vxp --comparemode=1 --comparetimes=1 --qps=10 --batchcount=100 --sourcedbtype=1 --targetdbfilterlist=0  --targetdbtype=1
[INFO 2020-05-08-17:42:41 main.go:65]: init log success
[INFO 2020-05-08-17:42:41 main.go:168]: configuration: {192.168.0.100:5719;192.168.0.101:5718;192.168.0.100:5723;192.168.0.100:5721;192.168.0.101:5720;192.168.0.101:5722;192.168.0.100:5717 fY1_6f.Psv auth 1 -1 30.10.0.77:5970;30.10.0.248:5971;30.10.0.77:5972 bO16t~.Vxp auth 1 0 result.db  1 1 unknown unknown unknown 10 5 100 5   false 16384  20445 false}
[INFO 2020-05-08-17:42:41 main.go:170]: ---------
[INFO 2020-05-08-17:42:41 full_check.go:238]: sourceDbType=1, p.sourcePhysicalDBList=[192.168.0.100:5719 192.168.0.101:5718 192.168.0.100:5723 192.168.0.100:5721 192.168.0.101:5720 192.168.0.101:5722 192.168.0.100:5717]
[INFO 2020-05-08-17:42:41 full_check.go:241]: db=0:keys=0(inaccurate for type cluster)
[INFO 2020-05-08-17:42:41 full_check.go:253]: ---------------- start 1th time compare
[INFO 2020-05-08-17:42:41 full_check.go:278]: start compare db 0
[INFO 2020-05-08-17:42:41 scan.go:20]: build connection[source redis addr: [192.168.0.100:5717]]
[INFO 2020-05-08-17:42:41 scan.go:20]: build connection[source redis addr: [192.168.0.100:5723]]
[INFO 2020-05-08-17:42:41 scan.go:20]: build connection[source redis addr: [192.168.0.101:5718]]
[INFO 2020-05-08-17:42:41 scan.go:20]: build connection[source redis addr: [192.168.0.101:5720]]
[INFO 2020-05-08-17:42:41 scan.go:20]: build connection[source redis addr: [192.168.0.100:5721]]
[INFO 2020-05-08-17:42:41 scan.go:20]: build connection[source redis addr: [192.168.0.101:5722]]
[INFO 2020-05-08-17:42:41 scan.go:20]: build connection[source redis addr: [192.168.0.100:5719]]
[INFO 2020-05-08-17:42:42 full_check.go:203]: stat:
times:1, db:0, dbkeys:0, finish:-1%, finished:true
KeyScan:{881 881 0}
KeyEqualAtLast|string|equal|{818 818 0}
KeyEqualAtLast|list|equal|{1 1 0}
KeyConflictAtLast|string|value|{3 3 0}
KeyConflictAtLast|string|lack_target|{59 59 0}

[INFO 2020-05-08-17:42:42 full_check.go:328]: --------------- finished! ----------------
all finish successfully, totally 62 key(s) and 0 field(s) conflict---  说明 执行完成后命令行输出校对结论，下方示例表示有62个不一致的key。如果此处为0，则两端数据一致。因为是在已有环境中测试，测试前已有数据。
[STG-rmytest01_C00:rd01:5717:M ~]$

至此迁移完成。

校验说明：校验时配置的群集源与目标ip 必须是master 节点，不能配置slave 节点如何节点很多，可以使用以下配置方式，以简化配置

  ./redis-full-check -s "master@192.168.0.100:6979" -p  world5555-t   "master@192.168.1.1:6475" -a  word1234--comparemode=1 --comparetimes=1 --qps=100 --batchcount=1000 --sourcedbtype=1 --targetdbfilterlist=0  --targetdbtype=1  >check.log &

ps:redis 迁移 工具对比

name 支持情况 是否开源 check 一致性 功能 参考说明
redis-migrate-tool 备份，
全量同步
增量		 是 支持 redis到cluster
cluster集群到cluster集群迁移
cluster到twemproxy的迁移
从AOF 和 RDB中恢复数据		 https://blog.csdn.net/singgel/article/details/94596464
https://github.com/vipshop/redis-migrate-tool
redis-shake 备份，
全量同步
增量		 是 单独的check工具 单节点->单节点
单节点->cluster
cluster->cluster
cluster->单节点		 　

免责声明：

① 本站未注明“稿件来源”的信息均来自网络整理。其文字、图片和音视频稿件的所属权归原作者所有。本站收集整理出于非商业性的教育和科研之目的，并不意味着本站赞同其观点或证实其内容的真实性。仅作为临时的测试数据，供内部测试之用。本站并未授权任何人以任何方式主动获取本站任何信息。

② 本站未注明“稿件来源”的临时测试数据将在测试完成后最终做删除处理。有问题或投稿请发送至: 邮箱/279061341@qq.com QQ/279061341

使用redis-shake迁移rediscluster实操
阅读原文内容投诉

使用redis-shake迁移redis cluster实操

下载Word文档到电脑，方便收藏和打印～

下载Word文档

相关文章

猜你喜欢

使用redis-shake迁移redis cluster实操

使用参考：https://help.aliyun.com/knowledge_detail/111066.html 校验工具：redis-full-check   版本1.4.8     使用参考：https://help.aliyun.com/documen
使用redis-shake迁移redis cluster实操
2017-06-01

redis数据备份和迁移工具redis-dump如何安装使用

2024-04-02

PHP中使用Redis实现批量操作

2023-05-16

SpringBoot中操作使用Redis实现详解

SpringBoot与Redis结合使用，通过使用SpringDataRedis来实现对Redis的操作，实现数据缓存和高效存储，提高应用程序的性能和响应速度。可以利用SpringBoot自带的RedisStarter方便地集成和配置Redis
2023-05-16

PHP使用Redis实战实录4：单例模式和面向过程操作redis的语法

2023-08-31

Java使用Jedis操作Redis服务器的实例代码

这几天Java项目中需要用到Redis，于是学习了一下使用Jedis来操作Redis服务器的相关知识，下面为具体的配置和代码。1、Maven中配置Jedis在maven项目的pom.xml中添加依赖
2023-05-31

如何使用Node.js和Redis实现增删改查操作

这篇文章主要介绍“如何使用Node.js和Redis实现增删改查操作”的相关知识，小编通过实际案例向大家展示操作过程，操作方法简单快捷，实用性强，希望这篇“如何使用Node.js和Redis实现增删改查操作”文章能帮助大家解决问题。什么是N
2023-07-05

在spring时使用RedisTemplate如何实现连接并操作Redis

在spring时使用RedisTemplate如何实现连接并操作Redis？很多新手对此不是很清楚，为了帮助大家解决这个难题，下面小编将为大家详细讲解，有这方面需求的人可以来学习下，希望你能有所收获。事务需要开启enableTransact
2023-05-31

迁移案例实操：MySQL迁移到DM8由于有248张表存在datetime字段类型，使用dts迁移到达梦报不支持数据类型【附数据对比工具】

2023-10-21

在Java项目中使用Jedis如何实现连接并操作Redis

在Java项目中使用Jedis如何实现连接并操作Redis？相信很多没有经验的人对此束手无策，为此本文总结了问题出现的原因和解决方法，通过这篇文章希望你能解决这个问题。一. redis的安装1.下载源码，解压缩后编译源码。[root@c
2023-05-31

java客户端中如何使用Jedis实现操作Redis Sentinel 连接池

这篇文章给大家介绍java客户端中如何使用Jedis实现操作Redis Sentinel 连接池，内容非常详细，感兴趣的小伙伴们可以参考借鉴，希望对大家能有所帮助。pom.xml配置 org.s
2023-05-31

热门标签

Linux(148)PHP(127)Java(102)正则表达式(101)JavaScript(69)最佳实践(67)jQuery(44)MySQL(39)Docker(37)C语言(36)性能优化(34)Python(34)XML(28)string(27)第三方库(23)回调函数(23)ZIP(22)数组(22)可扩展性(22)字符串比较(21)find(20)RPM(20)Go(20)grep(19)ASP.NETCore(19)XML解析器(19)事件(19)事件处理程序(19)StringBuilder(18)Nginx(18)

编程热搜

查看更多

编程资源站

  • 资料下载
  • 历年试题
2021年下半年软考高级信息系统项目管理师高频考点精选资料
2021下半年软考高级信息系统技术知识点记忆口诀精选资料
2021下半年软考《信息系统项目管理师》考试真题及答案精选资料
2021下半年软考高级考试备考攻略精选资料
2021年软考高级《信息系统项目管理师》巩固练习题汇总精选资料
2021下半年软考高级信息系统项目管理师30个易考知识点汇总精选资料
2021下半年软考高级知识点这样记，还担心记不住吗精选资料
2021年下半年软考高级考试重点汇总精选资料
2021下半年软考高级信息系统项目管理师计算公式汇总精选资料
2021年下半年软考高级《信息系统项目管理师》模拟试题精选资料
查看更多
信息系统项目管理师选择题每日一练（2024）历年试题
2023年下半年信息系统项目管理师综合知识真题演练历年试题
查看更多

目录

本网页已闲置超过3分钟，按键盘任意键或点击空白处，即可回到网页
最新资讯更多
    友情链接编程网

    反馈

    我要
    反馈