Redis 4.0.6 crashed by signal: 11

52 views
Skip to first unread message

Qian Chen

unread,
Jan 12, 2018, 2:08:20 AM1/12/18
to Redis DB
66527:M 10 Jan 05:35:08.351 # WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128.
66527:M 10 Jan 05:35:08.351 # Server initialized
66527:M 10 Jan 05:35:08.351 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.
66527:M 10 Jan 05:35:08.351 # WARNING you have Transparent Huge Pages (THP) support enabled in your kernel. This will create latency and memory usage issues with Redis. To fix this issue run the command 'echo never > /sys/kernel/mm/transparent_hugepage/enabled' as root, and add it to your /etc/rc.local in order to retain the setting after a reboot. Redis must be restarted after THP is disabled.
66527:M 10 Jan 05:35:08.351 * Ready to accept connections
66527:M 10 Jan 05:35:10.357 # Cluster state changed: ok
66527:M 10 Jan 05:35:18.378 * Clear FAIL state for node 3c250bfb9895bf087e37c76824c4dd3526bf6d12: is reachable again and nobody is serving its slots after some time.
66527:M 10 Jan 05:35:18.379 * Clear FAIL state for node bdf8134e4f3948b3b51356e044082eaaba0ba899: is reachable again and nobody is serving its slots after some time.
66527:M 10 Jan 05:35:18.380 * Clear FAIL state for node b0fe1fb4b0a5d86965552d8abc932a61ed80ffec: is reachable again and nobody is serving its slots after some time.
66527:M 10 Jan 05:35:20.786 * Clear FAIL state for node 4aeb9cd6c344d8c79e15ed64e9a66fcd972d2587: is reachable again and nobody is serving its slots after some time.
66527:M 10 Jan 05:39:21.546 * FAIL message received from b0fe1fb4b0a5d86965552d8abc932a61ed80ffec about e5c9a8c275f6877a43786cb80a656fea7ceac673
66527:M 10 Jan 05:39:21.546 * FAIL message received from b0fe1fb4b0a5d86965552d8abc932a61ed80ffec about eb3eb2ac0d1f3396220b2e9fb39d0e49c9f15749
66527:M 10 Jan 05:39:21.546 * FAIL message received from b0fe1fb4b0a5d86965552d8abc932a61ed80ffec about 9b6b9369e8b1d82e0547e0abaaa58285cc9c559c
66527:M 10 Jan 05:39:21.546 * FAIL message received from b0fe1fb4b0a5d86965552d8abc932a61ed80ffec about 8bd84ac0da2b8d94051be6cbc8244b56053e88c4
66527:M 10 Jan 05:40:07.315 * Clear FAIL state for node 9b6b9369e8b1d82e0547e0abaaa58285cc9c559c: is reachable again and nobody is serving its slots after some time.
66527:M 10 Jan 05:40:07.316 * Clear FAIL state for node e5c9a8c275f6877a43786cb80a656fea7ceac673: is reachable again and nobody is serving its slots after some time.
66527:M 10 Jan 05:40:07.317 * Clear FAIL state for node 8bd84ac0da2b8d94051be6cbc8244b56053e88c4: is reachable again and nobody is serving its slots after some time.
66527:M 10 Jan 05:40:07.317 * Clear FAIL state for node eb3eb2ac0d1f3396220b2e9fb39d0e49c9f15749: is reachable again and nobody is serving its slots after some time.


=== REDIS BUG REPORT START: Cut & paste starting from here ===
66527:M 10 Jan 14:46:13.596 # ------------------------------------------------
66527:M 10 Jan 14:46:13.596 # !!! Software Failure. Press left mouse button to continue
66527:M 10 Jan 14:46:13.596 # Guru Meditation: Redis built-in command declared keys positions not matching the arity requirements. #db.c:1163
66527:M 10 Jan 14:46:13.596 # (forcing SIGSEGV in order to print the stack trace)
66527:M 10 Jan 14:46:13.596 # ------------------------------------------------
66527:M 10 Jan 14:46:13.596 # Redis 4.0.6 crashed by signal: 11
66527:M 10 Jan 14:46:13.596 # Crashed running the instuction at: 0x460107
66527:M 10 Jan 14:46:13.596 # Accessing address: 0xffffffffffffffff
66527:M 10 Jan 14:46:13.596 # Failed assertion: <no assertion failed> (<no file>:0)

------ STACK TRACE ------
EIP:
redis-server 172.29.46.63:7109 [cluster](_serverPanic+0x117)[0x460107]

Backtrace:
redis-server 172.29.46.63:7109 [cluster](logStackTrace+0x29)[0x461b29]
redis-server 172.29.46.63:7109 [cluster](sigsegvHandler+0xac)[0x4621cc]
/lib64/libpthread.so.0(+0xf100)[0x7f6aa2be6100]
redis-server 172.29.46.63:7109 [cluster](_serverPanic+0x117)[0x460107]
redis-server 172.29.46.63:7109 [cluster](getKeysUsingCommandTable+0xbe)[0x439cfe]
redis-server 172.29.46.63:7109 [cluster](getNodeByQuery+0xe3)[0x46d683]
redis-server 172.29.46.63:7109 [cluster](processCommand+0x1fb)[0x425dfb]
redis-server 172.29.46.63:7109 [cluster](processInputBuffer+0x105)[0x434f75]
redis-server 172.29.46.63:7109 [cluster](aeProcessEvents+0x23d)[0x4200ad]
redis-server 172.29.46.63:7109 [cluster](aeMain+0x2b)[0x42038b]
redis-server 172.29.46.63:7109 [cluster](main+0x49f)[0x41d2bf]
/lib64/libc.so.6(__libc_start_main+0xf5)[0x7f6aa2837b15]
redis-server 172.29.46.63:7109 [cluster][0x41d4f5]

------ INFO OUTPUT ------
# Server
redis_version:4.0.6
redis_git_sha1:00000000
redis_git_dirty:0
redis_build_id:e5874437072652ff
redis_mode:cluster
os:Linux 3.10.0-327.el7.x86_64 x86_64
arch_bits:64
multiplexing_api:epoll
atomicvar_api:atomic-builtin
gcc_version:4.8.5
process_id:66527
run_id:6f1fab6d6d474d7180073477a66a7244eec2ebb4
tcp_port:7109
uptime_in_seconds:33065
uptime_in_days:0
hz:10
lru_clock:5617333
executable:/app/redis/redis-server
config_file:/app/redis/conf/7109.conf

# Clients
connected_clients:161
client_longest_output_list:0
client_biggest_input_buf:0
blocked_clients:0

# Memory
used_memory:4081961
used_memory_human:3.89M
used_memory_rss:6184960
used_memory_rss_human:5.90M
used_memory_peak:4292296
used_memory_peak_human:4.09M
used_memory_peak_perc:95.10%
used_memory_overhead:3830432
used_memory_startup:1081538
used_memory_dataset:251529
used_memory_dataset_perc:8.38%
total_system_memory:67370766336
total_system_memory_human:62.74G
used_memory_lua:74752
used_memory_lua_human:73.00K
maxmemory:4000000000
maxmemory_human:3.73G
maxmemory_policy:noeviction
mem_fragmentation_ratio:1.52
mem_allocator:libc
active_defrag_running:0
lazyfree_pending_objects:0

# Persistence
loading:0
rdb_changes_since_last_save:362
rdb_bgsave_in_progress:0
rdb_last_save_time:1515533708
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:-1
rdb_current_bgsave_time_sec:-1
rdb_last_cow_size:0
aof_enabled:0
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:-1
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:ok
aof_last_write_status:ok
aof_last_cow_size:0

# Stats
total_connections_received:13164
total_commands_processed:16694
instantaneous_ops_per_sec:3
total_net_input_bytes:1284209
total_net_output_bytes:1659594
instantaneous_input_kbps:72.72
instantaneous_output_kbps:35.11
rejected_connections:0
sync_full:0
sync_partial_ok:0
sync_partial_err:0
expired_keys:16
evicted_keys:0
keyspace_hits:2718
keyspace_misses:10
pubsub_channels:0
pubsub_patterns:0
latest_fork_usec:0
migrate_cached_sockets:0
slave_expires_tracked_keys:0
active_defrag_hits:0
active_defrag_misses:0
active_defrag_key_hits:0
active_defrag_key_misses:0

# Replication
role:master
connected_slaves:0
master_replid:edfbcca741cf96b240feb581e0cb44ca9b288a66
master_replid2:0000000000000000000000000000000000000000
master_repl_offset:0
second_repl_offset:-1
repl_backlog_active:0
repl_backlog_size:1048576
repl_backlog_first_byte_offset:0
repl_backlog_histlen:0

# CPU
used_cpu_sys:53.90
used_cpu_user:27.69
used_cpu_sys_children:0.00
used_cpu_user_children:0.00

# Commandstats
cmdstat_hincrby:calls=63,usec=492,usec_per_call=7.81
cmdstat_ping:calls=154,usec=372,usec_per_call=2.42
cmdstat_expire:calls=23,usec=80,usec_per_call=3.48
cmdstat_lset:calls=62,usec=306,usec_per_call=4.94
cmdstat_hmset:calls=71,usec=2415,usec_per_call=34.01
cmdstat_hmget:calls=64,usec=1194,usec_per_call=18.66
cmdstat_eval:calls=65,usec=16685,usec_per_call=256.69
cmdstat_llen:calls=188,usec=1072,usec_per_call=5.70
cmdstat_hset:calls=63,usec=213,usec_per_call=3.38
cmdstat_command:calls=17,usec=10601,usec_per_call=623.59
cmdstat_lindex:calls=62,usec=460,usec_per_call=7.42
cmdstat_hexists:calls=239,usec=1818,usec_per_call=7.61
cmdstat_get:calls=14,usec=114,usec_per_call=8.14
cmdstat_rpush:calls=63,usec=346,usec_per_call=5.49
cmdstat_ttl:calls=126,usec=84,usec_per_call=0.67
cmdstat_sadd:calls=1,usec=27,usec_per_call=27.00
cmdstat_lrange:calls=302,usec=4410,usec_per_call=14.60
cmdstat_exists:calls=64,usec=177,usec_per_call=2.77
cmdstat_evalsha:calls=126,usec=7169,usec_per_call=56.90
cmdstat_info:calls=14,usec=2424,usec_per_call=173.14
cmdstat_hget:calls=289,usec=2448,usec_per_call=8.47
cmdstat_auth:calls=13164,usec=35031,usec_per_call=2.66
cmdstat_setex:calls=16,usec=453,usec_per_call=28.31
cmdstat_hgetall:calls=1444,usec=42220,usec_per_call=29.24

# Cluster
cluster_enabled:1

# Keyspace
db0:keys=23,expires=23,avg_ttl=914172475302

------ CLIENT LIST OUTPUT ------
id=13024 addr=172.29.88.71:50682 fd=126 name= age=338 idle=338 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13025 addr=172.29.88.71:50683 fd=127 name= age=338 idle=338 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13066 addr=172.29.88.28:47737 fd=113 name= age=241 idle=241 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13067 addr=172.29.88.28:47738 fd=114 name= age=241 idle=241 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13068 addr=172.29.88.28:47739 fd=180 name= age=241 idle=241 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13026 addr=172.29.88.71:50684 fd=187 name= age=338 idle=338 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13120 addr=172.29.88.71:50857 fd=124 name= age=98 idle=98 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13121 addr=172.29.88.71:50858 fd=125 name= age=98 idle=98 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13122 addr=172.29.88.71:50859 fd=186 name= age=98 idle=98 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13042 addr=172.29.88.22:1547 fd=57 name= age=299 idle=299 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13043 addr=172.29.88.22:1548 fd=58 name= age=299 idle=299 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13044 addr=172.29.88.22:1549 fd=158 name= age=299 idle=299 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13162 addr=172.29.88.28:47960 fd=111 name= age=1 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13163 addr=172.29.88.28:47961 fd=112 name= age=1 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13164 addr=172.29.88.28:47962 fd=181 name= age=1 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13048 addr=172.29.88.70:26158 fd=73 name= age=287 idle=287 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13049 addr=172.29.88.70:26159 fd=74 name= age=287 idle=287 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13050 addr=172.29.88.70:26160 fd=165 name= age=287 idle=287 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13138 addr=172.29.88.22:1770 fd=55 name= age=59 idle=59 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13139 addr=172.29.88.22:1771 fd=56 name= age=59 idle=59 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13140 addr=172.29.88.22:1772 fd=159 name= age=59 idle=59 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13144 addr=172.29.88.70:26333 fd=9 name= age=47 idle=47 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13145 addr=172.29.88.70:26334 fd=72 name= age=47 idle=47 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13146 addr=172.29.88.70:26335 fd=163 name= age=47 idle=47 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13153 addr=172.29.88.40:33895 fd=90 name= age=37 idle=37 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13154 addr=172.29.88.40:33896 fd=91 name= age=37 idle=37 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13155 addr=172.29.88.40:33897 fd=172 name= age=37 idle=37 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13057 addr=172.29.88.40:33668 fd=92 name= age=277 idle=277 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13058 addr=172.29.88.40:33669 fd=93 name= age=277 idle=277 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13059 addr=172.29.88.40:33670 fd=171 name= age=277 idle=277 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=12988 addr=172.29.88.23:30862 fd=47 name= age=422 idle=383 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=lrange
id=12998 addr=172.29.88.25:44600 fd=69 name= age=411 idle=381 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=lrange
id=13020 addr=172.29.88.29:6927 fd=120 name= age=360 idle=360 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13021 addr=172.29.88.29:6928 fd=121 name= age=360 idle=360 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13022 addr=172.29.88.29:6929 fd=184 name= age=360 idle=360 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13084 addr=172.29.88.23:31083 fd=40 name= age=182 idle=182 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13085 addr=172.29.88.23:31084 fd=41 name= age=182 idle=182 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13086 addr=172.29.88.23:31085 fd=45 name= age=182 idle=182 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13033 addr=172.29.88.21:4472 fd=148 name= age=307 idle=307 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13034 addr=172.29.88.21:4473 fd=149 name= age=307 idle=307 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13035 addr=172.29.88.21:4474 fd=153 name= age=307 idle=307 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13117 addr=172.29.88.29:7150 fd=118 name= age=120 idle=120 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13118 addr=172.29.88.29:7151 fd=119 name= age=120 idle=120 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13119 addr=172.29.88.29:7152 fd=183 name= age=120 idle=120 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=12979 addr=172.29.88.41:55098 fd=136 name= age=453 idle=453 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13039 addr=172.29.88.24:10641 fd=50 name= age=300 idle=300 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13040 addr=172.29.88.24:10642 fd=51 name= age=300 idle=300 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13041 addr=172.29.88.24:10643 fd=155 name= age=300 idle=300 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13007 addr=172.29.88.42:7001 fd=89 name= age=401 idle=379 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=hgetall
id=13060 addr=172.29.88.26:17403 fd=99 name= age=254 idle=254 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13061 addr=172.29.88.26:17404 fd=100 name= age=254 idle=254 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13062 addr=172.29.88.26:17405 fd=174 name= age=254 idle=254 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13016 addr=172.29.88.27:40692 fd=110 name= age=364 idle=364 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13093 addr=172.29.88.25:44821 fd=62 name= age=171 idle=171 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13094 addr=172.29.88.25:44822 fd=63 name= age=171 idle=171 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13095 addr=172.29.88.25:44823 fd=162 name= age=171 idle=171 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13156 addr=172.29.88.26:17626 fd=97 name= age=14 idle=14 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13157 addr=172.29.88.26:17627 fd=98 name= age=14 idle=14 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13158 addr=172.29.88.26:17628 fd=175 name= age=14 idle=14 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13075 addr=172.29.88.41:55322 fd=134 name= age=213 idle=213 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13129 addr=172.29.88.21:4695 fd=146 name= age=67 idle=67 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13130 addr=172.29.88.21:4696 fd=147 name= age=67 idle=67 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13131 addr=172.29.88.21:4697 fd=194 name= age=67 idle=67 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13102 addr=172.29.88.42:7229 fd=82 name= age=161 idle=161 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13103 addr=172.29.88.42:7230 fd=83 name= age=161 idle=161 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13135 addr=172.29.88.24:10864 fd=48 name= age=60 idle=60 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13136 addr=172.29.88.24:10865 fd=49 name= age=60 idle=60 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13137 addr=172.29.88.24:10866 fd=156 name= age=60 idle=60 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13104 addr=172.29.88.42:7231 fd=170 name= age=161 idle=161 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13076 addr=172.29.88.41:55323 fd=135 name= age=213 idle=213 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13077 addr=172.29.88.41:55324 fd=189 name= age=213 idle=213 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13078 addr=172.29.88.20:61328 fd=142 name= age=196 idle=196 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13079 addr=172.29.88.20:61329 fd=143 name= age=196 idle=196 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13111 addr=172.29.88.27:40913 fd=108 name= age=124 idle=124 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13112 addr=172.29.88.27:40914 fd=109 name= age=124 idle=124 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13113 addr=172.29.88.27:40915 fd=179 name= age=124 idle=124 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13080 addr=172.29.88.20:61330 fd=191 name= age=196 idle=196 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13051 addr=172.29.88.72:4551 fd=79 name= age=282 idle=282 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13052 addr=172.29.88.72:4552 fd=80 name= age=282 idle=282 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13053 addr=172.29.88.72:4553 fd=168 name= age=282 idle=282 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=12982 addr=172.29.88.20:61105 fd=144 name= age=436 idle=379 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=hgetall
id=13072 addr=172.29.88.71:50770 fd=128 name= age=218 idle=218 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13073 addr=172.29.88.71:50771 fd=129 name= age=218 idle=218 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13074 addr=172.29.88.71:50772 fd=198 name= age=218 idle=218 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13114 addr=172.29.88.28:47848 fd=115 name= age=121 idle=121 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13115 addr=172.29.88.28:47849 fd=116 name= age=121 idle=121 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13147 addr=172.29.88.72:4726 fd=15 name= age=42 idle=42 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13148 addr=172.29.88.72:4727 fd=78 name= age=42 idle=42 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13149 addr=172.29.88.72:4728 fd=166 name= age=42 idle=42 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13116 addr=172.29.88.28:47850 fd=182 name= age=121 idle=121 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=12976 addr=172.29.88.71:50597 fd=188 name= age=458 idle=458 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13090 addr=172.29.88.22:1658 fd=59 name= age=179 idle=179 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13091 addr=172.29.88.22:1659 fd=60 name= age=179 idle=179 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13092 addr=172.29.88.22:1660 fd=160 name= age=179 idle=179 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13096 addr=172.29.88.70:26246 fd=70 name= age=167 idle=167 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13165 addr=172.29.46.60:10201 fd=199 name= age=1 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=object
id=13097 addr=172.29.88.70:26247 fd=71 name= age=167 idle=167 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13098 addr=172.29.88.70:26248 fd=75 name= age=167 idle=167 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13019 addr=172.29.88.28:47627 fd=117 name= age=361 idle=361 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=12995 addr=172.29.88.22:1437 fd=61 name= age=419 idle=419 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13001 addr=172.29.88.70:26073 fd=164 name= age=407 idle=407 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13010 addr=172.29.88.40:33553 fd=96 name= age=397 idle=397 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=12973 addr=172.29.88.29:6818 fd=185 name= age=480 idle=386 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=hgetall
id=13036 addr=172.29.88.23:30972 fd=39 name= age=302 idle=302 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13037 addr=172.29.88.23:30973 fd=44 name= age=302 idle=302 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13038 addr=172.29.88.23:30974 fd=154 name= age=302 idle=302 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13105 addr=172.29.88.40:33780 fd=94 name= age=157 idle=157 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13106 addr=172.29.88.40:33781 fd=95 name= age=157 idle=157 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13107 addr=172.29.88.40:33782 fd=173 name= age=157 idle=157 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13069 addr=172.29.88.29:7039 fd=122 name= age=240 idle=240 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13070 addr=172.29.88.29:7040 fd=123 name= age=240 idle=240 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13071 addr=172.29.88.29:7041 fd=197 name= age=240 idle=240 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13013 addr=172.29.88.26:17293 fd=103 name= age=374 idle=374 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=12985 addr=172.29.88.21:4362 fd=152 name= age=427 idle=427 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13045 addr=172.29.88.25:44710 fd=66 name= age=291 idle=291 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13046 addr=172.29.88.25:44711 fd=67 name= age=291 idle=291 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13047 addr=172.29.88.25:44712 fd=161 name= age=291 idle=291 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=12992 addr=172.29.88.24:10531 fd=54 name= age=420 idle=420 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13132 addr=172.29.88.23:31196 fd=42 name= age=62 idle=62 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13133 addr=172.29.88.23:31197 fd=43 name= age=62 idle=62 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13134 addr=172.29.88.23:31198 fd=46 name= age=62 idle=62 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13081 addr=172.29.88.21:4583 fd=150 name= age=187 idle=187 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13082 addr=172.29.88.21:4584 fd=151 name= age=187 idle=187 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13083 addr=172.29.88.21:4585 fd=193 name= age=187 idle=187 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13027 addr=172.29.88.41:55210 fd=132 name= age=333 idle=333 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13087 addr=172.29.88.24:10752 fd=52 name= age=180 idle=180 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13088 addr=172.29.88.24:10753 fd=53 name= age=180 idle=180 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13089 addr=172.29.88.24:10754 fd=157 name= age=180 idle=180 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13054 addr=172.29.88.42:7118 fd=86 name= age=281 idle=281 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13055 addr=172.29.88.42:7119 fd=87 name= age=281 idle=281 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13056 addr=172.29.88.42:7120 fd=169 name= age=281 idle=281 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13028 addr=172.29.88.41:55211 fd=133 name= age=333 idle=333 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13029 addr=172.29.88.41:55212 fd=137 name= age=333 idle=333 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13030 addr=172.29.88.20:61217 fd=140 name= age=316 idle=316 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13063 addr=172.29.88.27:40802 fd=106 name= age=244 idle=244 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13064 addr=172.29.88.27:40803 fd=107 name= age=244 idle=244 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13108 addr=172.29.88.26:17514 fd=101 name= age=134 idle=134 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13109 addr=172.29.88.26:17515 fd=102 name= age=134 idle=134 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13110 addr=172.29.88.26:17516 fd=176 name= age=134 idle=134 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13065 addr=172.29.88.27:40804 fd=177 name= age=244 idle=244 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13031 addr=172.29.88.20:61218 fd=141 name= age=316 idle=316 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13141 addr=172.29.88.25:44933 fd=64 name= age=51 idle=51 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13142 addr=172.29.88.25:44934 fd=65 name= age=51 idle=51 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13143 addr=172.29.88.25:44935 fd=68 name= age=51 idle=51 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13032 addr=172.29.88.20:61219 fd=145 name= age=316 idle=316 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13123 addr=172.29.88.41:55433 fd=130 name= age=93 idle=93 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13124 addr=172.29.88.41:55434 fd=131 name= age=93 idle=93 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13150 addr=172.29.88.42:7341 fd=84 name= age=41 idle=41 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13151 addr=172.29.88.42:7342 fd=85 name= age=41 idle=41 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13152 addr=172.29.88.42:7343 fd=88 name= age=41 idle=41 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13125 addr=172.29.88.41:55435 fd=190 name= age=93 idle=93 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13126 addr=172.29.88.20:61440 fd=138 name= age=76 idle=76 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13127 addr=172.29.88.20:61441 fd=139 name= age=76 idle=76 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13128 addr=172.29.88.20:61442 fd=192 name= age=76 idle=76 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13159 addr=172.29.88.27:41026 fd=104 name= age=4 idle=4 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13160 addr=172.29.88.27:41027 fd=105 name= age=4 idle=4 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13161 addr=172.29.88.27:41028 fd=178 name= age=4 idle=4 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13004 addr=172.29.88.72:4464 fd=167 name= age=402 idle=402 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13099 addr=172.29.88.72:4638 fd=76 name= age=162 idle=162 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13100 addr=172.29.88.72:4639 fd=77 name= age=162 idle=162 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth
id=13101 addr=172.29.88.72:4640 fd=81 name= age=162 idle=162 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=auth

------ CURRENT CLIENT INFO ------
id=13165 addr=172.29.46.60:10201 fd=199 name= age=1 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=object
argv[0]: 'object'
argv[1]: 'files.'

------ REGISTERS ------
66527:M 10 Jan 14:46:13.598 # 
RAX:0000000000000000 RBX:00000000004bd62e
RCX:0000000001702540 RDX:00007f6aa2bd07b8
RDI:00007f6aa2bd0760 RSI:0000000000000001
RBP:000000000000048b RSP:00007fff1a8c97b0
R8 :0000000000000001 R9 :00007f6aa3503740
R10:0000000000000030 R11:0000000000000206
R12:0000000000000002 R13:00007fff1a8c9a3c
R14:00000000018bc768 R15:0000000000000001
RIP:0000000000460107 EFL:0000000000010206
CSGSFS:0000000000000033
66527:M 10 Jan 14:46:13.598 # (00007fff1a8c97bf) -> 00007f6aa2bd0760
66527:M 10 Jan 14:46:13.598 # (00007fff1a8c97be) -> 00007fff002e7374
66527:M 10 Jan 14:46:13.598 # (00007fff1a8c97bd) -> 6e656d6572697571
66527:M 10 Jan 14:46:13.598 # (00007fff1a8c97bc) -> 6572207974697261
66527:M 10 Jan 14:46:13.598 # (00007fff1a8c97bb) -> 2065687420676e69
66527:M 10 Jan 14:46:13.598 # (00007fff1a8c97ba) -> 686374616d20746f
66527:M 10 Jan 14:46:13.598 # (00007fff1a8c97b9) -> 6e20736e6f697469
66527:M 10 Jan 14:46:13.598 # (00007fff1a8c97b8) -> 736f70207379656b
66527:M 10 Jan 14:46:13.599 # (00007fff1a8c97b7) -> 20646572616c6365
66527:M 10 Jan 14:46:13.599 # (00007fff1a8c97b6) -> 6420646e616d6d6f
66527:M 10 Jan 14:46:13.599 # (00007fff1a8c97b5) -> 63206e692d746c69
66527:M 10 Jan 14:46:13.599 # (00007fff1a8c97b4) -> 7562207369646552
66527:M 10 Jan 14:46:13.599 # (00007fff1a8c97b3) -> 00007fff1a8c98d0
66527:M 10 Jan 14:46:13.599 # (00007fff1a8c97b2) -> 00007fff1a8c99a0
66527:M 10 Jan 14:46:13.599 # (00007fff1a8c97b1) -> 0000003000000018
66527:M 10 Jan 14:46:13.599 # (00007fff1a8c97b0) -> ffff8000e57367d1

------ FAST MEMORY TEST ------
66527:M 10 Jan 14:46:13.599 # Bio thread for job type #0 terminated
66527:M 10 Jan 14:46:13.599 # Bio thread for job type #1 terminated
66527:M 10 Jan 14:46:13.600 # Bio thread for job type #2 terminated
*** Preparing to test memory region 6fa000 (90112 bytes)
*** Preparing to test memory region 1600000 (303104 bytes)
*** Preparing to test memory region 164a000 (4472832 bytes)
*** Preparing to test memory region 7f6a9aaed000 (8388608 bytes)
*** Preparing to test memory region 7f6a9b2ee000 (8388608 bytes)
*** Preparing to test memory region 7f6a9baef000 (8388608 bytes)
*** Preparing to test memory region 7f6aa2bd2000 (20480 bytes)
*** Preparing to test memory region 7f6aa2def000 (16384 bytes)
*** Preparing to test memory region 7f6aa3461000 (663552 bytes)
*** Preparing to test memory region 7f6aa3503000 (16384 bytes)
*** Preparing to test memory region 7f6aa3518000 (4096 bytes)
*** Preparing to test memory region 7f6aa3519000 (4096 bytes)
*** Preparing to test memory region 7f6aa351c000 (4096 bytes)
.O.O.O.O.O.O.O.O.O.O.O.O.O
Fast memory test PASSED, however your memory can still be broken. Please run a memory test for several hours if possible.

------ DUMPING CODE AROUND EIP ------
Symbol: _serverPanic (base: 0x45fff0)
Module: redis-server 172.29.46.63:7109 [cluster] (base 0x400000)
$ xxd -r -p /tmp/dump.hex /tmp/dump.bin
$ objdump --adjust-vma=0x45fff0 -D -b binary -m i386:x86-64 /tmp/dump.bin
------
66527:M 10 Jan 14:46:13.772 # dump of function (hexdump of 407 bytes):
5589f5534889fb4881ecd801000084c048898c24380100004c898424400100004c898c244801000074400f298424500100000f298c24600100000f299424700100000f299c24800100000f29a424900100000f29ac24a00100000f29b424b00100000f29bc24c0010000488d8424f0010000488d4c2408488d7c2420be000100004889442410488d842420010000c744240818000000c744240c300000004889442418e808c2fbff8b053eb8290085c07505e8f9f8ffffbea8174c00bf0300000031c0e88835fcffbee0174c00bf0300000031c0e87735fcff488d5424204189e84889d9beb8274c00bf0300000031c0e85b35fcffbe20184c00bf0300000031c0e84a35fcffbea8174c00bf0300000031c0e83935fcffc60425ffffffff784881c4d80100005b5dc30f1f8000000000415741564155415455534881ec4801000048c7070000000048c7470800000000c74710000000008b05bbb2290048897c241885c00f8ee108000048c744242800000000c7442424000000004c8db42494000000eb1e0f1f0083442424014883442428388b442424

=== REDIS BUG REPORT END. Make sure to include from START to END. ===

Qian Chen

unread,
Jan 12, 2018, 2:56:24 AM1/12/18
to Redis DB
noticed that before crash happens, we did not change the kernal parameters redis required to, and memory allocator is libc, now we change the kernal parameters and recompiled redis with jemalloc.
and when crash happens, client '172.29.46.60:10201'(its another node's ip in cluster) is executing the command 'object files.', mybe it is strange.
can someone help me? thanks.

Salvatore Sanfilippo

unread,
Jan 12, 2018, 4:35:41 AM1/12/18
to redi...@googlegroups.com
Hello, yes this is a bug generated by the fact that the invalid
command OBJECT FILES is called, and there is not enough check inside
the cluster key extraction mechanism to ensure that no crash
happens...
I'll fix the bug, to resolve your issue immediately just don't call
"OBJECT FILES" :-D But the next 4.0 will contain the fix preventing
this problem from happening.
> --
> You received this message because you are subscribed to the Google Groups
> "Redis DB" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to redis-db+u...@googlegroups.com.
> To post to this group, send email to redi...@googlegroups.com.
> Visit this group at https://groups.google.com/group/redis-db.
> For more options, visit https://groups.google.com/d/optout.



--
Salvatore 'antirez' Sanfilippo
open source developer - Redis Labs https://redislabs.com

"If a system is to have conceptual integrity, someone must control the
concepts."
— Fred Brooks, "The Mythical Man-Month", 1975.
Reply all
Reply to author
Forward
0 new messages