Skip to content

[CRASH] 6.3.4 unable to rewrite AOF File #763

Description

@bernhard-efler

Crash report

Paste the complete crash log between the quotes below. Please include a few lines from the log preceding the crash report to provide some context.

=== KEYDB BUG REPORT START: Cut & paste starting from here ===
109506:39:C 20 Dec 2023 06:12:56.831 # === ASSERTION FAILED ===
109506:39:C 20 Dec 2023 06:12:56.831 # ==> rdb.cpp:1372 'ckeysExpired == db->expireSize()' is not true

------ STACK TRACE ------

Backtrace:
keydb-aof-rewrite 0.0.0.0:6379(rdbSaveRio(_rio*, redisDbPersistentDataSnapshot const**, int*, int, rdbSaveInfo*)+0x54d) [0x55e50f27706d]
keydb-aof-rewrite 0.0.0.0:6379(rewriteAppendOnlyFile(char*)+0x161) [0x55e50f24f541]
keydb-aof-rewrite 0.0.0.0:6379(rewriteAppendOnlyFileBackground()+0x145) [0x55e50f24fd15]
keydb-aof-rewrite 0.0.0.0:6379(serverCron(aeEventLoop*, long long, void*)+0xe3d) [0x55e50f2d0fcd]
keydb-aof-rewrite 0.0.0.0:6379(aeProcessEvents+0x224) [0x55e50f2d75a4]
keydb-aof-rewrite 0.0.0.0:6379(aeMain+0x3a) [0x55e50f2dbcda]
keydb-aof-rewrite 0.0.0.0:6379(workerThreadMain(void*)+0x7e) [0x55e50f2c3ade]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f428f363609]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x43) [0x7f428f288133]

------ INFO OUTPUT ------
# Server
redis_version:6.3.4
redis_git_sha1:7e7e5e57
redis_git_dirty:1
redis_build_id:bb8fc59400781b64
redis_mode:standalone
os:Linux 6.0.18-200.fc36.x86_64 x86_64
arch_bits:64
multiplexing_api:epoll
atomicvar_api:atomic-builtin
gcc_version:9.4.0
process_id:109506
process_supervised:no
run_id:2c087b00de95c53d0fe501acbaf39c74d1a2ef81
tcp_port:6379
server_time_usec:1703052776826790
uptime_in_seconds:60414
uptime_in_days:0
hz:10
configured_hz:10
lru_clock:8553960
executable:/data/keydb-server
config_file:/etc/keydb/keydb.conf
availability_zone:
features:cluster_mget

# Clients
connected_clients:72
cluster_connections:0
maxclients:10000
client_recent_max_input_buffer:72
client_recent_max_output_buffer:20504
blocked_clients:0
tracking_clients:0
clients_in_timeout_table:0
current_client_thread:0
thread_0_clients:73

# Memory
used_memory:19007440
used_memory_human:18.13M
used_memory_rss:40144896
used_memory_rss_human:38.29M
used_memory_peak:33352656
used_memory_peak_human:31.81M
used_memory_peak_perc:56.99%
used_memory_overhead:6589368
used_memory_startup:1712376
used_memory_dataset:12418072
used_memory_dataset_perc:71.80%
allocator_allocated:20070848
allocator_active:22294528
allocator_resident:27926528
total_system_memory:84339466240
total_system_memory_human:78.55G
used_memory_lua:47104
used_memory_lua_human:46.00K
used_memory_scripts:2456
used_memory_scripts_human:2.40K
number_of_cached_scripts:7
maxmemory:268435456
maxmemory_human:256.00M
maxmemory_policy:noeviction
allocator_frag_ratio:1.11
allocator_frag_bytes:2223680
allocator_rss_ratio:1.25
allocator_rss_bytes:5632000
rss_overhead_ratio:1.44
rss_overhead_bytes:12218368
mem_fragmentation_ratio:2.10
mem_fragmentation_bytes:21016504
mem_not_counted_for_evict:762
mem_replication_backlog:1048576
mem_clients_slaves:20512
mem_clients_normal:1477128
mem_aof_buffer:768
mem_allocator:jemalloc-5.2.1
active_defrag_running:0
lazyfree_pending_objects:0
lazyfreed_objects:0
storage_provider:none
available_system_memory:unavailable

# Persistence
loading:0
current_cow_size:0
current_cow_size_age:0
current_fork_perc:0.00
current_save_keys_processed:0
current_save_keys_total:0
rdb_changes_since_last_save:18913662
rdb_bgsave_in_progress:0
rdb_last_save_time:1702992412
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:2
rdb_current_bgsave_time_sec:-1
rdb_last_cow_size:2129920
aof_enabled:1
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:11
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:err
aof_last_write_status:ok
aof_last_cow_size:8638464
module_fork_in_progress:0
module_fork_last_cow_size:0
aof_current_size:442091957
aof_base_size:7580881
aof_pending_rewrite:0
aof_buffer_length:0
aof_rewrite_buffer_length:0
aof_pending_bio_fsync:0
aof_delayed_fsync:0

# Stats
total_connections_received:76390
total_commands_processed:110615958
instantaneous_ops_per_sec:565
total_net_input_bytes:21086473307
total_net_output_bytes:7034580041
instantaneous_input_kbps:149.43
instantaneous_output_kbps:16.20
rejected_connections:0
sync_full:1
sync_partial_ok:0
sync_partial_err:1
expired_keys:1849
expired_stale_perc:0.00
expired_time_cap_reached_count:0
expire_cycle_cpu_milliseconds:18370
evicted_keys:0
keyspace_hits:19936031
keyspace_misses:8149529
pubsub_channels:2
pubsub_patterns:1
latest_fork_usec:2452
total_forks:608
migrate_cached_sockets:0
slave_expires_tracked_keys:0
active_defrag_hits:0
active_defrag_misses:0
active_defrag_key_hits:0
active_defrag_key_misses:0
tracking_total_keys:0
tracking_total_items:0
tracking_total_prefixes:0
unexpected_error_replies:21
total_error_replies:22
dump_payload_sanitizations:0
total_reads_processed:15059751
total_writes_processed:14866099
instantaneous_lock_contention:1
avg_lock_contention:0.078125
storage_provider_read_hits:0
storage_provider_read_misses:0

# Replication
role:active-replica
master_global_link_status:up
connected_masters:1
master_host:emp-backend-redis-node-1.emp-backend-redis-headless.evo-vkw-backend-qa.svc.cluster.local
master_port:6379
master_link_status:up
master_last_io_seconds_ago:0
master_sync_in_progress:0
slave_read_repl_offset:8346558085
slave_repl_offset:8346558085
slave_priority:100
slave_read_only:0
replica_announced:1
connected_slaves:1
slave0:ip=10.196.73.93,port=6379,state=online,offset=5745714964,lag=0
master_failover_state:no-failover
master_replid:f030836ebca8346ce74451d47f12826591737e54
master_replid2:0000000000000000000000000000000000000000
master_repl_offset:5745730077
second_repl_offset:-1
repl_backlog_active:1
repl_backlog_size:1048576
repl_backlog_first_byte_offset:5744681502
repl_backlog_histlen:1048576

# CPU
used_cpu_sys:0.002845
used_cpu_user:0.001898
used_cpu_sys_children:0.000000
used_cpu_user_children:0.000000
server_threads:1
long_lock_waits:19
used_cpu_sys_main_thread:0.002845
used_cpu_user_main_thread:0.001898

# Modules

# Commandstats
cmdstat_rpush:calls=16078,usec=167581,usec_per_call=10.42,rejected_calls=0,failed_calls=0
cmdstat_zremrangebyscore:calls=3157,usec=54378,usec_per_call=17.22,rejected_calls=0,failed_calls=0
cmdstat_mget:calls=2087,usec=5650413,usec_per_call=2707.43,rejected_calls=0,failed_calls=0
cmdstat_info:calls=123336,usec=5853413,usec_per_call=47.46,rejected_calls=0,failed_calls=0
cmdstat_zrangebyscore:calls=6809698,usec=34917143,usec_per_call=5.13,rejected_calls=0,failed_calls=0
cmdstat_zadd:calls=10227,usec=439336,usec_per_call=42.96,rejected_calls=0,failed_calls=0
cmdstat_set:calls=16839,usec=624382,usec_per_call=37.08,rejected_calls=0,failed_calls=0
cmdstat_KEYDB.MVCCRESTORE:calls=37548,usec=622176,usec_per_call=16.57,rejected_calls=0,failed_calls=0
cmdstat_zcard:calls=41778,usec=24309,usec_per_call=0.58,rejected_calls=0,failed_calls=0
cmdstat_keys:calls=4020,usec=75812,usec_per_call=18.86,rejected_calls=0,failed_calls=0
cmdstat_latency:calls=4028,usec=10885,usec_per_call=2.70,rejected_calls=0,failed_calls=0
cmdstat_setex:calls=18768478,usec=177708067,usec_per_call=9.47,rejected_calls=0,failed_calls=0
cmdstat_psync:calls=1,usec=1596,usec_per_call=1596.00,rejected_calls=0,failed_calls=0
cmdstat_subscribe:calls=17,usec=236,usec_per_call=13.88,rejected_calls=0,failed_calls=0
cmdstat_select:calls=455,usec=425,usec_per_call=0.93,rejected_calls=0,failed_calls=0
cmdstat_replconf:calls=58712,usec=301933,usec_per_call=5.14,rejected_calls=0,failed_calls=0
cmdstat_rreplay:calls=51543779,usec=409731143,usec_per_call=7.95,rejected_calls=0,failed_calls=0
cmdstat_del:calls=18039,usec=239223,usec_per_call=13.26,rejected_calls=0,failed_calls=0
cmdstat_zrem:calls=8039,usec=258455,usec_per_call=32.15,rejected_calls=0,failed_calls=0
cmdstat_eval:calls=10257222,usec=447598856,usec_per_call=43.64,rejected_calls=0,failed_calls=0
cmdstat_psubscribe:calls=17,usec=55,usec_per_call=3.24,rejected_calls=0,failed_calls=0
cmdstat_config:calls=4028,usec=543814,usec_per_call=135.01,rejected_calls=0,failed_calls=0
cmdstat_setnx:calls=201,usec=2157,usec_per_call=10.73,rejected_calls=0,failed_calls=0
cmdstat_auth:calls=76391,usec=1144899,usec_per_call=14.99,rejected_calls=0,failed_calls=0
cmdstat_client:calls=4028,usec=9830,usec_per_call=2.44,rejected_calls=0,failed_calls=0
cmdstat_exec:calls=19606,usec=926796176,usec_per_call=47271.05,rejected_calls=0,failed_calls=0
cmdstat_llen:calls=20100,usec=28530,usec_per_call=1.42,rejected_calls=0,failed_calls=0
cmdstat_get:calls=19149196,usec=164122528,usec_per_call=8.57,rejected_calls=0,failed_calls=0
cmdstat_exists:calls=13,usec=29,usec_per_call=2.23,rejected_calls=0,failed_calls=0
cmdstat_replping:calls=0,usec=0,usec_per_call=0.00,rejected_calls=1,failed_calls=0
cmdstat_slowlog:calls=8056,usec=55288,usec_per_call=6.86,rejected_calls=0,failed_calls=0
cmdstat_multi:calls=19606,usec=42117,usec_per_call=2.15,rejected_calls=0,failed_calls=0
cmdstat_lpop:calls=3412888,usec=8367127,usec_per_call=2.45,rejected_calls=0,failed_calls=0
cmdstat_ping:calls=77563,usec=58772,usec_per_call=0.76,rejected_calls=0,failed_calls=0

# Errorstats
errorstat_ERR:count=21
errorstat_NOAUTH:count=1

# Cluster
cluster_enabled:0

# Keyspace
db0:keys=12,expires=7,avg_ttl=-9223372036854775808,cached_keys=12
db1:keys=19,expires=23,avg_ttl=15935,cached_keys=19
db2:keys=37529,expires=37529,avg_ttl=2308619995,cached_keys=37529

# KeyDB
mvcc_depth:0

------ CLIENT LIST OUTPUT ------
id=3908 addr=10.196.112.115:56292 laddr=10.196.142.179:6379 fd=47 name= age=57411 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3909 addr=10.196.118.172:59540 laddr=10.196.142.179:6379 fd=48 name= age=57411 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=3937 addr=10.196.118.172:34326 laddr=10.196.142.179:6379 fd=40 name= age=57404 idle=2 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=114 addr=10.196.73.93:44613 laddr=10.196.142.179:6379 fd=60 name= age=60366 idle=0 flags=S db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=replconf user=default redir=-1
id=3936 addr=10.196.118.172:34316 laddr=10.196.142.179:6379 fd=22 name= age=57404 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=4201 addr=10.196.112.115:52352 laddr=10.196.142.179:6379 fd=96 name= age=57228 idle=51 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3906 addr=10.196.112.115:56284 laddr=10.196.142.179:6379 fd=39 name= age=57411 idle=3 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=47892 addr=10.196.112.115:43408 laddr=10.196.142.179:6379 fd=30 name= age=22646 idle=866 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=3914 addr=10.196.118.172:59556 laddr=10.196.142.179:6379 fd=51 name= age=57410 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=72918 addr=10.196.118.172:38812 laddr=10.196.142.179:6379 fd=79 name= age=2797 idle=2797 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=info user=default redir=-1
id=3915 addr=10.196.118.172:59568 laddr=10.196.142.179:6379 fd=52 name= age=57410 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=4036 addr=10.196.112.115:40434 laddr=10.196.142.179:6379 fd=18 name= age=57349 idle=171 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3947 addr=10.196.112.115:44658 laddr=10.196.142.179:6379 fd=58 name= age=57401 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3948 addr=10.196.118.172:34390 laddr=10.196.142.179:6379 fd=59 name= age=57401 idle=5 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=3954 addr=10.196.118.172:51276 laddr=10.196.142.179:6379 fd=66 name= age=57399 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3955 addr=10.196.118.172:51284 laddr=10.196.142.179:6379 fd=67 name= age=57399 idle=2 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=3866 addr=10.196.112.115:50706 laddr=10.196.142.179:6379 fd=36 name= age=57421 idle=12 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=3905 addr=10.196.118.172:59538 laddr=10.196.142.179:6379 fd=31 name= age=57411 idle=3 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=73680 addr=10.196.112.115:42690 laddr=10.196.142.179:6379 fd=46 name= age=2186 idle=26 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=3903 addr=10.196.118.172:59528 laddr=10.196.142.179:6379 fd=26 name= age=57412 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3904 addr=10.196.118.172:59530 laddr=10.196.142.179:6379 fd=27 name= age=57412 idle=2 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=73292 addr=10.196.118.172:60638 laddr=10.196.142.179:6379 fd=74 name= age=2500 idle=2497 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=info user=default redir=-1
id=3865 addr=10.196.112.115:50702 laddr=10.196.142.179:6379 fd=23 name= age=57421 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=3901 addr=10.196.112.115:56272 laddr=10.196.142.179:6379 fd=19 name= age=57412 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=75983 addr=10.196.112.115:55402 laddr=10.196.142.179:6379 fd=87 name= age=327 idle=327 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=75984 addr=10.196.118.172:56920 laddr=10.196.142.179:6379 fd=89 name= age=327 idle=327 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=75985 addr=10.196.118.172:56934 laddr=10.196.142.179:6379 fd=90 name= age=327 idle=26 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=75986 addr=10.196.118.172:56948 laddr=10.196.142.179:6379 fd=91 name= age=327 idle=327 flags=N db=4 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=75987 addr=10.196.112.115:55416 laddr=10.196.142.179:6379 fd=92 name= age=327 idle=327 flags=N db=5 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=3952 addr=10.196.112.115:44668 laddr=10.196.142.179:6379 fd=62 name= age=57399 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3953 addr=10.196.112.115:44672 laddr=10.196.142.179:6379 fd=65 name= age=57399 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=73418 addr=10.196.112.115:47324 laddr=10.196.142.179:6379 fd=73 name= age=2400 idle=2389 flags=P db=0 sub=2 psub=1 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=psubscribe user=default redir=-1
id=3902 addr=10.196.112.115:56282 laddr=10.196.142.179:6379 fd=25 name= age=57412 idle=2 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=73118 addr=10.196.112.115:35594 laddr=10.196.142.179:6379 fd=76 name= age=2639 idle=2639 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=73119 addr=10.196.112.115:35598 laddr=10.196.142.179:6379 fd=80 name= age=2639 idle=2639 flags=N db=4 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=73120 addr=10.196.118.172:44840 laddr=10.196.142.179:6379 fd=82 name= age=2639 idle=35 flags=N db=5 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=54646 addr=10.196.118.172:50400 laddr=10.196.142.179:6379 fd=75 name= age=17306 idle=1106 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=73691 addr=10.196.112.115:59892 laddr=10.196.142.179:6379 fd=72 name= age=2177 idle=2177 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=73692 addr=10.196.112.115:59908 laddr=10.196.142.179:6379 fd=84 name= age=2177 idle=2177 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=73693 addr=10.196.112.115:59910 laddr=10.196.142.179:6379 fd=86 name= age=2177 idle=2177 flags=N db=4 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=73695 addr=10.196.112.115:59926 laddr=10.196.142.179:6379 fd=88 name= age=2177 idle=2177 flags=N db=5 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=11 addr=10.196.73.93:6379 laddr=10.196.142.179:43785 fd=13 name= age=60403 idle=0 flags=M db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61480 events=r cmd=rreplay user=(superuser) redir=-1
id=3913 addr=10.196.112.115:56314 laddr=10.196.142.179:6379 fd=50 name= age=57411 idle=54 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=del user=default redir=-1
id=3983 addr=10.196.118.172:42604 laddr=10.196.142.179:6379 fd=78 name= age=57387 idle=2 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=3980 addr=10.196.112.115:33956 laddr=10.196.142.179:6379 fd=77 name= age=57387 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=73117 addr=10.196.118.172:44836 laddr=10.196.142.179:6379 fd=38 name= age=2639 idle=2639 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=3921 addr=10.196.112.115:56346 laddr=10.196.142.179:6379 fd=34 name= age=57408 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61496 events=r cmd=eval user=default redir=-1
id=3895 addr=10.196.112.115:56214 laddr=10.196.142.179:6379 fd=42 name= age=57413 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=3896 addr=10.196.112.115:56228 laddr=10.196.142.179:6379 fd=43 name= age=57413 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61496 events=r cmd=eval user=default redir=-1
id=3897 addr=10.196.118.172:59520 laddr=10.196.142.179:6379 fd=44 name= age=57413 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=3957 addr=10.196.118.172:51290 laddr=10.196.142.179:6379 fd=61 name= age=57398 idle=2 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=3898 addr=10.196.112.115:56232 laddr=10.196.142.179:6379 fd=45 name= age=57413 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61496 events=r cmd=eval user=default redir=-1
id=68537 addr=10.196.112.115:37040 laddr=10.196.142.179:6379 fd=81 name= age=6332 idle=86 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=3920 addr=10.196.112.115:56344 laddr=10.196.142.179:6379 fd=24 name= age=57408 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=72917 addr=10.196.112.115:43280 laddr=10.196.142.179:6379 fd=29 name= age=2797 idle=2797 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=info user=default redir=-1
id=3968 addr=10.196.118.172:51336 laddr=10.196.142.179:6379 fd=71 name= age=57393 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61496 events=r cmd=eval user=default redir=-1
id=3956 addr=10.196.118.172:51286 laddr=10.196.142.179:6379 fd=56 name= age=57398 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=72850 addr=10.196.112.115:40128 laddr=10.196.142.179:6379 fd=41 name= age=2847 idle=2847 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=72851 addr=10.196.118.172:42400 laddr=10.196.142.179:6379 fd=49 name= age=2847 idle=2847 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=72852 addr=10.196.118.172:42416 laddr=10.196.142.179:6379 fd=53 name= age=2847 idle=866 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=72853 addr=10.196.118.172:42430 laddr=10.196.142.179:6379 fd=54 name= age=2847 idle=2847 flags=N db=4 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=72854 addr=10.196.118.172:42436 laddr=10.196.142.179:6379 fd=85 name= age=2847 idle=2847 flags=N db=5 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=3967 addr=10.196.118.172:51324 laddr=10.196.142.179:6379 fd=70 name= age=57393 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=3938 addr=10.196.118.172:34340 laddr=10.196.142.179:6379 fd=55 name= age=57403 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3939 addr=10.196.118.172:34352 laddr=10.196.142.179:6379 fd=57 name= age=57403 idle=2 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=73453 addr=10.196.118.172:45878 laddr=10.196.142.179:6379 fd=64 name= age=2371 idle=2362 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=info user=default redir=-1
id=3958 addr=10.196.118.172:51306 laddr=10.196.142.179:6379 fd=68 name= age=57397 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=72916 addr=10.196.112.115:43894 laddr=10.196.142.179:6379 fd=15 name= age=2798 idle=2798 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=info user=default redir=-1
id=73116 addr=10.196.112.115:35586 laddr=10.196.142.179:6379 fd=37 name= age=2639 idle=35 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=keys user=default redir=-1
id=4124 addr=10.196.112.115:37802 laddr=10.196.142.179:6379 fd=95 name= age=57288 idle=171 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3959 addr=10.196.112.115:40388 laddr=10.196.142.179:6379 fd=69 name= age=57397 idle=9 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=3943 addr=10.196.112.115:44642 laddr=10.196.142.179:6379 fd=14 name= age=57401 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=3944 addr=10.196.112.115:44646 laddr=10.196.142.179:6379 fd=21 name= age=57401 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61496 events=r cmd=eval user=default redir=-1

------ MODULES INFO OUTPUT ------

------ FAST MEMORY TEST ------
*** Preparing to test memory region 55e50f983000 (2334720 bytes)
*** Preparing to test memory region 7f4283c00000 (4194304 bytes)
*** Preparing to test memory region 7f428407f000 (26738688 bytes)
*** Preparing to test memory region 7f4285a00000 (8388608 bytes)
*** Preparing to test memory region 7f4286200000 (18874368 bytes)
*** Preparing to test memory region 7f428747f000 (5767168 bytes)
*** Preparing to test memory region 7f4287a00000 (8388608 bytes)
*** Preparing to test memory region 7f4288200000 (4194304 bytes)
*** Preparing to test memory region 7f428877a000 (8388608 bytes)
*** Preparing to test memory region 7f4288f7b000 (8388608 bytes)
*** Preparing to test memory region 7f428977b000 (11010048 bytes)
*** Preparing to test memory region 7f428a1fc000 (8388608 bytes)
*** Preparing to test memory region 7f428a9fd000 (8388608 bytes)
*** Preparing to test memory region 7f428b1fe000 (8388608 bytes)
*** Preparing to test memory region 7f428b9ff000 (8388608 bytes)
*** Preparing to test memory region 7f428c200000 (8388608 bytes)
*** Preparing to test memory region 7f428ca00000 (4194304 bytes)
*** Preparing to test memory region 7f428cf80000 (8388608 bytes)
*** Preparing to test memory region 7f428d780000 (11010048 bytes)
*** Preparing to test memory region 7f428e324000 (69632 bytes)
*** Preparing to test memory region 7f428e368000 (32768 bytes)
*** Preparing to test memory region 7f428e4e6000 (4096 bytes)
*** Preparing to test memory region 7f428e523000 (8192 bytes)
*** Preparing to test memory region 7f428e581000 (4096 bytes)
*** Preparing to test memory region 7f428e6ba000 (4096 bytes)
*** Preparing to test memory region 7f428e6c7000 (8192 bytes)
*** Preparing to test memory region 7f428e8a1000 (8192 bytes)
*** Preparing to test memory region 7f428e8bd000 (8192 bytes)
*** Preparing to test memory region 7f428e905000 (4096 bytes)
*** Preparing to test memory region 7f428e9e3000 (8192 bytes)
*** Preparing to test memory region 7f428ecae000 (8192 bytes)
*** Preparing to test memory region 7f428ee40000 (8192 bytes)
*** Preparing to test memory region 7f428eea7000 (8192 bytes)
*** Preparing to test memory region 7f428ef97000 (8192 bytes)
*** Preparing to test memory region 7f428f08a000 (8192 bytes)
*** Preparing to test memory region 7f428f357000 (16384 bytes)
*** Preparing to test memory region 7f428f37a000 (16384 bytes)
*** Preparing to test memory region 7f428f399000 (8192 bytes)
*** Preparing to test memory region 7f428f6c9000 (12288 bytes)
*** Preparing to test memory region 7f428f99e000 (16384 bytes)
*** Preparing to test memory region 7f428fa57000 (8192 bytes)
*** Preparing to test memory region 7f428fa8b000 (4096 bytes)
.O.O.O.O.O.O.O.O.109506:39:C 20 Dec 2023 06:13:00.921 # KeyDB 6.3.4 crashed by signal: 11, si_code: 1
109506:39:C 20 Dec 2023 06:13:00.921 # Accessing address: 0xffffffffffffffe7
109506:39:C 20 Dec 2023 06:13:00.921 # Crashed running the instruction at: 0x7f4288e75818

------ STACK TRACE ------
EIP:
[0x7f4288e75818]

Backtrace:
/lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f428f36f420]
[0x7f4288e75818]

------ REGISTERS ------
109506:39:C 20 Dec 2023 06:13:00.921 # 
RAX:0000000000000000 RBX:00007f4288e757e8
RCX:00007f4288e79ff8 RDX:0000000000000000
RDI:00007f4288d7a000 RSI:0000000000020000
RBP:00007f4288e757f0 RSP:00007f4288e75820
R8 :0000000000000010 R9 :00007f4288e758a0
R10:0000000000100000 R11:00007f4288f75830
R12:00007f4288e757f8 R13:00007f4288e75800
R14:00007f4288e75808 R15:00007f4288e75810
RIP:00007f4288e75818 EFL:0000000000010246
CSGSFS:002b000000000033
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e7582f) -> 00007f4288e75898
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e7582e) -> 00007f4288e75890
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e7582d) -> 00007f4288e75888
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e7582c) -> 00007f4288e75880
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e7582b) -> 00007f4288e75878
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e7582a) -> 00007f4288e75870
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e75829) -> 00007f4288e75868
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e75828) -> 00007f4288e75860
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e75827) -> 00007f4288e75858
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e75826) -> 00007f4288e75850
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e75825) -> 00007f4288e75848
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e75824) -> 00007f4288e75840
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e75823) -> 00007f4288e75838
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e75822) -> 00007f4288e75830
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e75821) -> 00007f4288e75828
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e75820) -> 00007f4288e75820

------ INFO OUTPUT ------
# Server
redis_version:6.3.4
redis_git_sha1:7e7e5e57
redis_git_dirty:1
redis_build_id:bb8fc59400781b64
redis_mode:standalone
os:Linux 6.0.18-200.fc36.x86_64 x86_64
arch_bits:64
multiplexing_api:epoll
atomicvar_api:atomic-builtin
gcc_version:9.4.0
process_id:109506
process_supervised:no
run_id:2c087b00de95c53d0fe501acbaf39c74d1a2ef81
tcp_port:6379
server_time_usec:1703052776826790
uptime_in_seconds:60414
uptime_in_days:0
hz:10
configured_hz:10
lru_clock:8553960
executable:/data/keydb-server
config_file:/etc/keydb/keydb.conf
availability_zone:
features:cluster_mget

# Clients
connected_clients:72
cluster_connections:0
maxclients:10000
client_recent_max_input_buffer:72
client_recent_max_output_buffer:20504
blocked_clients:0
tracking_clients:0
clients_in_timeout_table:0
current_client_thread:0
thread_0_clients:73

# Memory
used_memory:19009936
used_memory_human:18.13M
used_memory_rss:40144896
used_memory_rss_human:38.29M
used_memory_peak:33352656
used_memory_peak_human:31.81M
used_memory_peak_perc:57.00%
used_memory_overhead:6589368
used_memory_startup:1712376
used_memory_dataset:12420568
used_memory_dataset_perc:71.81%
allocator_allocated:20070848
allocator_active:22294528
allocator_resident:27926528
total_system_memory:84339466240
total_system_memory_human:78.55G
used_memory_lua:47104
used_memory_lua_human:46.00K
used_memory_scripts:2456
used_memory_scripts_human:2.40K
number_of_cached_scripts:7
maxmemory:268435456
maxmemory_human:256.00M
maxmemory_policy:noeviction
allocator_frag_ratio:1.11
allocator_frag_bytes:2223680
allocator_rss_ratio:1.25
allocator_rss_bytes:5632000
rss_overhead_ratio:1.44
rss_overhead_bytes:12218368
mem_fragmentation_ratio:2.10
mem_fragmentation_bytes:21016504
mem_not_counted_for_evict:762
mem_replication_backlog:1048576
mem_clients_slaves:20512
mem_clients_normal:1477128
mem_aof_buffer:768
mem_allocator:jemalloc-5.2.1
active_defrag_running:0
lazyfree_pending_objects:0
lazyfreed_objects:0
storage_provider:none
available_system_memory:unavailable

# Persistence
loading:0
current_cow_size:0
current_cow_size_age:0
current_fork_perc:0.00
current_save_keys_processed:0
current_save_keys_total:0
rdb_changes_since_last_save:18913662
rdb_bgsave_in_progress:0
rdb_last_save_time:1702992412
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:2
rdb_current_bgsave_time_sec:-1
rdb_last_cow_size:2129920
aof_enabled:1
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:11
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:err
aof_last_write_status:ok
aof_last_cow_size:8638464
module_fork_in_progress:0
module_fork_last_cow_size:0
aof_current_size:442091957
aof_base_size:7580881
aof_pending_rewrite:0
aof_buffer_length:0
aof_rewrite_buffer_length:0
aof_pending_bio_fsync:0
aof_delayed_fsync:0

# Stats
total_connections_received:76390
total_commands_processed:110615958
instantaneous_ops_per_sec:565
total_net_input_bytes:21086473307
total_net_output_bytes:7034580041
instantaneous_input_kbps:149.43
instantaneous_output_kbps:16.20
rejected_connections:0
sync_full:1
sync_partial_ok:0
sync_partial_err:1
expired_keys:1849
expired_stale_perc:0.00
expired_time_cap_reached_count:0
expire_cycle_cpu_milliseconds:18370
evicted_keys:0
keyspace_hits:19936031
keyspace_misses:8149529
pubsub_channels:2
pubsub_patterns:1
latest_fork_usec:2452
total_forks:608
migrate_cached_sockets:0
slave_expires_tracked_keys:0
active_defrag_hits:0
active_defrag_misses:0
active_defrag_key_hits:0
active_defrag_key_misses:0
tracking_total_keys:0
tracking_total_items:0
tracking_total_prefixes:0
unexpected_error_replies:21
total_error_replies:22
dump_payload_sanitizations:0
total_reads_processed:15059751
total_writes_processed:14866099
instantaneous_lock_contention:1
avg_lock_contention:0.078125
storage_provider_read_hits:0
storage_provider_read_misses:0

# Replication
role:active-replica
master_global_link_status:up
connected_masters:1
master_host:emp-backend-redis-node-1.emp-backend-redis-headless.evo-vkw-backend-qa.svc.cluster.local
master_port:6379
master_link_status:up
master_last_io_seconds_ago:0
master_sync_in_progress:0
slave_read_repl_offset:8346558085
slave_repl_offset:8346558085
slave_priority:100
slave_read_only:0
replica_announced:1
connected_slaves:1
slave0:ip=10.196.73.93,port=6379,state=online,offset=5745714964,lag=4
master_failover_state:no-failover
master_replid:f030836ebca8346ce74451d47f12826591737e54
master_replid2:0000000000000000000000000000000000000000
master_repl_offset:5745730077
second_repl_offset:-1
repl_backlog_active:1
repl_backlog_size:1048576
repl_backlog_first_byte_offset:5744681502
repl_backlog_histlen:1048576

# CPU
used_cpu_sys:0.088297
used_cpu_user:0.245534
used_cpu_sys_children:0.000000
used_cpu_user_children:0.000000
server_threads:1
long_lock_waits:19
used_cpu_sys_main_thread:0.088297
used_cpu_user_main_thread:0.245534

# Modules

# Commandstats
cmdstat_rpush:calls=16078,usec=167581,usec_per_call=10.42,rejected_calls=0,failed_calls=0
cmdstat_zremrangebyscore:calls=3157,usec=54378,usec_per_call=17.22,rejected_calls=0,failed_calls=0
cmdstat_mget:calls=2087,usec=5650413,usec_per_call=2707.43,rejected_calls=0,failed_calls=0
cmdstat_info:calls=123336,usec=5853413,usec_per_call=47.46,rejected_calls=0,failed_calls=0
cmdstat_zrangebyscore:calls=6809698,usec=34917143,usec_per_call=5.13,rejected_calls=0,failed_calls=0
cmdstat_zadd:calls=10227,usec=439336,usec_per_call=42.96,rejected_calls=0,failed_calls=0
cmdstat_set:calls=16839,usec=624382,usec_per_call=37.08,rejected_calls=0,failed_calls=0
cmdstat_KEYDB.MVCCRESTORE:calls=37548,usec=622176,usec_per_call=16.57,rejected_calls=0,failed_calls=0
cmdstat_zcard:calls=41778,usec=24309,usec_per_call=0.58,rejected_calls=0,failed_calls=0
cmdstat_keys:calls=4020,usec=75812,usec_per_call=18.86,rejected_calls=0,failed_calls=0
cmdstat_latency:calls=4028,usec=10885,usec_per_call=2.70,rejected_calls=0,failed_calls=0
cmdstat_setex:calls=18768478,usec=177708067,usec_per_call=9.47,rejected_calls=0,failed_calls=0
cmdstat_psync:calls=1,usec=1596,usec_per_call=1596.00,rejected_calls=0,failed_calls=0
cmdstat_subscribe:calls=17,usec=236,usec_per_call=13.88,rejected_calls=0,failed_calls=0
cmdstat_select:calls=455,usec=425,usec_per_call=0.93,rejected_calls=0,failed_calls=0
cmdstat_replconf:calls=58712,usec=301933,usec_per_call=5.14,rejected_calls=0,failed_calls=0
cmdstat_rreplay:calls=51543779,usec=409731143,usec_per_call=7.95,rejected_calls=0,failed_calls=0
cmdstat_del:calls=18039,usec=239223,usec_per_call=13.26,rejected_calls=0,failed_calls=0
cmdstat_zrem:calls=8039,usec=258455,usec_per_call=32.15,rejected_calls=0,failed_calls=0
cmdstat_eval:calls=10257222,usec=447598856,usec_per_call=43.64,rejected_calls=0,failed_calls=0
cmdstat_psubscribe:calls=17,usec=55,usec_per_call=3.24,rejected_calls=0,failed_calls=0
cmdstat_config:calls=4028,usec=543814,usec_per_call=135.01,rejected_calls=0,failed_calls=0
cmdstat_setnx:calls=201,usec=2157,usec_per_call=10.73,rejected_calls=0,failed_calls=0
cmdstat_auth:calls=76391,usec=1144899,usec_per_call=14.99,rejected_calls=0,failed_calls=0
cmdstat_client:calls=4028,usec=9830,usec_per_call=2.44,rejected_calls=0,failed_calls=0
cmdstat_exec:calls=19606,usec=926796176,usec_per_call=47271.05,rejected_calls=0,failed_calls=0
cmdstat_llen:calls=20100,usec=28530,usec_per_call=1.42,rejected_calls=0,failed_calls=0
cmdstat_get:calls=19149196,usec=164122528,usec_per_call=8.57,rejected_calls=0,failed_calls=0
cmdstat_exists:calls=13,usec=29,usec_per_call=2.23,rejected_calls=0,failed_calls=0
cmdstat_replping:calls=0,usec=0,usec_per_call=0.00,rejected_calls=1,failed_calls=0
cmdstat_slowlog:calls=8056,usec=55288,usec_per_call=6.86,rejected_calls=0,failed_calls=0
cmdstat_multi:calls=19606,usec=42117,usec_per_call=2.15,rejected_calls=0,failed_calls=0
cmdstat_lpop:calls=3412888,usec=8367127,usec_per_call=2.45,rejected_calls=0,failed_calls=0
cmdstat_ping:calls=77563,usec=58772,usec_per_call=0.76,rejected_calls=0,failed_calls=0

# Errorstats
errorstat_ERR:count=21
errorstat_NOAUTH:count=1

# Cluster
cluster_enabled:0

# Keyspace
db0:keys=12,expires=7,avg_ttl=-9223372036854775808,cached_keys=12
db1:keys=19,expires=23,avg_ttl=15935,cached_keys=19
db2:keys=37529,expires=37529,avg_ttl=2308619995,cached_keys=37529

# KeyDB
mvcc_depth:0

------ CLIENT LIST OUTPUT ------
id=3908 addr=10.196.112.115:56292 laddr=10.196.142.179:6379 fd=47 name= age=57411 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3909 addr=10.196.118.172:59540 laddr=10.196.142.179:6379 fd=48 name= age=57411 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=3937 addr=10.196.118.172:34326 laddr=10.196.142.179:6379 fd=40 name= age=57404 idle=2 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=114 addr=10.196.73.93:44613 laddr=10.196.142.179:6379 fd=60 name= age=60366 idle=0 flags=S db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=replconf user=default redir=-1
id=3936 addr=10.196.118.172:34316 laddr=10.196.142.179:6379 fd=22 name= age=57404 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=4201 addr=10.196.112.115:52352 laddr=10.196.142.179:6379 fd=96 name= age=57228 idle=51 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3906 addr=10.196.112.115:56284 laddr=10.196.142.179:6379 fd=39 name= age=57411 idle=3 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=47892 addr=10.196.112.115:43408 laddr=10.196.142.179:6379 fd=30 name= age=22646 idle=866 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=3914 addr=10.196.118.172:59556 laddr=10.196.142.179:6379 fd=51 name= age=57410 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=72918 addr=10.196.118.172:38812 laddr=10.196.142.179:6379 fd=79 name= age=2797 idle=2797 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=info user=default redir=-1
id=3915 addr=10.196.118.172:59568 laddr=10.196.142.179:6379 fd=52 name= age=57410 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=4036 addr=10.196.112.115:40434 laddr=10.196.142.179:6379 fd=18 name= age=57349 idle=171 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3947 addr=10.196.112.115:44658 laddr=10.196.142.179:6379 fd=58 name= age=57401 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3948 addr=10.196.118.172:34390 laddr=10.196.142.179:6379 fd=59 name= age=57401 idle=5 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=3954 addr=10.196.118.172:51276 laddr=10.196.142.179:6379 fd=66 name= age=57399 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3955 addr=10.196.118.172:51284 laddr=10.196.142.179:6379 fd=67 name= age=57399 idle=2 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=3866 addr=10.196.112.115:50706 laddr=10.196.142.179:6379 fd=36 name= age=57421 idle=12 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=3905 addr=10.196.118.172:59538 laddr=10.196.142.179:6379 fd=31 name= age=57411 idle=3 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=73680 addr=10.196.112.115:42690 laddr=10.196.142.179:6379 fd=46 name= age=2186 idle=26 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=3903 addr=10.196.118.172:59528 laddr=10.196.142.179:6379 fd=26 name= age=57412 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3904 addr=10.196.118.172:59530 laddr=10.196.142.179:6379 fd=27 name= age=57412 idle=2 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=73292 addr=10.196.118.172:60638 laddr=10.196.142.179:6379 fd=74 name= age=2500 idle=2497 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=info user=default redir=-1
id=3865 addr=10.196.112.115:50702 laddr=10.196.142.179:6379 fd=23 name= age=57421 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=3901 addr=10.196.112.115:56272 laddr=10.196.142.179:6379 fd=19 name= age=57412 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=75983 addr=10.196.112.115:55402 laddr=10.196.142.179:6379 fd=87 name= age=327 idle=327 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=75984 addr=10.196.118.172:56920 laddr=10.196.142.179:6379 fd=89 name= age=327 idle=327 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=75985 addr=10.196.118.172:56934 laddr=10.196.142.179:6379 fd=90 name= age=327 idle=26 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=75986 addr=10.196.118.172:56948 laddr=10.196.142.179:6379 fd=91 name= age=327 idle=327 flags=N db=4 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=75987 addr=10.196.112.115:55416 laddr=10.196.142.179:6379 fd=92 name= age=327 idle=327 flags=N db=5 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=3952 addr=10.196.112.115:44668 laddr=10.196.142.179:6379 fd=62 name= age=57399 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3953 addr=10.196.112.115:44672 laddr=10.196.142.179:6379 fd=65 name= age=57399 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=73418 addr=10.196.112.115:47324 laddr=10.196.142.179:6379 fd=73 name= age=2400 idle=2389 flags=P db=0 sub=2 psub=1 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=psubscribe user=default redir=-1
id=3902 addr=10.196.112.115:56282 laddr=10.196.142.179:6379 fd=25 name= age=57412 idle=2 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=73118 addr=10.196.112.115:35594 laddr=10.196.142.179:6379 fd=76 name= age=2639 idle=2639 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=73119 addr=10.196.112.115:35598 laddr=10.196.142.179:6379 fd=80 name= age=2639 idle=2639 flags=N db=4 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=73120 addr=10.196.118.172:44840 laddr=10.196.142.179:6379 fd=82 name= age=2639 idle=35 flags=N db=5 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=54646 addr=10.196.118.172:50400 laddr=10.196.142.179:6379 fd=75 name= age=17306 idle=1106 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=73691 addr=10.196.112.115:59892 laddr=10.196.142.179:6379 fd=72 name= age=2177 idle=2177 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=73692 addr=10.196.112.115:59908 laddr=10.196.142.179:6379 fd=84 name= age=2177 idle=2177 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=73693 addr=10.196.112.115:59910 laddr=10.196.142.179:6379 fd=86 name= age=2177 idle=2177 flags=N db=4 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=73695 addr=10.196.112.115:59926 laddr=10.196.142.179:6379 fd=88 name= age=2177 idle=2177 flags=N db=5 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=11 addr=10.196.73.93:6379 laddr=10.196.142.179:43785 fd=13 name= age=60403 idle=0 flags=M db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61480 events=r cmd=rreplay user=(superuser) redir=-1
id=3913 addr=10.196.112.115:56314 laddr=10.196.142.179:6379 fd=50 name= age=57411 idle=54 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=del user=default redir=-1
id=3983 addr=10.196.118.172:42604 laddr=10.196.142.179:6379 fd=78 name= age=57387 idle=2 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=3980 addr=10.196.112.115:33956 laddr=10.196.142.179:6379 fd=77 name= age=57387 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=73117 addr=10.196.118.172:44836 laddr=10.196.142.179:6379 fd=38 name= age=2639 idle=2639 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=3921 addr=10.196.112.115:56346 laddr=10.196.142.179:6379 fd=34 name= age=57408 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61496 events=r cmd=eval user=default redir=-1
id=3895 addr=10.196.112.115:56214 laddr=10.196.142.179:6379 fd=42 name= age=57413 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=3896 addr=10.196.112.115:56228 laddr=10.196.142.179:6379 fd=43 name= age=57413 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61496 events=r cmd=eval user=default redir=-1
id=3897 addr=10.196.118.172:59520 laddr=10.196.142.179:6379 fd=44 name= age=57413 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=3957 addr=10.196.118.172:51290 laddr=10.196.142.179:6379 fd=61 name= age=57398 idle=2 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=3898 addr=10.196.112.115:56232 laddr=10.196.142.179:6379 fd=45 name= age=57413 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61496 events=r cmd=eval user=default redir=-1
id=68537 addr=10.196.112.115:37040 laddr=10.196.142.179:6379 fd=81 name= age=6332 idle=86 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=3920 addr=10.196.112.115:56344 laddr=10.196.142.179:6379 fd=24 name= age=57408 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=72917 addr=10.196.112.115:43280 laddr=10.196.142.179:6379 fd=29 name= age=2797 idle=2797 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=info user=default redir=-1
id=3968 addr=10.196.118.172:51336 laddr=10.196.142.179:6379 fd=71 name= age=57393 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61496 events=r cmd=eval user=default redir=-1
id=3956 addr=10.196.118.172:51286 laddr=10.196.142.179:6379 fd=56 name= age=57398 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=72850 addr=10.196.112.115:40128 laddr=10.196.142.179:6379 fd=41 name= age=2847 idle=2847 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=72851 addr=10.196.118.172:42400 laddr=10.196.142.179:6379 fd=49 name= age=2847 idle=2847 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=72852 addr=10.196.118.172:42416 laddr=10.196.142.179:6379 fd=53 name= age=2847 idle=866 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=72853 addr=10.196.118.172:42430 laddr=10.196.142.179:6379 fd=54 name= age=2847 idle=2847 flags=N db=4 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=72854 addr=10.196.118.172:42436 laddr=10.196.142.179:6379 fd=85 name= age=2847 idle=2847 flags=N db=5 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=3967 addr=10.196.118.172:51324 laddr=10.196.142.179:6379 fd=70 name= age=57393 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=3938 addr=10.196.118.172:34340 laddr=10.196.142.179:6379 fd=55 name= age=57403 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3939 addr=10.196.118.172:34352 laddr=10.196.142.179:6379 fd=57 name= age=57403 idle=2 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=73453 addr=10.196.118.172:45878 laddr=10.196.142.179:6379 fd=64 name= age=2371 idle=2362 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=info user=default redir=-1
id=3958 addr=10.196.118.172:51306 laddr=10.196.142.179:6379 fd=68 name= age=57397 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=72916 addr=10.196.112.115:43894 laddr=10.196.142.179:6379 fd=15 name= age=2798 idle=2798 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=info user=default redir=-1
id=73116 addr=10.196.112.115:35586 laddr=10.196.142.179:6379 fd=37 name= age=2639 idle=35 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=keys user=default redir=-1
id=4124 addr=10.196.112.115:37802 laddr=10.196.142.179:6379 fd=95 name= age=57288 idle=171 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3959 addr=10.196.112.115:40388 laddr=10.196.142.179:6379 fd=69 name= age=57397 idle=9 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=3943 addr=10.196.112.115:44642 laddr=10.196.142.179:6379 fd=14 name= age=57401 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=3944 addr=10.196.112.115:44646 laddr=10.196.142.179:6379 fd=21 name= age=57401 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61496 events=r cmd=eval user=default redir=-1

------ MODULES INFO OUTPUT ------

------ FAST MEMORY TEST ------
*** Preparing to test memory region 55e50f983000 (2334720 bytes)
*** Preparing to test memory region 7f4283c00000 (4194304 bytes)
*** Preparing to test memory region 7f428407f000 (26738688 bytes)
*** Preparing to test memory region 7f4285a00000 (8388608 bytes)
*** Preparing to test memory region 7f4286200000 (18874368 bytes)
*** Preparing to test memory region 7f428747f000 (5767168 bytes)
*** Preparing to test memory region 7f4287a00000 (8388608 bytes)
*** Preparing to test memory region 7f4288200000 (4194304 bytes)
*** Preparing to test memory region 7f428877a000 (8388608 bytes)
*** Preparing to test memory region 7f4288f7b000 (8388608 bytes)
*** Preparing to test memory region 7f428977b000 (11010048 bytes)
*** Preparing to test memory region 7f428a1fc000 (8388608 bytes)
*** Preparing to test memory region 7f428a9fd000 (8388608 bytes)
*** Preparing to test memory region 7f428b1fe000 (8388608 bytes)
*** Preparing to test memory region 7f428b9ff000 (8388608 bytes)
*** Preparing to test memory region 7f428c200000 (8388608 bytes)
*** Preparing to test memory region 7f428ca00000 (4194304 bytes)
*** Preparing to test memory region 7f428cf80000 (8388608 bytes)
*** Preparing to test memory region 7f428d780000 (11010048 bytes)
*** Preparing to test memory region 7f428e324000 (69632 bytes)
*** Preparing to test memory region 7f428e368000 (32768 bytes)
*** Preparing to test memory region 7f428e4e6000 (4096 bytes)
*** Preparing to test memory region 7f428e523000 (8192 bytes)
*** Preparing to test memory region 7f428e581000 (4096 bytes)
*** Preparing to test memory region 7f428e6ba000 (4096 bytes)
*** Preparing to test memory region 7f428e6c7000 (8192 bytes)
*** Preparing to test memory region 7f428e8a1000 (8192 bytes)
*** Preparing to test memory region 7f428e8bd000 (8192 bytes)
*** Preparing to test memory region 7f428e905000 (4096 bytes)
*** Preparing to test memory region 7f428e9e3000 (8192 bytes)
*** Preparing to test memory region 7f428ecae000 (8192 bytes)
*** Preparing to test memory region 7f428ee40000 (8192 bytes)
*** Preparing to test memory region 7f428eea7000 (8192 bytes)
*** Preparing to test memory region 7f428ef97000 (8192 bytes)
*** Preparing to test memory region 7f428f08a000 (8192 bytes)
*** Preparing to test memory region 7f428f357000 (16384 bytes)
*** Preparing to test memory region 7f428f37a000 (16384 bytes)
*** Preparing to test memory region 7f428f399000 (8192 bytes)
*** Preparing to test memory region 7f428f6c9000 (12288 bytes)
*** Preparing to test memory region 7f428f99e000 (16384 bytes)
*** Preparing to test memory region 7f428fa57000 (8192 bytes)
*** Preparing to test memory region 7f428fa8b000 (4096 bytes)
.O.O.O.O.O.O.O.O.1:39:S 20 Dec 2023 06:13:11.023 # Background AOF rewrite terminated by signal 11
1:39:S 20 Dec 2023 06:13:11.123 * Starting automatic rewriting of AOF on 5764% growth
1:39:S 20 Dec 2023 06:13:11.125 * Background append only file rewriting started by pid 109525

Aditional information

  1. eqalpha/keydb:x86_64_v6.3.4 Docker image
  2. Steps to reproduce (if any):
    At normal operation the AOF file grows and is not rewritten when the size is reached.
    Upgrade from 6.3.1 to 6.3.4, after the upgrade the error above appeared

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions