猪齿鱼所有平台都无法访问了
c7n-mysql，和harbor状态变成了CrashLoopBackOff
mysql的日志如下：
[root@env-sanitation-db ~]# kubectl logs c7n-mysql-5c5dc67dbb-zzfdg -n c7n-system
2021-07-22T13:57:43.985870Z 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit_defaults_for_timestamp server option (see documentation for more details).
2021-07-22T13:57:44.624573Z 0 [Note] mysqld (mysqld 5.7.23) starting as process 1 ...
2021-07-22T13:57:45.296798Z 0 [Note] InnoDB: PUNCH HOLE support available
2021-07-22T13:57:45.296833Z 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
2021-07-22T13:57:45.296837Z 0 [Note] InnoDB: Uses event mutexes
2021-07-22T13:57:45.296840Z 0 [Note] InnoDB: GCC builtin __atomic_thread_fence() is used for memory barrier
2021-07-22T13:57:45.296843Z 0 [Note] InnoDB: Compressed tables use zlib 1.2.3
2021-07-22T13:57:45.296846Z 0 [Note] InnoDB: Using Linux native AIO
2021-07-22T13:57:45.297948Z 0 [Note] InnoDB: Number of pools: 1
2021-07-22T13:57:45.298194Z 0 [Note] InnoDB: Using CPU crc32 instructions
2021-07-22T13:57:45.300783Z 0 [Note] InnoDB: Initializing buffer pool, total size = 128M, instances = 1, chunk size = 128M
2021-07-22T13:57:45.309514Z 0 [Note] InnoDB: Completed initialization of buffer pool
2021-07-22T13:57:45.312052Z 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
2021-07-22T13:57:48.621149Z 0 [ERROR] InnoDB: Unable to lock ./ib_logfile1 error: 11
2021-07-22T13:57:48.621180Z 0 [Note] InnoDB: Check that you do not already have another mysqld process using the same InnoDB data or log files.
2021-07-22 21:57:48 0x7fa9338ba740 InnoDB: Assertion failure in thread 140364690990912 in file fil0fil.cc line 896
InnoDB: Failing assertion: success
InnoDB: We intentionally generate a memory trap.
InnoDB: Submit a detailed bug report to http://bugs.mysql.com.
InnoDB: If you get repeated assertion failures or crashes, even
InnoDB: immediately after the mysqld startup, there may be
InnoDB: corruption in the InnoDB tablespace. Please refer to
InnoDB: http://dev.mysql.com/doc/refman/5.7/en/forcing-innodb-recovery.html
InnoDB: about forcing recovery.
13:57:48 UTC - mysqld got signal 6 ;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.
Attempting to collect some information that could help diagnose the problem.
As this is a crash and something is definitely wrong, the information
collection process might fail.
key_buffer_size=8388608
read_buffer_size=131072
max_used_connections=0
max_threads=1500
thread_count=0
connection_count=0
It is possible that mysqld could use up to
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 604254 K bytes of memory
Hope that's ok; if not, decrease some variables in the equation.
Thread pointer: 0x0
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 0 thread_stack 0x40000
mysqld(my_print_stacktrace+0x2c)[0x55cfab96fa6c]
mysqld(handle_fatal_signal+0x479)[0x55cfab29b709]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x110c0)[0x7fa93349a0c0]
/lib/x86_64-linux-gnu/libc.so.6(gsignal+0xcf)[0x7fa931c26fff]
/lib/x86_64-linux-gnu/libc.so.6(abort+0x16a)[0x7fa931c2842a]
mysqld(+0x628c7b)[0x55cfab271c7b]
mysqld(+0xfa309b)[0x55cfabbec09b]
mysqld(_Z40fil_open_log_and_system_tablespace_filesv+0xeb)[0x55cfabbefdcb]
mysqld(_Z34innobase_start_or_create_for_mysqlv+0x2f20)[0x55cfabaea0b0]
mysqld(+0xd6d933)[0x55cfab9b6933]
mysqld(_Z24ha_initialize_handlertonP13st_plugin_int+0x4f)[0x55cfab2e63df]
mysqld(+0xb143d6)[0x55cfab75d3d6]
mysqld(_Z40plugin_register_builtin_and_init_core_sePiPPc+0x2f0)[0x55cfab7605c0]
mysqld(+0x64ae16)[0x55cfab293e16]
mysqld(_Z11mysqld_mainiPPc+0xc71)[0x55cfab2959d1]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0x7fa931c142e1]
mysqld(_start+0x2a)[0x55cfab28c0ba]
The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
information that should help you find out what is causing the crash.
说是缓存的问题
查看缓存
[root@env-sanitation-db ~]# free -h
total used free shared buff/cache available
Mem: 62G 17G 8.7G 3.4G 36G 41G
Swap: 0B 0B 0B
node信息：
[root@env-sanitation-db ~]# kubectl get nodes
NAME STATUS ROLES AGE VERSION
node1 Ready control-plane,etcd,master,worker 42d v1.21.0
大佬帮忙看一下，要怎么弄~~~
