Getting 410018 error on curveadm deploy command

[micgoldberg]

Hello,

I'm constantly getting the similar error:

Error-Code: 410018
Error-Description: wait all chunkservers online timeout
How to Solve:
  * Website: https://github.com/opencurve/curveadm/wiki/errno4#410018

on executing curveadm deploy -k command.

Additional information:

• There are three nodes in the cluster. On each node there are three disks for data.
• I passed curveadm format and curveadm precheck commands without errors.
• format.yaml file is attached (converted to txt file)
• topology.yaml file attached (converted to txt file)
• Command curveadm deploy starts with:

Cluster Name    : cluster_name
Cluster Kind    : curvebs
Cluster Services: etcd*3, mds*3, chunkserver*0, snapshotclone*3

• In cubeadm server logs there is the following error:

2024-07-08 08:44:27	[ERR]:	(log.go:109):	Execute command
    remoteAddr: [email protected]
    command: sudo docker exec  62edaeb771ce9336ff3083e389d3d9f33e9da1973b378bc701f6764d6d0c170b bash /curvebs/tools/sbin/wait_chunkservers.sh 9
    output: wait all chunkserver online timeout, total=9, online=0
    error: Process exited with status 1

• In server logs there are similar errors:

E 2024-07-08T16:43:55.148221+0800     7 file_pool.cpp:191] crc check failed!
E 2024-07-08T16:43:55.148227+0800     7 file_pool.cpp:237] Decode meta info from meta file failed!
E 2024-07-08T16:43:55.148232+0800     7 file_pool.cpp:209] check valid failed!
F 2024-07-08T16:43:55.148236+0800     7 chunkserver.cpp:144] Failed to init chunk file pool

• Server log example attached.
• Docker with role chunkserver starts with command:

/entrypoint.sh --role chunkserver '--args=-raftSnapshotUri=curve:///curvebs/chunkserver/data/copysets -copySetUri=local:///curvebs/chunkserver/data/copysets -chunkFilePoolDir=/curvebs/chunkserver/data -recycleUri=local:///curvebs/chunkserver/data/recycler -raftLogUri=curve:///curvebs/chunkserver/data/copysets -chunkServerMetaUri=local:///curvebs/chunkserver/data/chunkserver.dat -bthread_concurrency=18 -graceful_quit_on_sigterm=true -raft_max_segment_size=8388608 -chunkServerPort=8202 -raft_use_fsync_rather_than_fdatasync=false -raft_max_install_snapshot_tasks_num=1 -chunkFilePoolMetaPath=/curvebs/chunkserver/data/chunkfilepool.meta -walFilePoolDir=/curvebs/chunkserver/data -walFilePoolMetaPath=/curvebs/chunkserver/data/walfilepool.meta -raft_sync_meta=true -chunkServerExternalIp=172.31.37.117 -chunkServerIp=172.31.37.117 -enableExternalServer=false -chunkServerStoreUri=local:///curvebs/chunkserver/data -raft_sync=true -raft_sync_segments=true -conf=/curvebs/chunkserver/conf/chunkserver.conf'

Can you please help me to resolve the error?