[Feature] Implement Handoff Queue in Banyandb Trace Model

[hanahmily]

Search before asking

• I had searched in the issues and found no similar feature requirement.

Description

We need to add a handoff queue to the trace model that will be utilized at the liaison node. This queue will preserve synchronization information for nodes that are temporarily offline. Once these nodes come back online, the queue will send the relevant data parts to them.

Requirements:

1. Implement a handoff queue on the liaison node to manage syncing for offline nodes.
2. The liaison node must maintain a list of data nodes. Introduce a new flag for this:

   --data-node-list=data-0,data-1,data-2
   

3. Update the Helm chart to accommodate this new flag based on the current data StatefulSet settings.
4. The trace model does not currently support automatic scale-up/scale-down. Therefore, if a new data node is added or an existing one is removed, the liaison nodes must be restarted to update their data node lists.
5. Relevant documentation should be revised to reflect these changes.

Use case

No response

Related issues

No response

Are you willing to submit a pull request to implement this on your own?

• Yes I am willing to submit a pull request on my own!

Code of Conduct

• I agree to follow this project's Code of Conduct