BUG: Runtime error: task attach to another loop when the pool stops

Note that the issue tracker is NOT the place for general support.  For
discussions about development, questions about usage, or any general questions,
contact us on https://discuss.xorbits.io/.
Xinference UT test_opt 4-bit can reproduce this error.