Error while deploying bitsandbites model

[sudhanshu19102003]

This is the output I got from the logs

This is my config:

• quantization bitsandbites
• context length to 4096

rest all was set to default

see I am new to sglang I don't know if it's my fault or some issue with the system