Skip to content

Issues: xorbitsai/inference

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

158 Open 1,430 Closed
158 Open 1,430 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Failure to specify the maximum model length when using the vllm engine causes loading failure！ feature gpu
#2787 opened Jan 26, 2025 by tensorflowt v1.x
1
please add support for Kokoro-TTS feature
#2782 opened Jan 24, 2025 by thinkinds v1.x
1
@codingl2k1
1
ChatTTS下载好后不能运行，其它的模型都可以起启 gpu
#2780 opened Jan 23, 2025 by cq134cq
1 of 3 tasks
v1.x
5
建议 支持 DeepSeek-R1 feature
#2778 opened Jan 22, 2025 by wangyongpenga v1.x
3
BGE 系列的embedding是否支持query instruction 参数
#2774 opened Jan 22, 2025 by wanfade v1.x
2
增加Paraformer-large模型部署 feature stale
#2772 opened Jan 22, 2025 by zjxxsr v1.x
2
多模态embeding 支持和llamacpp embeding后端支持 feature
#2768 opened Jan 17, 2025 by ZanePoe v1.x
2
MiniCPM-o-2_6全模态模型有支持计划吗？ feature
#2766 opened Jan 16, 2025 by yhfgyyf v1.x
4
Codegeex4 ERROR: ChatGLM4Tokenizer._pad() got an unexpected keyword argument 'padding_side'"} gpu
#2757 opened Jan 12, 2025 by Oaklight
1 of 3 tasks
v1.x
6
embedding模型接口调用后名称发生变化
#2751 opened Jan 10, 2025 by sliontc
1 of 3 tasks
v1.x
1
5
添加对deepseek v3的支持 feature stale
#2736 opened Jan 4, 2025 by jqhr v1.x
7
增加跨域的配置 good first issue Good for newcomers pr welcome stale
#2735 opened Jan 4, 2025 by closer-finger
1 of 3 tasks
v1.x
3
建议增加xgrammar结构化输出支持 feature
#2620 opened Dec 2, 2024 by ZanePoe v1.x
10
xprobe/xinference:v0.14.0.post1 运行Alibaba-NLP/gte-Qwen2-7B-instruct报错 no moudle run install flash_attn gpu
#2022 opened Aug 6, 2024 by xujingsen521
1 of 3 tasks
v1.x
2
Please Support Embedding Model BGE-Multilingual-Gemma2 feature good first issue Good for newcomers pr welcome
#2020 opened Aug 5, 2024 by Rookie-Kai v1.x
Windows 使用 qwen2 无法设置 GPU 使用 gpu
#2019 opened Aug 5, 2024 by allanpk716
1 of 3 tasks
v1.x
1
使用网页启动自定义模型报错 _extractNVMLErrorsAsClasses.<locals>.gen_new.<locals>.new() gpu
#2014 opened Aug 5, 2024 by edwar172038
1 of 3 tasks
v1.x
4
internlm2.5-chat-gptq-int4运行时报错 gpu
#2013 opened Aug 5, 2024 by c935289832
1 of 3 tasks
v1.x
1
autodl上使用xinference加载qwen2-72b-instruct模型，运行不起来
#2012 opened Aug 4, 2024 by qq745639151
1 of 3 tasks
v1.x
1
ONNX Model Support feature
#2005 opened Aug 2, 2024 by zhipeng9802 v1.x
2
运行模型sd3-medium 提示 AutoPipeline can't find a pipeline linked to StableDiffusion3Pipeline
#2003 opened Aug 2, 2024 by Fun-Fox
1 of 3 tasks
v1.x
4
用户调用多，出现bug，到2500后自动卡死 gpu
#2001 opened Aug 1, 2024 by stevensy123
1 of 3 tasks
v1.x
@codingl2k1
16
不支持单个请求的abort gpu
#1998 opened Aug 1, 2024 by bstr9
1 of 3 tasks
v1.x
3
CPU and GPU usage 一直累积，模型再下载就卡死 gpu
#1996 opened Aug 1, 2024 by Adelaide999
1 of 3 tasks
v1.x
Error: Could not instantiate the backend tokenizer gpu
#1993 opened Aug 1, 2024 by LucisBaoshg
1 of 3 tasks
v1.x
2
ProTip! Follow long discussions with comments:>50.