Skip to content

Issues: xorbitsai/inference

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
167 Open 1,589 Closed
167 Open 1,589 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

请问在哪里查看启动模型时可传入的全部参数
#3011 opened Mar 7, 2025 by ZimaBlueee v1.x
1
continous batching support otherimage-generation model?
#3009 opened Mar 7, 2025 by chenslcool v1.x
1
使用pip install "xinference[all]"安装后启动模型报错
#3004 opened Mar 5, 2025 by zscxc
1 of 3 tasks
v1.x
2
启动qwen2.5-vl时报错 gpu
#3002 opened Mar 5, 2025 by hackerhaiJu
1 of 3 tasks
v1.x
1
用mlx-vlm启动的qwen2.5-vl-instruct模型输出内容不完整，同样的模型用lm-studio启动输出没问题，lm-studio也是用的mlx引擎
#3001 opened Mar 5, 2025 by mrhuangyong
2 of 3 tasks
v1.x
4
set the option trust_remote_code=True to remove this error.
#3000 opened Mar 5, 2025 by guxingxiayu v1.x
1
为什么通过命令启动重排序模型，会多出一个reasoning_content=False参数 gpu
#2999 opened Mar 5, 2025 by xiaowang-xuexiji v1.x
3
vLLM不支持enable_prefix_cache参数 good first issue Good for newcomers gpu
#2998 opened Mar 5, 2025 by xyk0930
1 of 3 tasks
v1.x
4
xinference无法通过公网ip进行访问
#2996 opened Mar 4, 2025 by Ask-sola
1 of 3 tasks
v1.x
模型部署后出现异常，无法下线也无法调用
#2995 opened Mar 4, 2025 by micohuang
1 of 3 tasks
v1.x
1
申请支持baichuan-inc/Baichuan-M1-14B-Instruct feature
#2994 opened Mar 4, 2025 by moshilangzi v1.x
1
[UI] gpu index display was wrong gpu
#2988 opened Mar 4, 2025 by lordk911
1 of 3 tasks
v1.x
1
0.0.0.0:9997/docs打不开 gpu
#2987 opened Mar 4, 2025 by Silenceang
1 of 3 tasks
v1.x
1
启动reranker模型失败 good first issue Good for newcomers
#2985 opened Mar 4, 2025 by TZJ12
1 of 3 tasks
v1.x
1
request_limits 这个参数怎么理解
#2983 opened Mar 4, 2025 by gxx-ljy v1.x
1
fishspeech-v1.5添加音色支持 feature
#2981 opened Mar 3, 2025 by ai408 v1.x
2
cannot connect to supervisor
#2978 opened Mar 2, 2025 by shenghaomail
1 of 3 tasks
v1.x
1
使用Sglang做推理后端运行一段时间后，Ctrl+C退出xinference之后，Sglang没有退出没有释放资源 gpu
#2977 opened Mar 2, 2025 by maxiaoyuzdz
1 of 3 tasks
v1.x
1
如何启动bitsandbytes模型呢？
#2976 opened Mar 2, 2025 by nopipifish
1 of 3 tasks
v1.x
1
所有的TTS模型跟dify连接都报错 gpu
#2975 opened Mar 2, 2025 by tismagic
1 of 3 tasks
v1.x
9
加载模型时不支持pytorch的量化参数输入，比如w8a8，建议加入pytorch量化支持 feature
#2972 opened Mar 1, 2025 by hendrymax v1.x
1
启动worker报错cannot connect to supervisor
#2970 opened Feb 28, 2025 by gxx-ljy v1.x
1
rmm._cuda.gpu.CUDARuntimeError: cudaErrorInitializationError: initialization error gpu
#2969 opened Feb 28, 2025 by BBaconjack
3 tasks
v1.x
1
容器部署xinference传入“使用工具”参数启动vllm后端失败 gpu
#2968 opened Feb 28, 2025 by l241025097
1 of 3 tasks
v1.x
1
部署ChatTTS用来做文字转语音，出现错误：RuntimeError: Encoder not found for codec: mp3 gpu
#2967 opened Feb 28, 2025 by jenven
1 of 3 tasks
v1.x
2
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.