Skip to content

Conversation

@huangyajie
Copy link

miloco_ai_engine主要修改点:
a.支持 MPS 设备:设备枚举新增 mps,自动优化时跳过 CUDA 显存探测,避免 macOS 上 nvidia-smi 报错。
b.新增构建脚本及文档更新
c.在mac mini m2上通过源码方式编译通过,并做验证:
在config/ai_engine_config.yaml(测试使用,未提交) 中新增本地 Qwen3-4B-Q4_K_M-local 示例(mps),可以正常工作
image

@yangbaofu007
Copy link
Collaborator

@huangyajie ai_engine是否能跑MiMo-VL-Miloco-7B模型,性能怎样?

@huangyajie
Copy link
Author

@huangyajie ai_engine是否能跑MiMo-VL-Miloco-7B模型,性能怎样?

我的硬件跑不动,没有进行测试

@yangbaofu007 yangbaofu007 requested a review from BSXXSB December 3, 2025 06:53
@libi
Copy link

libi commented Dec 5, 2025

@huangyajie ai_engine是否能跑MiMo-VL-Miloco-7B模型,性能怎样?

我用的macmini M4 跑的 mradermacher/Xiaomi-MiMo-VL-Miloco-7B-GGUF Q4_K_S的版本识别挺准确,速度一般。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants