How to utilize the locally deployed qwen2:7b model as a model called by roles in ChatDev?

[ChatWithMOSS]

How to utilize the locally deployed qwen2:7b model as a model called by roles in ChatDev?

Currently, there is always an issue with loading the qwen2:7b model.

Please provide assistance.

[skypu]

i've forked and made some change to the code. https://github.com/skypu/ChatDev
now it supports both openai-style-api and local ollam. all you need to do is set the env info

for openai-style-api:
$env:OPENAI_API_KEY="your_openai_api_key"
$env:BASE_URL="https://ark.cn-beijing.volces.com/api/v3"
$env:DEFAULT_AI_MODEL="deepseek-r1-250120"
$env:AI_PROVIDER="openai"

for local ollama:
$env:OPENAI_API_KEY="not needed, but keep it"
$env:BASE_URL="http://localhost:11434/api/generate"
$env:DEFAULT_AI_MODEL="gemma3:latest"
$env:AI_PROVIDER="ollama"

[ChatWithMOSS]

嗨，最近新出的mgx和chatdev很像，是mgx借鉴了chatdev吗？

…

---Original--- From: ***@***.***> Date: Thu, Mar 20, 2025 14:28 PM To: ***@***.***>; Cc: ***@***.******@***.***>; Subject: Re: [OpenBMB/ChatDev] How to utilize the locally deployed qwen2:7bmodel as a model called by roles in ChatDev? (Issue #393) i've forked and made some change to the code. https://github.com/skypu/ChatDev now it supports both openai-style-api and local ollam. all you need to do is set the env info for openai-style-api: $env:OPENAI_API_KEY="your_openai_api_key" $env:BASE_URL="https://ark.cn-beijing.volces.com/api/v3" $env:DEFAULT_AI_MODEL="deepseek-r1-250120" $env:AI_PROVIDER="openai" for local ollama: $env:OPENAI_API_KEY="not needed, but keep it" $env:BASE_URL="http://localhost:11434/api/generate" $env:DEFAULT_AI_MODEL="gemma3:latest" $env:AI_PROVIDER="ollama" — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: ***@***.***> skypu left a comment (OpenBMB/ChatDev#393) i've forked and made some change to the code. https://github.com/skypu/ChatDev now it supports both openai-style-api and local ollam. all you need to do is set the env info for openai-style-api: $env:OPENAI_API_KEY="your_openai_api_key" $env:BASE_URL="https://ark.cn-beijing.volces.com/api/v3" $env:DEFAULT_AI_MODEL="deepseek-r1-250120" $env:AI_PROVIDER="openai" for local ollama: $env:OPENAI_API_KEY="not needed, but keep it" $env:BASE_URL="http://localhost:11434/api/generate" $env:DEFAULT_AI_MODEL="gemma3:latest" $env:AI_PROVIDER="ollama" — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: ***@***.***>