Skip to content

mthreads/ollama 容器中运行 ollama, 显示gpu没有被占用 #78

Open
@h3z

Description

@h3z

按照这个文档操作的

https://blog.mthreads.com/blog/AI/2025-02-17-deepseek/

# musa_version_query
musa_toolkits:
{
    "version":    "3.1.1",
    "git branch":    "kuae1.3.0_musa3.1.0",
    "git tag":    "No tag",
    "commit id":    "a3acd3d639a5762e08021e12c7e63ed79487431e",
    "commit date":    "2024-11-13 12:39:19 +0800"
}
mcc:
{
    "version":    "3.1.0",
    "git branch":    "kuae1.3.0_musa3.1.0",
    "git tag":    "No tag",
    "commit id":    "baf70da0ba9f1a95a844726d8b2c28a1365b886a",
    "c
.....
# mthreads-gmi
Tue Apr  1 13:42:18 2025
---------------------------------------------------------------
    mthreads-gmi:1.8.2           Driver Version:2.5.0
---------------------------------------------------------------
ID   Name           |PCIe                |%GPU  Mem
     Device Type    |Pcie Lane Width     |Temp  MPC Capable
+-------------------------------------------------------------+
0    MTT S80        |00000000:01:00.0    |0%    92MiB(16384MiB)
     Physical       |16x(16x)            |54C   YES
---------------------------------------------------------------
---------------------------------------------------------------
Processes:
ID   PID       Process name                         GPU Memory
                                                         Usage
+-------------------------------------------------------------+
0    1107      /usr/bin/gnome-shell                      74MiB
---------------------------------------------------------------
# docker info | grep mthreads
 Runtimes: runc io.containerd.runc.v2 mthreads mthreads-experimental
 Default Runtime: mthreads
# clinfo |grep "Platform Name"
  Platform Name                                   Moore Threads OpenCL
  Platform Name                                   Moore Threads OpenCL
    Platform Name                                 Moore Threads OpenCL
    Platform Name                                 Moore Threads OpenCL
    Platform Name                                 Moore Threads OpenCL
# clinfo |grep "Driver Version"
  Driver Version                                  20230926_develop-36-g6d1e11a670da-dirty release
# dmesg |grep "Driver Version"
[    2.922786] MTGPU Driver Version: 352ee78 release build for Desktop

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions