Search results

opencl: broadcast for <code>soft_max</code>

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

OpenCLIssues specific to the OpenCL backendIssues specific to the OpenCL backend

Status: Open (in progress).

ggml-org/llama.cppnumber 14510

#14510 In ggml-org/llama.cpp;

· lhez opened on Jul 3, 2025

vulkan: support mixed/deepseekR1 FA head sizes

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

VulkanIssues specific to the Vulkan backendIssues specific to the Vulkan backend

Status: Open (in progress).

ggml-org/llama.cppnumber 14509

#14509 In ggml-org/llama.cpp;

· jeffbolznv opened on Jul 2, 2025

ggml : fix FA mask dim 2 and 3

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

testingEverything test relatedEverything test related

VulkanIssues specific to the Vulkan backendIssues specific to the Vulkan backend

Status: Open (in progress).

ggml-org/llama.cppnumber 14505

#14505 In ggml-org/llama.cpp;

· ggerganov opened on Jul 2, 2025

sycl: Fix conditional enabling following arch checks for ggml-sycl

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

SYCLhttps://en.wikipedia.org/wiki/SYCL - GPU programming languagehttps://en.wikipedia.org/wiki/SYCL - GPU programming language

Status: Open (in progress).

ggml-org/llama.cppnumber 14504

#14504 In ggml-org/llama.cpp;

· s-Nick opened on Jul 2, 2025

MUSA: upgrade musa sdk to &lt;&lt;TBD&gt;&gt;

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

Status: Draft (not ready).

ggml-org/llama.cppnumber 14498

#14498 In ggml-org/llama.cpp;

· yeahdongcn opened on Jul 2, 2025

vulkan: unpack more values at a time for iquants mat mul

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

VulkanIssues specific to the Vulkan backendIssues specific to the Vulkan backend

Status: Open (in progress).

ggml-org/llama.cppnumber 14485

#14485 In ggml-org/llama.cpp;

· netrunnereve opened on Jul 1, 2025

ggml: backward pass for split swiglu

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

testingEverything test relatedEverything test related

Status: Open (in progress).

ggml-org/llama.cppnumber 14483

#14483 In ggml-org/llama.cpp;

· JohannesGaessler opened on Jul 1, 2025

opencl : add GELU_ERF

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

OpenCLIssues specific to the OpenCL backendIssues specific to the OpenCL backend

Status: Open (in progress).

ggml-org/llama.cppnumber 14476

#14476 In ggml-org/llama.cpp;

· CISC opened on Jul 1, 2025

ggml : implement GEGLU_ERF and GEGLU_QUICK ops

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

examples

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

OpenCLIssues specific to the OpenCL backendIssues specific to the OpenCL backend

SYCLhttps://en.wikipedia.org/wiki/SYCL - GPU programming languagehttps://en.wikipedia.org/wiki/SYCL - GPU programming language

VulkanIssues specific to the Vulkan backendIssues specific to the Vulkan backend

Status: Open (in progress).

ggml-org/llama.cppnumber 14445

#14445 In ggml-org/llama.cpp;

· CISC opened on Jun 29, 2025

ggml : add ggml_scale_bias

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

testingEverything test relatedEverything test related

Status: Draft (not ready).

ggml-org/llama.cppnumber 14417

#14417 In ggml-org/llama.cpp;

· ngxson opened on Jun 27, 2025

[CANN] weight format to nz for Ascend310P3

Ascend NPUissues specific to Ascend NPUsissues specific to Ascend NPUs

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Status: Open (in progress).

ggml-org/llama.cppnumber 14407

#14407 In ggml-org/llama.cpp;

· tqgy6 opened on Jun 27, 2025

OpenCL: add conv2d kernel

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

OpenCLIssues specific to the OpenCL backendIssues specific to the OpenCL backend

Status: Open (in progress).

ggml-org/llama.cppnumber 14403

#14403 In ggml-org/llama.cpp;

· rmatif opened on Jun 26, 2025