Search results

QUESTION / NOT ISSUE: Can it use Ollama models already installed?

Status: Open.

#65 In madroidmaq/mlx-omni-server;

· B1tMaster opened on Jul 29, 2025

How to use Bark with mlx-omni-server

Status: Open.

#63 In madroidmaq/mlx-omni-server;

· emircanerkul opened on Jul 19, 2025

Support Anthropic Messages API

Status: Open.

#62 In madroidmaq/mlx-omni-server;

· madroidmaq opened on Jul 15, 2025

Insufficient Memory error on Mac Studio

Status: Open.

#59 In madroidmaq/mlx-omni-server;

· vishnualpha opened on Jun 29, 2025

ERROR: Model type gemma3n not supported causes 500 Internal Server Error

Status: Open.

#58 In madroidmaq/mlx-omni-server;

· mbakgun opened on Jun 29, 2025

Failed with BERT method: name 'model_id' is not defined. Trying general generate() function.

Status: Open.

#55 In madroidmaq/mlx-omni-server;

· csunijena opened on Jun 15, 2025

Scope "response" is possibly unbound

Status: Open.

#53 In madroidmaq/mlx-omni-server;

· dbs-huynguyen opened on Jun 9, 2025

Why calculate <code>delta_text</code> itself instead of using <code>response.text</code> directly?

Status: Open.

#45 In madroidmaq/mlx-omni-server;

· TendernessCJS opened on May 17, 2025

ModernBERT

Status: Open.

#44 In madroidmaq/mlx-omni-server;

· oatmealm opened on May 16, 2025

[Enhancement] Add speculative decoding

enhancementNew feature or requestNew feature or request

Status: Open.

#38 In madroidmaq/mlx-omni-server;

· parthpat12 opened on Apr 22, 2025

Request a feature to serve the MLX distributed backend.

Status: Open.

#35 In madroidmaq/mlx-omni-server;

· southkorea2013 opened on Apr 12, 2025

VRAM is not released after concurrency testing

Status: Open.

#30 In madroidmaq/mlx-omni-server;

· southkorea2013 opened on Mar 20, 2025