Search results

Update results with LLaMa 3 models

Status: Open.

#14 In ray-project/llmperf-leaderboard;

· tedspare opened on Apr 20, 2024

server spec for ray llm serving

Status: Open.

#12 In ray-project/llmperf-leaderboard;

· Fizzbb opened on Feb 22, 2024

Throughput of llama2 70b higher than llama2 7b

Status: Open.

#11 In ray-project/llmperf-leaderboard;

· debraj135 opened on Feb 14, 2024

use this on local models

Status: Open.

#9 In ray-project/llmperf-leaderboard;

· Akash08naik opened on Jan 10, 2024

Mixtral comparison to OAI / Anthropic / Google

Status: Open.

#5 In ray-project/llmperf-leaderboard;

· cadedaniel opened on Dec 28, 2023

Add cost / token per model and provider

Status: Open.

#3 In ray-project/llmperf-leaderboard;

· richardliaw opened on Dec 22, 2023

Track these metrics over time

Status: Open.

#2 In ray-project/llmperf-leaderboard;

· richardliaw opened on Dec 22, 2023