Skip to content

benchmark_llm_serving v1.0.3 Public Latest

A library to benchmark LLMs via their API exposure. For now, it is vLLM oriented

Install from the command line
Learn more about packages
$ docker pull ghcr.io/france-travail/benchmark_llm_serving:v1.0.3

Recent tagged image versions

  • latest v1.0.3
    Published 6 months ago · Digest
    sha256:a4655df365227a794eacb27738027bdab394434d0c769c26f64a04ed746672d2
    13 Version downloads
  • v1.0.2
    Published 6 months ago · Digest
    sha256:076211689159339d4f584ffcee450092ddb47c6d53cf2ef03488f8caf847e0bb
    8 Version downloads
  • v1.0.1
    Published 7 months ago · Digest
    sha256:e04152b126281bde956f9fa37faf7b1e418861c4c731d1da2a8c83338273cc97
    11 Version downloads
  • v1.0.0
    Published 7 months ago · Digest
    sha256:bd86b09ac4a7eb23628f061b4f7b570a1f9e150041dd84e37e16a7904a1025d6
    9 Version downloads
View all tagged versions

Loading

Details

Last published

6 months ago

Issues

0

Total downloads

41