Search results

make modelbench more composable

Status: Open.

#1105 In mlcommons/modelbench;

· wpietri opened on Jun 26, 2025

Merge Test class functionality into Hazard in modelgauge

Status: Open.

#1104 In mlcommons/modelbench;

· rogthefrog opened on Jun 26, 2025

try to reduce size of modelbench's libraries

Status: Open.

#1103 In mlcommons/modelbench;

· wpietri opened on Jun 26, 2025

One SUT per run

Status: Open.

#1102 In mlcommons/modelbench;

· bkorycki opened on Jun 26, 2025

Prototype a way to share SUT options between CLIs and web

Status: Open.

#1101 In mlcommons/modelbench;

· rogthefrog opened on Jun 26, 2025

CLI support for different SUT input formats (params, --json, --config)

Status: Open.

#1100 In mlcommons/modelbench;

· bkorycki opened on Jun 26, 2025

Rip out SUT registration

Status: Open.

#1099 In mlcommons/modelbench;

· bkorycki opened on Jun 26, 2025

Fix driver / provider distinction in modelgauge code and doc

choreShould do it, but it doesn't directly create valueShould do it, but it doesn't directly create value

documentationImprovements or additions to documentationImprovements or additions to documentation

milestoneA goal that other cards add up toA goal that other cards add up to

Status: Open.

#1098 In mlcommons/modelbench;

· rogthefrog opened on Jun 26, 2025

Prototype new SUT UIDs based on JSON config

Status: Open.

#1097 In mlcommons/modelbench;

· bollacker opened on Jun 26, 2025

Each journal file is only one SUT run

Status: Open.

#1096 In mlcommons/modelbench;

· bollacker opened on Jun 26, 2025

Move plugins into core, and lazy-load SUT supporting packages

Status: Open.

#1095 In mlcommons/modelbench;

· rogthefrog opened on Jun 25, 2025

Ensembles are a type of annotator

Status: Open.

#1094 In mlcommons/modelbench;

· bkorycki opened on Jun 25, 2025