Skip to content

Baal 2.0: Experiment API

Latest
Compare
Choose a tag to compare
@Dref360 Dref360 released this 11 Jun 15:47
· 1 commit to master since this release
85c3866

Quite a large update with a renewed experience for researchers: Experiment API.

Nonetheless, production users will benefit from EPIG, the new SotA in Active Learning!

Experiment API
The new experiment object will simplify your experiments by reducing it to a 1-liner.

Experiment API

EPIG
Contribution from @reeshipaul @Dref360 and @fbickfordsmith, EPIG is the new state-of-the-art in Bayesian Active Learning.
It better estimates the predictive uncertainty than PowerBALD and considers the labeled training set.

EPIG

Stopping Criterion
A new object that helps you stop an experiment when reaching your labeling budget or a plateau in uncertainty/performance.

Stopping criterion

Breaking Changes

  • Arguments in ModelWrapper.*_on_dataset have been for the most part moved to TrainingArguments and are included in ModelWrapper constructor. Visit the documentation for more details.

What's Changed

Full Changelog: v1.9.2...v2.0.0