This release contains the Memo
class for better memory efficiency when benchmarking multiple models or datasets with large memory footprint in succession.
It also introduces Transform
s as a way to encapsulate processing of records for multiple purposes, like generating statistics or serialization/deserialization.
What's Changed
- Example Guide: Benchmark on Saved Models by @maxmynter in #92
- Add a lightning demo to the README.md by @nicholasjng in #98
- Hotfix: Adjust snippet paths by @nicholasjng in #102
- Add Parameters to Benchmarks by @maxmynter in #103
- Run pre-commit autoupdate, bump dependencies by @nicholasjng in #104
- Implement a FSspec based ArtifactLoader by @maxmynter in #100
- Add Artifacts guide by @maxmynter in #107
- Remove the
ArtifactCollection
class by @maxmynter in #109 - Inline the
_cleanup
function for theFilePathArtifactLoader
. by @maxmynter in #111 - Unique keys by @maxmynter in #112
functools.partial
ize thennbench.parametrize
decorators. by @maxmynter in #116- Add transform proposal by @nicholasjng in #113
- Make
Transform
an abstract base class, delete iapply method ... by @nicholasjng in #118 - Check loaded module names before importing a new one from a file by @nicholasjng in #119
- Rollforward of lakefs-spec doc changes by @nicholasjng in #123
- Add transform submodule, parameter compression transform by @nicholasjng in #124
- Feature: Thunks as an alternative to artifacts by @nicholasjng in #120
- Add new memoization guide by @nicholasjng in #129
- State injection into setup and teardown by @maxmynter in #127
- Add global memo cache and integrate with the setUp and teardown injection by @maxmynter in #130
- Update dev requirements, add Memray artifacts to gitignore by @nicholasjng in #136
- Organize
nnbench.types.types
into different files by @maxmynter in #135 - Implement memo garbage collection by @nicholasjng in #137
- Update HuggingFace example to use memoization by @nicholasjng in #133
Full Changelog: v0.2.0...v0.3.0