Skip to content

Releases: bghira/webshart

v0.4.3 - cache file locks

06 Sep 15:18
6c2e4b9
Compare
Choose a tag to compare

What's Changed

Full Changelog: v0.4.2...v0.4.3

v0.4.2 - drop-in caching iterator helper

06 Sep 13:50
9bc55e8
Compare
Choose a tag to compare

What's Changed

  • add drop-in next helper with cache-aware progress reporting by @bghira in #14

Full Changelog: v0.4.1...v0.4.2

v0.4.1 - more iterator APIs

06 Sep 10:47
6f1af11
Compare
Choose a tag to compare

What's Changed

  • add iter_range method to run through specific subsets of a shard by @bghira in #12
  • add context manager that yields when shard caching exhaustion is reached by @bghira in #13

Full Changelog: v0.4.0...v0.4.1

v0.4.0 - aspect bucketing, caching, and general clean-up

03 Sep 19:49
812b403
Compare
Choose a tag to compare

What's Changed

  • remove python async functions to remove dependency on pyo3-asyncio by @bghira in #9
  • aspect bucketing API by @bghira in #10
  • bucketing dataloader by @bghira in #11

Full Changelog: v0.3.0...v0.4.0

v0.3.0 - iterable streaming dataloader, image metadata, state_dict

02 Sep 02:03
8593923
Compare
Choose a tag to compare

What's Changed

  • include image geometry by @bghira in #2
  • add more api methods for dataset statistics/details by @bghira in #3
  • add dataloader with docs by @bghira in #4
  • skippable iterator via shard() or skip() dataloader methods by @bghira in #5
  • add mention of shard + skip to the README by @bghira in #6
  • add state_dict, from_state_dict, and load_state_dict methods by @bghira in #7
  • chunked streaming in dataloader; use anyhow for errors by @bghira in #8

Full Changelog: v0.2.0...v0.3.0

v0.2.0 - extraction and reduced rate-limiting

31 Aug 15:49
24bf0f0
Compare
Choose a tag to compare

What's Changed

  • wds format conversion to webshart format by @bghira in #1

Full Changelog: v0.1.0...v0.2.0

v0.1.0

30 Aug 23:46
Compare
Choose a tag to compare
fix release