Adding webp support

[feat] MiniPR, enable webp support (#131)

* testing this, but should be enough

* adding a unit test

More robust image decoding & file dispatch

See #128 and #129

Much faster image processing

Thanks to this crate https://github.com/Cykooz/fast_image_resize, CPU use while image processing (crop and resize) went down by around 50% (depending on the bottleneck, if IO then improvement will be less impressive).

First Webdataset compatible release

[feat] Webdataset support (#111)

* Better error messages on http path

- async tarball pull, but behavior is clunky
- general arch could be simpler and using tokio more
- handling jpg/png/jpeg/cls/txt/json types
- some shuffling handling

missing unit tests, and better behavior, doing pauses at the moment

better documentation

big rewrite, nicer and smaller code I believe (#117)

Co-authored-by: Benjamin Lefaudeux <[email protected]>

Async tarball pull and dispatch

Random_sampling in the config, at least for now. Thanks for the review Roman !

* Code review (#120)

Some missing items (would be good to propagate the archive name for instance), but most fixes should be there

* second round, hoopefully good to go. Perf could probably be improved, competing sample pull

* handling multi image samples (#121)

bugfixing the previous PR, ideally we should unit test more

* final update round

* second review, not perfect but feels like we can land this and carry on

---------

Co-authored-by: Benjamin Lefaudeux <[email protected]>

Fix version number in cargo toml and release to PyPi

v2025.4.3

bump version number to trigger PyPi deployment (#110)

Relaxed main timeout

Shouldn't affect most users, but now waiting 5 minutes for a given sample before wrapping up the whole client

Security and stability updates

Minor, baking in the pip wheels the openssl stability update, along with pyo3 security update (not big issues, but better be on the stable side)

Attributes filtering and additional tags filters

What's Changed

• Add attributes and tags filters by @tarek-ayed in #103

Faster PNG, less compression

remove a CPU bottleneck in many cases when re-compressing the payloads

Better RGB8 sanitization options

Merge pull request #101 from Photoroom/ben/rgb8

better handling of rgb8, removing some code duplication