Releases: helpmefindaname/transformer-smaller-training-vocab
Releases · helpmefindaname/transformer-smaller-training-vocab
v0.4.2
What's Changed
- fix: import requires_backends from transformers utils package by @stefan-it in #21
New Contributors
- @stefan-it made their first contribution in #21
Full Changelog: 0.4.1...0.4.2
v0.4.1
What's Changed
- fix handling of special tokens for tokenizer that have strange buildups by @helpmefindaname in #16
- loosen numpy requirements and drop python 3.8 by @BraSDon and @helpmefindaname in #19 via #18
Full Changelog: 0.4.0...0.4.1
v0.4.0
What's Changed
- Increase compability for python 3.12 by @helpmefindaname in #13
Full Changelog: 0.3.3...0.4.0
v0.3.3
What's Changed
- set the vocab size correctly when recreating the full embedding by @helpmefindaname in #11
Full Changelog: 0.3.2...0.3.3
v0.3.2
What's Changed
- Fix version constrain for torch by @marcelotrevisani in #10
New Contributors
- @marcelotrevisani made their first contribution in #10
Full Changelog: 0.3.1...0.3.2
v0.3.1
fix github action
v0.3.0
What's Changed
- Sphinx multiversioning by @helpmefindaname in #8
- bump python version & poetry version and make datasets an optional dependency by @helpmefindaname in #9
Full Changelog: 0.2.4...0.3.0
0.2.4
What's Changed
- Add
reduce_train_vocab_and_context
andrecreate_vocab
to puplic api - Add doc page by @helpmefindaname in #7
Full Changelog: 0.2.3...0.2.4
0.2.3
What's Changed
- fix handling of added special tokens in tokenizers by @helpmefindaname in #6
Full Changelog: 0.2.2...0.2.3