Add-helium#35669

Merged

ArthurZucker merged 20 commits intomainfrom

Jan 13, 2025

Commits on Jan 13, 2025

Add the helium model.

LaurentMazare
authored and
ArthurZucker
committed
Add a missing helium.

LaurentMazare
authored and
ArthurZucker
committed
And add another missing helium.

LaurentMazare
authored and
ArthurZucker
committed
Use float for the rmsnorm mul.

LaurentMazare
authored and
ArthurZucker
committed
Add the Helium tokenizer converter.

LaurentMazare
authored and
ArthurZucker
committed
Add the pad token as suggested by Arthur.

LaurentMazare
authored and
ArthurZucker
committed
Update the RMSNorm + some other tweaks.

LaurentMazare
authored and
ArthurZucker
committed
Fix more rebase issues.

LaurentMazare
authored and
ArthurZucker
committed
fix copies and style
ArthurZucker
committed
fixes and add helium.md
ArthurZucker
committed
add missing tests
ArthurZucker
committed
udpate the backlink
ArthurZucker
committed
oups
ArthurZucker
committed
style
ArthurZucker
committed
update init, and expected results
ArthurZucker
committed
small fixes
ArthurZucker
committed
match test outputs
ArthurZucker
committed
style fixup, fix doc builder
ArthurZucker
committed
add dummies and we should be good to go!z
ArthurZucker
committed
update sdpa and fa2 documentation
ArthurZucker
committed