Code

Add-helium#35669

Code

Merged

ArthurZucker merged 20 commits intomainhuggingface/transformers:mainfrom add-heliumhuggingface/transformers:add-heliumCopy head branch name to clipboardJan 13, 2025

+1,826

Commits

Commits on Jan 13, 2025

• Add the helium model.

  

  LaurentMazare

  authored and

  ArthurZucker

  committed
  5c3a688

  Copy full SHA for 5c3a688

• Add a missing helium.

  

  LaurentMazare

  authored and

  ArthurZucker

  committed
  65c60fd

  Copy full SHA for 65c60fd

• And add another missing helium.

  

  LaurentMazare

  authored and

  ArthurZucker

  committed
  ac98f3e

  Copy full SHA for ac98f3e

• Use float for the rmsnorm mul.

  

  LaurentMazare

  authored and

  ArthurZucker

  committed
  cc976ea

  Copy full SHA for cc976ea

• Add the Helium tokenizer converter.

  

  LaurentMazare

  authored and

  ArthurZucker

  committed
  eba0fa4

  Copy full SHA for eba0fa4

• Add the pad token as suggested by Arthur.

  

  LaurentMazare

  authored and

  ArthurZucker

  committed
  19eadb2

  Copy full SHA for 19eadb2

• Update the RMSNorm + some other tweaks.

  

  LaurentMazare

  authored and

  ArthurZucker

  committed
  2d69919

  Copy full SHA for 2d69919

• Fix more rebase issues.

  

  LaurentMazare

  authored and

  ArthurZucker

  committed
  e2d4d3a

  Copy full SHA for e2d4d3a

• fix copies and style

  ArthurZucker

  committed
  703ff88

  Copy full SHA for 703ff88

• fixes and add helium.md

  ArthurZucker

  committed
  53b23c2

  Copy full SHA for 53b23c2

• add missing tests

  ArthurZucker

  committed
  9f55a11

  Copy full SHA for 9f55a11

• udpate the backlink

  ArthurZucker

  committed
  5d55ec3

  Copy full SHA for 5d55ec3

• oups

  ArthurZucker

  committed
  00b747d

  Copy full SHA for 00b747d

• style

  ArthurZucker

  committed
  ccec6e1

  Copy full SHA for ccec6e1

• update init, and expected results

  ArthurZucker

  committed
  47762b6

  Copy full SHA for 47762b6

• small fixes

  ArthurZucker

  committed
  a1e2a50

  Copy full SHA for a1e2a50

• match test outputs

  ArthurZucker

  committed
  dd6816d

  Copy full SHA for dd6816d

• style fixup, fix doc builder

  ArthurZucker

  committed
  bf2bd24

  Copy full SHA for bf2bd24

• add dummies and we should be good to go!z

  ArthurZucker

  committed
  fb2ee61

  Copy full SHA for fb2ee61

• update sdpa and fa2 documentation

  ArthurZucker

  committed
  cf8460b

  Copy full SHA for cf8460b