Skip to content

v0.1
Compare
Choose a tag to compare
@feifeibear feifeibear released this 11 Apr 08:32
· 89 commits to main since this release
v0.1
80c8b46
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

Sequence parallel attention adopting a hybrid ulysses and ring attention approach.
Support GQA
Support QKV packed.

Assets 2
Loading