1.8.7

fix value residual

1.8.6

add value residual based simple vit

1.8.5

Full Changelog: 1.8.4...1.8.5

1.8.4

go all the way with the normalized vit, fix some scales

1.8.2

go for multi-headed rmsnorm for the qknorm on hypersphere vit

1.8.1

add a hypersphere vit, adapted from https://arxiv.org/abs/2410.01131

1.8.0

add a hypersphere vit, adapted from https://arxiv.org/abs/2410.01131

1.7.14

Full Changelog: 1.7.12...1.7.14

1.7.12

Full Changelog: 1.7.11...1.7.12

1.7.11

What's Changed

• Add ViViT variant with factorized self-attention by @roydenwa in #327

Full Changelog: 1.7.10...1.7.11