Search results

Fix scaling in attention computation

Status: Open.

Bug

#71 In PAIR-code/tiny-transformers;

· aliciafmachado opened on Apr 29, 2025

Support running scripts with Nodejs or Deno, including webgpu support

Status: Open.

#62 In PAIR-code/tiny-transformers;

· iislucas opened on Feb 19, 2025

Add support for cross-entropy loss with integer labels

enhancementNew feature or requestNew feature or request

Status: Open.

#60 In PAIR-code/tiny-transformers;

· aliciafmachado opened on Feb 17, 2025

Refactor transformer_gtensor.ts and gpt2.ts to share functions in a common file

enhancementNew feature or requestNew feature or request

Status: Open.

#54 In PAIR-code/tiny-transformers;

· aliciafmachado opened on Jan 16, 2025

Add GPT2 tokenizer

Status: Open.

#52 In PAIR-code/tiny-transformers;

· aliciafmachado opened on Jan 16, 2025

Fix typos in the codebase

Status: Open.

#51 In PAIR-code/tiny-transformers;

· aliciafmachado opened on Jan 16, 2025

Support loading/saving of models from h5 files

Status: Open.

#41 In PAIR-code/tiny-transformers;

· iislucas opened on Nov 5, 2024

Create patchscopes module

Status: Open.

#40 In PAIR-code/tiny-transformers;

· aliciafmachado opened on Nov 2, 2024

Pass dropout once for whole neural-network

Status: Open.

#38 In PAIR-code/tiny-transformers;

· aliciafmachado opened on Oct 14, 2024

Create a Gemma compatible transformer implementation

enhancementNew feature or requestNew feature or request

help wantedExtra attention is neededExtra attention is needed

project:TTPFor the Tiny Transformer PlaygroundFor the Tiny Transformer Playground

Status: Open.

#30 In PAIR-code/tiny-transformers;

· iislucas opened on Sep 18, 2024

Provide a visualization for the norms of different parts of a transformer model

enhancementNew feature or requestNew feature or request

project:TTPFor the Tiny Transformer PlaygroundFor the Tiny Transformer Playground

Status: Open.

#25 In PAIR-code/tiny-transformers;

· iislucas opened on Aug 28, 2024