Search results

How to pretrain transformer using Wikitext103? Can you provide the corresponding config file?

Status: Open.

#50 In HazyResearch/safari;

· wenhaoli-xmu opened on May 22, 2025

Does the code base support parallel computing?

Status: Open.

#49 In HazyResearch/safari;

· Peilin-FF opened on Mar 30, 2025

lose lm.yaml

Status: Open.

#48 In HazyResearch/safari;

· Peilin-FF opened on Nov 27, 2024

how long convolution ensures causal language modeling

Status: Open.

#47 In HazyResearch/safari;

· 0205090923 opened on Sep 5, 2024

How to reproduce the Hyena-Imagenet experiment result simillar with the paper?

Status: Open.

#46 In HazyResearch/safari;

· Diagreen opened on Feb 13, 2024

How to visualize Hyena Matrix H(u) from the Paper

Status: Open.

#45 In HazyResearch/safari;

· ZHymLumine opened on Jan 4, 2024

Non-causal implementation of language model for synthetic datasets

Status: Open.

#42 In HazyResearch/safari;

· Karami-m opened on Nov 30, 2023

dropout_add_layer_norm is not installed

Status: Open.

#39 In HazyResearch/safari;

· oferballin opened on Oct 1, 2023

RWKV

Status: Open.

#37 In HazyResearch/safari;

· Alchemy5 opened on Sep 19, 2023

What is the suggested config for running LRA exps with Hyena?

Status: Open.

#36 In HazyResearch/safari;

· pone7 opened on Sep 12, 2023

Does Hyena support BERT style LLM?

Status: Open.

#32 In HazyResearch/safari;

· sherdencooper opened on Jul 13, 2023

Encoder decoder

Status: Open.

#31 In HazyResearch/safari;

· him4318 opened on Jul 11, 2023