Search results

Where can I download the preprocessed pretraining dataset for OLMo2?

type/questionAn issue that's a questionAn issue that's a question

Status: Open.

#871 In allenai/OLMo;

· yi-yvonne-yu opened on Aug 2, 2025

Running run_dataloader.py is very slow

type/bugAn issue about a bugAn issue about a bug

Status: Open.

#869 In allenai/OLMo;

· andrewivan123 opened on Jul 26, 2025

If I have all the .npy downloaded, how can I load data from disk?

type/questionAn issue that's a questionAn issue that's a question

Status: Open.

#868 In allenai/OLMo;

· SpeeeedLee opened on Jul 23, 2025

Process get stuck at buling training data loader during Stage 2 training.

type/questionAn issue that's a questionAn issue that's a question

Status: Open.

#864 In allenai/OLMo;

· SpeeeedLee opened on Jul 16, 2025

How many nodes were used for the WandB plots?

type/questionAn issue that's a questionAn issue that's a question

Status: Open.

#861 In allenai/OLMo;

· moinulrahat opened on Jul 11, 2025

Question about data generation process for olmo-mix-1124.

type/questionAn issue that's a questionAn issue that's a question

Status: Open.

#859 In allenai/OLMo;

· WwwwYz666 opened on Jul 7, 2025

Where is cfg.device_train_grad_accum used in OLMo training?

type/questionAn issue that's a questionAn issue that's a question

Status: Open.

#858 In allenai/OLMo;

· Suzehva opened on Jul 5, 2025

Incorporating LayerNorm Scaling into the OLMo Repository

type/featureAn issue or pull request that introduces a new featureAn issue or pull request that introduces a new feature

Status: Open.

#857 In allenai/OLMo;

· Shiweiliuiiiiiii opened on Jul 3, 2025

Corrupted Output After Converting OLMo Model to Hugging Face Format

type/questionAn issue that's a questionAn issue that's a question

Status: Open.

#856 In allenai/OLMo;

· chx-he opened on Jul 3, 2025

Generating config.json in olmo_data/oe_eval_tasks for new evaluation tasks.

type/questionAn issue that's a questionAn issue that's a question

Status: Open.

#854 In allenai/OLMo;

· YeskendirK opened on Jun 26, 2025

Scaling of multinode training

type/questionAn issue that's a questionAn issue that's a question

Status: Open.

#845 In allenai/OLMo;

· bhaddow opened on May 29, 2025

Clarification on Reddit Data Usage in OLMo1 vs OLMo2 Pretraining

type/questionAn issue that's a questionAn issue that's a question

Status: Open.

#824 In allenai/OLMo;

· LeoLaugier opened on Apr 9, 2025