Skip to content

@HazyResearch HazyResearch

Change the repository type filter

All

    Repositories list

    122 repositories

    • minions

      Public
      Big & Small LLMs working together
      Python
      •
      MIT License
      •113•1k•0•12•Updated Jun 25, 2025Jun 25, 2025

    • scaling-verification

      Public
      Python
      •
      MIT License
      •0•10•0•0•Updated Jun 24, 2025Jun 24, 2025

    • ThunderKittens

      Public
      Tile primitives for speedy kernels
      Cuda
      •
      MIT License
      •158•2.5k•38•14•Updated Jun 22, 2025Jun 22, 2025

    • cartridges

      Public
      Storing long contexts in tiny caches with self-study
      Python
      •
      Apache License 2.0
      •5•71•4•0•Updated Jun 19, 2025Jun 19, 2025

    • zoology

      Public
      Understand and test language model architectures on synthetic tasks.
      Python
      •
      Apache License 2.0
      •35•218•2•1•Updated Jun 8, 2025Jun 8, 2025

    • based

      Public
      Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"
      Python
      •
      Apache License 2.0
      •15•235•3•0•Updated Jun 6, 2025Jun 6, 2025

    • Megakernels

      Public
      kernels, of the mega variety
      Python
      •
      MIT License
      •19•406•2•1•Updated Jun 2, 2025Jun 2, 2025

    • hyena-dna

      Public
      Official implementation for HyenaDNA, a long-range genomic foundation model built with Hyena
      genomicslanguage-modelsfoundation-models
      Assembly
      •
      Apache License 2.0
      •99•694•32•7•Updated Apr 22, 2025Apr 22, 2025

    • precision-ls

      Public
      Python
      •
      MIT License
      •5•7•0•0•Updated Mar 18, 2025Mar 18, 2025

    • lolcats

      Public
      Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"
      Python
      •
      Apache License 2.0
      •25•239•7•0•Updated Jan 31, 2025Jan 31, 2025

    • aioli

      Public
      Aioli: A unified optimization framework for language model data mixing
      Jupyter Notebook
      •
      Apache License 2.0
      •4•27•1•0•Updated Jan 17, 2025Jan 17, 2025

    • flash-fft-conv

      Public
      FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores
      C++
      •
      Apache License 2.0
      •28•319•18•3•Updated Dec 28, 2024Dec 28, 2024

    • m2

      Public
      Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"
      Assembly
      •
      Apache License 2.0
      •42•554•25•2•Updated Dec 28, 2024Dec 28, 2024

    • meerkat

      Public
      Creative interactive views of any dataset.
      data-sciencemlpandasfoundation-modelsmachine-learning
      Python
      •
      Apache License 2.0
      •43•841•8•3•Updated Dec 24, 2024Dec 24, 2024

    • smoothie

      Public
      Jupyter Notebook
      •
      MIT License
      •3•7•0•0•Updated Dec 10, 2024Dec 10, 2024

    • train-tk

      Public
      train with kittens!
      Python
      •7k•60•0•0•Updated Oct 25, 2024Oct 25, 2024

    • wonderbread

      Public
      WONDERBREAD benchmark + dataset for BPM tasks
      Jupyter Notebook
      •6•24•1•0•Updated Oct 20, 2024Oct 20, 2024

    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •8.3k•1•0•0•Updated Oct 14, 2024Oct 14, 2024

    • eclair-agents

      Public
      Automating enterprise workflows with multimodal agents
      Jupyter Notebook
      •
      Apache License 2.0
      •13•107•0•0•Updated Oct 9, 2024Oct 9, 2024

    • legalbench

      Public
      An open science effort to benchmark legal reasoning in foundation models
      Python
      •65•444•9•7•Updated Aug 25, 2024Aug 25, 2024

    • hgcn

      Public
      Hyperbolic Graph Convolutional Networks in PyTorch.
      Python
      •114•627•20•3•Updated Jul 25, 2024Jul 25, 2024

    • manifest

      Public
      Prompt programming with FMs.
      Python
      •
      Apache License 2.0
      •45•443•6•2•Updated Jul 22, 2024Jul 22, 2024

    • prefix-linear-attention

      Public
      Python
      •1•55•0•0•Updated Jul 9, 2024Jul 9, 2024

    • safari

      Public
      Convolutions for Sequence Modeling
      Assembly
      •
      Apache License 2.0
      •71•890•25•1•Updated Jun 13, 2024Jun 13, 2024

    • based-evaluation-harness

      Public
      A framework for few-shot evaluation of language models.
      Python
      •
      MIT License
      •2.5k•10•0•0•Updated Jun 8, 2024Jun 8, 2024

    • olive-evaluation-harness

      Public
      A framework for few-shot evaluation of language models.
      Python
      •
      MIT License
      •2.5k•8•0•0•Updated Jun 3, 2024Jun 3, 2024

    • axolive

      Public
      Go ahead and axolotl questions
      Python
      •
      Apache License 2.0
      •1.1k•1•0•0•Updated Jun 3, 2024Jun 3, 2024

    • olive-recipes

      Public
      Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.
      Jupyter Notebook
      •2.5k•1•0•0•Updated Jun 3, 2024Jun 3, 2024

    • hippo-code

      Public
      Python
      •
      Apache License 2.0
      •32•178•2•0•Updated May 27, 2024May 27, 2024

    • evaporate

      Public
      This repo contains data and code for the paper "Language Models Enable Simple Systems for Generating Structured Views of Heterogeneous Data Lakes"
      Python
      •44•488•10•2•Updated Mar 26, 2024Mar 26, 2024