Skip to content

mfuntowicz/primus

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Primus - A Retargetable Modern Large Language Model Kernels compiler

PrimusIR - High-Level Intermediate Representation for Large Language Models Kernels

Supported operations

Operation Description
primus.silu SiLU activation function : $y = x * sigmoid(x)$
primus.embed_rotary Rotary Embeddingsfrom precomputed cosines and sinus frequencies

Optimus - Primus IR Just-in-Time (JIT) Compiler

Building

1. Prerequisites

2. Building LLVM and MLIR from sources

3 Build Primus and Optimus targets

About

Efficient Transformers computation kernels lowering through MLIR

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published