Skip to content
@aifoundry-org

AI Foundry

We are a community initiative to create an open ecosystem of shareable building blocks (from silicon to open models) empowering humanity to own its own AI

AI Foundry: own your own AI from silicon to open models.

Follow us on HF

Hi there 👋 -- we are building a collection of shareable building blocks (from silicon to open models) empowering humanity to own its own AI. We bring together open source hackers in the fields of computer architecture, ASIC design, advanced systems, and neural network compilers who are bold enough to think that you don't have to work for a mega corporation to build your own computers for AI. Our mission is to bring the spirit of Homebrew Computer Club back into vogue. The easiest place to find us is on our Discord or at FOSDEM.

We believe AGI can only be achieved through cat super intelligence, and we grew up playing the worst Atari game ever created.

We don't attempt to re-invent the wheel and try to work directly with as many upstream communities as possible. We are eternally grateful for ggml/llama.cpp, tinygrad, gcc, llvm, and RISC-V (to name a few), and we're not shy to use those building blocks in our end-to-end designs.

When we can't find appropriate building blocks in the open, we're not shy to build them ourselves from scratch. That's why we're going all the way to the chip design level and creating the world's first fully open-source, many-core hardware architecture scalable from a few dozen processing units to 4096. We also have opinions about the software side of AI inference servers and are trying to change the state of the art there as well.

Oh, and mark our words: Transputers are due for a huge comeback in the AI-centric world.

ET and reference hardware designs

RISC-V enablement

System support

Inference frameworks supporting ET

Inference engines and CLIs

Research

Pinned Loading

  1. tinyMHAQ tinyMHAQ Public

    You like MHAQ? You like tinygrad? You love tinyMHAQ!

    Python 1

  2. riscv-gnu-toolchain riscv-gnu-toolchain Public

    Forked from riscv-collab/riscv-gnu-toolchain

    GNU toolchain for RISC-V, including GCC

    C 1

  3. tinygrad tinygrad Public

    Forked from tinygrad/tinygrad

    You like pytorch? You like micrograd? You love tinygrad! ❤️

    Python 1

  4. llama.cpp llama.cpp Public

    Forked from ggml-org/llama.cpp

    LLM inference in C/C++

    C++ 2

  5. ETARS ETARS Public

    ONNXRuntime-based inference backend for the SmolVLA

    Jupyter Notebook 2

  6. et-platform et-platform Public

    ET Accelerator Firmware and Runtime

    C 1

Repositories

Showing 10 of 33 repositories

Top languages

Loading…

Most used topics

Loading…