Skip to content

@InftyAI InftyAI

Change the repository type filter

All

    Repositories list

    12 repositories

    • Awesome-LLMOps

      Public
      🎉 An awesome & curated list of best LLMOps tools.
      awesomeaiawesome-listllmllmopsai-developer-tools
      Python
      •
      Apache License 2.0
      •26•135•0•0•Updated Jul 9, 2025Jul 9, 2025

    • llmaz

      Public
      ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
      kubernetesinferencehuggingfacellmmodelscopellamacppvllmtext-generation-inferenceollamasglang
      Go
      •
      Apache License 2.0
      •34•223•37•3•Updated Jul 6, 2025Jul 6, 2025

    • karpenter

      Public
      This is a fork of Karpenter focused on GPU scaling with llmaz.
      Go
      •
      Apache License 2.0
      •300•0•1•0•Updated Jun 18, 2025Jun 18, 2025

    • .github

      Public
      Apache License 2.0
      •1•0•0•0•Updated Jun 17, 2025Jun 17, 2025

    • scheduler-plugins

      Public
      Scheduler-Plugins maintains a list of kubernetes scheduler plugins used in InftyAI community.
      Go
      •
      Apache License 2.0
      •3•10•1•0•Updated Jun 16, 2025Jun 16, 2025

    • website

      Public
      Website and Blogs.
      blogwebsite
      HTML
      •
      MIT License
      •1•1•2•0•Updated May 14, 2025May 14, 2025

    • community

      Public
      The InftyAI community.
      Apache License 2.0
      •1•0•0•0•Updated Apr 18, 2025Apr 18, 2025

    • template-repo

      Public template
      A template repo.
      Apache License 2.0
      •1•0•0•0•Updated Mar 15, 2025Mar 15, 2025

    • Manta

      Public
      💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIX promise 🎯
      kubernetesdistributed-systemscachep2p-networkllm
      Go
      •
      Apache License 2.0
      •3•24•14•1•Updated Dec 6, 2024Dec 6, 2024

    • omnistore

      Public
      🎯 An unified python client to communicate with various kinds of object-store providers.
      pythonosss3gcsminioobject-store
      Python
      •
      MIT License
      •3•2•4•1•Updated Nov 11, 2024Nov 11, 2024

    • llmlite

      Public
      🌵 A library helps to communicate with all kinds of LLMs consistently.
      llmops
      Python
      •
      MIT License
      •3•18•18•0•Updated Jul 5, 2024Jul 5, 2024

    • PR-Copilot

      Public
      Your AI pair programmer 🤖️ specialized in code review, code summary and even code completion. 🧑‍💻🐛
      Python
      •
      MIT License
      •3•3•2•0•Updated Jun 29, 2024Jun 29, 2024