Skip to content
@EmbeddedLLM

EmbeddedLLM

EmbeddedLLM is the creator behind JamAI Base, a platform designed to orchestrate AI with spreadsheet-like simplicity.

Pinned Loading

  1. JamAIBase JamAIBase Public

    The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate…

    Python 620 19

  2. vllm vllm Public

    Forked from vllm-project/vllm

    vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs

    Python 89 5

  3. embeddedllm embeddedllm Public

    EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU

    Python 25

Repositories

Showing 10 of 43 repositories
  • vllm-rocmfork Public Forked from ROCm/vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

    EmbeddedLLM/vllm-rocmfork’s past year of commit activity
    Python 0 Apache-2.0 5,033 0 2 Updated Dec 24, 2024
  • composable_kernel Public Forked from ROCm/composable_kernel

    Composable Kernel: Performance Portable Programming Model for Machine Learning Tensor Operators

    EmbeddedLLM/composable_kernel’s past year of commit activity
    C++ 0 135 0 0 Updated Dec 20, 2024
  • vllm Public Forked from vllm-project/vllm

    vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs

    EmbeddedLLM/vllm’s past year of commit activity
    Python 89 Apache-2.0 5,033 2 0 Updated Dec 20, 2024
  • LMCache Public Forked from LMCache/LMCache

    ROCm support of Ultra-Fast and Cheaper Long-Context LLM Inference

    EmbeddedLLM/LMCache’s past year of commit activity
    Python 0 Apache-2.0 35 0 0 Updated Dec 19, 2024
  • lmcache-vllm Public Forked from LMCache/lmcache-vllm

    The driver for LMCache core to run in vLLM

    EmbeddedLLM/lmcache-vllm’s past year of commit activity
    Python 0 Apache-2.0 13 0 0 Updated Dec 19, 2024
  • EmbeddedLLM/lmcache-tests’s past year of commit activity
    Python 0 7 0 0 Updated Dec 19, 2024
  • Mooncake Public Forked from kvcache-ai/Mooncake

    Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

    EmbeddedLLM/Mooncake’s past year of commit activity
    C++ 0 Apache-2.0 129 0 0 Updated Dec 16, 2024
  • torchac_rocm Public Forked from LMCache/torchac_cuda

    ROCm Implementation of torchac_cuda from LMCache

    EmbeddedLLM/torchac_rocm’s past year of commit activity
    Cuda 0 1 0 0 Updated Dec 16, 2024
  • etalon Public Forked from project-etalon/etalon

    LLM Serving Performance Evaluation Harness

    EmbeddedLLM/etalon’s past year of commit activity
    Python 0 Apache-2.0 6 0 0 Updated Dec 16, 2024
  • infinity-executable Public Forked from michaelfeil/infinity

    Infinity is a high-throughput, low-latency REST API for serving vector embeddings, supporting a wide range of text-embedding models and frameworks.

    EmbeddedLLM/infinity-executable’s past year of commit activity
    Python 0 MIT 121 0 1 Updated Dec 7, 2024