Skip to content

@EvolvingLMMs-Lab LMMs-Lab

Change the repository type filter

All

    Repositories list

    19 repositories

    • lmms-eval

      Public
      One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
      evaluationagimultimodallarge-language-models
      Python
      •
      Other
      •342•2.8k•242•3•Updated Jul 21, 2025Jul 21, 2025

    • multimodal-sae

      Public
      [ICCV 2025] Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.
      Python
      •
      Other
      •8•145•3•0•Updated Jul 11, 2025Jul 11, 2025

    • sae

      Public
      A framework that allows you to apply Sparse AutoEncoder on any models
      Python
      •1•33•1•0•Updated Jul 11, 2025Jul 11, 2025

    • MGPO

      Public
      High-Resolution Visual Reasoning via Multi-Turn Grounding-Based Reinforcement Learning
      1•38•2•0•Updated Jul 9, 2025Jul 9, 2025

    • multimodal-search-r1

      Public
      MMSearch-R1 is an end-to-end RL framework that enables LMMs to perform on-demand, multi-turn search with real-world multimodal search tools.
      Python
      •
      Apache License 2.0
      •11•260•5•0•Updated Jul 3, 2025Jul 3, 2025

    • VideoMMMU

      Public
      Python
      •
      Other
      •1•50•0•0•Updated Jun 24, 2025Jun 24, 2025

    • openevolve

      Public
      Open-source implementation of AlphaEvolve
      Python
      •
      Apache License 2.0
      •439•2•0•0•Updated Jun 20, 2025Jun 20, 2025

    • DeepEyes

      Public
      Python
      •
      Apache License 2.0
      •28•3•0•0•Updated Jun 16, 2025Jun 16, 2025

    • agent-rl

      Public
      A fork version of verl to support multi-turn tool use and many more agentic tasks.
      Python
      •
      MIT License
      •25•1•0•0•Updated Jun 14, 2025Jun 14, 2025

    • Aero-1

      Public
      Python
      •
      Apache License 2.0
      •6•76•3•0•Updated May 4, 2025May 4, 2025

    • EgoLife

      Public
      [CVPR 2025] EgoLife: Towards Egocentric Life Assistant
      ragegocentric-visionomnimodal
      Python
      •
      Other
      •18•308•6•0•Updated Mar 19, 2025Mar 19, 2025

    • LongVA

      Public
      Long Context Transfer from Language to Vision
      Python
      •
      Other
      •20•384•27•0•Updated Mar 18, 2025Mar 18, 2025

    • .github

      Public
      0•1•0•0•Updated Mar 7, 2025Mar 7, 2025

    • open-r1-multimodal

      Public
      A fork to add multimodal model training to open-r1
      Python
      •
      Apache License 2.0
      •67•1.3k•23•1•Updated Feb 8, 2025Feb 8, 2025

    • my-python-template

      Public template
      My template repo for setting up a new python repo
      Python
      •1•0•0•0•Updated Dec 11, 2024Dec 11, 2024

    • demos

      Public
      Python
      •0•0•0•0•Updated Sep 18, 2024Sep 18, 2024

    • sglang

      Public
      SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.
      Python
      •
      Apache License 2.0
      •2.4k•4•0•0•Updated Sep 18, 2024Sep 18, 2024

    • Otter

      Public
      🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.
      machine-learningdeep-learningmulti-modalityartificial-inteligenceembodied-aigpt-4foundation-modelslarge-scale-modelsvisual-language-learningchatgpt
      Python
      •
      MIT License
      •210•3.3k•62•1•Updated Mar 5, 2024Mar 5, 2024

    • RelateAnything

      Public
      Relate Anything Model is capable of taking an image as input and utilizing SAM to identify the corresponding mask within the image.
      Python
      •
      Apache License 2.0
      •22•456•6•0•Updated Jul 4, 2023Jul 4, 2023