Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feat] - MCP improvements, add support for using SSE MCP servers #9642

Merged
merged 27 commits into from
Mar 30, 2025

Conversation

ishaan-jaff
Copy link
Contributor

@ishaan-jaff ishaan-jaff commented Mar 30, 2025

[Feat] - MCP improvements, add support for using SSE MCP servers

Allow onboarding MCP SSE Servers onto litellm proxy like this

model_list:
  - model_name: gpt-4o
    litellm_params:
      model: openai/gpt-4o

mcp_servers:
  {
    "Zapier_MCP": {
      "url": "https://actions.zapier.com/mcp/sk-ak-2ew3bofIeQIkNoeKIdXrF1Hhhp/sse",
      "mcp_info": {
        "logo_url": "https://espysys.com/wp-content/uploads/2024/08/zapier-logo.webp",
      }
    }, {
      "fetch": {
        "url": "https://localhost:8000/sse",
      }
    }
  }

Relevant issues

Pre-Submission checklist

Please complete all items before asking a LiteLLM maintainer to review your PR

  • I have Added testing in the tests/litellm/ directory, Adding at least 1 test is a hard requirement - see details
  • I have added a screenshot of my new test passing locally
  • My PR passes all unit tests on (make test-unit)[https://docs.litellm.ai/docs/extras/contributing_code]
  • My PR's scope is as isolated as possible, it only solves 1 specific problem

Type

🆕 New Feature
✅ Test

Changes

Copy link

vercel bot commented Mar 30, 2025

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
litellm ✅ Ready (Inspect) Visit Preview 💬 Add feedback Mar 30, 2025 1:41am

@ishaan-jaff ishaan-jaff merged commit 5df985f into main Mar 30, 2025
36 of 41 checks passed
ishaan-jaff added a commit that referenced this pull request Mar 30, 2025
…_sse_urls

[Feat] - MCP improvements, add support for using SSE MCP servers
proxy_config=proxy_config,
)
return await call_mcp_tool(**data)

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👏

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants