Skip to content

Conversation

tim-hm
Copy link
Collaborator

@tim-hm tim-hm commented May 8, 2025

This is a POC built during an internal hackathon and so should not be merged and considered incomplete. The two features to call out:

  • adds openai compatible tool calling end points under /api/v1/openai/* with the open api spec served at GET /api/v1/openai/openapi.json.
  • adds scaffolding for MCP v2025-03-26 which implements Streamable HTTP by wrapping the hono server to make it compatible.

Both features are behind feature flags which can be enabled using env vars: APP_ENABLED_FEATURES=openai-tool-api,mcp-api.

To enable add `openai-tool-api` to the `APP_ENABLED_FEATURES` env var then openai tool endpoints will be served under `/api/v1/openai/*`.

Host applications must pass the invocation NUC on the auth header for these requests to work. This can be difficult with openai-tool compatible applications.
@tim-hm tim-hm self-assigned this May 8, 2025
@tim-hm tim-hm force-pushed the feat/add-mcp-openai-apis branch from 26413f0 to db0fe8a Compare May 8, 2025 08:43
@tim-hm tim-hm marked this pull request as draft May 9, 2025 09:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant