Support MCP interface

[syoyo]

Goal

Support MCP(Model Context Protocol) to edit/process USD scene using AI agent(Claude, ChatGPT, LLM), and add a feature to connect to genAI models(Generate a mesh with text-to-3D, then export it as USD using TinyUSDZ MCP)

Strategy

Recently we've improved JS/WASM binding including USD composition on JS/WASM https://github.com/lighttransport/tinyusdz/wiki/WASM-and-JavaScript-module in v0.9.0 release

This was a required step to support MCP feature to TinyUSDZ.

Features needed to implement

• JSON serialization of USD scene and scene editing commands(e.g USD compositions)
  • since MCP uses JSON-RPC
• MCP server in JS and/or C++
  • http protocol
  • SSE event notification
• Add frequently used commands as presets/prompts

References

Blender-MCP https://github.com/ahujasid/blender-mcp

[syoyo]

Commands

• Get scene info(Stage/Prim, Layer/PrimSpec)
• Get extent(AABB) of Stage/Prim
• Change Xform
• Change Texture
• Change Material parameters
• Add Mesh(Prim)
• USD composition
  • Sublayer
  • References
  • Inherits
  • Payload
  • Variant

Commands in JS/WASM(Threejs)

• Viewport screenshot

[github-actions]

This issue is stale because it has been open for 30 days with no activity.

[syoyo]

MCP support is actively developing in mcp branch

[github-actions]

This issue is stale because it has been open for 30 days with no activity.

[syoyo]

MCP support is actively developing in mcp branch

[github-actions]

This issue is stale because it has been open for 30 days with no activity.