Async API

[ollmer]

• for LLM, both cloud and VLLM
• for agents
• for environments
• for MCP tools
• async loop example
• tool calls with async LLM

Description by Korbit AI

What change is being made?

Implement an asynchronous API framework, introduce multiprocess execution, refine environment and tool management, and update agent functionality, alongside dependency enhancements.

Why are these changes being made?

The changes support concurrent execution and improve performance by utilizing asynchronous and multiprocess capabilities in line with the agent's capabilities. It enhances the ability of the framework to streamline the agent-environment interactions, optimize resource usage, and expand possible configurations in line with modern asynchronous computing practices.

Is this description stale? Ask me to generate a new description by commenting /korbit-generate-pr-description

[korbit-ai]

Based on your review schedule, I'll hold off on reviewing this PR until it's marked as ready for review. If you'd like me to take a look now, comment /korbit-review.

Your admin can change your review schedule in the Korbit Console

[korbit-ai]

Korbit doesn't automatically review large (3000+ lines changed) pull requests such as this one. If you want me to review anyway, use /korbit-review.

[rizar]

Awesome, LGTM! also see some opinionated naming comments