Skip to content

Add necessary APIs to support using models from a remote LM Studio #356

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Jul 1, 2025
Merged

Add necessary APIs to support using models from a remote LM Studio #356

merged 1 commit into from
Jul 1, 2025

Conversation

ryan-the-crayon
Copy link
Collaborator

  1. Add tool call callbacks to .respond API (currently still experimental).
  2. Allow creation of remote LM Studio clients within a plugin context,.
  3. Make LM Studio Client async disposable - upon dispose, it will wait until all the connection are "settled" and then terminate the websocket connection
  4. Correctly propagate errors related to connection failures to the corresponding calls.

@ryan-the-crayon ryan-the-crayon requested a review from yagil July 1, 2025 16:23
@github-actions github-actions bot added the CLA signed Indicates if all contributors have signed the CLA label Jul 1, 2025
@ryan-the-crayon ryan-the-crayon merged commit 1760a4c into main Jul 1, 2025
1 check passed
@ryan-the-crayon ryan-the-crayon deleted the ryan/support-for-remote-lmstudio branch July 1, 2025 18:32
@github-actions github-actions bot locked and limited conversation to collaborators Jul 1, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers

@yagil yagil yagil approved these changes

Assignees
No one assigned
Labels
CLA signed Indicates if all contributors have signed the CLA
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@ryan-the-crayon @yagil