Skip to content

Commit

Permalink
update gateway
Browse files Browse the repository at this point in the history
Signed-off-by: Mustafa <[email protected]>
  • Loading branch information
MSCetin37 committed Nov 9, 2024
1 parent 6a87761 commit c314778
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions comps/cores/mega/gateway.py
Original file line number Diff line number Diff line change
Expand Up @@ -418,8 +418,8 @@ def __init__(self, megaservice, host="0.0.0.0", port=8888):
)

async def handle_request(self, request: Request, files: List[UploadFile] = File(default=None)):
data = await request.form()
stream_opt = data.get("stream", True)
data = await request.json()
stream_opt = data.get("stream", True)
chat_request = ChatCompletionRequest.model_validate(data)

prompt = self._handle_message(chat_request.messages)
Expand Down

0 comments on commit c314778

Please sign in to comment.