Skip to content

Commit

Permalink
Add model parameter for DocSumGateway in gateway.py file
Browse files Browse the repository at this point in the history
Signed-off-by: sgurunat <[email protected]>
  • Loading branch information
sgurunat committed Nov 11, 2024
1 parent 9a50131 commit c9845a9
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions comps/cores/mega/gateway.py
Original file line number Diff line number Diff line change
Expand Up @@ -446,6 +446,7 @@ async def handle_request(self, request: Request, files: List[UploadFile] = File(
repetition_penalty=chat_request.repetition_penalty if chat_request.repetition_penalty else 1.03,
streaming=stream_opt,
language=chat_request.language if chat_request.language else "auto",
model=chat_request.model if chat_request.model else None
)
result_dict, runtime_graph = await self.megaservice.schedule(
initial_inputs={"query": prompt}, llm_parameters=parameters
Expand Down

0 comments on commit c9845a9

Please sign in to comment.