Pin httpx
to fix openai
TypeError based on proxies
kwarg
#1034
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
httpx
pinned version to0.27.2
to fixopenai
TypeErrorLOGFLAG
is parsed from environment to ensure a real boolean is setPin the version of
httpx
inrequirements
to use0.27.2
. For TGI LLM which has a pinnedopenai
dependency.Versions of
httpx
from0.28
onwards conflict with the pinnedopenai==1.35.13
dependency. Theopenai
use ofhttpx.AsyncClient
passesproxies
as akwarg
, however inhttpx>0.27.2
theproxies
kwarg has been removed.Without this pinned version a
TypeError
is thrown when calling the TGI LLM directly using OPEA ChatCompletion format:Issues
n/a
Type of change
List the type of change like below. Please delete options that are not relevant.
Dependencies
httpx==0.27.2
(was previously justhttpx
)Tests
Tested using built docker deployment to Gaudi 2 server in Intel Developer Cloud