Allow configuration of base uri

[grafst]

This is very useful to use drop in replacements of the openai-api for local models.

[gehrisandro]

Hi @grafst

Thank you for your PR.

It looks like this is introducing a breaking change, because it will fail for all existing users not having the base_uri in their configuration file.
I think this can be fixed, by making the default null and only set the baseUri if a configuration exists and is not null.

And in my opinion there is no need to validate if the base uri is a string. Maybe we can just enforce a string casting.

[grafst]

yes you are totally right, it should just ignore if the config is not present.
Oh and really sorry I didn't see the other PR before :(

Is this now better?

[Xinecraft]

Hi,
Any update on getting this resolved and merged? or a new PR should be created?

[debjit]

So we still do not have any option to pass a custom URL for self-hosting LLM? Or just have to pass as an HTTP request?

[grafst]

Yes I will look into it soon.

On February 17, 2024, Markus Hilsenbeck ***@***.***> wrote: So we still do not have any option to pass a custom URL for self- hosting LLM? Or just have to pass as an HTTP request?

— Reply to this email directly, view it on GitHub <#72 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe- auth/ACAUED23YVD2ZCU4SSAYOETYUDIHHAVCNFSM6AAAAAA7N5TJZSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSNJQGI2DGOJYGM>. You are receiving this because you were mentioned.Message ID: <openai- ***@***.***>

[giltotherescue]

I would also love to see this added. Am hoping to use this along with openrouter.ai to get access to many different models from one interface.

[angristan]

FYI - This allowed me to get Ollama working locally with the lib, although I needed openai-php/client#375 as well

[YassineBenh]

This is much needed !

For now, you can add this code to your AppServiceProvider register() method to override the client used.
Here, i just changed the baseuri and removed the organization header:

$this->app->extend(ClientContract::class, function ($openAiClient, $app) {
    $apiKey = config('openai.api_key');

    // return a new client or modify the existing one
    return \OpenAI::factory()
        ->withBaseUri('https://openrouter.ai/api/v1')
        ->withApiKey($apiKey)
        ->withHttpHeader('OpenAI-Beta', 'assistants=v2')
        ->withHttpClient(new \GuzzleHttp\Client(['timeout' => config('openai.request_timeout', 30)]))
        ->make();
});