Skip to content

fix: support overrideName for Responses API deployments #264

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 5 commits into
base: development
Choose a base branch
from

Conversation

adubovik
Copy link
Collaborator

@adubovik adubovik commented Jul 31, 2025

Before the fix: the following DIAL Core configuration for Response API deployment wasn't possible:

{
    "models": {
        "my-dial-deployment": {
            "type": "chat",
            "overrideName": "gpt-4o-2024-11-20",
            "endpoint": "${ADAPTER_OPENAI_ORIGIN}/openai/deployments/my-adapter-deployment/chat/completions",
            "upstreams": [
                {
                    "endpoint": "${AZURE_OPENAI_ORIGIN}/openai/v1/responses",
                    "key": "api-key"
                }
            ]
        }
    }
}

Adapter tried to call Azure OpenAI Response API with a model name equal to my-adapter-deployment.
This request was failing since such an Azure OpenAI deployment doesn't exist.

After the fix: the adapter correctly calls the model called gpt-4o-2024-11-20 provided in the overrideName parameter. The call succeeds (assuming the deployment indeed exists).


Added unit test for this.

@adubovik adubovik self-assigned this Jul 31, 2025
@adubovik adubovik force-pushed the fix/responses-with-override-name branch from ee33326 to 7b5e0a9 Compare July 31, 2025 14:18
@adubovik adubovik requested a review from sdryapko July 31, 2025 14:42
@adubovik
Copy link
Collaborator Author

adubovik commented Jul 31, 2025

/deploy-review

Environment URL: review-environment | pipeline
Chat E2E tests status: success
Overlay E2E tests status: success

@adubovik adubovik changed the title fix: support Responses API with overrideName fix: support overrideName for Responses API deployments Jul 31, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant