How do I have multiple models when using a custom provider?

[willpayne23]

I define a proxy to OpenAI like so (this is internal to where I work for model usage e.t.c)

                ["openai_proxy"] = {
                    __inherited_from = "openai",
                    endpoint = "https://openai-proxy.i.apps.ai-safety-institute.org.uk/v1",
                    model = "gpt-4o"
                    api_key_name = "OPENAI_PROXY_KEY",
                },
                ["claude-proxy"] = {
                    __inherited_from = "claude",
                    endpoint = "https://anthropic-proxy.i.apps.ai-safety-institute.org.uk",
                    api_key_name = "ANTHROPIC_RESOLVED_KEY",
                },

But this only has gpt-4o as an available model, I'd like the ability to switch between all the models openai (and claude) provide.

I'd also like to disable other providers

[juniorrodes]

Did you find anything on how to do this?

[juniorrodes]

Just wanted to share that I found a way to do this, I feel it's kynda hacky but it worked for me.
I created a function to get the models from openrouter, parse the body and extract the names of the models:

local function retrieve_openrouter_models()
    local openrouter_key = os.getenv(openrouter_key_env)

    -- Use plenary's curl to make HTTP request
    local curl = require('plenary.curl')

    -- Make synchronous GET request to /models endpoint
    local response = curl.get(openrouter_endpoint .. '/models', {
        headers = {
            ['Authorization'] = 'Bearer ' .. openrouter_key,
            ['Content-Type'] = 'application/json',
        },
        accept = 'application/json',
    })

    -- Parse the JSON response
    if response.status ~= 200 then
        vim.notify('Failed to retrieve OpenRouter models: ' .. response.status, vim.log.levels.ERROR)
        return {}
    end

    local ok, data = pcall(vim.fn.json_decode, response.body)
    if not ok then
        vim.notify('Failed to parse OpenRouter models response', vim.log.levels.ERROR)
        return {}
    end

    -- Extract model names from the response
    local models = {}
    if data.data then
        for _, model in ipairs(data.data) do
            table.insert(models, model.id)
        end
    end
    return models
end

And then inside my opts I call this function to populate the field model_names, and with this I got a list of the available models in openrouter, if your proxy has something similar you can do this, or just populate model_names with the models that you want to use.

Hope this helps anyone that may find this