Skip to content

Commit fd15bbf

Browse files
Update docs for operator (#338)
Co-authored-by: michaeljguarino <[email protected]>
1 parent 340dc60 commit fd15bbf

File tree

1 file changed

+5
-0
lines changed
  • pages/deployments/operator

1 file changed

+5
-0
lines changed

pages/deployments/operator/api.md

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -53,6 +53,7 @@ _Appears in:_
5353
| Field | Description | Default | Validation |
5454
| --- | --- | --- | --- |
5555
| `model` _string_ | Model is the LLM model name to use. | | Optional: {} <br /> |
56+
| `toolModel` _string_ | Model to use for tool calling, which is less frequent and often requires more advanced reasoning | | Optional: {} <br /> |
5657
| `baseUrl` _string_ | A custom base url to use, for reimplementations of the same API scheme (for instance Together.ai uses the OpenAI API spec) | | Optional: {} <br /> |
5758
| `tokenSecretRef` _[SecretKeySelector](https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.29/#secretkeyselector-v1-core)_ | TokenSecretRef is a reference to the local secret holding the token to access<br />the configured AI provider. | | Required: {} <br /> |
5859

@@ -98,6 +99,7 @@ _Appears in:_
9899
| `endpoint` _string_ | Your Azure OpenAI endpoint, should be formatted like: https://{endpoint}/openai/deployments/{deployment-id}" | | Required: {} <br /> |
99100
| `apiVersion` _string_ | The azure openai Data plane - inference api version to use, defaults to 2024-10-01-preview or the latest available | | Optional: {} <br /> |
100101
| `model` _string_ | The OpenAi Model you wish to use. If not specified, Plural will provide a default | | Optional: {} <br /> |
102+
| `toolModel` _string_ | Model to use for tool calling, which is less frequent and often requires more advanced reasoning | | Optional: {} <br /> |
101103
| `tokenSecretRef` _[SecretKeySelector](https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.29/#secretkeyselector-v1-core)_ | TokenSecretRef is a reference to the local secret holding the token to access<br />the configured AI provider. | | Required: {} <br /> |
102104

103105

@@ -115,6 +117,7 @@ _Appears in:_
115117
| Field | Description | Default | Validation |
116118
| --- | --- | --- | --- |
117119
| `modelId` _string_ | The AWS Bedrock Model ID to use | | Required: {} <br /> |
120+
| `toolModelId` _string_ | Model to use for tool calling, which is less frequent and often requires more advanced reasoning | | Optional: {} <br /> |
118121
| `accessKeyId` _string_ | An AWS Access Key ID to use, can also use IRSA to acquire credentials | | Optional: {} <br /> |
119122
| `secretAccessKeyRef` _[SecretKeySelector](https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.29/#secretkeyselector-v1-core)_ | An AWS Secret Access Key to use, can also use IRSA to acquire credentials | | Optional: {} <br /> |
120123

@@ -1602,6 +1605,7 @@ _Appears in:_
16021605
| --- | --- | --- | --- |
16031606
| `url` _string_ | URL is the url this model is queryable on | | Required: {} <br /> |
16041607
| `model` _string_ | Model is the Ollama model to use when querying the /chat api | | Required: {} <br /> |
1608+
| `toolModel` _string_ | Model to use for tool calling, which is less frequent and often requires more advanced reasoning | | Optional: {} <br /> |
16051609
| `tokenSecretRef` _[SecretKeySelector](https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.29/#secretkeyselector-v1-core)_ | TokenSecretRef is a reference to the local secret holding the contents of a HTTP Authorization header<br />to send to your ollama api in case authorization is required (eg for an instance hosted on a public network) | | Optional: {} <br /> |
16061610

16071611

@@ -2731,6 +2735,7 @@ _Appears in:_
27312735
| Field | Description | Default | Validation |
27322736
| --- | --- | --- | --- |
27332737
| `model` _string_ | The Vertex AI model to use | | Optional: {} <br /> |
2738+
| `toolModel` _string_ | Model to use for tool calling, which is less frequent and often requires more advanced reasoning | | Optional: {} <br /> |
27342739
| `project` _string_ | The GCP project you'll be using | | Required: {} <br /> |
27352740
| `location` _string_ | The GCP region Vertex is queried from | | Required: {} <br /> |
27362741
| `endpoint` _string_ | A custom endpoint for self-deployed models | | Optional: {} <br /> |

0 commit comments

Comments
 (0)