Skip to content

Conversation

@TimPietruskyRunPod
Copy link
Member

Summary

Adds support for the deepcogito/cogito-671b-v2.1-fp8 model to the AI SDK provider.

Changes

  • Added model mapping for deepcogito/cogito-671b-v2.1-fp8 (supports both lowercase and uppercase FP8 variants)
  • Maps to OpenAI model name: deepcogito/cogito-671b-v2.1-FP8
  • Endpoint: https://api.runpod.ai/v2/cogito-671b-v2-1-fp8-dynamic/openai/v1
  • Updated tests to verify both model ID variants work correctly
  • Updated README.md and AI SDK docs with new model capabilities

Testing

  • ✅ generateText - working
  • ✅ streamText - working
  • ✅ generateObject - working
  • ✅ Tool calling - working

Model Capabilities

  • Streaming: ✅
  • Object Generation: ✅ (with warning about responseFormat)
  • Tool Usage: ✅

Closes CSE-979

- Add model mapping for deepcogito/cogito-671b-v2.1-fp8 (supports both lowercase and uppercase FP8)
- Map to OpenAI model name: deepcogito/cogito-671b-v2.1-FP8
- Add endpoint mapping to cogito-671b-v2-1-fp8-dynamic
- Update tests to verify both model ID variants work
- Update README.md and AI SDK docs with new model capabilities
@TimPietruskyRunPod TimPietruskyRunPod changed the title Add deepcogito/cogito-671b-v2.1-fp8 model support add deepcogito/cogito-671b-v2.1-fp8 model support Nov 21, 2025
@TimPietruskyRunPod TimPietruskyRunPod merged commit 3ca13ef into main Nov 21, 2025
3 checks passed
@TimPietruskyRunPod TimPietruskyRunPod deleted the add-cogito-671b-model branch November 21, 2025 17:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants