Skip to content

Conversation

wsargent
Copy link
Contributor

@wsargent wsargent commented May 15, 2025

Please describe the purpose of this pull request.

Claude Sonnet 3.7 has a token efficient beta mode for a 14% to 70% savings. Letta can enable it for that specific model and fall through if does not match.

Also, I think the "tools" beta may not be necessary any more... the only place I could find a reference was https://bestofai.com/article/tool-use-function-calling

How to test

Should see it in the HTTPX request headers.

Have you tested this PR?

Nope!

sarahwooders and others added 30 commits April 12, 2025 17:03
Co-authored-by: Caren Thomas
Co-authored-by: Kevin Lin <[email protected]>
Co-authored-by: Kevin Lin <[email protected]>
carenthomas and others added 22 commits May 9, 2025 14:20
- update Letta server URLs in base configuration to enable external database
- remove env redundancy
- align with startup.sh
Co-authored-by: Andy Li <[email protected]>
Co-authored-by: Kevin Lin <[email protected]>
@wsargent wsargent marked this pull request as ready for review May 15, 2025 00:41
@wsargent wsargent changed the title Enable token-efficient-header for Anthropic Claude Sonnet 3.7 feat: Enable token-efficient-header for Anthropic Claude Sonnet 3.7 May 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.