Skip to content

fix: [DO-NOT-MERGE] [AI chat] remove docs from system-prompt, rely on tool calls instead #2846

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: app
Choose a base branch
from

Conversation

dubwub
Copy link
Contributor

@dubwub dubwub commented Jun 2, 2025

When injecting documents into system prompt, we are unable to get the URL metadata on the front-end. Relying on tool-calls (1) allows the LLM to make better query wording decisions and (2) allows us to get the beautified citation format in every message

Tested locally

@dubwub dubwub requested a review from dsinghvi as a code owner June 2, 2025 21:48
Copy link

vercel bot commented Jun 2, 2025

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Updated (UTC)
dev.ferndocs.com ✅ Ready (Inspect) Visit Preview Jun 2, 2025 9:51pm
fern-dashboard ✅ Ready (Inspect) Visit Preview Jun 2, 2025 9:51pm
fern-dashboard-dev ✅ Ready (Inspect) Visit Preview Jun 2, 2025 9:51pm
ferndocs.com ✅ Ready (Inspect) Visit Preview Jun 2, 2025 9:51pm
preview.ferndocs.com ✅ Ready (Inspect) Visit Preview Jun 2, 2025 9:51pm
prod-assets.ferndocs.com ✅ Ready (Inspect) Visit Preview Jun 2, 2025 9:51pm
prod.ferndocs.com ✅ Ready (Inspect) Visit Preview Jun 2, 2025 9:51pm

@dubwub dubwub changed the title fix: [AI chat] remove docs from system-prompt, rely on tool calls instead fix: [DO-NOT-MERGE] [AI chat] remove docs from system-prompt, rely on tool calls instead Jun 4, 2025
@dubwub
Copy link
Contributor Author

dubwub commented Jun 4, 2025

Not merging this, seeing some weird behavior

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants