feature: Context Caching for Gemini Provider

[ONLYstcm]

I'm exploring the flutter/ai package and would like to understand how to implement Context Caching for specific content as described in the Gemini API documentation. I want to optimize token usage by caching repeated context or static content while generating responses dynamically for user-specific inputs. However, the documentation doesn't explicitly describe how this can be integrated with Flutter's AI package.

[csells]

What would the scenario be here?

[ONLYstcm]

I have a document which serve as the main source of information for all of the user prompts. I want all the user prompts to be based on the document. In vertex studio, by instructing the system to only look at the context provided, I was sort of able to achieve this. Rather than feeding this document for each user prompt I was investigating if there's an alternative and more optimised approach since several users will be using the same document (single main source of information)

[csells]

Can you share some example code that shows what you have in mind?

[ONLYstcm]

I think this snippet in the Gemini docs should best describe it - https://ai.google.dev/gemini-api/docs/caching?lang=python#generate-content

[csells]

That sample seems to show creating a model using the cached content. If that's the case, just pass that model when creating the LlmChatView.