Batch queries can't be configured. #1137
Description
The batch module with inline queries for the Gemini API does not support many of the options that regular queries support.
- Specifying thinking configuration: No support for thinking budget in batch request API. #1103
- Specifying cached content:
Invalid JSON payload received. Unknown name "cachedContent".
These are two that I know of, but there are probably more. According to your documentation, this should all be possible:
You can use any requests you would use in non-batch (or interactive) mode. For example, you could specify the temperature, system instructions or even pass in other modalities.
The problem is that CreateBatchJobConfig only allows for display_name, http_options, and dest. So the config has to be added to each InlinedRequest. This type has config: GenerateContentConfig, but some of its fields lead to errors when used in batch query.