Support for OpenAI Predicted Outputs

[notpeter]

Check for existing issues

• Completed

Describe the feature

On 2024-11-04 OpenAI Announced support for Predicted Outputs. One of the suggested use cases is for code rewriting where you provide the provide the existing code block both as an input message and as a predicted output. For example:

{
  model: "gpt-4o",
  messages: [
    {
      role: "user",
      content: "Replace the Username property with an Email property. Respond only with code, and with no markdown formatting."
    },
    {
      role: "user",
      content: code
    }
  ],
  prediction: {
    type: "content",
    content: code
  }
}

My understanding is that this can reduce latency and result in faster edits. It is currently only supported on gpt-4o and gpt-4-mini models.

Environment

Zed: v0.162.0 (Zed Nightly 083f063)
OS: macOS 14.7.0
Memory: 64 GiB
Architecture: aarch64

If applicable, add mockups / screenshots to help present your vision of the feature

No response