Truncate span input when input is too large

[ant31]

Truncate span input when too large

Trace span input has a size limit
The whole run fails, not sending the trace should be at most a log warning:
the generation(aka cost) already happened and tracing is secondary.

I don't want to disable trace all together.
I would like to:

1. Skip or truncate input/output automatically when too large on spans
   2. Don't raise errors but warnings, or at least have the options to ignore them (trace_ignore_errors=True)

Tracing client error 400: {
  "error": {
    "message": "Invalid 'data[0].span_data.input': data payload too large. Expected a JSON value under 100KB.",
    "type": "invalid_request_error",
    "param": "data[0].span_data.input",
    "code": null
  }
}

[rm-openai]

Thanks, we should definitely fix this. Though that said - the run shouldn't fail, since it just logs an error (doesn't raise an Exception). Are you seeing the entire run fail?

[ant31]

Ha! you're correct, I tested again and it doesn't fail the run. I'm updating the description.
thanks