feat: add haiku 4.5 as reasoning model #382
send-message-integration-tests.yml
on: pull_request
send-message-tests
/
changed-files
14s
send-message-tests
/
block-until-sdk-preview-finishes
3m 6s
Matrix: send-message-tests.test-run
Annotations
4 errors and 64 warnings
send-message-tests / test-run (gemini-2.5-flash.json)
Process completed with exit code 1.
|
send-message-tests / test-run (gemini-2.5-flash.json):
tests/integration_test_send_message.py#L1629
test_async_tool_call[gemini-2.5-flash]
TimeoutError: Run run-22ec540c-3ed5-406e-9074-873319a26c7c did not complete within 30.0 seconds (last status: created)
|
send-message-tests / test-run (claude-3-7-sonnet-extended.json)
Process completed with exit code 1.
|
send-message-tests / test-run (claude-3-7-sonnet-extended.json):
tests/integration_test_send_message.py#L2154
test_inner_thoughts_false_non_reasoner_models_streaming[claude-3-7-sonnet-20250219]
assert 5 == 3
+ where 5 = len([ToolCallMessage(id='message-3ac5d238-88b0-4b93-98d7-845078d85d7f', date=datetime.datetime(2025, 10, 15, 21, 27, 26, tzinfo=TzInfo(UTC)), name=None, message_type='tool_call_message', otid='3ac5d238-88b0-4b93-98d7-845078d85d00', sender_id=None, step_id='step-db56bf4c-7b76-437a-9aee-8707bffc50a7', is_err=None, seq_id=None, run_id='run-0b0ada50-0076-446f-bd54-7c7c5131b031', tool_call=ToolCall(name='roll_dice', arguments='{"num_sides": 6, "request_heartbeat": true}', tool_call_id='toolu_01HzUMmD86zCb3RxPtcehpC9'), tool_calls=[{'name': 'roll_dice', 'arguments': '{"num_sides": 6, "request_heartbeat": true}', 'tool_call_id': 'toolu_01HzUMmD86zCb3RxPtcehpC9'}]), ToolReturnMessage(id='message-c15aa3f2-6900-4a0f-a98b-a631e7ece753', date=datetime.datetime(2025, 10, 15, 21, 27, 26, tzinfo=TzInfo(UTC)), name='roll_dice', message_type='tool_return_message', otid='c15aa3f2-6900-4a0f-a98b-a631e7ece700', sender_id=None, step_id='step-db56bf4c-7b76-437a-9aee-8707bffc50a7', is_err=None, seq_id=None, run_id='run-0b0ada50-0076-446f-bd54-7c7c5131b031', tool_return='3', status='success', tool_call_id='toolu_01HzUMmD86zCb3RxPtcehpC9', stdout=[], stderr=[], tool_returns=[{'tool_return': '3', 'status': 'success', 'tool_call_id': 'toolu_01HzUMmD86zCb3RxPtcehpC9', 'stdout': [], 'stderr': []}]), AssistantMessage(id='message-3ba03404-db7a-41ff-9998-1204cdb2033d', date=datetime.datetime(2025, 10, 15, 21, 27, 28, tzinfo=TzInfo(UTC)), name=None, message_type='assistant_message', otid='3ba03404-db7a-41ff-9998-1204cdb20300', sender_id=None, step_id='step-5c21dee6-ef91-403b-bab2-83e4f3791727', is_err=None, seq_id=None, run_id='run-0b0ada50-0076-446f-bd54-7c7c5131b031', content='Teamwork makes the dream work'), LettaStopReason(message_type='stop_reason', stop_reason='end_turn'), LettaUsageStatistics(message_type='usage_statistics', completion_tokens=86, prompt_tokens=808, total_tokens=894, step_count=2, steps_messages=None, run_ids=None)])
|
send-message-tests / test-run (gemini-1.5-pro.json):
tests/integration_test_send_message.py#L1795
Unknown pytest.mark.flaky - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
|
send-message-tests / test-run (gemini-1.5-pro.json):
.venv/lib/python3.12/site-packages/pydantic/fields.py#L1093
Using extra keyword arguments on `Field` is deprecated and will be removed. Use `json_schema_extra` instead. (Extra keys: 'example')
|
send-message-tests / test-run (gemini-1.5-pro.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_generate_schema.py#L298
`json_encoders` is deprecated. See https://docs.pydantic.dev/2.11/concepts/serialization/#custom-serializers for alternatives
|
send-message-tests / test-run (gemini-1.5-pro.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_generate_schema.py#L298
`json_encoders` is deprecated. See https://docs.pydantic.dev/2.11/concepts/serialization/#custom-serializers for alternatives
|
send-message-tests / test-run (gemini-1.5-pro.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_generate_schema.py#L298
`json_encoders` is deprecated. See https://docs.pydantic.dev/2.11/concepts/serialization/#custom-serializers for alternatives
|
send-message-tests / test-run (gemini-1.5-pro.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_generate_schema.py#L298
`json_encoders` is deprecated. See https://docs.pydantic.dev/2.11/concepts/serialization/#custom-serializers for alternatives
|
send-message-tests / test-run (gemini-1.5-pro.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_config.py#L323
Support for class-based `config` is deprecated, use ConfigDict instead.
|
send-message-tests / test-run (openai-gpt-4o-mini.json):
tests/integration_test_send_message.py#L1795
Unknown pytest.mark.flaky - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
|
send-message-tests / test-run (openai-gpt-4o-mini.json):
.venv/lib/python3.12/site-packages/pydantic/fields.py#L1093
Using extra keyword arguments on `Field` is deprecated and will be removed. Use `json_schema_extra` instead. (Extra keys: 'example')
|
send-message-tests / test-run (openai-gpt-4o-mini.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_generate_schema.py#L298
`json_encoders` is deprecated. See https://docs.pydantic.dev/2.11/concepts/serialization/#custom-serializers for alternatives
|
send-message-tests / test-run (openai-gpt-4o-mini.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_generate_schema.py#L298
`json_encoders` is deprecated. See https://docs.pydantic.dev/2.11/concepts/serialization/#custom-serializers for alternatives
|
send-message-tests / test-run (openai-gpt-4o-mini.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_generate_schema.py#L298
`json_encoders` is deprecated. See https://docs.pydantic.dev/2.11/concepts/serialization/#custom-serializers for alternatives
|
send-message-tests / test-run (openai-gpt-4o-mini.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_generate_schema.py#L298
`json_encoders` is deprecated. See https://docs.pydantic.dev/2.11/concepts/serialization/#custom-serializers for alternatives
|
send-message-tests / test-run (openai-gpt-4o-mini.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_config.py#L323
Support for class-based `config` is deprecated, use ConfigDict instead.
|
send-message-tests / test-run (gemini-2.5-pro.json):
.venv/lib/python3.12/site-packages/letta_client/core/jsonable_encoder.py#L47
The `dict` method is deprecated; use `model_dump` instead.
|
send-message-tests / test-run (gemini-2.5-pro.json):
.venv/lib/python3.12/site-packages/uvicorn/protocols/websockets/websockets_impl.py#L14
websockets.server.WebSocketServerProtocol is deprecated
|
send-message-tests / test-run (gemini-2.5-pro.json):
.venv/lib/python3.12/site-packages/websockets/legacy/__init__.py#L6
websockets.legacy is deprecated; see https://websockets.readthedocs.io/en/stable/howto/upgrade.html for upgrade instructions
|
send-message-tests / test-run (gemini-2.5-pro.json):
tests/integration_test_send_message.py#L1795
Unknown pytest.mark.flaky - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
|
send-message-tests / test-run (gemini-2.5-pro.json):
.venv/lib/python3.12/site-packages/pydantic/fields.py#L1093
Using extra keyword arguments on `Field` is deprecated and will be removed. Use `json_schema_extra` instead. (Extra keys: 'example')
|
send-message-tests / test-run (gemini-2.5-pro.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_generate_schema.py#L298
`json_encoders` is deprecated. See https://docs.pydantic.dev/2.11/concepts/serialization/#custom-serializers for alternatives
|
send-message-tests / test-run (gemini-2.5-pro.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_generate_schema.py#L298
`json_encoders` is deprecated. See https://docs.pydantic.dev/2.11/concepts/serialization/#custom-serializers for alternatives
|
send-message-tests / test-run (gemini-2.5-pro.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_generate_schema.py#L298
`json_encoders` is deprecated. See https://docs.pydantic.dev/2.11/concepts/serialization/#custom-serializers for alternatives
|
send-message-tests / test-run (gemini-2.5-pro.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_generate_schema.py#L298
`json_encoders` is deprecated. See https://docs.pydantic.dev/2.11/concepts/serialization/#custom-serializers for alternatives
|
send-message-tests / test-run (gemini-2.5-pro.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_config.py#L323
Support for class-based `config` is deprecated, use ConfigDict instead.
|
send-message-tests / test-run (claude-3-5-sonnet.json):
.venv/lib/python3.12/site-packages/letta_client/core/jsonable_encoder.py#L47
The `dict` method is deprecated; use `model_dump` instead.
|
send-message-tests / test-run (claude-3-5-sonnet.json):
.venv/lib/python3.12/site-packages/uvicorn/protocols/websockets/websockets_impl.py#L14
websockets.server.WebSocketServerProtocol is deprecated
|
send-message-tests / test-run (claude-3-5-sonnet.json):
.venv/lib/python3.12/site-packages/websockets/legacy/__init__.py#L6
websockets.legacy is deprecated; see https://websockets.readthedocs.io/en/stable/howto/upgrade.html for upgrade instructions
|
send-message-tests / test-run (claude-3-5-sonnet.json):
tests/integration_test_send_message.py#L1795
Unknown pytest.mark.flaky - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
|
send-message-tests / test-run (claude-3-5-sonnet.json):
.venv/lib/python3.12/site-packages/pydantic/fields.py#L1093
Using extra keyword arguments on `Field` is deprecated and will be removed. Use `json_schema_extra` instead. (Extra keys: 'example')
|
send-message-tests / test-run (claude-3-5-sonnet.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_generate_schema.py#L298
`json_encoders` is deprecated. See https://docs.pydantic.dev/2.11/concepts/serialization/#custom-serializers for alternatives
|
send-message-tests / test-run (claude-3-5-sonnet.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_generate_schema.py#L298
`json_encoders` is deprecated. See https://docs.pydantic.dev/2.11/concepts/serialization/#custom-serializers for alternatives
|
send-message-tests / test-run (claude-3-5-sonnet.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_generate_schema.py#L298
`json_encoders` is deprecated. See https://docs.pydantic.dev/2.11/concepts/serialization/#custom-serializers for alternatives
|
send-message-tests / test-run (claude-3-5-sonnet.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_generate_schema.py#L298
`json_encoders` is deprecated. See https://docs.pydantic.dev/2.11/concepts/serialization/#custom-serializers for alternatives
|
send-message-tests / test-run (claude-3-5-sonnet.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_config.py#L323
Support for class-based `config` is deprecated, use ConfigDict instead.
|
send-message-tests / test-run (gemini-2.5-flash.json):
.venv/lib/python3.12/site-packages/letta_client/core/jsonable_encoder.py#L47
The `dict` method is deprecated; use `model_dump` instead.
|
send-message-tests / test-run (gemini-2.5-flash.json):
.venv/lib/python3.12/site-packages/uvicorn/protocols/websockets/websockets_impl.py#L14
websockets.server.WebSocketServerProtocol is deprecated
|
send-message-tests / test-run (gemini-2.5-flash.json):
.venv/lib/python3.12/site-packages/websockets/legacy/__init__.py#L6
websockets.legacy is deprecated; see https://websockets.readthedocs.io/en/stable/howto/upgrade.html for upgrade instructions
|
send-message-tests / test-run (gemini-2.5-flash.json):
tests/integration_test_send_message.py#L1795
Unknown pytest.mark.flaky - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
|
send-message-tests / test-run (gemini-2.5-flash.json):
.venv/lib/python3.12/site-packages/pydantic/fields.py#L1093
Using extra keyword arguments on `Field` is deprecated and will be removed. Use `json_schema_extra` instead. (Extra keys: 'example')
|
send-message-tests / test-run (gemini-2.5-flash.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_generate_schema.py#L298
`json_encoders` is deprecated. See https://docs.pydantic.dev/2.11/concepts/serialization/#custom-serializers for alternatives
|
send-message-tests / test-run (gemini-2.5-flash.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_generate_schema.py#L298
`json_encoders` is deprecated. See https://docs.pydantic.dev/2.11/concepts/serialization/#custom-serializers for alternatives
|
send-message-tests / test-run (gemini-2.5-flash.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_generate_schema.py#L298
`json_encoders` is deprecated. See https://docs.pydantic.dev/2.11/concepts/serialization/#custom-serializers for alternatives
|
send-message-tests / test-run (gemini-2.5-flash.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_generate_schema.py#L298
`json_encoders` is deprecated. See https://docs.pydantic.dev/2.11/concepts/serialization/#custom-serializers for alternatives
|
send-message-tests / test-run (gemini-2.5-flash.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_config.py#L323
Support for class-based `config` is deprecated, use ConfigDict instead.
|
send-message-tests / test-run (claude-3-7-sonnet-extended.json):
.venv/lib/python3.12/site-packages/letta_client/core/jsonable_encoder.py#L47
The `dict` method is deprecated; use `model_dump` instead.
|
send-message-tests / test-run (claude-3-7-sonnet-extended.json):
.venv/lib/python3.12/site-packages/uvicorn/protocols/websockets/websockets_impl.py#L14
websockets.server.WebSocketServerProtocol is deprecated
|
send-message-tests / test-run (claude-3-7-sonnet-extended.json):
.venv/lib/python3.12/site-packages/websockets/legacy/__init__.py#L6
websockets.legacy is deprecated; see https://websockets.readthedocs.io/en/stable/howto/upgrade.html for upgrade instructions
|
send-message-tests / test-run (claude-3-7-sonnet-extended.json):
tests/integration_test_send_message.py#L1795
Unknown pytest.mark.flaky - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
|
send-message-tests / test-run (claude-3-7-sonnet-extended.json):
.venv/lib/python3.12/site-packages/pydantic/fields.py#L1093
Using extra keyword arguments on `Field` is deprecated and will be removed. Use `json_schema_extra` instead. (Extra keys: 'example')
|
send-message-tests / test-run (claude-3-7-sonnet-extended.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_generate_schema.py#L298
`json_encoders` is deprecated. See https://docs.pydantic.dev/2.11/concepts/serialization/#custom-serializers for alternatives
|
send-message-tests / test-run (claude-3-7-sonnet-extended.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_generate_schema.py#L298
`json_encoders` is deprecated. See https://docs.pydantic.dev/2.11/concepts/serialization/#custom-serializers for alternatives
|
send-message-tests / test-run (claude-3-7-sonnet-extended.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_generate_schema.py#L298
`json_encoders` is deprecated. See https://docs.pydantic.dev/2.11/concepts/serialization/#custom-serializers for alternatives
|
send-message-tests / test-run (claude-3-7-sonnet-extended.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_generate_schema.py#L298
`json_encoders` is deprecated. See https://docs.pydantic.dev/2.11/concepts/serialization/#custom-serializers for alternatives
|
send-message-tests / test-run (claude-3-7-sonnet-extended.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_config.py#L323
Support for class-based `config` is deprecated, use ConfigDict instead.
|
send-message-tests / test-run (claude-4-sonnet-extended.json):
.venv/lib/python3.12/site-packages/letta_client/core/jsonable_encoder.py#L47
The `dict` method is deprecated; use `model_dump` instead.
|
send-message-tests / test-run (claude-4-sonnet-extended.json):
.venv/lib/python3.12/site-packages/uvicorn/protocols/websockets/websockets_impl.py#L14
websockets.server.WebSocketServerProtocol is deprecated
|
send-message-tests / test-run (claude-4-sonnet-extended.json):
.venv/lib/python3.12/site-packages/websockets/legacy/__init__.py#L6
websockets.legacy is deprecated; see https://websockets.readthedocs.io/en/stable/howto/upgrade.html for upgrade instructions
|
send-message-tests / test-run (claude-4-sonnet-extended.json):
tests/integration_test_send_message.py#L1795
Unknown pytest.mark.flaky - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
|
send-message-tests / test-run (claude-4-sonnet-extended.json):
.venv/lib/python3.12/site-packages/pydantic/fields.py#L1093
Using extra keyword arguments on `Field` is deprecated and will be removed. Use `json_schema_extra` instead. (Extra keys: 'example')
|
send-message-tests / test-run (claude-4-sonnet-extended.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_generate_schema.py#L298
`json_encoders` is deprecated. See https://docs.pydantic.dev/2.11/concepts/serialization/#custom-serializers for alternatives
|
send-message-tests / test-run (claude-4-sonnet-extended.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_generate_schema.py#L298
`json_encoders` is deprecated. See https://docs.pydantic.dev/2.11/concepts/serialization/#custom-serializers for alternatives
|
send-message-tests / test-run (claude-4-sonnet-extended.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_generate_schema.py#L298
`json_encoders` is deprecated. See https://docs.pydantic.dev/2.11/concepts/serialization/#custom-serializers for alternatives
|
send-message-tests / test-run (claude-4-sonnet-extended.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_generate_schema.py#L298
`json_encoders` is deprecated. See https://docs.pydantic.dev/2.11/concepts/serialization/#custom-serializers for alternatives
|
send-message-tests / test-run (claude-4-sonnet-extended.json):
.venv/lib/python3.12/site-packages/pydantic/_internal/_config.py#L323
Support for class-based `config` is deprecated, use ConfigDict instead.
|