Releases: wandb/weave
Releases · wandb/weave
v0.52.26
What's Changed
- chore(weave): fix obj delete test flake -- attempt 1 by @gtarpenning in #5934
- fix(weave): clear inserts on ch insert error, prevent leak? by @gtarpenning in #5935
- chore(weave): bump ClickHouse version to 25.10 in nightly run by @chance-wnb in #5939
- chore(weave): Make dependabot work with our CI by @andrewtruong in #5940
- chore(weave): bump fickling from 0.1.5 to 0.1.7 by @dependabot[bot] in #5932
- chore(weave): bump pypdf from 5.9.0 to 6.6.0 by @dependabot[bot] in #5928
- chore(weave): bump filelock from 3.20.0 to 3.20.3 by @dependabot[bot] in #5933
- fix(weave): Avoid importing IPython at weave startup by @shawnlewis in #5915
- chore(weave): Tidy verifiers tests by @andrewtruong in #5955
- chore(weave): Add skills to bump and release weave by @andrewtruong in #5916
- chore(weave): Make dependabot work with our CI(2) by @andrewtruong in #5954
- chore(weave): add calls_complete v2 write path by @gtarpenning in #5911
- chore(weave): Set no:ddtrace for pytest by @andrewtruong in #5958
- fix(weave): retry Empty query with fresh insert generator by @gtarpenning in #5956
- chore(weave): more memory leak prevention, explicitly close stream by @gtarpenning in #5959
- chore(weave): bump werkzeug from 3.1.3 to 3.1.5 by @dependabot[bot] in #5951
- chore(weave): bump urllib3 from 2.5.0 to 2.6.3 by @dependabot[bot] in #5953
- fix(weave): only apply docs check to features by @zbirenbaum in #5967
- fix(weave): Fix langchain CI by @zbirenbaum in #5966
- chore(weave): bump polyfile version by @zbirenbaum in #5964
- fix(weave): force mutation migrations to be sync by @gtarpenning in #5963
- chore(weave): add calls_complete read path by @gtarpenning in #5912
- chore(weave): support on cluster queries by @gtarpenning in #5969
- revert(weave): support on cluster queries by @gtarpenning in #5971
- feat(weave): usage stats api by @bcsherma in #5721
- chore(weave): support lightweight update on distributed clusters by @gtarpenning in #5972
- fix(weave): filtering by summary value on calls_complete by @gtarpenning in #5974
- chore(weave): bump virtualenv from 20.35.4 to 20.36.1 by @dependabot[bot] in #5930
- chore(weave): bump aiohttp from 3.13.2 to 3.13.3 by @dependabot[bot] in #5952
- chore(weave): bump azure-core from 1.36.0 to 1.38.0 by @dependabot[bot] in #5929
- chore(weave): bump pyasn1 from 0.6.1 to 0.6.2 by @dependabot[bot] in #5931
- fix(weave): Google GenAI: Fix token overcounting issue by @andrewtruong in #5927
- chore(weave): Pin notdiamond to unblock CI by @andrewtruong in #5981
- chore(weave): support nested ref filtering on calls_complete table by @gtarpenning in #5975
- perf(weave): PREWHERE optimization for distributed cluster queries by @gtarpenning in #5968
- chore(weave): fix summary field order by calls_complete by @gtarpenning in #5983
- chore(weave): add retry to flaky azure test by @gtarpenning in #5982
- chore(weave): Fix sqlite resource leak in tests by @andrewtruong in #5988
- chore(weave): Simplify ThrowingServer by @andrewtruong in #5984
- chore(weave): Suppress Google integration warning by @andrewtruong in #5986
- chore(weave): ddtracing for content conversions by @gtarpenning in #5993
- chore(weave): ran make update_model_providers by @jamie-rasmussen in #5997
- chore(weave): Update costs 1/27 by @jwlee64 in #5998
- chore(weave): Rename audio_input_scoring_json_paths for media scoring by @mscavezze-cw in #5989
- chore(weave): increase read timeout in catalog_augment_hf script by @jamie-rasmussen in #6000
- chore(weave): add mutation paths for calls_complete by @gtarpenning in #6003
- feat(weave): Add /trace/usage endpoint to dynamically aggregate usage data by @andrewtruong in #5992
- chore(weave): use helper for dd tracing on ch commands by @gtarpenning in #6005
- feat(weave): opt into better performance with new flag by @gtarpenning in #5913
- chore(weave): Add Support for Filtering Calls by Annotation Queue by @chance-wnb in #5996
- feat(weave): Add /calls/usage endpoint to dynamically bulk-aggregate usage data by @andrewtruong in #5995
- chore(weave): Allow LLM As A Judge to specify image and video scoring by @mscavezze-cw in #6013
- chore(weave): wire up call-end bufstream for calls-complete + refactor by @gtarpenning in #6016
- fix(weave): otel ops not working with monitors by @zbirenbaum in #6017
- chore(weave): add trace_size computing for calls_complete stats query by @gtarpenning in #6015
- fix(weave): noop if duplicate gcp upload - prevents 429 by @gtarpenning in #6027
- chore(weave): Remove docs check by @andrewtruong in #6024
- chore(weave): remove unused function + bump error message by @gtarpenning in #6031
- refactor(weave): move query builders into query_builder/ by @gtarpenning in #6029
- feat(weave): Add patching for Anthropic parse by @andrewtruong in #6021
- chore(weave): Run deprecate model providers by @jwlee64 in #6020
- feat(weave): add column_order field to SavedViewDefinition by @bcsherma in #6040
- refactor(weave): costs tests refactor by @gtarpenning in #6038
- fix(weave): add id to annotation queue id filter handling by @gtarpenning in #6042
- chore(weave): Parametrize video tests by @andrewtruong in #6037
- chore(weave): Use correct api key pattern for verifier tests by @andrewtruong in #6045
- chore(weave): Simplify CachingMiddlewareTraceServer by @andrewtruong in #6022
- chore(weave): relax test constraints on flakey test by @gtarpenning in #6043
Full Changelog: v0.52.25...v0.52.26
v0.52.25
What's Changed
- chore(dev): call stats clickhouse query layer by @bcsherma in #5892
- chore(weave): fix test flake in poison pill test by @gtarpenning in #5917
- chore(weave): typo in llamaindex by @gtarpenning in #5925
- fix(weave): Remove redundant response capture by @zbirenbaum in #5924
- fix(weave): Google GenAI: Track system instructions by @andrewtruong in #5922
- fix(weave): Google GenAI: Start tracking thinking tokens by @andrewtruong in #5923
Full Changelog: v0.52.24...v0.52.25
v0.52.24
What's Changed
- fix(weave): Remove chars causing op creation to fail by @zbirenbaum in #5873
- chore(weave): Move codegen tools to core by @andrewtruong in #5807
- chore(weave): Add autopatching helper to simplify integration patching by @andrewtruong in #5894
- chore(weave): retry 413 with smaller batches if possible by @gtarpenning in #5895
- chore(weave): more datadog reporting on types of calls queries by @gtarpenning in #5890
- feat(weave): helper method for typescript sdk prompts by @matthoare117-wandb in #5898
- chore(weave): make the annotation endpoints more restful by @chance-wnb in #5897
- chore(weave): Generalize the ClickhouseMigrator to remove TraceServer-specific details by @tssweeney in #5903
- feat(weave): autoconvert base64 safely in trace server by @zbirenbaum in #5900
- feat(weave): Update Leaderboard schema to support overhaul features by @zbirenbaum in #5809
- chore(weave): API to support queue item state change by @chance-wnb in #5883
- chore(weave): Adds prompt to LLMAsAJudgeScorer by @jwlee64 in #5863
- feat(weave): add redact_pii_exclude_fields setting by @scottire in #5904
- fix(weave): Accept HTTP/HTTPS/ALL_PROXY env vars with HTTPX client by @andrewtruong in #5907
- feat(weave): Audio support in LLMAsAJudgeScorer by @mscavezze-cw in #5891
- chore(weave): remove broken image link from README by @tssweeney in #5908
- feat(weave): Add support for op kinds and colors by @andrewtruong in #5862
- feat(weave): Add op kinds for integrations by @andrewtruong in #5905
- fix(weave): Fix nesting issue when tracing generators by @andrewtruong in #5914
New Contributors
- @matthoare117-wandb made their first contribution in #5898
Full Changelog: v0.52.23...v0.52.24
v0.52.23
What's Changed
- chore(weave): move otel export off async inserts by @gtarpenning in #5810
- fix(weave): Fixes non-deterministic ordering of large-table evals by @tssweeney in #5815
- chore(weave): bump clickhouse version in CI by @gtarpenning in #5828
- chore(weave): Make termios optional by @andrewtruong in #5820
- refactor(weave): remove unused param by @gtarpenning in #5811
- chore(weave): Add GPT 5.2 to playground by @jwlee64 in #5840
- chore(weave): Update costs by @jwlee64 in #5850
- chore(weave): Remove BaseModel from leaderboard by @andrewtruong in #5826
- chore(weave): Remove BaseModel from ORM by @andrewtruong in #5823
- chore(weave): Remove BaseModel from imperative evals by @andrewtruong in #5822
- chore(weave): Add ty type checker by @andrewtruong in #5853
- fix(weave): Costs query not handling input and output tokens by @zbirenbaum in #5865
- feat(weave): Input and output parsing for logfire pydantic ai instrumentation by @zbirenbaum in #5866
- chore(weave): Add gpt image 1.5 to playground by @jwlee64 in #5861
- chore(weave): Expose storage parameters in weave_client.get_calls() by @mscavezze-cw in #5852
- chore(weave): Add uv/pytest workflow to CONTRIBUTING.md by @mscavezze-cw in #5860
- chore(weave): add _test suffix to ch db in tests by @gtarpenning in #5868
- fix(weave): actually support distributed replicated clickhouse tables by @gtarpenning in #5864
- fix(weave): guard kafka flush with env check by @gtarpenning in #5884
- chore(weave): make distributed db_mangement table name unique by @gtarpenning in #5885
- chore(weave): Allows the client to enforce a minimum trace server version by @tssweeney in #5888
- chore(weave): Update google generative api patch autopatch target by @andrewtruong in #5867
- chore(weave): Add Database Migration for Queue-Based Call Annotation System by @chance-wnb in #5772
- chore(weave): Add configuration to support end-to-end test for scoring worker by @mscavezze-cw in #5889
- chore(weave): new APIs for annotation queue management by @chance-wnb in #5777
- chore(weave): Add Annotation Queues Stats API by @chance-wnb in #5781
- chore(weave): API for querying queue items by @chance-wnb in #5882
- chore(weave): Better autopatching for common langchain imports by @andrewtruong in #5893
New Contributors
- @mscavezze-cw made their first contribution in #5852
Full Changelog: v0.52.22...v0.52.23
v0.52.22
What's Changed
- chore(weave): Add configurable http timeout by @andrewtruong in #5791
- chore(weave): Reraise 4xx errors by @andrewtruong in #5790
- chore(weave): update server check logic in conftest by @chance-wnb in #5799
- chore(weave): Fix kafka patching issue by @andrewtruong in #5802
- chore(weave): fix the http client auth issue by @chance-wnb in #5806
- chore(weave): calls complete only project switcher by @gtarpenning in #5702
- chore(weave): Dont template assistant messages by @jwlee64 in #5801
- chore(weave): Delete unused helper by @jwlee64 in #5804
- feat(weave): Save and use prompts and template vars on LLMStructuredCompletionModels by @jwlee64 in #5773
- refactor(weave): add dd set tags helpers by @gtarpenning in #5803
- chore(weave): Move prompt format error message into prompt class by @jwlee64 in #5813
- fix(weave): Fix clickhouse import issue by @andrewtruong in #5805
Full Changelog: v0.52.20...v0.52.22
v0.52.20
What's Changed
- chore(weave): Validate remote http trace server with pydantic
@validate_calldecorator by @andrewtruong in #5740 - chore(weave): Ensure remaining tests run by @tssweeney in #5744
- chore(weave): Add project_id utils by @andrewtruong in #5743
- chore(weave): Moves errors to the top of the file so it's more obvious what errors exist by @andrewtruong in #5738
- chore(weave): Use Self type instead of explicitly naming class by @andrewtruong in #5737
- chore(weave): Fix nightly tests by @andrewtruong in #5748
- chore(weave): use async insert with settings + dd tracing by @gtarpenning in #5749
- chore(weave): Add gpt 5.1 costs and provider by @jwlee64 in #5750
- chore(weave): ddtrace async_insert by @gtarpenning in #5753
- chore(weave): Increase minimum python version to 3.10 and upgrade to py310 syntax by @andrewtruong in #5446
- chore(weave): Tidy contextvars imports by @andrewtruong in #5755
- feat(weave): Allow passing prompt and template vars to completions_create_stream by @jwlee64 in #5741
- chore(weave): use project_id partition key for bufstream produce by @gtarpenning in #5763
- feat(weave): Implement fromUri method for ObjectRef to create instances from Weave URIs by @chance-wnb in #5647
- chore(weave): all inserts use async inserts, every 1000ms (not 2s) by @gtarpenning in #5762
- chore(weave): fix feedback batching test flake by @gtarpenning in #5754
- chore(weave): Update to py310+ (pt2) by @andrewtruong in #5760
- chore(weave): add gemini 3 pro preview by @jwlee64 in #5765
- chore(weave): Remove examples as they have moved to the docs site by @andrewtruong in #5759
- chore(weave): Update stainless tooling by @andrewtruong in #5745
- feat(weave): Start tracking x-request-id for openai responses api by @abraham-leal in #5764
- chore(weave): Remove legacy weave query from OS codebase by @tssweeney in #5746
- chore(weave): Correctly link non-server tests to the matrix checks by @tssweeney in #5770
- chore(weave): Use httpx by @andrewtruong in #5502
- chore(weave): calls_complete migration file by @gtarpenning in #5701
- chore(weave): AGENTS.md ts test instructions, remove alpha language by @shawnlewis in #5778
- feat(weave): Bedrock Agents by @tcapelle in #3802
- chore(weave): Cleanup database connections in tests by @andrewtruong in #5766
- feat(weave): typescript sdk withAttributes by @shawnlewis in #5780
- chore(weave): Add StainlessRemoteHTTPTraceServer as opt-in backend by @andrewtruong in #5699
- chore(weave): Show op deco without parens if no args are passed by @andrewtruong in #5785
- fix(weave): patch memory leak in openai agents tracing processor by @bcsherma in #5795
- chore(weave): bump version to 0.11.0 by @chance-wnb in #5787
- chore(weave): Update costs and model providers by @jwlee64 in #5794
- fix(weave): Dont publish refs when weave is in disabled mode by @andrewtruong in #5786
- chore(weave): Temporarily remove Stainless extra by @andrewtruong in #5798
- fix(weave): Fix iteration issue when moving from requests to httpx by @andrewtruong in #5800
Full Changelog: v0.52.17...v0.52.20
v0.52.17
What's Changed
- fix(weave): cte builder with costs can sort by deselected field by @gtarpenning in #5707
- chore(weave): Update default names for V2 objects by @andrewtruong in #5697
- chore(weave): Make project uv-sync-able by @andrewtruong in #5710
- chore(weave): Simplify Stainless codegen tooling by @andrewtruong in #5692
- chore(weave): Switch to dependency groups for pyproject by @andrewtruong in #5712
- chore(weave): Update costs 11/10 by @jwlee64 in #5716
- fix(weave): Fix n-times for completion_create_stream by @jwlee64 in #5549
- chore(weave): fix tests on master by @jwlee64 in #5727
- fix(weave): parse otel output_tokens by @zbirenbaum in #5731
- fix(weave): allow escaped periods to designate non-delimiters by @gtarpenning in #5722
- chore(weave): update api key length check by @jennwandb in #5732
- chore(weave): Remove unused legacy op api by @andrewtruong in #5729
- chore(weave): Rename V2 API to Objects API by @andrewtruong in #5730
- chore(weave): Only update lockfile explicitly by @andrewtruong in #5728
- chore(weave): Update codegen to support typescript by @andrewtruong in #5736
- chore(weave): Narrow V2 API ObjectVersionFilter to ops or not-ops by @andrewtruong in #5713
- chore(weave): Condense multiple trace shards into 1 shard by @andrewtruong in #5488
- fix(weave): sort calls query with costs by complex fields by @gtarpenning in #5718
New Contributors
- @jennwandb made their first contribution in #5732
Full Changelog: v0.52.16...v0.52.17
v0.52.16
What's Changed
- chore(weave): update notdiamond tests for new models by @gtarpenning in #5695
- chore(weave): analytics on batch start/end breakdown by @gtarpenning in #5694
- refactor(weave): add helper for calls query builder optimize by @gtarpenning in #5700
- feat(weave): Add support for redacting dataclasses by @andrewtruong in #5631
- feat(weave): Allow the user to specify WB Run to associate traces with by @tssweeney in #5693
- fix(weave): object creation breaks sdk due to object_id by @zbirenbaum in #5706
- chore(weave): Respect log level setting when set in init by @andrewtruong in #5698
- chore(weave): Update stainless config and reference server to uptake new V2 endpoints by @andrewtruong in #5691
Full Changelog: v0.52.15...v0.52.16
v0.52.15
What's Changed
- chore(weave): skip failing langchain tests on Win by @ayulockin in #5653
- chore(weave): Manually bump weave to 0.52.15-dev0 by @andrewtruong in #5661
- fix(weave): update outdated notdiamond models for tests by @gtarpenning in #5672
- chore(weave): add header depth to saved view definition by @chance-wnb in #5662
- chore(weave): Simplify op signature by @andrewtruong in #5660
- chore(weave): Tidy V2 methods on RemoteHTTPTraceServer so they all use generic_request instead of the request executors directly by @andrewtruong in #5658
- chore(weave): Remove docspec from code by @andrewtruong in #5659
- fix(weave): store otel dump length not raw dump in stats table by @gtarpenning in #5670
- chore(weave): update llm completion test by @gtarpenning in #5679
- fix(weave): fix query builder tests by @gtarpenning in #5677
- chore(weave): fix conftest test by @gtarpenning in #5680
- chore(weave): fix llm completions test ch batched by @gtarpenning in #5682
- chore(weave): clean up otel test by @gtarpenning in #5684
- chore(weave): another test fix by @gtarpenning in #5687
- chore(weave): content test fix for length incraese by @gtarpenning in #5686
- chore(weave): Remove deprecated client methods by @andrewtruong in #5663
- fix(weave): run all trace server tests in CI by @gtarpenning in #5683
- chore(weave): Run tests relative to the root dir, not the tests dir by @andrewtruong in #5664
- feat(weave): implement obj_create_batch by @zbirenbaum in #5676
- refactor(weave): no-op refactor to improve calls query organization by @gtarpenning in #5678
- feat(weave): create ops for OTEL spans by @zbirenbaum in #5689
- refactor(weave): query builder test utils by @gtarpenning in #5690
Full Changelog: v0.52.14...v0.52.15
v0.52.14
What's Changed
- chore(weave): Update costs 10/23 by @jwlee64 in #5613
- chore(weave): Resolve SQLite testing issues on Windows by @andrewtruong in #5611
- chore(weave): Migrate to new docs system by @andrewtruong in #5610
- chore(weave): bump ts SDK version to 0.10.1 by @chance-wnb in #5605
- fix(weave): Add missing auth params for V2 APIs by @andrewtruong in #5618
- feat(weave): Add attribute for wb_run_id to OTEL by @zbirenbaum in #5620
- chore(weave): Remove references to google_ai_studio by @andrewtruong in #5624
- chore(weave): Add missing finish_post_processor by @andrewtruong in #5614
- chore(weave): Unpin pydantic by @andrewtruong in #5567
- chore(weave): Add check to ensure docs are available for features by @andrewtruong in #5615
- chore(weave): Fix smolagent tests by @tssweeney in #5634
- feat(weave): Add new CRUD endpoints for interacting with Models by @andrewtruong in #5621
- feat(weave):
weave.log_call- Imperative call logger by @tssweeney in #5633 - chore(weave): Fix nightly tests by @andrewtruong in #5622
- chore(weave): Add issue templates for github issues by @andrewtruong in #5617
- chore(weave): Improve agent-based testing by @tssweeney in #5635
- feat(weave): Add simple way to log a row using EvaluationLogger by @andrewtruong in #5598
- chore(weave): Temporarily remove llamaindex shard to unblock CI by @andrewtruong in #5641
- chore(weave): add ComparisonView type for persisting compare page state by @bcsherma in #5638
- feat(weave): Add new CRUD endpoints for interacting with EvaluationRuns, Predictions, Scores by @andrewtruong in #5547
- fix(weave): Fix wb_run_id schema and add wb_run_step by @zbirenbaum in #5640
- chore(weave): don't allow empty env var override netrc value by @chance-wnb in #5636
- feat(weave): Support properly retrieving a dataset back in TS SDK by @chance-wnb in #5630
- chore(weave): Filter fix for EvaluationRun API by @andrewtruong in #5645
- chore(weave): force round robin in kafka producer by @gtarpenning in #5604
- perf(weave): migrate db to store OTEL data in special column by @gtarpenning in #5642
- chore(weave): add the LlamaIndex shard back by @ayulockin in #5652
- fix(weave): fix DSPy handling of BaseModel based modules and context propagation by @ayulockin in #5650
- chore(weave): Manually bump weave to 0.52.12 by @andrewtruong in #5654
- chore(weave): Manually bump weave to 0.52.14-dev0 by @andrewtruong in #5655
- chore(weave): Manually bump weave to 0.52.14 by @andrewtruong in #5656
Full Changelog: v0.52.11...v0.52.14