feat(weave): add CallViewSpec for rich evaluation reports #6019
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This consolidates the CallViewSpec feature for attaching rich views to calls, particularly useful for evaluation reports. Key capabilities: ## Schema Changes - Add view_spec_ref column to call schema for linking to view specifications ## CallViewSpec Types (3 item types) - ContentViewItem: Rich content (HTML, markdown, images) with base64 encoding - ObjectRefViewItem: References to any weave object/table by URI - SavedViewDefinitionItem: Embedded table view configurations ## SDK Features - weave.set_view() for attaching views to the current call - SavedView definitions embedded directly in CallViewSpec (no separate save needed) - Support for Content, strings, Tables, ObjectRefs, and SavedViews as view items ## Evaluation Integration - on_complete callback for Evaluation class - Create custom reports with charts, tables, and filtered views - Filter SavedViews by trace_id, op name, and output fields ## SavedView Enhancements - filter_op() method for filtering by operation name - add_filter() for field-level filtering with operators (is, isNot, etc.) - set_columns() for configuring visible columns - Proper query serialization for trace filters
This was referenced Jan 30, 2026
Contributor
|
❌ Documentation Reference Check Failed No documentation reference found in the PR description. Please add either:
This check is required for all PRs that start with "feat(weave)" unless they explicitly state "docs are not required". Please update your PR description and this check will run again automatically. |
This was referenced Jan 30, 2026
Codecov Report❌ Patch coverage is 📢 Thoughts on this report? Let us know! |
|
Preview this PR with FeatureBee: https://beta.wandb.ai/?betaVersion=7a059a1d7e12522bdcfe335f409f534cf158993f |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
This consolidates the CallViewSpec feature for attaching rich views to calls, particularly useful for evaluation reports.
Schema Changes
view_spec_refcolumn to call schema for linking to view specificationsCallViewSpec Types (3 item types)
ContentViewItem: Rich content (HTML, markdown, images) with base64 encodingObjectRefViewItem: References to any weave object/table by URISavedViewDefinitionItem: Embedded table view configurationsSDK Features
weave.set_view()for attaching views to the current callEvaluation Integration
on_completecallback for Evaluation classSavedView Enhancements
filter_op()method for filtering by operation nameadd_filter()for field-level filtering with operators (is, isNot, etc.)set_columns()for configuring visible columnsTest Plan