Skip to content

Only update benchmark weights when there is a significant change #3708

@teor2345

Description

@teor2345

There is noise in benchmark runs that results in a lot of trivial weight changes every time we re-run a benchmark.

To reduce benchmark churn, and focus reviewer time on significant changes, any trivial changes should not be added to the PR.

This could be implemented in the benchmark code generator, or as a post-run script that removes trivial changes from the git diff.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or requestexecutionSubspace executionupstreamBlocked by upstream

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions