Skip to content

suppress unnecesary test messages from logs benchmark #4242

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 2 commits into from

Conversation

emdneto
Copy link
Member

@emdneto emdneto commented Oct 30, 2024

Description

We have a lot of test messages being logged in benchmarks that are not necessary to log, and we can suppress them to facilitate seeing the results. Example: https://github.com/open-telemetry/opentelemetry-python/actions/runs/11517939886/job/32063666683

@emdneto emdneto added the Skip Changelog PRs that do not require a CHANGELOG.md entry label Oct 30, 2024
@emdneto emdneto requested a review from a team as a code owner October 30, 2024 19:09
@emdneto emdneto changed the title suppress unecessary test messages from logs benchmark suppress unnecesary test messages from logs benchmark Oct 30, 2024
@xrmx
Copy link
Contributor

xrmx commented Oct 30, 2024

Does it affect numbers?

@emdneto
Copy link
Member Author

emdneto commented Oct 30, 2024

Does it affect numbers?

@xrmx Yes. I can share the differences for test_simple_get_logger_different_names[1000] (but I ran locally in my laptop):

Execution Time Metrics (in milliseconds)

Metric Main (ms) This PR (ms)
Min 480.3077140 5.2409910
Max 804.4341670 13.4429550
Mean 584.9409834 6.4648222
StdDev 137.9129717 0.9937184
Median 507.1512170 6.1664920
IQR 188.2382130 0.6891970

Operational Metrics

Metric Main This PR
OPS 1.7096 154.6833
Rounds 5 136
Iterations per Round 1 1
Outliers 1;0 14;8

@emdneto
Copy link
Member Author

emdneto commented Oct 30, 2024

Closing as the benchmark was added to test LoggingHandler so it does makes sense. Maybe can just set propagate to false to suppress the logs while still benchmark the LoggingHandler

@emdneto emdneto closed this Oct 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Skip Changelog PRs that do not require a CHANGELOG.md entry
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants