Skip to content

ci: zephyr_integration: avoid collision in test report artifacts #721

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Jan 6, 2025

Conversation

sam-golioth
Copy link
Contributor

@sam-golioth sam-golioth commented Jan 3, 2025

When creating the report summary, we were downloading the test results for all boards, instead of just the one we're testing. This caused results to be recorded multiple times, and for boards which completed testing later to include results from boards which completed testing earlier.

In this screenshot you can see how the ESP32 Zephyr integration test includes results for many more runs than it should:
Screenshot 2025-01-03 at 5 51 27 PM

When creating the report summary, we were downloading the
test results for all boards, instead of just the one we're
testing. This caused results to be recorded multiple times, and
for boards which completed testing later to include results from
boards which completed testing earlier.

Signed-off-by: Sam Friedman <[email protected]>
@sam-golioth sam-golioth self-assigned this Jan 3, 2025
Copy link

github-actions bot commented Jan 3, 2025

Visit the preview URL for this PR (updated for commit aefeac8):

https://golioth-firmware-sdk-doxygen-dev--pr721-fix-test-repor-wqskx6li.web.app

(expires Fri, 10 Jan 2025 22:35:46 GMT)

🔥 via Firebase Hosting GitHub Action 🌎

Sign: a9993e61697a3983f3479e468bcb0b616f9a0578

Copy link

github-actions bot commented Jan 3, 2025

Code Coverage

Code Coverage

Package Line Rate Branch Rate Health
include.golioth 75% 50%
port.linux 62% 34%
port.utils 58% 46%
port.zephyr 58% 25%
src 70% 31%
Summary 69% (2713 / 3940) 31% (1124 / 3621)

Copy link

codecov bot commented Jan 3, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

see 2 files with indirect coverage changes

@sam-golioth sam-golioth marked this pull request as ready for review January 3, 2025 22:52
@sam-golioth sam-golioth merged commit 296ef54 into main Jan 6, 2025
133 of 137 checks passed
@sam-golioth sam-golioth deleted the fix_test_report_collision branch January 6, 2025 16:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants