-
Notifications
You must be signed in to change notification settings - Fork 52
Add python lit test coverage #1936
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
🤯 |
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #1936 +/- ##
==========================================
+ Coverage 96.61% 97.15% +0.54%
==========================================
Files 66 86 +20
Lines 7645 9643 +1998
Branches 898 897 -1
==========================================
+ Hits 7386 9369 +1983
- Misses 195 219 +24
+ Partials 64 55 -9 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
Hello. You may have forgotten to update the changelog!
|
I don't think this requires a changelog entry since it includes only build system changes |
Context:
Currently, Catalyst's code coverage reporting only includes Python pytest tests, missing coverage from lit tests. This could result in an incomplete picture of the actual coverage, especially as the Python compiler would rely on lit tests for testing its core compilation functionality.
Description of the Change:
This PR combines lit test coverage with the existing pytest coverage. In particular, it adds a new
lit-coverage
target for running lit tests with coverage enabled and updatescoverage-frontend
to combine pytest and lit coverage data usingcoverage combine
.Benefits:
More accurate overall coverage metrics
Possible Drawbacks:
Related GitHub Issues:
[sc-95508]