[DO NOT MERGE] Working branch for test framework improvements #6535
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually. Contributors can view more details about this message here. |
github-actions
bot
added
conda
Contributor
Author
|
/ok to test 5a2fd63 |
csadorf
force-pushed
the
work/improve-test-robustness
branch
from
5a2fd63 to
56aeac7
Compare
Contributor
Author
|
/ok to test 56aeac7 |
csadorf
force-pushed
the
work/improve-test-robustness
branch
from
56aeac7 to
b1c0fb8
Compare
Added sections on test organization, accuracy testing, memory usage considerations, and best practices for writing tests. Included detailed recommendations for using fixtures, parametrization, and hypothesis for test input generation. This update aims to improve the clarity and effectiveness of testing strategies within the codebase.
Included a section detailing how to run tests from the python/cuml/ directory, including common pytest commands and options.
Introduced a new section outlining three levels of test parameters: unit, quality, and stress tests.
The test should be removed with 25.08, not 24.08.
Introduced a new memory profiler plugin that tracks memory usage during test execution. The plugin records memory usage at the start and end of each test, reporting significant memory consumption. Updated the test configuration to include the new plugin for enhanced memory monitoring.
Updated the memory profiler plugin to utilize GPU memory statistics and issue warnings for high memory usage during test execution. Removed the previous memory tracking methods and streamlined the reporting mechanism to focus on peak GPU memory usage.
csadorf
force-pushed
the
work/improve-test-robustness
branch
from
b1c0fb8 to
4878c5b
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Create a draft PR to run CI on test infrastructure improvements. Do not merge.