Skip to content

testsuite: add debugging and fix a test failure if verbose set in environment #6915

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Jul 18, 2025

Conversation

grondo
Copy link
Contributor

@grondo grondo commented Jul 16, 2025

This PR adds set of debugging enhancements for the specific test failures mentioned in #6908.

Additionally, a fix for one test that fails if verbose=t is set in the environment is included.

Copy link
Member

@garlick garlick left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

grondo added 3 commits July 18, 2025 08:02
Problem: A test in t0001-basic.t fails if `verbose` is set in the
test environment. This occurs because this variable causes sharness
to emit unexpected output:

  not ok 86 - test_under_flux fails if loaded modules are not unloaded

Unset `verbose` in this test so that the environment doesn't affect
the outcome.
Problem: t2603-job-shell-initrc.t uses the MULTICORE prereq but
doesn't set it, so a test is always skipped.

Set the MULTICORE prereq at the top of the test file.
Problem: A few tests are failing as reported in issue flux-framework#6908, but
there's no debug information or other output to help diagnose the
reason for the failures.

Add extra debug to specific failing tests in t2603-job-shell-initrc.t,
t2613-job-shell-batch.t, and t3002-pmi.t to assist debug of these
failures.
@mergify mergify bot merged commit 5833fed into flux-framework:master Jul 18, 2025
33 checks passed
Copy link

codecov bot commented Jul 18, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 83.91%. Comparing base (928cea5) to head (df3c11c).
Report is 5 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #6915      +/-   ##
==========================================
+ Coverage   83.89%   83.91%   +0.01%     
==========================================
  Files         540      540              
  Lines       90610    90610              
==========================================
+ Hits        76018    76033      +15     
+ Misses      14592    14577      -15     

see 12 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants