Skip to content

testsuite: add debugging and fix a test failure if verbose set in environment#6915

Merged
mergify[bot] merged 3 commits intoflux-framework:masterfrom
grondo:issue#6908
Jul 18, 2025
Merged

testsuite: add debugging and fix a test failure if verbose set in environment#6915
mergify[bot] merged 3 commits intoflux-framework:masterfrom
grondo:issue#6908

Conversation

@grondo
Copy link
Contributor

@grondo grondo commented Jul 16, 2025

This PR adds set of debugging enhancements for the specific test failures mentioned in #6908.

Additionally, a fix for one test that fails if verbose=t is set in the environment is included.

Copy link
Member

@garlick garlick left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

grondo added 3 commits July 18, 2025 08:02
Problem: A test in t0001-basic.t fails if `verbose` is set in the
test environment. This occurs because this variable causes sharness
to emit unexpected output:

  not ok 86 - test_under_flux fails if loaded modules are not unloaded

Unset `verbose` in this test so that the environment doesn't affect
the outcome.
Problem: t2603-job-shell-initrc.t uses the MULTICORE prereq but
doesn't set it, so a test is always skipped.

Set the MULTICORE prereq at the top of the test file.
Problem: A few tests are failing as reported in issue flux-framework#6908, but
there's no debug information or other output to help diagnose the
reason for the failures.

Add extra debug to specific failing tests in t2603-job-shell-initrc.t,
t2613-job-shell-batch.t, and t3002-pmi.t to assist debug of these
failures.
@mergify mergify bot merged commit 5833fed into flux-framework:master Jul 18, 2025
33 checks passed
@codecov
Copy link

codecov bot commented Oct 16, 2025

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 83.91%. Comparing base (928cea5) to head (df3c11c).
⚠️ Report is 690 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #6915      +/-   ##
==========================================
+ Coverage   83.89%   83.91%   +0.01%     
==========================================
  Files         540      540              
  Lines       90610    90610              
==========================================
+ Hits        76018    76033      +15     
+ Misses      14592    14577      -15     

see 12 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants