Skip to content

[#2539] fix(client-spark): NPE in DataPusher when sendShuffleData fails #2556

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Jul 25, 2025

Conversation

yunchipang
Copy link
Contributor

What changes were proposed in this pull request?

NullPointerException occurs in DataPusher when sendShuffleData() throws an exception, leaving result null, but the finally block attempts to access result.getShuffleServerPushCostTracker() without null checking.

Why are the changes needed?

Add null check to result before accessing shuffle server push cost tracker.
Fix: #2539

Does this PR introduce any user-facing change?

No.

How was this patch tested?

DataPusherTest passes.

Signed-off-by: Yunchi Pang <[email protected]>
Copy link

github-actions bot commented Jul 25, 2025

Test Results

 3 082 files  ±0   3 082 suites  ±0   6h 49m 29s ⏱️ + 1m 53s
 1 191 tests ±0   1 190 ✅ ±0   1 💤 ±0  0 ❌ ±0 
15 100 runs  ±0  15 085 ✅ ±0  15 💤 ±0  0 ❌ ±0 

Results for commit 061d33f. ± Comparison against base commit 4629fc6.

♻️ This comment has been updated with latest results.

Copy link
Member

@zuston zuston left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice catch @yunchipang . Thanks for your contribution!

Welcome to the Uniffle community. 🎉

@zuston zuston merged commit ccc534b into apache:master Jul 25, 2025
80 of 81 checks passed
@yunchipang yunchipang deleted the fix/npe-in-datapusher branch July 25, 2025 17:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Bug] NPE about shuffle push cost tracker in spark client side
2 participants