Skip to content

[#2520] fix(spark3): Shuffle write total duration is incorrectly accumulated in event log #2521

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Jun 26, 2025

Conversation

zuston
Copy link
Member

@zuston zuston commented Jun 25, 2025

What changes were proposed in this pull request?

Shuffle write total duration is incorrectly accumulated in event log

Why are the changes needed?

fix #2520

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Needn't

@zuston
Copy link
Member Author

zuston commented Jun 25, 2025

Small fix @jerqi

Copy link

Test Results

 3 049 files  ±0   3 049 suites  ±0   6h 47m 37s ⏱️ +16s
 1 188 tests ±0   1 187 ✅ ±0   1 💤 ±0  0 ❌ ±0 
15 067 runs  ±0  15 052 ✅ ±0  15 💤 ±0  0 ❌ ±0 

Results for commit 94096fa. ± Comparison against base commit f3eaf06.

Copy link
Contributor

@jerqi jerqi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

@zuston zuston merged commit 7781bf6 into apache:master Jun 26, 2025
41 checks passed
@zuston zuston deleted the fixWriteTimes branch June 26, 2025 06:34
zuston added a commit to zuston/incubator-uniffle that referenced this pull request Jul 2, 2025
…y accumulated in event log (apache#2521)

### What changes were proposed in this pull request?

Shuffle write total duration is incorrectly accumulated in event log

### Why are the changes needed?

fix apache#2520

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Needn't
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Bug] Incorrect total write times in spark UI tab
2 participants