Skip to content

[TASK] Investigation query96 slowness on Spark353/Delta 3.3.0 #13168

@razajafri

Description

@razajafri

When we ran nds benchmarks on Delta with scale factor 3k we found a regression

Name = query96
--
Means = 16932.6, 36346.4
Time diff = -19413.800000000003
Speedup = 0.4658673211102062
T-Test (test statistic, p value, df) = -29.462838405674567, 1.9084353438074023e-09, 8.0
T-Test Confidence Interval = -20933.283712339424, -17894.316287660582
ALERT: significant change has been detected (p-value < 0.05)
ALERT: regression in performance has been observed

This needs further investigation.

Metadata

Metadata

Assignees

No one assigned

    Labels

    taskWork required that improves the product but is not user facing

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions