Skip to content

Commit 5f7997f

Browse files
committed
feat: add minValues and maxValues support to StatisticsCollector
- Add min/max tracking for all supported types - Primitive types (int8-64, uint8-64, float32/64) - Date, timestamp with all time units - Decimal128 - String types with truncation to 32 chars - Merge min/max across multiple batches - Tests for min/max across single and multiple batches
1 parent de88cb2 commit 5f7997f

File tree

2 files changed

+529
-4
lines changed

2 files changed

+529
-4
lines changed

kernel/Cargo.toml

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -65,6 +65,8 @@ tokio = { version = "1.47", optional = true, features = ["rt-multi-thread"] }
6565
# both arrow versions below are optional and require object_store
6666
object_store = { version = "0.12.3", optional = true, features = ["aws", "azure", "gcp", "http"] }
6767
comfy-table = { version = "7.1", optional = true }
68+
# used for Float trait in stats computation
69+
num-traits = { version = "0.2", optional = true }
6870

6971
# arrow 56
7072
[dependencies.arrow_56]
@@ -118,6 +120,7 @@ default-engine-base = [
118120
"arrow-expression",
119121
"futures",
120122
"need-arrow",
123+
"num-traits",
121124
"tokio",
122125
]
123126
# the default-engine-native-tls use the reqwest crate with default features which uses native-tls. if you want

0 commit comments

Comments
 (0)