Skip to content

Commit 2e448d2

Browse files
committed
add compact-all to the tpch script
1 parent a88e28f commit 2e448d2

File tree

1 file changed

+8
-2
lines changed

1 file changed

+8
-2
lines changed

scripts/generate_tpch.clj

Lines changed: 8 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,8 @@
99
[xtdb.api :as xt]
1010
[xtdb.datasets.tpch :as tpch]
1111
[xtdb.node :as xtn]
12-
[xtdb.db-catalog :as db-catalog])
12+
[xtdb.db-catalog :as db-catalog]
13+
[xtdb.compactor :as compactor])
1314
(:import [xtdb.aws.s3 S3Configurator]
1415
[software.amazon.awssdk.regions Region]))
1516

@@ -38,10 +39,15 @@
3839
;; Wait for data to be ingested
3940
(Thread/sleep 5000)
4041

41-
;; Finish block to ensure all data is written
42+
;; Finish block to ensure all data is written
4243
(log/info "Calling finish-block to ensure data is persisted...")
4344
(.finishBlock (.getLogProcessor (db-catalog/primary-db node)))
4445

46+
;; Compact all data
47+
(log/info "Starting compaction...")
48+
(compactor/compact-all node nil)
49+
(log/info "Compaction complete")
50+
4551
(log/info "Dataset generation complete!"))))
4652

4753
(defn -main [& args]

0 commit comments

Comments
 (0)