Skip to content

Commit 2a46133

Browse files
authored
Update CHANGELOG for 6.4.0 release.
1 parent cc77ad9 commit 2a46133

File tree

1 file changed

+14
-0
lines changed

1 file changed

+14
-0
lines changed

CHANGELOG

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -16,6 +16,20 @@
1616

1717
# spark-redshift Changelog
1818

19+
## 6.4.0 (2024-12-02)
20+
- Supports utilizing the Redshift Data API as an alternative mechanism for communicating with Redshift (see parameters "data_api_*" in the README). [Beaux Sharifi]
21+
- Adds DML pushdown support for four Spark SQL operators: INSERT, DELETE, UPDATE, and MERGE. [Hari Kishore Chaparala, Ruei Yang Huang, Xiaoxuan Li, Beaux Sharifi, Brooke White]
22+
- Adds new pushdown support for the following Spark operators: LocalRelation, CreateNamedStruct, Intersect, and Except [Hari Kishore Chaparala, Xiaoxuan Li, Beaux Sharifi]
23+
- Enhances InSubQuery pushdown to support multiple values. [Beaux Sharifi]
24+
- Adds pushdown support for join conditions [Beaux Sharifi, Brooke White]
25+
- Adds sub-field pushdown support to child scalar subqueries. [Beaux Sharifi]
26+
- Converts left semi and left anti joins into intersect and except set operations in some conditions to improve pushdown performance. [Hari Kishore Chaparala]
27+
- Reverses readSidePadding Spark optimization rule to improve pushdown performance. [Atul Payapilly]
28+
- Adds parameter "check_s3_bucket_usage" for disabling S3 bucket checks during operation to reduce network calls. [Armin Najafi]
29+
- Abbreviates generated pushdown SQL for accommodating Redshift Data API’s smaller maximum query length. [Jack Ye]
30+
- Strengthens logic for detecting and preventing cross-cluster pushdowns. [Beaux Sharifi]
31+
- Validates connector tests pass with the latest Spark patch releases 3.3.4, 3.4.4, and 3.5.3 [Beaux Sharifi]
32+
1933
## 6.3.0 (2024-07-03)
2034
- Validates connector tests pass with Spark releases 3.4.3 and 3.5.1 [Beaux Sharifi]
2135
- Adds support for three-part table names to allow connector to query Redshift data sharing tables (#153) [Prashant Singh, Beaux Sharifi]

0 commit comments

Comments
 (0)