Version bump to 6.6.0 and doc change

Author: rueiyhuang

CHANGELOG

@@ -16,6 +16,28 @@
 
 # spark-redshift Changelog
 
+## 6.6.0 (2026-1-15)
+- Support for Apache Spark 4.0.0, which includes Scala 2.13 as its bundled Scala version [Ruei-Yang Huang]
+- Updated deprecated syntax and APIs for compatibility with Scala 2.13 [Ruei-Yang Huang]
+- Added retry logic for DataAPI throttling exceptions (e.g., ThrottlingException), automatically retrying affected operations with configurable backoff strategies to improve resilience during rate-limited scenarios [Ruei-Yang Huang]
+
+## 6.5.1 (2025-11-17)
+- Excluded unused dependency jackson-mapper-asl dependency due to CVEs [Luis Garza]
+- Upgraded Apache Spark dependency to version 3.5.7 [Luis Garza]
+- Upgraded to JDBC version 2.2.0 [Luis Garza]
+
+## 6.5.0 (2025-10-08)
+- Upgraded to AWS SDK v2 [Luis Garza]
+- Improved AWS credentials handling by deferring credential resolution until actually needed [Luis Garza]
+- Fixed string comparison in integration tests to handle cross-platform line ending differences [Luis Garza]
+
+## 6.4.3 (2025-07-01)
+- Upgraded Apache Spark dependency to version 3.5.6 [Luis Garza]
+- Upgraded to JDBC version 2.1.0.33 [Luis Garza]
+- Upgraded sbt build tool to version 1.11.2 [Ruei-Yang Huang]
+- Updated Sonatype publishing from OSSRH to Central Publisher Portal [Ruei-Yang Huang]
+- Fixed getDefaultRegion handling to return null on exceptions, aligning with AWS SDK behavior [Ruei-Yang Huang]
+
 ## 6.4.2 (2025-04-09)
 - Add spark configurations for enforcing secure JDBC connections and usage of aws_iam_role for authorizing Redshift COPY/UNLOAD operations.
 - Verified the connector is compatible with the latest Spark patch release 3.5.5.

README.md

@@ -105,7 +105,7 @@ You may use this library in your applications with the following dependency info
     spark-submit \
       --deploy-mode cluster \
       --master yarn \
-      --packages com.amazon.redshift:redshift-jdbc42:2.2.0,org.apache.spark:spark-avro_2.12:3.5.7,io.github.spark-redshift-community:spark-redshift_2.12:6.5.1-spark_3.5 \
+      --packages com.amazon.redshift:redshift-jdbc42:2.2.0,org.apache.spark:spark-avro_2.12:3.5.7,io.github.spark-redshift-community:spark-redshift_2.12:6.6.0-spark_4.0 \
       my_script.py
     ```
 
@@ -116,14 +116,14 @@ You may use this library in your applications with the following dependency info
     <dependency>
         <groupId>io.github.spark-redshift-community</groupId>
         <artifactId>spark-redshift_2.12</artifactId>
-        <version>6.5.1-spark_3.5</version>
+        <version>6.6.0-spark_4.0</version>
     </dependency>
     ```
 
 - **In SBT**:
 
     ```SBT
-    libraryDependencies += "io.github.spark-redshift-community" %% "spark-redshift_2.12" % "6.5.1-spark_3.5"
+    libraryDependencies += "io.github.spark-redshift-community" %% "spark-redshift_2.12" % "6.6.0-spark_4.0"
     ```
 
 ### Local builds
@@ -132,7 +132,7 @@ You may also build the connector locally by following the below steps.
 2. Install Java 1.8
 3. Install scala (https://www.scala-lang.org/download/)
 4. Install sbt (https://www.scala-sbt.org/download/)
-5. Modify the value `sparkVersion` within `build.sbt` to the target version of Spark. The connector supports Spark 3.3.x, 3.4.x, and 3.5.x
+5. Modify the value `sparkVersion` within `build.sbt` to the target version of Spark. The connector supports Spark 3.3.x, 3.4.x, 3.5.x, and 4.0.x
 6. Build the connector `sbt clean package`
 7. The jar file can be found in `target\scala-2.12\`
 
@@ -901,7 +901,7 @@ for more information.</p>
     <td>""</td>
     <td>
         An identifier to include in the query group set when running queries with the connector. Should be 100 or fewer characters and all characters must be valid unicodeIdentifierParts. Characters in excess of 100 will be trimmed.
-        When running a query with the connector a json formatted string will be set as the query group (for example `{"spark-redshift-connector":{"svc":"","ver":"6.5.1-spark_3.5","op":"Read","lbl":"","tid":""}}`). 
+        When running a query with the connector a json formatted string will be set as the query group (for example `{"spark-redshift-connector":{"svc":"","ver":"6.6.0-spark_4.0","op":"Read","lbl":"","tid":""}}`). 
         This option will be substituted for the value of the `lbl` key.
     </td>
 </tr>
@@ -1074,7 +1074,7 @@ var sparkConf = new SparkConf().set("spark.datasource.redshift.community.reject_
 ### trace_id
 A new tracing identifier field that is added to the existing `label` parameter. When set, the provided string value will be used as part of label. Otherwise, it will default to the Spark application identifier. For example:
 
-`{"spark-redshift-connector":{"svc":"","ver":"6.5.1-spark_3.5","op":"Read","lbl":"","tid":"..."}}`)
+`{"spark-redshift-connector":{"svc":"","ver":"6.6.0-spark_4.0","op":"Read","lbl":"","tid":"..."}}`)
 
 To set the value, run the following command:
 ```sparksql

version.sbt

@@ -14,4 +14,4 @@
  * limitations under the License.
  */
 
-ThisBuild / version := "6.5.1"
+ThisBuild / version := "6.6.0"