v1.11.6

What's Changed

• #592 Allow sinks depend on other sinks in #593
• #595 Locking support for delta bookkeeping in #596
• #597 Fix HadoopFs lock behavior to match other locks in #599
• #598 Add '--skip-locked' option so that already running jobs are skipped instead of error thrown in #600
• #601 Acquire lock at the start of running a job instead of just on write in #602
• Fix HadoopFs token lock behavior for DBFS filesystem in #603
• Update Scala and Spark versions in #594

Full Changelog: v1.11.5...v1.11.6

v1.11.5

What's Changed

• #583 Fix removal of shutdown hooks during shutdown causing cascade failures in #583
• #584 Add timeout for sending emails (5 minutes) in #586
• #585 Add stack traces to notifications when the code invokes System.exit() in #587
• #588 Fix SQL query for MS SQL Server when the record count of a table exceeds 2 billion in #589

Full Changelog: v1.11.4...v1.11.5

v.1.11.4

What's Changed

• #574 Pro-actively initialize JDBC driver of SparkSink when used with JDBC target in #575
• #576 Fix setting of autocommit to false is not supported by some JDBC drivers in #578
• #577 Add auto close and release to Sonatype for CI/CD releases in #579

Full Changelog: v1.11.3...v1.11.4

v.1.11.3

What's Changed

• #570 Add support for the new Cloudera Hive driver in #571
• #551 Allow specifying special characters per-source in #572

Full Changelog: v1.11.2...v1.11.3

v1.11.2

What's Changed

• #561 Fix the absence of iceberg in the HiveFormat enumeration in #563
• #562 Fix the catalog table lookup for Iceberg tables in Glue in #564
• #565 Add POM files for better integration with IDEs in #566

Full Changelog: v1.11.1...v1.11.2

v1.11.1

What's Changed

• #558 Fix iceberg format configuration parsing in #559

Full Changelog: v1.11.0...v1.11.1

v1.11.0

What's Changed

• #547 Add run date and more info in email notifications in #556

Full Changelog: v1.10.5...v1.11.0

v1.10.5

What's Changed

• #542 Add databricks driver processing in SqlGeneratorLoader and provide databricks dialect using by @ValeriiKhalimendik in #543
• #545 Add the ability to manage partitioning schemes for Delta Lake format by @yruslan in #546
• #544 Add Iceberg format support by @yruslan in #550
• #549 SparkSource datetime expressions parsing by @ValeriiKhalimendik in #553
• #552 Fix Hive DDL for tables with long descriptions with '\n' characters. by @yruslan in #554

Full Changelog: v1.10.4...v1.10.5

v1.10.4

What's Changed

• #531 Add the ability to restrict domains of emails that can be used as email recipients in #532
• #488 Make Pramen more strict on successes and failures of pipelines in #533
• corrected spelling errors by @dwfchu in #535
• #534 Allow specifying the explicit number of partitions for metastore tables in #536
• #537 Update 'kafka-clients' version and move it to 'extras', including HyperdriveNotificationTarget in #538

Full Changelog: v1.10.3...v1.10.4

v1.10.3

What's Changed

• #520 Add ability to run incremental transformers and sinks in #526

Full Changelog: v1.10.2...v1.10.3