Skip to content

Commit

Permalink
Prepare for 0.5.0 release
Browse files Browse the repository at this point in the history
  • Loading branch information
oguzhanunlu committed Oct 31, 2024
1 parent 3952d13 commit 79928c7
Show file tree
Hide file tree
Showing 2 changed files with 29 additions and 5 deletions.
24 changes: 24 additions & 0 deletions CHANGELOG
Original file line number Diff line number Diff line change
@@ -1,3 +1,27 @@
Version 0.5.0 (2024-08-31)
--------------------------
Upgrade dependencies
DynamoDB runtime dependencies for Delta S3 multi-writer
PDP-1323 Handle initialization errors for GCP
PDP-1324 - Handle initialization errors for lake loader Delta Azure
Upgrade common-streams to 0.8.0-M5
Delete files asynchronously
Upgrade common-streams 0.8.0-M4
Avoid error on duplicate view name
Add option to exit on missing Iglu schemas
common-streams 0.8.x with refactored health monitoring
Create table concurrently with subscribing to stream of events
Iceberg fail fast if missing permissions on the catalog
Make alert messages more human-readable
Hudi loader should fail early if missing permissions on Glue catalog
Add alert & retry for delta/s3 initialization
Implement alerting and retrying mechanisms
Bump aws-hudi to 1.0.0-beta2
Bump hudi to 0.15.0
Allow disregarding Iglu field's nullability when creating output columns
Extend health probe to report unhealthy on more error scenarios
Fix bad rows resizing

Version 0.4.1 (2024-06-04)
--------------------------
Fix missing s3 dependency for Delta
Expand Down
10 changes: 5 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@

This project contains applications required to load Snowplow data into Open Table Formats.

Lake Loader 0.4.1 supports [Delta](https://docs.delta.io/latest/index.html), [Iceberg](https://iceberg.apache.org/docs/latest/) and [Hudi](https://hudi.apache.org/docs/overview/) as output formats.
Lake Loader 0.5.0 supports [Delta](https://docs.delta.io/latest/index.html), [Iceberg](https://iceberg.apache.org/docs/latest/) and [Hudi](https://hudi.apache.org/docs/overview/) as output formats.

Check out [the example config files](./config) for how to configure your lake loader.

Expand All @@ -22,7 +22,7 @@ Basic usage:
docker run \
-v /path/to/config.hocon:/var/config.hocon \
-v /path/to/iglu.json:/var/iglu.json \
snowplow/lake-loader-azure:0.4.1 \
snowplow/lake-loader-azure:0.5.0 \
--config /var/config.hocon \
--iglu-config /var/iglu.json
```
Expand All @@ -35,7 +35,7 @@ The GCP lake loader reads the stream of enriched events from Pubsub and writes t
docker run \
-v /path/to/config.hocon:/var/config.hocon \
-v /path/to/iglu.json:/var/iglu.json \
snowplow/lake-loader-gcp:0.4.1 \
snowplow/lake-loader-gcp:0.5.0 \
--config /var/config.hocon \
--iglu-config /var/iglu.json
```
Expand All @@ -48,7 +48,7 @@ The AWS lake loader reads the stream of enriched events from Kinesis and writes
docker run \
-v /path/to/config.hocon:/var/config.hocon \
-v /path/to/iglu.json:/var/iglu.json \
snowplow/lake-loader-aws:0.4.1 \
snowplow/lake-loader-aws:0.5.0 \
--config /var/config.hocon \
--iglu-config /var/iglu.json
```
Expand Down Expand Up @@ -79,7 +79,7 @@ Licensed under the [Snowplow Limited Use License Agreement][license]. _(If you a
[build-image]: https://github.com/snowplow-incubator/snowplow-lake-loader/workflows/CI/badge.svg
[build]: https://github.com/snowplow-incubator/snowplow-lake-loader/actions/workflows/ci.yml

[release-image]: https://img.shields.io/badge/release-0.4.1-blue.svg?style=flat
[release-image]: https://img.shields.io/badge/release-0.5.0-blue.svg?style=flat
[releases]: https://github.com/snowplow-incubator/snowplow-lake-loader/releases

[license]: https://docs.snowplow.io/limited-use-license-1.0
Expand Down

0 comments on commit 79928c7

Please sign in to comment.