Skip to content

Commit 79928c7

Browse files
committed
Prepare for 0.5.0 release
1 parent 3952d13 commit 79928c7

File tree

2 files changed

+29
-5
lines changed

2 files changed

+29
-5
lines changed

CHANGELOG

Lines changed: 24 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,27 @@
1+
Version 0.5.0 (2024-08-31)
2+
--------------------------
3+
Upgrade dependencies
4+
DynamoDB runtime dependencies for Delta S3 multi-writer
5+
PDP-1323 Handle initialization errors for GCP
6+
PDP-1324 - Handle initialization errors for lake loader Delta Azure
7+
Upgrade common-streams to 0.8.0-M5
8+
Delete files asynchronously
9+
Upgrade common-streams 0.8.0-M4
10+
Avoid error on duplicate view name
11+
Add option to exit on missing Iglu schemas
12+
common-streams 0.8.x with refactored health monitoring
13+
Create table concurrently with subscribing to stream of events
14+
Iceberg fail fast if missing permissions on the catalog
15+
Make alert messages more human-readable
16+
Hudi loader should fail early if missing permissions on Glue catalog
17+
Add alert & retry for delta/s3 initialization
18+
Implement alerting and retrying mechanisms
19+
Bump aws-hudi to 1.0.0-beta2
20+
Bump hudi to 0.15.0
21+
Allow disregarding Iglu field's nullability when creating output columns
22+
Extend health probe to report unhealthy on more error scenarios
23+
Fix bad rows resizing
24+
125
Version 0.4.1 (2024-06-04)
226
--------------------------
327
Fix missing s3 dependency for Delta

README.md

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@
88

99
This project contains applications required to load Snowplow data into Open Table Formats.
1010

11-
Lake Loader 0.4.1 supports [Delta](https://docs.delta.io/latest/index.html), [Iceberg](https://iceberg.apache.org/docs/latest/) and [Hudi](https://hudi.apache.org/docs/overview/) as output formats.
11+
Lake Loader 0.5.0 supports [Delta](https://docs.delta.io/latest/index.html), [Iceberg](https://iceberg.apache.org/docs/latest/) and [Hudi](https://hudi.apache.org/docs/overview/) as output formats.
1212

1313
Check out [the example config files](./config) for how to configure your lake loader.
1414

@@ -22,7 +22,7 @@ Basic usage:
2222
docker run \
2323
-v /path/to/config.hocon:/var/config.hocon \
2424
-v /path/to/iglu.json:/var/iglu.json \
25-
snowplow/lake-loader-azure:0.4.1 \
25+
snowplow/lake-loader-azure:0.5.0 \
2626
--config /var/config.hocon \
2727
--iglu-config /var/iglu.json
2828
```
@@ -35,7 +35,7 @@ The GCP lake loader reads the stream of enriched events from Pubsub and writes t
3535
docker run \
3636
-v /path/to/config.hocon:/var/config.hocon \
3737
-v /path/to/iglu.json:/var/iglu.json \
38-
snowplow/lake-loader-gcp:0.4.1 \
38+
snowplow/lake-loader-gcp:0.5.0 \
3939
--config /var/config.hocon \
4040
--iglu-config /var/iglu.json
4141
```
@@ -48,7 +48,7 @@ The AWS lake loader reads the stream of enriched events from Kinesis and writes
4848
docker run \
4949
-v /path/to/config.hocon:/var/config.hocon \
5050
-v /path/to/iglu.json:/var/iglu.json \
51-
snowplow/lake-loader-aws:0.4.1 \
51+
snowplow/lake-loader-aws:0.5.0 \
5252
--config /var/config.hocon \
5353
--iglu-config /var/iglu.json
5454
```
@@ -79,7 +79,7 @@ Licensed under the [Snowplow Limited Use License Agreement][license]. _(If you a
7979
[build-image]: https://github.com/snowplow-incubator/snowplow-lake-loader/workflows/CI/badge.svg
8080
[build]: https://github.com/snowplow-incubator/snowplow-lake-loader/actions/workflows/ci.yml
8181

82-
[release-image]: https://img.shields.io/badge/release-0.4.1-blue.svg?style=flat
82+
[release-image]: https://img.shields.io/badge/release-0.5.0-blue.svg?style=flat
8383
[releases]: https://github.com/snowplow-incubator/snowplow-lake-loader/releases
8484

8585
[license]: https://docs.snowplow.io/limited-use-license-1.0

0 commit comments

Comments
 (0)