Source assets going to GCS / Iceberg

[ryscheng]

What is it?

Need to explore this a bit more, but it might be the case that sending source assets to BigQuery is leading to the current BQ costs we have.
If so, it might be cheaper and more desirable to bypass BigQuery

[linear]

OSO-500 Source assets going to GCS / Iceberg

[ravenac95]

Note: https://dlthub.com/docs/dlt-ecosystem/table-formats/iceberg

Not sure if that needs an additional step to commit it to the metastore.

[ravenac95]

Oh: https://dlthub.com/docs/plus/ecosystem/iceberg it's a paid product :(

[ryscheng]

dlt+ is "coming soon"
https://dlthub.com/product/data-platform-teams

no pricing announced yet, accepting emails on a waiting list

[ravenac95]

From the dlt+ website:

Declarative yaml interfaces,

disgusting.