Skip to content

Document: support iceberg on azure blob #407

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 3 commits into
base: main
Choose a base branch
from
Open

Conversation

WanYixian
Copy link
Collaborator

@WanYixian WanYixian commented Apr 24, 2025

Description

Support iceberg sink and iceberg source on azure blob.

Hi @wcy-fdu, @chenzl25, I just added doc about supporting iceberg source and source on Azblob, and wanna double check if we support iceberg table engine on azblob? That is to say, if we support the syntax like the following

CREATE CONNECTION public.conn WITH (
   type = 'iceberg',
   catalog.type = 'rest',
   catalog.uri = 'http://localhost:8181/catalog',
   warehouse.path = 'azblob://my-container/demo',
   azblob.container_name = 'my-container',
   azblob.credentials.account_name = '<account>',
   azblob.credentials.account_key = '<key>',
   azblob.endpoint_url = 'https://<account>.blob.core.windows.net/',
   catalog.name = 'demo'
);

Currently, I didn't find azblob-related params here. Any comments are welcome!

Related code PR:

risingwavelabs/iceberg-rust#45
risingwavelabs/risingwave#21468

Related doc issue:

Fix #402

Comment on lines +107 to +109
azblob.container_name = 'xxx',
azblob.credentials.account_name = 'xxx',
azblob.credentials.account_key = 'xxx',

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

cc @wcy-fdu The keys seem to be inconsistent with the code. I think it should be azblob.account_name, azblob.account_key and no azblob.container_name
#[serde(rename = "azblob.account_name")]
pub azblob_account_name: Option,
#[serde(rename = "azblob.account_key")]
pub azblob_account_key: Option,
#[serde(rename = "azblob.endpoint_url")]
pub azblob_endpoint_url: Option,

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Document: feat(iceberg): support iceberg on azure blob
2 participants