Skip to content

Add ORC support to GCSToBigQueryOperator and test for external tables #49188

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Apr 14, 2025

Conversation

Shashwatpandey4
Copy link
Contributor

This PR adds support for the ORC source format to the GCSToBigQueryOperator.

Changes

  • Updated GCSToBigQueryOperator to accept source_format="ORC"
  • Added a unit test to validate ORC format works with external tables

This closes: #48624

Checklist

  • Code change includes tests
  • Verified DAG parsing and task execution locally
  • Added test: test_external_table_should_accept_orc_source_format

Copy link
Contributor

@bugraoz93 bugraoz93 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the new PR! Let's wait CI to be green

@bugraoz93 bugraoz93 force-pushed the feature/orc-support branch from d919324 to 72bdcab Compare April 14, 2025 20:56
@bugraoz93 bugraoz93 merged commit 18c99df into apache:main Apr 14, 2025
58 checks passed
Copy link

boring-cyborg bot commented Apr 14, 2025

Awesome work, congrats on your first merged pull request! You are invited to check our Issue Tracker for additional contributions.

@bugraoz93
Copy link
Contributor

Congratulations, @Shashwatpandey4!

@Shashwatpandey4
Copy link
Contributor Author

Thanks a lot @bugraoz93 🙌

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:providers provider:google Google (including GCP) related issues
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Support for ORC in GCSToBigQueryOperator
3 participants