Skip to content

chore: update to DataFusion 49.0.0 #3603

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

alamb
Copy link
Contributor

@alamb alamb commented Jul 18, 2025

@github-actions github-actions bot added the binding/rust Issues for the Rust crate label Jul 18, 2025
Copy link

ACTION NEEDED

delta-rs follows the Conventional Commits specification for release automation.

The PR title and description are used as the merge commit message. Please update your PR title and description to match the specification.

@alamb alamb force-pushed the alamb/update_datafusion_49 branch from 5e5b545 to 01834d7 Compare July 18, 2025 20:04
@alamb alamb changed the title chore: Update to DataFusion 49.0.0 chore: update to DataFusion 49.0.0 Jul 18, 2025
Copy link

codecov bot commented Jul 20, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 20.69%. Comparing base (6a4f249) to head (01834d7).
Report is 3 commits behind head on main.

❗ There is a different number of reports uploaded between BASE (6a4f249) and HEAD (01834d7). Click for more details.

HEAD has 4 uploads less than BASE
Flag BASE (6a4f249) HEAD (01834d7)
6 2
Additional details and impacted files
@@             Coverage Diff             @@
##             main    #3603       +/-   ##
===========================================
- Coverage   74.50%   20.69%   -53.82%     
===========================================
  Files         146       76       -70     
  Lines       44876    13270    -31606     
  Branches    44876    13270    -31606     
===========================================
- Hits        33437     2746    -30691     
- Misses       9248    10243      +995     
+ Partials     2191      281     -1910     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@alamb
Copy link
Contributor Author

alamb commented Jul 21, 2025

I also updated the version of rust used due to a failing CI

https://github.com/delta-io/delta-rs/actions/runs/16379330458/job/46335659927?pr=3603

error: rustc 1.82.0 is not supported by the following packages:
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
  [email protected] requires rustc 1.85.1
Either upgrade rustc or select compatible dependency versions with
`cargo update <name>@<current-ver> --precise <compatible-ver>`
where `<compatible-ver>` is the latest version supporting rustc 1.82.0

error: process didn't exit successfully: `/home/runner/.rustup/toolchains/1.82-x86_64-unknown-linux-gnu/bin/cargo test --tests --manifest-path /home/runner/work/delta-rs/delta-rs/Cargo.toml --target-dir /home/runner/work/delta-rs/delta-rs/target/llvm-cov-target --features integration_test,azure,datafusion,s3,gcs,glue,hdfs --workspace --exclude delta-inspect --exclude deltalake-hdfs --exclude deltalake-lakefs` (exit status: 101)

This came in as part of

I think it deserves a mention in the upgrade guide. I will do so

@ion-elgreco
Copy link
Collaborator

@alamb we pinned the aws sdk libraries actually so that we didn't have to bump our rustc version

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
binding/rust Issues for the Rust crate
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants