-
Notifications
You must be signed in to change notification settings - Fork 3.8k
WIP: Dummy PR to check maint-20.0.0 status #46037
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
) ### Rationale for this change See: #46023 ### What changes are included in this PR? 1. Bumped `mathworks/libmexclass` version to git commit `2a75a5e9bbb524a044572598e371c994cc715d3d`. This version of `mathworks/libmexclass` requires CMake version `3.6.0` or later, which is compatible with CMake 4.0.0 (used by `apache/arrow`. ### Are these changes tested? Yes. 1. [Pending MATLAB CI job running in `mathworks/arrow`]( https://github.com/mathworks/arrow/actions/runs/14269264384). ### Are there any user-facing changes? Yes. 1. Users will now need CMake version `3.6.0` or later to build the MATLAB interface. ### Notes 1. Thank you @ sgilmore10 for your help with this pull request! * GitHub Issue: #46023 Authored-by: Kevin Gurney <kgurney@mathworks.com> Signed-off-by: Kevin Gurney <kgurney@mathworks.com>
### Rationale for this change reticulate may create some files in home directory. It's not desired on CRAN. ### What changes are included in this PR? Disable tests that use reticulate. ### Are these changes tested? Yes. ### Are there any user-facing changes? No. * GitHub Issue: #45714 Authored-by: Sutou Kouhei <kou@clear-code.com> Signed-off-by: Sutou Kouhei <kou@clear-code.com>
This gets rid of `OBJECT`, `DATAPTR` has been replaced with `INTEGER()`, `REAL()`, etc. though strings are more complicated. I will fully admit that this C++ is stretching my comfort zone, so might include obviously wrong things! CI is currently failing, but I'm not totally sure yet if that means the code changes here are wrong or if maybe these allow us to have slightly different assumptions about materialization (see #45951 (comment)) I've also requested reviews broadly for folks I know have been around this code before, I appreciate any effort that y'all can spare 🙏 * GitHub Issue: #45949 Lead-authored-by: Jonathan Keane <jkeane@gmail.com> Co-authored-by: Dewey Dunnington <dewey@dunnington.ca> Signed-off-by: Jonathan Keane <jkeane@gmail.com>
### Rationale for this change We need explicit upcast for `std::unique_ptr<>` with g++ 7.5.0. ### What changes are included in this PR? Add explicit upcast. ### Are these changes tested? Yes. ### Are there any user-facing changes? Yes. * GitHub Issue: #46022 Authored-by: Sutou Kouhei <kou@clear-code.com> Signed-off-by: Sutou Kouhei <kou@clear-code.com>
### Rationale for this change We always use `BoostConfig.cmake` by #45623. We don't use `FindBoost.cmake`. We need to use recent vcpkg to use `BoostConfig.cmake` because old Boost doesn't provide it. ### What changes are included in this PR? * Update `vcpkg.json` for `cpp/` and `c_glib/`. * Always use the latest vcpkg instead of using vcpkg bundled in Visual Studio. * C++: Don't use gflags for building bundled gRPC because bundled gRPC doens't use gflags. * C++: Don't define `-D*_EXPORT` macros to `Cflags.private` in `*.pc` because pkgconf 1.7.4 or later uses `--static` by default on Windows. If `--static` is used by default, `*_EXPORT`s are defined for shared linking. It causes link errors. This is a workaround of this. * FYI: pkgconf/pkgconf@008d706 * GLib: Add support for finding Apache Arrow C++ by CMake. It's another workaround for the pkgconf problem. If we use CMake, the pkgconf problem isn't related. ### Are these changes tested? Yes. ### Are there any user-facing changes? Yes. * GitHub Issue: #45994 Authored-by: Sutou Kouhei <kou@clear-code.com> Signed-off-by: Raúl Cumplido <raulcumplido@gmail.com>
Thanks for opening a pull request! If this is not a minor PR. Could you open an issue for this pull request on GitHub? https://github.com/apache/arrow/issues/new/choose Opening GitHub issues ahead of time contributes to the Openness of the Apache Arrow project. Then could you also rename the pull request title in the following format?
or
See also: |
@github-actions crossbow submit --group verify-rc-source --group packaging |
Revision: caf885b Submitted crossbow builds: ursacomputing/crossbow @ actions-7ed1a76d04 |
…alled on free-threaded Windows wheel tests (#46042) ### Rationale for this change Pandas is currently not providing nightly wheels for free-threaded wheels. It has been failing for a while on their nightly channels and built wheels have been removed. Building from source fails on our free-threaded job. In order to provide our pyarrow Windows free-threaded wheels for 20.0.0 we temporarily disable installing pandas and testing pandas on free-threaded. ### What changes are included in this PR? Temporarily disable pandas from being installed and tested on the Windows free-threaded wheel. ### Are these changes tested? Via archery ### Are there any user-facing changes? No * GitHub Issue: #46041 Authored-by: Raúl Cumplido <raulcumplido@gmail.com> Signed-off-by: Jacob Wujciak-Jens <jacob@wujciak.de>
### Rationale for this change Prevent warnings on CRAN ### What changes are included in this PR? Remove paths on windows analogous to linux. ### Are these changes tested? Yes, via winbuilder ### Are there any user-facing changes? No * GitHub Issue: #46050 Authored-by: Bryce Mecum <petridish@gmail.com> Signed-off-by: Jacob Wujciak-Jens <jacob@wujciak.de>
### Rationale for this change Keep NEWS.md in sync ### What changes are included in this PR? Update NEWS.md ### Are these changes tested? No ### Are there any user-facing changes? No * GitHub Issue: #46051 Lead-authored-by: "Bryce Mecum <petridish@gmail.com>" Co-authored-by: Jacob Wujciak-Jens <jacob@wujciak.de> Co-authored-by: Bryce Mecum <petridish@gmail.com> Signed-off-by: Jacob Wujciak-Jens <jacob@wujciak.de>
@ursabot please benchmark |
Benchmark runs are scheduled for commit e0708c7. Watch https://buildkite.com/apache-arrow and https://conbench.ursa.dev for updates. A comment will be posted here when the runs are complete. |
@github-actions crossbow submit --group packaging |
I am just triggering the above because some new nightly failures seem they might fail here too :( Just trying to validate |
Revision: e0708c7 Submitted crossbow builds: ursacomputing/crossbow @ actions-6bb0a86962 |
It seems it was either a hiccup or not happening here from the CI jobs! That's great! 👍 |
Thanks for your patience. Conbench analyzed the 4 benchmarking runs that have been run so far on PR commit e0708c7. There were 2 benchmark results indicating a performance regression:
The full Conbench report has more details. |
### Rationale for this change A Yum repository uses hash value for metadata file name. e.g.: https://apache.jfrog.io/artifactory/arrow/almalinux/9/x86_64/repodata/00965b628ce7491674b8b0e20355e2c0e81c8d57b04b7e88ac2e6777aad09472-filelists.sqlite.bz2 We can remove old metadata files when update a Yum repository's metadata. But our Artifactory/Maven repository client implementation (`dev/release/binary-task.rb`) doesn't have a complete implementation for removing existing files. But our configuration enables the feature. ### What changes are included in this PR? Disable the feature. The feature was enabled by #45903 accidentally. Old implementation disables the feature. So this doesn't change the existing behavior. (Garbage will be increased in Yum repositories...) ### Are these changes tested? Yes. ### Are there any user-facing changes? No. * GitHub Issue: #46072 Authored-by: Sutou Kouhei <kou@clear-code.com> Signed-off-by: Sutou Kouhei <kou@clear-code.com>
### Rationale for this change Flatbuffers statically requires that the version used to generate the prototypes within the code base is the same version used to compile it. A system install of Flatbuffers is therefore highly unlikely to be usable ### What changes are included in this PR? Removed the system install of Flatbuffers on macOS ### Are these changes tested? In CI ### Are there any user-facing changes? No * GitHub Issue: #46067 Authored-by: Will Ayd <william.ayd@icloud.com> Signed-off-by: Sutou Kouhei <kou@clear-code.com>
…Maven repository (#46082) ### Rationale for this change `uploaded-files.txt` is for Artifactory. Artifactory doesn't have the staging feature. So we emulate the feature by `uploaded-files.txt`. But Maven repository has the feature. So we don't need to generate `uploaded-files.txt`. ### What changes are included in this PR? Don't generate `uploaded-files.txt`. ### Are these changes tested? Yes. ### Are there any user-facing changes? No. * GitHub Issue: #46081 Authored-by: Sutou Kouhei <kou@clear-code.com> Signed-off-by: Sutou Kouhei <kou@clear-code.com>
### Rationale for this change Boost has remove their `include/boost/process/v1.hpp` ### What changes are included in this PR? Instead of using their old include file (which was a wrapper for the different includes) add the individual includes. ### Are these changes tested? Via CI. ### Are there any user-facing changes? No * GitHub Issue: #46111 Authored-by: Raúl Cumplido <raulcumplido@gmail.com> Signed-off-by: Raúl Cumplido <raulcumplido@gmail.com>
…s again (#46108) ### Rationale for this change It seems that ASF's Maven repository (Nexus 2) isn't suitable for APT/Yum repositories because it can't update existing files. We need to update existing files for APT/Yum repositories' metadata. Let's keep using Artifactory for 20.0.0. We may revisit this after 20.0.0 release. ### What changes are included in this PR? * Use Artifatory again. * Use packages.apache.org not apache.jfrog.io. ### Are these changes tested? Yes. ### Are there any user-facing changes? No. (Keep the existing URL.) * GitHub Issue: #46083 Lead-authored-by: Sutou Kouhei <kou@clear-code.com> Co-authored-by: Sutou Kouhei <kou@cozmixng.org> Co-authored-by: Jacob Wujciak-Jens <jacob@wujciak.de> Signed-off-by: Jacob Wujciak-Jens <jacob@wujciak.de>
…w` on protobuf methods to `std::string` (#46136) ### Rationale for this change Protobuf v30.2 uses `absl::string_view` instead of `const char*` as seen here: protocolbuffers/protobuf@a9ad51f This is breaking on our CI. ### What changes are included in this PR? Explicitly convert `google::protobuf::EnumValueDescriptor::name()` and `google::protobuf::Message::descriptor()->full_name()` from `absl::string_view` to `std::string` ### Are these changes tested? Via CI, MinGW CI jobs use protobuf v30.2 and those are fixed with this change. ### Are there any user-facing changes? No * GitHub Issue: #46134 Authored-by: Raúl Cumplido <raulcumplido@gmail.com> Signed-off-by: Sutou Kouhei <kou@clear-code.com>
### Rationale for this change ### What changes are included in this PR? ### Are these changes tested? ### Are there any user-facing changes? **This PR includes breaking changes to public APIs.** (If there are any breaking changes to public APIs, please explain which changes are breaking. If not, you can remove this.) **This PR contains a "Critical Fix".** (If the changes fix either (a) a security vulnerability, (b) a bug that caused incorrect or invalid data to be produced, or (c) a bug that causes a crash (even when the API contract is upheld), please provide explanation. If not, you can remove this.) * GitHub Issue: #46075 Authored-by: Jacob Wujciak-Jens <jacob@wujciak.de> Signed-off-by: Jacob Wujciak-Jens <jacob@wujciak.de>
### Rationale for this change The current bundle Google 1.11.0 was released in 2021. It's too old. ### What changes are included in this PR? Update to the latest GoogleTest: 1.16.0 ### Are these changes tested? Yes. ### Are there any user-facing changes? No. * GitHub Issue: #45986 Authored-by: Sutou Kouhei <kou@clear-code.com> Signed-off-by: Raúl Cumplido <raulcumplido@gmail.com>
### Rationale for this change R 4.5 was released, we use rel and old-rel for nightlies ### What changes are included in this PR? Update the artifacts ### Are these changes tested? Ci ### Are there any user-facing changes? New nightly binaries * GitHub Issue: #46167 Authored-by: Jacob Wujciak-Jens <jacob@wujciak.de> Signed-off-by: Jacob Wujciak-Jens <jacob@wujciak.de>
… repositories anymore (#46171) ### Rationale for this change The [debian-12-docs](https://github.com/ursacomputing/crossbow/actions/runs/14477216662/job/40605633697) are failing due to R 4.4 missing from Debian repositories and https://cloud.r-project.org/bin/linux/ubuntu/ has also updated to 4.5 ### What changes are included in this PR? Update default R version on `.env` and ARG ### Are these changes tested? Via CI (archery) ### Are there any user-facing changes? No * GitHub Issue: #46169 Authored-by: Raúl Cumplido <raulcumplido@gmail.com> Signed-off-by: Raúl Cumplido <raulcumplido@gmail.com>
…on boost 1.88 and use individual includes (#46160) ### Rationale for this change Similar to #46113 but for boost v2. The files `v1.hpp` and `v2.hpp` have been removed from `include/boost/process` on `1.88`: https://github.com/boostorg/process/tree/develop/include/boost/process but were available on `1.87`: https://github.com/boostorg/process/blob/boost-1.87.0/include/boost/process/v1.hpp https://github.com/boostorg/process/blob/boost-1.87.0/include/boost/process/v2.hpp ### What changes are included in this PR? Stop using include for possible missing file and add individual includes ### Are these changes tested? Via CI ### Are there any user-facing changes? No * GitHub Issue: #46159 Authored-by: Raúl Cumplido <raulcumplido@gmail.com> Signed-off-by: Jacob Wujciak-Jens <jacob@wujciak.de>
…t_array_internal.cc` (#46124) ### Rationale for this change Removing undefined behaviors, adding a CI job for the M1-mac sanitizer now being run. ### What changes are included in this PR? The fixes + a sanitizer job that confirms they are fixed. ### Are these changes tested? Yup! ### Are there any user-facing changes? Fewer undefined behaviors. * GitHub Issue: #46123 Lead-authored-by: Jonathan Keane <jkeane@gmail.com> Co-authored-by: Rossi Sun <zanmato1984@gmail.com> Signed-off-by: Jonathan Keane <jkeane@gmail.com>
@github-actions crossbow submit --group verify-rc-source --group packaging |
Revision: 2f82cd8 Submitted crossbow builds: ursacomputing/crossbow @ actions-479cd34113 |
### Rationale for this change Our C++ build started failing with GitHub Actions runner macos-13 ([13.7.5 (22H527)](actions/runner-images#11962)): ```text FAILED: src/arrow/CMakeFiles/arrow_util.dir/util/utf8.cc.o /usr/local/bin/ccache /usr/bin/c++ -DARROW_HAVE_RUNTIME_AVX2 -DARROW_HAVE_RUNTIME_AVX512 -DARROW_HAVE_RUNTIME_BMI2 -DARROW_HAVE_RUNTIME_SSE4_2 -DARROW_HAVE_SSE4_2 -DARROW_WITH_TIMING_TESTS -DURI_STATIC_BUILD -I/Users/runner/work/arrow/arrow/build/cpp/src -I/Users/runner/work/arrow/arrow/cpp/src -I/Users/runner/work/arrow/arrow/cpp/src/generated -isystem /usr/local/Cellar/boost/1.87.0_1/include -isystem /usr/local/Cellar/brotli/1.1.0/include -isystem /usr/local/opt/lz4/include -fno-aligned-new -Qunused-arguments -fcolor-diagnostics -Wall -Wextra -Wdocumentation -DARROW_WARN_DOCUMENTATION -Wshorten-64-to-32 -Wno-missing-braces -Wno-unused-parameter -Wno-constant-logical-operand -Wno-return-stack-address -Wdate-time -Wno-unknown-warning-option -Wno-pass-failed -msse4.2 -g -Werror -O0 -ggdb -g1 -std=c++17 -mmacosx-version-min=12 -fPIC -MD -MT src/arrow/CMakeFiles/arrow_util.dir/util/utf8.cc.o -MF src/arrow/CMakeFiles/arrow_util.dir/util/utf8.cc.o.d -o src/arrow/CMakeFiles/arrow_util.dir/util/utf8.cc.o -c /Users/runner/work/arrow/arrow/cpp/src/arrow/util/utf8.cc In file included from /Users/runner/work/arrow/arrow/cpp/src/arrow/util/utf8.cc:28: In file included from /Users/runner/work/arrow/arrow/cpp/src/arrow/util/utf8_internal.h:28: In file included from /usr/local/include/xsimd/xsimd.hpp:57: /usr/local/include/xsimd/memory/xsimd_aligned_allocator.hpp:165:15: error: parameter 'hint' not found in the function declaration [-Werror,-Wdocumentation] * @ param hint unused parameter provided for standard compliance. ^~~~ /usr/local/include/xsimd/memory/xsimd_aligned_allocator.hpp:186:15: error: parameter 'n' not found in the function declaration [-Werror,-Wdocumentation] * @ param n number of objects earlier passed to allocate(). ^ ``` It's caused by warnings in XSimd headers. (There are similar warnings in RaipdJSON headers and so on.) In general, warnings in external libraries are ignored by `-isystem`. But `-isystem /usr/local/include` isn't used in the runner. I don't know what is the cause of this behavior change in the runner update. But CMake 3.31.6 -> 4.0.0 update may be related. ### What changes are included in this PR? Disable `-Werror` because it's difficult to suppress warnings all packages installed by Homebrew. ### Are these changes tested? Yes. ### Are there any user-facing changes? No. * GitHub Issue: #46077 Authored-by: Sutou Kouhei <kou@clear-code.com> Signed-off-by: Raúl Cumplido <raulcumplido@gmail.com>
No description provided.