Skip to content

[SPARK-51949][CONNECT] Bump up the default value of CONNECT_GRPC_MARSHALLER_RECURSION_LIMIT #50756

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

vicennial
Copy link
Contributor

What changes were proposed in this pull request?

Bump the default value of CONNECT_GRPC_MARSHALLER_RECURSION_LIMIT from 1024 to 4096.

Why are the changes needed?

To aid plugin development. We have seen in our prod environment that 1024 can be insufficient when processing complex queries.

Does this PR introduce any user-facing change?

Yes. Nested gRPC messages deeper than 1024 depth and up to 4096 depth can now be processed without explicitly/manually tuning the config.

How was this patch tested?

Was this patch authored or co-authored using generative AI tooling?

@vicennial vicennial marked this pull request as draft April 29, 2025 20:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant