Skip to content

Conversation

@jatinkumarsingh
Copy link

Add section explaining Profile Guided Optimization can provide up to 25% performance improvements. Includes three-stage build process instructions and tips for effective PGO usage. References issue #9507.

Which issue does this PR close?

Closes #9561

Rationale for this change

Adds documentation for Profile Guided Optimization (PGO) as requested. PGO can provide up to 25% performance improvements for DataFusion workloads, and users need clear guidance on how to use it.

What changes are included in this PR?

  • Added "Profile Guided Optimization (PGO)" section to docs/source/user-guide/crate-configuration.md
  • Three-stage build process instructions (instrumentation, profiling, recompilation)
  • Tips for effective PGO usage (representative workloads, multiple iterations, combining with other optimizations)
  • Links to Rust compiler guide and issue Profile-Guided Optimization (PGO) benchmark results #9507

Are these changes tested?

Yes. Documentation changes are validated by the CI workflow which builds the docs and checks for errors. The markdown syntax is valid and follows existing patterns.

Are there any user-facing changes?

Yes. This adds documentation that will be published on the DataFusion website under "Crate Configuration" > "Optimizing Builds". Users will find guidance on using PGO to improve performance.

@github-actions github-actions bot added the documentation Improvements or additions to documentation label Nov 27, 2025
@jatinkumarsingh
Copy link
Author

jatinkumarsingh commented Nov 27, 2025

@alamb
sir i have raised the pr with the changes required
plzzz have a look on my pr
thnku

Add section explaining Profile Guided Optimization can provide up to 25% performance improvements. Includes build process instructions and tips for effective PGO usage. References issue apache#9507.
@2010YOUY01
Copy link
Contributor

Thank you, this is great.

I'm not familiar with this topic, so I'm adding a question that I think would be helpful to address:

I remember some previous discussions where we decided not to use PGO for release binaries, but I can’t recall the reason. I think @alamb knows it.

@jatinkumarsingh
Copy link
Author

@2010YOUY01
Sir, thank you.
Could you please go through the PR?
My merge is currently blocked and it will only open once a reviewer with write access approves it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add a section to the documentation explaining that PGO can help up substantially (25%) and maybe offer some tips for users to use it?

2 participants