Limit stats parsing to stats required to resolve a query #4015
Description
Is your feature request related to a problem?
Currently stats parsing is a source of some redundant work as delta kernel internally parses the stats field as well as us since the parsed stats are (not yet) exposed for engines to consume as well. This can be a significant performance overhead we want to avoid.
Describe the solution you'd like
Make stats parsing more selective to only the fields (if any) required to execute a given query.
Describe alternatives you've considered
No response
Priority
High - Important for my use case
Additional context
No response
Contribution
- I'm willing to submit a pull request for this feature
- I can help with testing this feature
- I can help with documentation for this feature