Skip to content

[Parquet] Support version in ParquetObjectReader #8568

@yeya24

Description

@yeya24

Is your feature request related to a problem or challenge? Please describe what you are trying to do.

I want to use ParquetObjectReader

ParquetObjectReader::new(store, meta.location).with_file_size(meta.size);
to read an S3 object with a specific version. This is not possible with the ParquetObjectReader implementation today.

Describe the solution you'd like

In ParquetObjectReader, add a new version field and a new with_version method. Change the AsyncFileReader and MetadataSuffixFetch implementation to use get_opts with version if version is specified.

Describe alternatives you've considered

Alternative is to maintain a ParquetObjectReader implementation that supports object version in our implementation.

Additional context

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementAny new improvement worthy of a entry in the changelog

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions