Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Optionally write version 2 page headers in Parquet writer #13751

Merged
merged 36 commits into from
Aug 15, 2023
Merged

Optionally write version 2 page headers in Parquet writer #13751

merged 36 commits into from
Aug 15, 2023

Commits on Jul 24, 2023

  1. first pass with hardcoded v2, no compression

    @etseidl
    etseidl committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    0d24ec9 View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2023

  1. compression seems to work now...disable some tests

    @etseidl
    etseidl committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    fe6d34d View commit details
    Browse the repository at this point in the history

  2. add write_v2_headers to options...still need to fix tests

    @etseidl
    etseidl committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    dc56e24 View commit details
    Browse the repository at this point in the history

  3. add v2 page header

    @etseidl
    etseidl committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    cd28d08 View commit details
    Browse the repository at this point in the history

  4. start adding v2 tests

    @etseidl
    etseidl committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    268b39f View commit details
    Browse the repository at this point in the history

  5. add v2 to options (forgot header)

    @etseidl
    etseidl committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    8916b71 View commit details
    Browse the repository at this point in the history

  6. fix v2 header reader and add more tests

    @etseidl
    etseidl committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    e1b4632 View commit details
    Browse the repository at this point in the history

  7. move null counting to value encoding

    @etseidl
    etseidl committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    792077e View commit details
    Browse the repository at this point in the history

  8. add test of struct with nulls

    @etseidl
    etseidl committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    f4586d5 View commit details
    Browse the repository at this point in the history

  9. a few cleanups

    @etseidl
    etseidl committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    4ac47b6 View commit details
    Browse the repository at this point in the history

  10. Merge branch 'branch-23.10' into feature/write_v2_header

    @etseidl
    etseidl authored Jul 25, 2023
    Configuration menu
    Copy the full SHA
    a027d69 View commit details
    Browse the repository at this point in the history

  11. a few more cleanups

    @etseidl
    etseidl committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    9d67c68 View commit details
    Browse the repository at this point in the history

  12. formatting

    @etseidl
    etseidl committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    cadcfe6 View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2023

  1. Merge branch 'branch-23.10' into feature/write_v2_header

    @etseidl
    etseidl authored Jul 26, 2023
    Configuration menu
    Copy the full SHA
    e638f2d View commit details
    Browse the repository at this point in the history

  2. Merge branch 'branch-23.10' into feature/write_v2_header

    @etseidl
    etseidl authored Jul 26, 2023
    Configuration menu
    Copy the full SHA
    dc172fc View commit details
    Browse the repository at this point in the history

  3. simplify num_valid check

    @etseidl
    etseidl committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    e618a44 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'branch-23.10' into feature/write_v2_header

    @etseidl
    etseidl authored Jul 26, 2023
    Configuration menu
    Copy the full SHA
    b8a119c View commit details
    Browse the repository at this point in the history

Commits on Jul 28, 2023

  1. Merge branch 'branch-23.10' into feature/write_v2_header

    @etseidl
    etseidl authored Jul 28, 2023
    Configuration menu
    Copy the full SHA
    92095d7 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'branch-23.10' into feature/write_v2_header

    @etseidl
    etseidl authored Jul 28, 2023
    Configuration menu
    Copy the full SHA
    7ca5524 View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2023

  1. Merge branch 'rapidsai:branch-23.10' into feature/write_v2_header

    @etseidl
    etseidl authored Jul 31, 2023
    Configuration menu
    Copy the full SHA
    64cab8d View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2023

  1. Merge branch 'rapidsai:branch-23.10' into feature/write_v2_header

    @etseidl
    etseidl authored Aug 1, 2023
    Configuration menu
    Copy the full SHA
    a8e7da7 View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2023

  1. Merge branch 'branch-23.10' into feature/write_v2_header

    @etseidl
    etseidl authored Aug 2, 2023
    Configuration menu
    Copy the full SHA
    345da7c View commit details
    Browse the repository at this point in the history

Commits on Aug 3, 2023

  1. Merge branch 'branch-23.10' into feature/write_v2_header

    @etseidl
    etseidl authored Aug 3, 2023
    Configuration menu
    Copy the full SHA
    118ff3e View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2023

  1. Merge branch 'rapidsai:branch-23.10' into feature/write_v2_header

    @etseidl
    etseidl authored Aug 4, 2023
    Configuration menu
    Copy the full SHA
    0341856 View commit details
    Browse the repository at this point in the history

  2. move builder function implementations to functions.cpp

    @etseidl
    etseidl committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    7b84849 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'feature/write_v2_header' of github.com:etseidl/cudf int… 

    …o feature/write_v2_header
    @etseidl
    etseidl committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    98060ed View commit details
    Browse the repository at this point in the history

  4. Merge branch 'rapidsai:branch-23.10' into feature/write_v2_header

    @etseidl
    etseidl authored Aug 4, 2023
    Configuration menu
    Copy the full SHA
    4a5fe3f View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2023

  1. Merge branch 'branch-23.10' into feature/write_v2_header

    @vuule
    vuule authored Aug 7, 2023
    Configuration menu
    Copy the full SHA
    28bce4d View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2023

  1. Merge branch 'rapidsai:branch-23.10' into feature/write_v2_header

    @etseidl
    etseidl authored Aug 9, 2023
    Configuration menu
    Copy the full SHA
    2929b21 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'rapidsai:branch-23.10' into feature/write_v2_header

    @etseidl
    etseidl authored Aug 9, 2023
    Configuration menu
    Copy the full SHA
    133ed61 View commit details
    Browse the repository at this point in the history

Commits on Aug 11, 2023

  1. rename offset per review suggestion

    @etseidl
    etseidl committed Aug 11, 2023
    Configuration menu
    Copy the full SHA
    ca86cb9 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'branch-23.10' into feature/write_v2_header

    @etseidl
    etseidl authored Aug 11, 2023
    Configuration menu
    Copy the full SHA
    49653f9 View commit details
    Browse the repository at this point in the history

  3. implement suggestion from review 

    Co-authored-by: Nghia Truong <[email protected]>
    @etseidl @ttnghia
    etseidl and ttnghia authored Aug 11, 2023
    Configuration menu
    Copy the full SHA
    d19f20f View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2023

  1. Merge branch 'rapidsai:branch-23.10' into feature/write_v2_header

    @etseidl
    etseidl authored Aug 14, 2023
    Configuration menu
    Copy the full SHA
    88bfcc8 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'branch-23.10' into feature/write_v2_header

    @etseidl
    etseidl authored Aug 14, 2023
    Configuration menu
    Copy the full SHA
    ba38a9f View commit details
    Browse the repository at this point in the history

Commits on Aug 15, 2023

  1. Merge branch 'rapidsai:branch-23.10' into feature/write_v2_header

    @etseidl
    etseidl authored Aug 15, 2023
    Configuration menu
    Copy the full SHA
    a3159d4 View commit details
    Browse the repository at this point in the history