Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

lots of efforts to accelerate training #391

Open
wants to merge 30 commits into
base: main
Choose a base branch
from
Open

lots of efforts to accelerate training #391

wants to merge 30 commits into from
+1,639 −275

Commits on Feb 15, 2024

  1. Fix allocation query for decoding images

    Wu, Jiantao (PG/R - Comp Sci & Elec Eng) committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    e094b6d View commit details
    Browse the repository at this point in the history

  2. update useful tools

    Wu, Jiantao (PG/R - Comp Sci & Elec Eng) committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    b3e86c9 View commit details
    Browse the repository at this point in the history

Commits on Feb 24, 2024

  1. add im crop_resize decode to avoid decode the whole images

    @erow
    erow committed Feb 24, 2024
    Configuration menu
    Copy the full SHA
    5c4f9cb View commit details
    Browse the repository at this point in the history

  2. remove crop for resize

    @erow
    erow committed Feb 24, 2024
    Configuration menu
    Copy the full SHA
    37ac528 View commit details
    Browse the repository at this point in the history

Commits on Feb 25, 2024

  1. use "crop region" instead of transform in libffcv.py

    @erow
    erow committed Feb 25, 2024
    Configuration menu
    Copy the full SHA
    94f3a0b View commit details
    Browse the repository at this point in the history

  2. Update dependencies and improve image encoding

    @erow
    erow committed Feb 25, 2024
    Configuration menu
    Copy the full SHA
    d9d3e82 View commit details
    Browse the repository at this point in the history

Commits on Feb 28, 2024

  1. add compile pipelines for Loader

    Wu, Jiantao (PG/R - Comp Sci & Elec Eng) committed Feb 28, 2024
    Configuration menu
    Copy the full SHA
    aeee936 View commit details
    Browse the repository at this point in the history

Commits on Mar 3, 2024

  1. support changing pipeline

    @erow
    erow committed Mar 3, 2024
    Configuration menu
    Copy the full SHA
    de4964b View commit details
    Browse the repository at this point in the history

Commits on Mar 17, 2024

  1. Support more cache manager: Shared Momory

    @erow
    erow committed Mar 17, 2024
    Configuration menu
    Copy the full SHA
    02b525b View commit details
    Browse the repository at this point in the history

  2. Fix shared memory management and add libbuffer module

    @erow
    erow committed Mar 17, 2024
    Configuration menu
    Copy the full SHA
    98c38fc View commit details
    Browse the repository at this point in the history

  3. Add libbuffer.cpp to the project

    @erow
    erow committed Mar 17, 2024
    Configuration menu
    Copy the full SHA
    5a28c0b View commit details
    Browse the repository at this point in the history

Commits on Mar 18, 2024

  1. v1.1.1 for shared memory

    @erow
    erow committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    232e0d5 View commit details
    Browse the repository at this point in the history

Commits on Mar 19, 2024

  1. support png

    @erow
    erow committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    59a2f0a View commit details
    Browse the repository at this point in the history

Commits on Apr 4, 2024

  1. remove raise for enabling paralle

    Jiantao Wu committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    5fee1f6 View commit details
    Browse the repository at this point in the history

  2. fix field mode

    @erow
    erow committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    378e3b9 View commit details
    Browse the repository at this point in the history

Commits on Apr 20, 2024

  1. fix the warn of parallel=True

    @erow
    erow committed Apr 20, 2024
    Configuration menu
    Copy the full SHA
    189880a View commit details
    Browse the repository at this point in the history

Commits on May 9, 2024

  1. fix not a supported order type

    @erow
    erow committed May 9, 2024
    Configuration menu
    Copy the full SHA
    95ed764 View commit details
    Browse the repository at this point in the history

Commits on May 19, 2024

  1. fix bugs in benchmark; reduce the memory usage for imcropdecode

    @erow
    erow committed May 19, 2024
    Configuration menu
    Copy the full SHA
    3847b50 View commit details
    Browse the repository at this point in the history

  2. fix wrong attribution: use_ffcv

    @erow
    erow committed May 19, 2024
    Configuration menu
    Copy the full SHA
    db675a6 View commit details
    Browse the repository at this point in the history

  3. log memory for benchmark

    @erow
    erow committed May 19, 2024
    Configuration menu
    Copy the full SHA
    649f1b5 View commit details
    Browse the repository at this point in the history

Commits on May 20, 2024

  1. feat: Add script to write dataset with configurable options

    @erow
    erow committed May 20, 2024
    Configuration menu
    Copy the full SHA
    436242b View commit details
    Browse the repository at this point in the history

Commits on May 21, 2024

  1. Refactor shared memory initialization in SharedMemoryContext

    @erow
    erow committed May 21, 2024
    Configuration menu
    Copy the full SHA
    2592e25 View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2024

  1. fix cache

    @erow
    erow committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    77b5cb3 View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2024

  1. better print for shared_cache

    @erow
    erow committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    d6a061b View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2024

  1. use float32 for color jitter

    @erow
    erow committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    54ab9e0 View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2024

  1. add transformations

    @erow
    erow committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    26c06d2 View commit details
    Browse the repository at this point in the history

Commits on Jun 16, 2024

  1. fix error for SharedMemoryContext

    @erow
    erow committed Jun 16, 2024
    Configuration menu
    Copy the full SHA
    41ec8e4 View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2024

  1. benchmark

    Wu, Jiantao (PG/R - Comp Sci & Elec Eng) committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    feb400a View commit details
    Browse the repository at this point in the history

  2. update comparison

    Wu, Jiantao (PG/R - Comp Sci & Elec Eng) committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    f51bb71 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' of https://github.com/erow/ffcv

    Wu, Jiantao (PG/R - Comp Sci & Elec Eng) committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    a56ae3f View commit details
    Browse the repository at this point in the history