Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Flash attn v2 forward #10465

Closed
wants to merge 13 commits into from
Closed

Flash attn v2 forward #10465

wants to merge 13 commits into from

Commits on Mar 25, 2024

  1. updata cmake files for flash-attention.

    @cccddd77
    cccddd77 committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    2e16534 View commit details
    Browse the repository at this point in the history

Commits on Mar 29, 2024

  1. update flash_attention.cmake

    @cccddd77
    cccddd77 committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    f8bcb78 View commit details
    Browse the repository at this point in the history

  2. add flash-attention 2 forward kernel.

    @cccddd77
    cccddd77 committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    c74d206 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'Oneflow-Inc:master' into flash_attn_v2

    @cccddd77
    cccddd77 authored Mar 29, 2024
    Configuration menu
    Copy the full SHA
    79a4e39 View commit details
    Browse the repository at this point in the history

Commits on Apr 1, 2024

  1. fix bugs.

    @cccddd77
    cccddd77 committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    60d616b View commit details
    Browse the repository at this point in the history

  2. Merge branch 'flash_attn_v2' of https://github.com/cccddd77/oneflow i… 

    …nto flash_attn_v2 for updates.
    @cccddd77
    cccddd77 committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    45f9ee0 View commit details
    Browse the repository at this point in the history

  3. format check.

    @cccddd77
    cccddd77 committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    78aa88b View commit details
    Browse the repository at this point in the history

Commits on Apr 2, 2024

  1. fix bug.

    @cccddd77
    cccddd77 committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    599f11f View commit details
    Browse the repository at this point in the history

Commits on Apr 9, 2024

  1. add output tensor for rng_state.

    @cccddd77
    cccddd77 committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    0062b64 View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2024

  1. fix typo.

    @cccddd77
    cccddd77 committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    5058ebd View commit details
    Browse the repository at this point in the history

  2. rm duplicated license.

    @cccddd77
    cccddd77 committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    7fbaf6a View commit details
    Browse the repository at this point in the history

  3. format check.

    @cccddd77
    cccddd77 committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    bb68ee1 View commit details
    Browse the repository at this point in the history

  4. cmake format.

    @cccddd77
    cccddd77 committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    996c00c View commit details
    Browse the repository at this point in the history