Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove Unexecuted Hyena Code Paths #12856

Merged
merged 21 commits into from
Apr 8, 2025
Merged

Conversation

farhadrgh
Copy link
Contributor

Important

The Update branch button must only be pressed in very rare occassions.
An outdated branch is never blocking the merge of a PR.
Please reach out to the automation team before pressing that button.

What does this PR do ?

Add a one line overview of what this PR aims to accomplish.

Collection: [Note which collection this PR will affect]

Changelog

  • Add specific line by line info of high level changes in this PR.

Usage

  • You can potentially add a usage example below
# Add a code snippet demonstrating how to use this 

GitHub Actions CI

The Jenkins CI system has been replaced by GitHub Actions self-hosted runners.

The GitHub Actions CI will run automatically when the "Run CICD" label is added to the PR.
To re-run CI remove and add the label again.
To run CI on an untrusted fork, a NeMo user with write access must first click "Approve and run".

Before your PR is "Ready for review"

Pre checks:

  • Make sure you read and followed Contributor guidelines
  • Did you write any new necessary tests?
  • Did you add or update any necessary documentation?
  • Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
    • Reviewer: Does the PR have correct import guards for all optional libraries?

PR Type:

  • New Feature
  • Bugfix
  • Documentation

If you haven't finished some of the above items you can still open "Draft" PR.

Who can review?

Anyone in the community is free to review the PR once the checks have passed.
Contributor guidelines contains specific people who can review PRs to various areas.

Additional Information

  • Related to # (issue)

farhadrgh added 16 commits April 1, 2025 12:42
Signed-off-by: Farhad Ramezanghorbani <[email protected]>
Signed-off-by: Farhad Ramezanghorbani <[email protected]>
Signed-off-by: Farhad Ramezanghorbani <[email protected]>
Signed-off-by: Farhad Ramezanghorbani <[email protected]>
Signed-off-by: Farhad Ramezanghorbani <[email protected]>
Signed-off-by: Farhad Ramezanghorbani <[email protected]>
Signed-off-by: Farhad Ramezanghorbani <[email protected]>
Signed-off-by: Farhad Ramezanghorbani <[email protected]>
Signed-off-by: Farhad Ramezanghorbani <[email protected]>
Signed-off-by: Farhad Ramezanghorbani <[email protected]>
Signed-off-by: Farhad Ramezanghorbani <[email protected]>
Signed-off-by: Farhad Ramezanghorbani <[email protected]>
Signed-off-by: Farhad Ramezanghorbani <[email protected]>
Signed-off-by: Farhad Ramezanghorbani <[email protected]>
Signed-off-by: Farhad Ramezanghorbani <[email protected]>
Signed-off-by: Farhad Ramezanghorbani <[email protected]>
@jstjohn jstjohn requested review from JRD971000 and jstjohn April 2, 2025 16:32
jstjohn
jstjohn previously approved these changes Apr 2, 2025
Copy link
Collaborator

@jstjohn jstjohn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please post output from bionemo tests showing that those pass with these changes. Otherwise thanks for removing so much dead code!

@moradza
Copy link

moradza commented Apr 2, 2025

LGTM, dead code is dead!

Signed-off-by: Farhad Ramezanghorbani <[email protected]>
farhadrgh and others added 4 commits April 2, 2025 11:59
Signed-off-by: Farhad Ramezanghorbani <[email protected]>
Signed-off-by: Farhad Ramezanghorbani <[email protected]>
@JRD971000 JRD971000 merged commit 5786ad3 into NVIDIA:main Apr 8, 2025
252 of 440 checks passed
jomitchellnv pushed a commit to jomitchellnv/NeMo that referenced this pull request Apr 8, 2025
* drop multihead_forward

Signed-off-by: Farhad Ramezanghorbani <[email protected]>

* drop multihead_forward

Signed-off-by: Farhad Ramezanghorbani <[email protected]>

* drop flashfft

Signed-off-by: Farhad Ramezanghorbani <[email protected]>

* drop use_long_conv1d

Signed-off-by: Farhad Ramezanghorbani <[email protected]>

* drop cgcg

Signed-off-by: Farhad Ramezanghorbani <[email protected]>

* drop custom hyena mlp/short conv kernels

Signed-off-by: Farhad Ramezanghorbani <[email protected]>

* drop downsampling

Signed-off-by: Farhad Ramezanghorbani <[email protected]>

* drop unused is_mlp path

Signed-off-by: Farhad Ramezanghorbani <[email protected]>

* improve make_upper_case

Signed-off-by: Farhad Ramezanghorbani <[email protected]>

* remove unused configs

Signed-off-by: Farhad Ramezanghorbani <[email protected]>

* switch to inplace

Signed-off-by: Farhad Ramezanghorbani <[email protected]>

* consolidate fp8 logic

Signed-off-by: Farhad Ramezanghorbani <[email protected]>

* doc str

Signed-off-by: Farhad Ramezanghorbani <[email protected]>

* rm douplicate import

Signed-off-by: Farhad Ramezanghorbani <[email protected]>

* fix linting issues

Signed-off-by: Farhad Ramezanghorbani <[email protected]>

* drop unnecessary rearrange

Signed-off-by: Farhad Ramezanghorbani <[email protected]>

* reduce rearrange overhead

Signed-off-by: Farhad Ramezanghorbani <[email protected]>

* Apply isort and black reformatting

Signed-off-by: farhadrgh <[email protected]>

* make flake8 happy

Signed-off-by: Farhad Ramezanghorbani <[email protected]>

---------

Signed-off-by: Farhad Ramezanghorbani <[email protected]>
Signed-off-by: farhadrgh <[email protected]>
Signed-off-by: Jonathan Mitchell <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants