Skip to content

Does hls4ml currently support transform architectures? #1097

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
LmDeng0 opened this issue Oct 28, 2024 · 5 comments
Open

Does hls4ml currently support transform architectures? #1097

LmDeng0 opened this issue Oct 28, 2024 · 5 comments

Comments

@LmDeng0
Copy link

LmDeng0 commented Oct 28, 2024

Does hls4ml currently support transform architectures now?
I saw in the paper Ultra Fast Transformers on FPGAs for Particle Physics Experiments that MHA support will be made available in the near future.
@LmDeng0 LmDeng0 added the bug label Oct 28, 2024
@JanFSchulte
Copy link
Contributor

It's not available yet, we expect a pull request integrating this code in the next weeks.

@JanFSchulte JanFSchulte removed the bug label Oct 28, 2024
@LmDeng0
Copy link
Author

LmDeng0 commented Oct 28, 2024

I'm looking forward to it, thank you!

@vmayoral
Copy link

vmayoral commented Jan 7, 2025

Greetings @JanFSchulte, any chance this integration has happened already since Oct? Thanks

@ChloeCarbonniere
Copy link

Hello,

Has the integration happened since October 2024?

@bo3z
Copy link
Contributor

bo3z commented Apr 9, 2025

Some experimental support in PRs: #1163 for multi-head attention and #1110 for LayerNorm.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@vmayoral @JanFSchulte @bo3z @LmDeng0 @ChloeCarbonniere