Skip to content

Issues: NVIDIA/FasterTransformer

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

249 Open 376 Closed
249 Open 376 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Can FasterTransformer support SAM2 ( Meta segment anything model 2)?
#795 opened Sep 5, 2024 by jackwei86
How to implement a gemm with FP16 and INT4 using kernel in FasterTransformer/src/fastertransformer/kernels/cutlass_kernels/fpA_intB_gemm
#794 opened Jul 26, 2024 by AkatsukiChiri
An error occurred for the specific cuda version bug Something isn't working
#793 opened May 8, 2024 by CSLiuPeng
can be used in diffusion models,like sd and sdxl? how?where is the demos?tks bug Something isn't working
#792 opened Apr 24, 2024 by henbucuoshanghai
bug: memory of position_encoding_table is not malloced correctly. bug Something isn't working
#790 opened Mar 27, 2024 by johnson-magic
1
How to know the correspondence between versions vcr.io/nvidia/pytorch:xx.xx-py3 and pytorch?
#788 opened Feb 29, 2024 by johnson-magic
what is the mean of EFF-FT?
#787 opened Feb 29, 2024 by johnson-magic
Are fuseQKV masked attention and Flash Attention the same?
#786 opened Feb 4, 2024 by likejazz
on H800 can not exec nvidia/pytorch:23.09-py3 container success
#784 opened Dec 29, 2023 by chenglinjun
Confidence is not returned in the decoding example？ bug Something isn't working
#783 opened Dec 26, 2023 by liuzhuang1024
Does FasterTransformer support multi-stream pipeline parallelism ?
#781 opened Nov 21, 2023 by FlyingPotatoZ
error You need C++17 to compile PyTorch bug Something isn't working
#779 opened Nov 7, 2023 by ranggihwang
can support decoder only bart? such as MBartForCausalLM
#778 opened Nov 3, 2023 by sjtu-cz
Sparsity support bug Something isn't working
#775 opened Oct 29, 2023 by zhang662817
How to get started?
#774 opened Oct 28, 2023 by turbobuilt
Is llama2 70b supported? Do you know minimal configuration?
#771 opened Oct 23, 2023 by ChristineSeven
1
Supporting for expert parallelism in MoE inference
#769 opened Oct 19, 2023 by iteratorlee
Whether fastertransformer supports gpt-2 classification model, such as GPT2ForSequenceClassification？
#768 opened Oct 19, 2023 by cabbagetalk
cuSPARSELt is slower?
#767 opened Oct 16, 2023 by BDHU
1
Incorrect inline ptx device assembly code usage bug Something isn't working
#766 opened Oct 13, 2023 by zhiweij1
CUDA code compile error with clang: function template partial specialization is not allowed bug Something isn't working
#765 opened Oct 12, 2023 by zhiweij1
How to calculate local batch size?
#764 opened Oct 11, 2023 by fotstrt
src/fastertransformer/kernels/decoder_masked_multihead_attention /decoder_masked_multihead_attention_template.hpp:36 open this macro definition, it'll find a build error bug Something isn't working
#763 opened Oct 11, 2023 by pengl
terminate called after throwing an instance of 'std::runtime_error'
#761 opened Sep 19, 2023 by HalFTeen
fastertransformer/utils/nccl_utils.cc:62 'unhandled cuda error' bug Something isn't working
#760 opened Sep 14, 2023 by wangweiwei1188
ProTip! Follow long discussions with comments:>50.