Skip to content

Commit

Permalink
[DLight] Update Adreno GEMV Rules (#17016)
Browse files Browse the repository at this point in the history
When reduction axis is small, it's not necessary to use rfactor. This
PR updates the gemv rule to use rfactor only when the reduction axis is
large enough.
  • Loading branch information
Hzfengsy authored May 21, 2024
1 parent 3b97658 commit 2e56421
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion python/tvm/dlight/gpu/gemv.py
Original file line number Diff line number Diff line change
Expand Up @@ -711,7 +711,7 @@ def apply(
if LOAD_V_SHARED is False:
LOAD_V_TILE = 1

if not isinstance(len_r, int):
if not isinstance(len_r, int) or len_r < LOAD_V_TILE * TR * SCALE_PACK * DEC_PACK:
return None

if not isinstance(len_s, int):
Expand Down

0 comments on commit 2e56421

Please sign in to comment.