Skip to content

Commit 458c7de

Browse files
xrennvidiaptrendx
authored andcommitted
Fix CP unit test on A100 and L40s (#1211)
skip FP8 CP tests if hardware does not support FP8 Signed-off-by: Xiaowei Ren <[email protected]>
1 parent c328071 commit 458c7de

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

tests/pytorch/fused_attn/test_fused_attn_with_cp.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -112,6 +112,8 @@ def test_cp_with_fused_attention(dtype, model, qkv_format, cp_comm_type):
112112
pytest.skip("THD format is only supported on sm90+!")
113113
if cp_comm_type == "all_gather" and get_cudnn_version() < (9, 3, 0):
114114
pytest.skip("CP implementation with KV all-gather is only supported with cuDNN >= 9.3.0!")
115+
if dtype == "fp8" and get_device_compute_capability() < (9, 0):
116+
pytest.skip("FP8 attention is only supported on sm90+!")
115117

116118
config = model_configs_fused_attn[model]
117119
if qkv_format == "thd" and config.num_heads != config.num_gqa_groups:

0 commit comments

Comments
 (0)