4.54.0 bug: ImportError: cannot import name 'deterministic_g' from 'transformers.modeling_flash_attention_utils'

[georgethrax]

System Info

4.54.0 bug: ImportError: cannot import name 'deterministic_g' from 'transformers.modeling_flash_attention_utils'
4.53.3: import success
@ArthurZucker

Who can help?

No response

Information

• The official example scripts
• My own modified scripts

Tasks

• An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
• My own task or dataset (give details below)

Reproduction

1. pip install transformers=4.54.0
2. from transformers.modeling_flash_attention_utils import deterministic_g

Expected behavior

raise exception:

ImportError: cannot import name 'deterministic_g' from 'transformers.modeling_flash_attention_utils'

[georgethrax]

pip install transformers -U
python -c "import transformers; print(transformers.__version__); from transformers.modeling_flash_attention_utils import deterministic_g; print(deterministic_g)"
## 4.54.0
## Traceback (most recent call last):
##   File "<string>", line 1, in <module>
## ImportError: cannot import name 'deterministic_g' from 'transformers.modeling_flash_attention_utils' (/usr/local/lib/python3.10/dist-packages/transformers/modeling_flash_attention_utils.py)

pip install transformers==4.53.3
## 4.53.3
## None

[kadirnar]

@georgethrax This might have been done to make it more readable instead of being an error.

https://github.com/huggingface/transformers/blob/main/src/transformers/modeling_flash_attention_utils.py#L388

If you think this is a mistake, a correction like this could be made.
https://github.com/huggingface/transformers/pull/37185/files