Transformers still tries to use apex.amp which is no longer a thing in apex.

[yselivonchyk]

System Info

root@12bb27e08b1b:/# pip show transformers
Name: transformers
Version: 4.52.3

trainer.py contains this:

if is_apex_available():
    from apex import amp

Apex (built from source, as they recommend) does no longer come with amp.

How to reproduce?

1. install transformers
2. install apex
3. python from trl import SFTTrainer

Who can help?

No response

Information

• The official example scripts
• My own modified scripts

Tasks

• An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
• My own task or dataset (give details below)

Reproduction

How to reproduce?

1. install transformers
2. install apex
3. python from trl import SFTTrainer

Expected behavior

There should not be from apex import amp in the code base

[punitvara]

I am not from HF team. Just trying to help you. Can you share exact error message ?