Transformers still tries to use apex.amp which is no longer a thing in apex.

[yselivonchyk]

System Info

root@12bb27e08b1b:/# pip show transformers
Name: transformers
Version: 4.52.3

trainer.py contains this:

if is_apex_available():
    from apex import amp

Apex (built from source, as they recommend) does no longer come with amp.

How to reproduce?

1. install transformers
2. install apex
3. python from trl import SFTTrainer

Who can help?

No response

Information

• The official example scripts
• My own modified scripts

Tasks

• An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
• My own task or dataset (give details below)

Reproduction

How to reproduce?

1. install transformers
2. install apex
3. python from trl import SFTTrainer

Expected behavior

There should not be from apex import amp in the code base

[punitvara]

I am not from HF team. Just trying to help you. Can you share exact error message ?

[Rocketknight1]

cc @SunMarc since I think this is mostly in Trainer and @qgallouedec for TRL

[SunMarc]

Please download the latest version of transformers @yselivonchyk, we fixed this !

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.