Skip to content

CI fails: TypeError: RLOOTrainer._get_per_token_logps_and_entropies() got an unexpected keyword argument 'token_type_ids' #4150

@albertvillanova

Description

@albertvillanova

CI fails for all tests using tiny-Gemma3ForConditionalGeneration: https://github.com/huggingface/trl/actions/runs/18026398970/job/51294192894

TypeError: RLOOTrainer._get_per_token_logps_and_entropies() got an unexpected keyword argument 'token_type_ids'
FAILED tests/test_rloo_trainer.py::RLOOTrainerTester::test_training_vlm_0_trl_internal_testing_tiny_Gemma3ForConditionalGeneration - TypeError: _get_per_token_logps_and_entropies() got an unexpected keyword argument 'token_type_ids'
= 1 failed, 912 passed, 58 skipped, 3 xfailed, 142 warnings, 7 rerun in 815.53s (0:13:35) =

Metadata

Metadata

Labels

🏋 RLOORelated to RLOO🐛 bugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions