Sequential Sampling

[jiosephlee]

Feature request

Add the ability to change the default sampler (which is Random) to other Samplers e.g. Sequential Sampler

Motivation

All huggingface trainers default to random sampling, and there is no way to allow sequential sampling, which is valuable when the user has a custom data curriculum, for instance.

Your contribution

Existing PR: #42265 (comment)

[ArthurZucker]

cc @SunMarc

[SunMarc]

we will most likely add an arg to have more flexibility for the sampler ! see pr