Rollout Scheduling

[HCookie]

Our current rollout implementation is very focused on sequential epoch increments, it would be good to generalise this to provide schedulers to control rollout.

Work was done in aifs-mono to enable this. here
I think this can be generalised and provide more general applicability.

Features

Below is a list of features and requirements as I see them

• Epoch Step rollout
• Static Rollout
• Upon hitting a threshold begin another strategy
• Random selection of rollout between bounds
• Dynamic selection of increments

Questions

• Will the rollout only change between epochs? Could within an epoch it change?

What other features may be needed?

Discussion of #145

Points raised in Issue

• Step based dynamic rollout
• Useful for auto training and changing rollout at 200,000 steps