[REQUEST] Can deepspeed initialize multiple datasets/dataloaders?

[manyuanbin]

When I train a model, I want to evaluate the model and save ckpt at each epoch, enabling the same DP for the training dataloader and eval dataloader.

Now: DeepSpeed can only initialize the training dataset. If using the torch dataloader within the epoch, it will run duplicated.