[Tests] Ensure `datasets` supports renamed repositories

[lhoestq]

On https://hf.co/datasets you can rename a dataset (or sometimes move it to another user/org). The website handles redirections correctly and AFAIK datasets does as well.

However it would be nice to have an integration test to make sure we don't break support for renamed datasets.

To implement this we can use the /api/repos/move endpoint on hub-ci to rename/move a repo (it is documented at https://huggingface.co/docs/hub/api)

[julien-c]

You could also switch to using huggingface_hub more directly, where such a guarantee is already tested =)

cc @Wauplin

[ArjunJagdale]

Hi! @lhoestq, I'd love to work on this issue as part of my ongoing contributions to datasets.

I'm planning to implement an integration test that ensures load_dataset() works even after a dataset repo is renamed or moved. I can work locally and interact with the /api/repos/move endpoint, using either huggingface_hub or requests, and will also run the test suite to validate behavior end-to-end.

Before I begin, I have two quick questions:

1. Is there a recommended test dataset or sandbox repo that I should use for safely renaming/moving during tests?
2. Do I need special permissions or tokens to use hub-ci or to move repos between users/orgs?

Once confirmed, I’ll proceed with writing and validating the test locally and open a PR soon after. Thank you!