You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi, thanks for your work, it is a really useful tool! Unfortunately, when using it to download datasets from Zenodo that contain several (small) files, Zenodo receives too many requests and stops the download. This can be easily solved, for instance, by adding a random sleep in the for loop for downloading the remote datasets, and this is what I did in my fork of your project in this commit. If you think it can be a useful feature and you agree in the way I implemented it I can add an ad-hoc test and create a pull request to your repository, or alternatively search for a better solution. Thanks for your help!
The text was updated successfully, but these errors were encountered:
Hi @d-consoli, thanks for suggestion! Surely it is a useful feature. For another project I developed a similar code in the past, which waits for a random time period and does this in a loop, so that if the waiting time is not sufficient it waits for a longer time until the file becomes available or a maximum number of tries is reached. I can add it to the store method. Meanwhile please feel free to create a pull request for your solution if you wish.
Hi, thanks for your work, it is a really useful tool! Unfortunately, when using it to download datasets from Zenodo that contain several (small) files, Zenodo receives too many requests and stops the download. This can be easily solved, for instance, by adding a random sleep in the for loop for downloading the remote datasets, and this is what I did in my fork of your project in this commit. If you think it can be a useful feature and you agree in the way I implemented it I can add an ad-hoc test and create a pull request to your repository, or alternatively search for a better solution. Thanks for your help!
The text was updated successfully, but these errors were encountered: