Youtube HTTP Error 429: Too Many Requests. IP/Profile-block makes it impossible to download the dataset ?

[Lucas Chaumeny]

Hello,

When trying to download the videos referenced in the csv files of the dataset, I got the following error from Youtube:

ERROR: Unable to download webpage: HTTP Error 429: Too Many Requests

It occured after having launched a test download routine of a few thousand samples using the youtube-dl package.

It now also occurs using the audiosetdl python script, on the very first request.

This problem seems to have come up since Youtube/Google have updated their restrictions. The official Youtube API does not provide content download.

Is it still possible to download this dataset ?

 

Has anyone found a way around this ?

Is it maybe necessary to request a whitelist IP from Youtube if that is even possible ?

Thanks a lot for your help!

Lucas

[Lucas Chaumeny]

Hello,

I feel like I have tried every possible approach to this problem like reducing the frequency of the download calls, passing cookies or http headers to the requests...

Can anyone help me out ? How did everyone download this dataset ?

Does someone know how the authors of this paper downloaded the dataset ?

Thank you in advance.

Lucas