Download error in some videos

[gur...@gmail.com]

Hi All,

Is it just me or other also not able to download some of the videos. 

Error shown is "Sign required to download this video".

I am using https://github.com/activitynet/ActivityNet/tree/master/Crawler to fetch the videos.

Thanks,

Gurkirt

[gur...@gmail.com]

I error like below.

ERROR: 81LATpIw6zE: YouTube said: Please sign in to view this video.

[youtube] Po8gmt7hVTY: Downloading webpage

[youtube] Po8gmt7hVTY: Downloading video info webpage

ERROR: Po8gmt7hVTY: YouTube said: This video contains content from Channel 4, who has blocked it in your country on copyright grounds.

[youtube] _z3MXy3Wc-k: Downloading webpage

[youtube] _z3MXy3Wc-k: Downloading embed webpage

[youtube] _z3MXy3Wc-k: Refetching age-gated info webpage

ERROR: _z3MXy3Wc-k: YouTube said: Please sign in to view this video.

[youtube] T60xwc6nKJI: Downloading webpage

[youtube] T60xwc6nKJI: Downloading video info webpage

ERROR: T60xwc6nKJI: YouTube said: This video is no longer available because the YouTube account associated with this video has been terminated.

[youtube] JFYuFs_akM4: Downloading webpage

[youtube] JFYuFs_akM4: Downloading video info webpage

ERROR: JFYuFs_akM4: YouTube said: This video does not exist.

[youtube] fxgbk_Kk4Rw: Downloading webpage

[youtube] fxgbk_Kk4Rw: Downloading video info webpage

ERROR: fxgbk_Kk4Rw: YouTube said: This video does not exist.

[youtube] PVdd6E1S0Yc: Downloading webpage

[youtube] PVdd6E1S0Yc: Downloading video info webpage

ERROR: PVdd6E1S0Yc: YouTube said: This video does not exist.

[youtube] 2JyEK7sKsrY: Downloading webpage

[youtube] 2JyEK7sKsrY: Downloading video info webpage

ERROR: 2JyEK7sKsrY: YouTube said: This video does not exist.

[youtube] Dl0JNkGbZT4: Downloading webpage

[youtube] Dl0JNkGbZT4: Downloading embed webpage

[youtube] Dl0JNkGbZT4: Refetching age-gated info webpage

ERROR: Dl0JNkGbZT4: YouTube said: Please sign in to view this video.

[youtube] a2JBhm22-M4: Downloading webpage

[youtube] a2JBhm22-M4: Downloading video info webpage

ERROR: a2JBhm22-M4: YouTube said: "Emilie Le Pennec UB 200..."

The YouTube account associated with this video has been terminated due to multiple third-party notifications of copyright infringement.

[youtube] PplBDkLlpEw: Downloading webpage

[youtube] PplBDkLlpEw: Downloading video info webpage

ERROR: PplBDkLlpEw: YouTube said: This video does not exist.

[youtube] yPsEMk0KMp4: Downloading webpage

[youtube] yPsEMk0KMp4: Downloading embed webpage

[youtube] yPsEMk0KMp4: Refetching age-gated info webpage

ERROR: yPsEMk0KMp4: YouTube said: Please sign in to view this video.

[youtube] IssfjAvSwo0: Downloading webpage

[youtube] IssfjAvSwo0: Downloading embed webpage

[youtube] IssfjAvSwo0: Refetching age-gated info webpage

ERROR: IssfjAvSwo0: YouTube said: Please sign in to view this video.

[youtube] jCVi9xt3GUY: Downloading webpage

[youtube] jCVi9xt3GUY: Downloading embed webpage

[youtube] jCVi9xt3GUY: Refetching age-gated info webpage

ERROR: jCVi9xt3GUY: YouTube said: Please sign in to view this video.

[youtube] boWMu522Pfc: Downloading webpage

[youtube] boWMu522Pfc: Downloading embed webpage

[youtube] boWMu522Pfc: Refetching age-gated info webpage

ERROR: boWMu522Pfc: YouTube said: Please sign in to view this video.

Thanks

G.

[Fabian Caba]

Hi Gurkirt,

I am going to detail each of the errors that occurs in your sample log:

Geo-Blocking restrictions:

   - Example video: Po8gmt7hVTY

   - Problem: The video is blocked in the country where you are trying to retrieve it.

   - Solution:  Use a VPN to bypass the Geo-Locking restriction.

Removed videos (Copyright + deleted)

   - Example video: 2JyEK7sKsrY

   - Problem: Video was removed from YouTube

   - Solution: Those videos will be removed at evaluation time (see our evaluation scripts). So, the performance of your method won't be affected is there is no prediction on those videos.

Age restricted videos

   - Example video: _z3MXy3Wc-k

   - Problem: The video is blocked due to sensible content.

   - Solution: A possible solution is described here (You will need to provide a YouTube username & password when calling youtube-dl). We will try to incorporate this feature to the provided scripts.

I hope this help you, and stay tuned for future versions of the Crawler code.

Best regards,

Fabian

. 

[gur...@gmail.com]

Thanks Fabian,

it might be good idea to remove th evideos at evaluation time using one class named something like 'VidoeNotFoundAtSource'.

Then evaluation script can ignore that video. 

Thanks,

G.

[1505...@brookes.ac.uk]

Hi Fabian,

I am able to download most of the dataset videos. There 216 videis which gave youtube-dl error. Most of the error were either video is private or video/account are removed. One can not view or download videos even if you provide username and password. 

Here is the file with name of videos and crosponfinf youtube-dl download command. https://drive.google.com/a/brookes.ac.uk/file/d/0B214BMF-jSGsRDZuM2g1Vi1xVUk/view?usp=sharing

Also there are some(very few) videos are blocked in UK. I tried VPN using location as India but didn't work. Is it possible to get a proxy link can be used to download videos. One will just need to add  --proxy <link> to youtube-dl to download those videos.

Or just add videoNotFound class in evealuation script.

Many Thanks

Gurkirt

On Monday, 18 April 2016 16:19:37 UTC+1, Fabian Caba wrote:

[Fabian Caba]

Hi Gurkirt,

Regarding the private/removed videos, our evaluation server is skipping them at testing time. You can check the videoIDs that are been discarded in the following url: http://ec2-52-11-11-89.us-west-2.compute.amazonaws.com/challenge16/api.py?action=get_blocked

The proxy link is a good idea, we will try to provide that service in the future. Meanwhile, could you send me a text file containing the videoIDs that are blocked in UK?

Best,

Fabian

--
You received this message because you are subscribed to the Google Groups "ActivityNet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to activity-net...@googlegroups.com.
To post to this group, send email to activi...@googlegroups.com.
Visit this group at https://groups.google.com/group/activity-net.

To view this discussion on the web visit https://groups.google.com/d/msgid/activity-net/bb19f778-e6c4-47fa-aa1a-4b75c6638e49%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Fabian Caba Heilbron

Research Assistant in Computer Vision

Geometric Modeling and Scientific Visualization Center

King Abdullah University of Science and Technology

Al Khawarizmi Building (Bldg 1). Thuwal, Kingdom of Saudi Arabia