Google Groups no longer supports new Usenet posts or subscriptions. Historical content remains viewable.
Dismiss
Bug#987226: youtube-dl: ERROR: Unable to extract yt initial data
1,169 views
Skip to first unread message
Mike Gabriel
Apr 19, 2021, 5:50:03 PM4/19/21
to
Package: youtube-dl
Severity: grave
Version: 2021.02.10-1
Dear maintainer,
when trying out youtube-dl from Debian testing (aka bullseye) I get
this error for simple video or playlist based downloads:
ERROR: Unable to extract yt initial data; please report this issue on
https://yt-dl.org/bug . Make sure you are using the latest version;
see https://yt-dl.org/update on how to update. Be sure to call
youtube-dl with the --verbose flag and include its complete output.
E.g. for a playlist:
```
[sunweaver@sunobo New-Song]$ youtube-dl --verbose --extract-audio
--audio-format mp3 -o "%(title)s.%(ext)s" "<playlist-url>"
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--verbose', '--extract-audio',
'--audio-format', 'mp3', '-o', '%(title)s.%(ext)s', '<playlist-url>']
[debug] Encodings: locale UTF-8, fs utf-8, out utf-8, pref UTF-8
[debug] youtube-dl version 2021.02.10
[debug] Python version 3.9.2 (CPython) -
Linux-5.10.0-5-amd64-x86_64-with-glibc2.31
[debug] exe versions: ffmpeg 4.3.2-0, ffprobe 4.3.2-0, rtmpdump 2.4
[debug] Proxy map: {}
[youtube:tab] OLAK5uy_m3-t4xLGBOHujynldlI3w-3Qp0WU62EAo: Downloading webpage
ERROR: Unable to extract yt initial data; please report this issue on
https://yt-dl.org/bug . Make sure you are using the latest version;
see https://yt-dl.org/update on how to update. Be sure to call
youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/youtube_dl/YoutubeDL.py", line
806, in wrapper
return func(self, *args, **kwargs)
File "/usr/lib/python3/dist-packages/youtube_dl/YoutubeDL.py", line
827, in __extract_info
ie_result = ie.extract(url)
File
"/usr/lib/python3/dist-packages/youtube_dl/extractor/common.py", line
532, in extract
ie_result = self._real_extract(url)
File
"/usr/lib/python3/dist-packages/youtube_dl/extractor/youtube.py", line
2647, in _real_extract
data = self._extract_yt_initial_data(item_id, webpage)
File
"/usr/lib/python3/dist-packages/youtube_dl/extractor/youtube.py", line
283, in _extract_yt_initial_data
self._search_regex(
File
"/usr/lib/python3/dist-packages/youtube_dl/extractor/common.py", line
1010, in _search_regex
raise RegexNotFoundError('Unable to extract %s' % _name)
youtube_dl.utils.RegexNotFoundError: Unable to extract yt initial
data; please report this issue on https://yt-dl.org/bug . Make sure
you are using the latest version; see https://yt-dl.org/update on
how to update. Be sure to call youtube-dl with the --verbose flag and
include its complete output.
```
I then tried the latest youtube-dl release (2021-04-17) and all my
download test succeed.
Unfortunately, that youtube-dl version contains tons of fixes and
changes, so it may be a challenge enrolling the release team into
allowing an upstream version bump here.
Unfortunately, I currently lack time for diving into this and finding
the exact commit that fixes the above issue.
Greets,
Mike
--
DAS-NETZWERKTEAM
c\o Technik- und Ökologiezentrum Eckernförde
Mike Gabriel, Marienthaler Str. 17, 24340 Eckernförde
mobile: +49 (1520) 1976 148
landline: +49 (4351) 850 8940
GnuPG Fingerprint: 9BFB AEE8 6C0A A5FF BF22 0782 9AF4 6B30 2577 1B31
mail: mike.g...@das-netzwerkteam.de, http://das-netzwerkteam.de
Severity: grave
Version: 2021.02.10-1
Dear maintainer,
when trying out youtube-dl from Debian testing (aka bullseye) I get
this error for simple video or playlist based downloads:
ERROR: Unable to extract yt initial data; please report this issue on
https://yt-dl.org/bug . Make sure you are using the latest version;
see https://yt-dl.org/update on how to update. Be sure to call
youtube-dl with the --verbose flag and include its complete output.
E.g. for a playlist:
```
[sunweaver@sunobo New-Song]$ youtube-dl --verbose --extract-audio
--audio-format mp3 -o "%(title)s.%(ext)s" "<playlist-url>"
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--verbose', '--extract-audio',
'--audio-format', 'mp3', '-o', '%(title)s.%(ext)s', '<playlist-url>']
[debug] Encodings: locale UTF-8, fs utf-8, out utf-8, pref UTF-8
[debug] youtube-dl version 2021.02.10
[debug] Python version 3.9.2 (CPython) -
Linux-5.10.0-5-amd64-x86_64-with-glibc2.31
[debug] exe versions: ffmpeg 4.3.2-0, ffprobe 4.3.2-0, rtmpdump 2.4
[debug] Proxy map: {}
[youtube:tab] OLAK5uy_m3-t4xLGBOHujynldlI3w-3Qp0WU62EAo: Downloading webpage
ERROR: Unable to extract yt initial data; please report this issue on
https://yt-dl.org/bug . Make sure you are using the latest version;
see https://yt-dl.org/update on how to update. Be sure to call
youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/youtube_dl/YoutubeDL.py", line
806, in wrapper
return func(self, *args, **kwargs)
File "/usr/lib/python3/dist-packages/youtube_dl/YoutubeDL.py", line
827, in __extract_info
ie_result = ie.extract(url)
File
"/usr/lib/python3/dist-packages/youtube_dl/extractor/common.py", line
532, in extract
ie_result = self._real_extract(url)
File
"/usr/lib/python3/dist-packages/youtube_dl/extractor/youtube.py", line
2647, in _real_extract
data = self._extract_yt_initial_data(item_id, webpage)
File
"/usr/lib/python3/dist-packages/youtube_dl/extractor/youtube.py", line
283, in _extract_yt_initial_data
self._search_regex(
File
"/usr/lib/python3/dist-packages/youtube_dl/extractor/common.py", line
1010, in _search_regex
raise RegexNotFoundError('Unable to extract %s' % _name)
youtube_dl.utils.RegexNotFoundError: Unable to extract yt initial
data; please report this issue on https://yt-dl.org/bug . Make sure
you are using the latest version; see https://yt-dl.org/update on
how to update. Be sure to call youtube-dl with the --verbose flag and
include its complete output.
```
I then tried the latest youtube-dl release (2021-04-17) and all my
download test succeed.
Unfortunately, that youtube-dl version contains tons of fixes and
changes, so it may be a challenge enrolling the release team into
allowing an upstream version bump here.
Unfortunately, I currently lack time for diving into this and finding
the exact commit that fixes the above issue.
Greets,
Mike
--
DAS-NETZWERKTEAM
c\o Technik- und Ökologiezentrum Eckernförde
Mike Gabriel, Marienthaler Str. 17, 24340 Eckernförde
mobile: +49 (1520) 1976 148
landline: +49 (4351) 850 8940
GnuPG Fingerprint: 9BFB AEE8 6C0A A5FF BF22 0782 9AF4 6B30 2577 1B31
mail: mike.g...@das-netzwerkteam.de, http://das-netzwerkteam.de
Mike Gabriel
Apr 20, 2021, 3:30:03 PM4/20/21
to
Hi Holger,
On Di 20 Apr 2021 16:17:21 CEST, Holger Levsen wrote:
> control: severity -1 important
> thanks
Debatable...
> hi Mike,
>
> On Mon, Apr 19, 2021 at 09:39:55PM +0000, Mike Gabriel wrote:
>> Package: youtube-dl
>> Severity: grave
>
> you didn't really describe why you thought the severity should be grave,
> but anyway:
>
> $ youtube-dl https://twitter.com/zemodancingto/status/1381937205787172867#m
> [twitter] 1381937205787172867: Downloading guest token
> [twitter] 1381937205787172867: Downloading JSON metadata
> [twitter] 1381937205787172867: Downloading m3u8 information
> [download] Destination: zemo dancing to - Rick Astley - Never Gonna
> Give You Up-1381937205787172867.mp4
> [download] 100% of 3.00MiB in 00:01
> $
>
> so this clearly shows the package isn't broken for everyone.
Hmm, so rename src:pkg to twitter-dl? (Kidding...) Youtube downloads
are broken these days, at least. For a tool being named after Youtube,
this surely is a bad thing to have in upcoming Debian stable.
On Di 20 Apr 2021 16:17:21 CEST, Holger Levsen wrote:
> control: severity -1 important
> thanks
Debatable...
> hi Mike,
>
> On Mon, Apr 19, 2021 at 09:39:55PM +0000, Mike Gabriel wrote:
>> Package: youtube-dl
>> Severity: grave
>
> you didn't really describe why you thought the severity should be grave,
> but anyway:
>
> $ youtube-dl https://twitter.com/zemodancingto/status/1381937205787172867#m
> [twitter] 1381937205787172867: Downloading guest token
> [twitter] 1381937205787172867: Downloading JSON metadata
> [twitter] 1381937205787172867: Downloading m3u8 information
> [download] Destination: zemo dancing to - Rick Astley - Never Gonna
> Give You Up-1381937205787172867.mp4
> [download] 100% of 3.00MiB in 00:01
> $
>
> so this clearly shows the package isn't broken for everyone.
Hmm, so rename src:pkg to twitter-dl? (Kidding...) Youtube downloads
are broken these days, at least. For a tool being named after Youtube,
this surely is a bad thing to have in upcoming Debian stable.
Holger Levsen
Apr 20, 2021, 7:10:03 PM4/20/21
to
Dear Mike,
On Tue, Apr 20, 2021 at 07:23:48PM +0000, Mike Gabriel wrote:
> > control: severity -1 important
> Debatable...
quoting https://www.debian.org/Bugs/Developer#severities
grave
makes the package in question unusable or mostly so, or causes data loss, or introduces a security hole allowing access to the accounts of users who use the package.
important
a bug which has a major effect on the usability of a package, without rendering it completely unusable to everyone.
this bug *might* be *serious*, but certainly not *grave*.
> Hmm, so rename src:pkg to twitter-dl? (Kidding...) Youtube downloads are
> broken these days, at least. For a tool being named after Youtube, this
> surely is a bad thing to have in upcoming Debian stable.
$ apt-cache show youtube-dl|wc -l
1165
now please read the output of "apt-cache show youtube-dl|less".
yes, the software is badly named.
--
cheers,
Holger
⢀⣴⠾⠻⢶⣦⠀
⣾⠁⢠⠒⠀⣿⡁ holger@(debian|reproducible-builds|layer-acht).org
⢿⡄⠘⠷⠚⠋⠀ OpenPGP: B8BF54137B09D35CF026FE9D 091AB856069AAA1C
⠈⠳⣄
In Germany we don‘t say „Happy Valentine‘s Day, I love you“, we say „ich werde
diesen vom Markt kreierten, konsumorientierten Trend des Kapitalismus nicht
unterstützen,“ and I think that’s beautiful. (Hazel Brugger)
On Tue, Apr 20, 2021 at 07:23:48PM +0000, Mike Gabriel wrote:
> > control: severity -1 important
quoting https://www.debian.org/Bugs/Developer#severities
grave
makes the package in question unusable or mostly so, or causes data loss, or introduces a security hole allowing access to the accounts of users who use the package.
important
a bug which has a major effect on the usability of a package, without rendering it completely unusable to everyone.
this bug *might* be *serious*, but certainly not *grave*.
> Hmm, so rename src:pkg to twitter-dl? (Kidding...) Youtube downloads are
> broken these days, at least. For a tool being named after Youtube, this
> surely is a bad thing to have in upcoming Debian stable.
1165
now please read the output of "apt-cache show youtube-dl|less".
yes, the software is badly named.
--
cheers,
Holger
⢀⣴⠾⠻⢶⣦⠀
⣾⠁⢠⠒⠀⣿⡁ holger@(debian|reproducible-builds|layer-acht).org
⢿⡄⠘⠷⠚⠋⠀ OpenPGP: B8BF54137B09D35CF026FE9D 091AB856069AAA1C
⠈⠳⣄
In Germany we don‘t say „Happy Valentine‘s Day, I love you“, we say „ich werde
diesen vom Markt kreierten, konsumorientierten Trend des Kapitalismus nicht
unterstützen,“ and I think that’s beautiful. (Hazel Brugger)
Thorsten Glaser
Jul 6, 2021, 3:30:04 PM7/6/21
to
found 987226 2021.02.10-2
thanks
Andreas Tille dixit:
>Could you please give some example to reproduce the bug? When asking
This is… indeed tricky… I tried a couple URLs but they work;
I don’t have a viewing history though. The example from Mike’s
bug still fails, though:
tglase@tglase-nb:/tmp $ youtube-dl -f 18 OLAK5uy_m3-t4xLGBOHujynldlI3w-3Qp0WU62EAo
[youtube:tab] playlist New Song: Downloading 11 videos
[download] Downloading video 1 of 11
[youtube] P8kTNCUzC1g: Downloading webpage
[youtube] P8kTNCUzC1g: Downloading player 7acefd5d
^C
ERROR: Interrupted by user
Second one (Youtube-dl with capital Y) is the upstream binary, patched
to have python3 in the shebang, shown to prove they fixed it later on.
I aborted it because I’m not interested in downloading that actually ☺
bye,
//mirabilos
--
Gestern Nacht ist mein IRC-Netzwerk explodiert. Ich hatte nicht damit
gerechnet, darum bin ich blutverschmiert… wer konnte ahnen, daß SIE so
reagier’n… gestern Nacht ist mein IRC-Netzwerk explodiert~~~
(as of 2021-06-15 The MirOS Project temporarily reconvenes on OFTC)
thanks
Andreas Tille dixit:
>Could you please give some example to reproduce the bug? When asking
This is… indeed tricky… I tried a couple URLs but they work;
I don’t have a viewing history though. The example from Mike’s
bug still fails, though:
tglase@tglase-nb:/tmp $ youtube-dl -f 18 OLAK5uy_m3-t4xLGBOHujynldlI3w-3Qp0WU62EAo
[youtube:tab] OLAK5uy_m3-t4xLGBOHujynldlI3w-3Qp0WU62EAo: Downloading webpage
ERROR: Unable to extract yt initial data; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see https://yt-dl.org/update on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
1|tglase@tglase-nb:/tmp $ Youtube-dl -f 18 OLAK5uy_m3-t4xLGBOHujynldlI3w-3Qp0WU62EAo
ERROR: Unable to extract yt initial data; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see https://yt-dl.org/update on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
[youtube:tab] OLAK5uy_m3-t4xLGBOHujynldlI3w-3Qp0WU62EAo: Downloading webpage
[download] Downloading playlist: New Song
[youtube:tab] playlist New Song: Downloading 11 videos
[download] Downloading video 1 of 11
[youtube] P8kTNCUzC1g: Downloading webpage
[youtube] P8kTNCUzC1g: Downloading player 7acefd5d
^C
ERROR: Interrupted by user
Second one (Youtube-dl with capital Y) is the upstream binary, patched
to have python3 in the shebang, shown to prove they fixed it later on.
I aborted it because I’m not interested in downloading that actually ☺
bye,
//mirabilos
--
Gestern Nacht ist mein IRC-Netzwerk explodiert. Ich hatte nicht damit
gerechnet, darum bin ich blutverschmiert… wer konnte ahnen, daß SIE so
reagier’n… gestern Nacht ist mein IRC-Netzwerk explodiert~~~
(as of 2021-06-15 The MirOS Project temporarily reconvenes on OFTC)
Andreas Tille
Jul 8, 2021, 10:30:04 AM7/8/21
to
Hi,
I can confirm the issue with the even simpler command
youtube-dl 9k4SnovHRRM
youtube-dl RiA7pTaAag0
... other single videos of this sequence
So this seems to be an issue. I'll go in uploading and will file an
unblock request.
Kind regards
Andreas.
--
http://fam-tille.de
I can confirm the issue with the even simpler command
youtube-dl 9k4SnovHRRM
youtube-dl RiA7pTaAag0
... other single videos of this sequence
So this seems to be an issue. I'll go in uploading and will file an
unblock request.
Kind regards
Andreas.
http://fam-tille.de
Thorsten Glaser
Jul 8, 2021, 10:50:03 AM7/8/21
to
Andreas Tille dixit:
>So this seems to be an issue. I'll go in uploading and will file an
>unblock request.
You can also file an unblock request for pre-approval before
uploading, that way you’ll know whether they’ll accept it.
On the other hand, time’s short…
>So this seems to be an issue. I'll go in uploading and will file an
>unblock request.
uploading, that way you’ll know whether they’ll accept it.
On the other hand, time’s short…
Andreas Tille
Jul 8, 2021, 3:10:03 PM7/8/21
to
On Thu, Jul 08, 2021 at 02:36:16PM +0000, Thorsten Glaser wrote:
>
> You can also file an unblock request for pre-approval before
> uploading, that way you’ll know whether they’ll accept it.
I admit I do not expect any *other* RC bug than this one - so most
>
> You can also file an unblock request for pre-approval before
> uploading, that way you’ll know whether they’ll accept it.
probably there is no real harm done by an upload to unstable.
Kind regards
Andreas.
--
http://fam-tille.de
0 new messages