Issue 240 in get-flash-videos: Daily Show Full Episode Downloads Broken

25 views
Skip to first unread message

get-flas...@googlecode.com

unread,
Feb 18, 2011, 1:32:33 AM2/18/11
to get-flas...@googlegroups.com
Status: New
Owner: ----
Labels: Type-Defect Priority-Medium

New issue 240 by enigma%t...@gtempaccount.com: Daily Show Full Episode
Downloads Broken
http://code.google.com/p/get-flash-videos/issues/detail?id=240

What steps will reproduce the problem?

get_flash_videos
http://www.thedailyshow.com/full-episodes/wed-february-16-2011-brian-williams

Downloading
http://www.thedailyshow.com/full-episodes/wed-february-16-2011-brian-williams
Using method 'mtvnservices' for
http://btg.mtvnservices.com/aria/coda.html?site=thedailyshow.com
Error: Can't use an undefined value as a HASH reference at
/usr/local/bin/get_flash_videos line 13609.

Couldn't extract Flash movie URL. This site may need specific support
adding,
or fixing.

Please confirm the site is using Flash video and if you have Flash available
check that the URL really works(!).

Check for updates by running: /usr/local/bin/get_flash_videos --update

If the latest version does not support this please open a bug (or
contribute a patch!) at http://code.google.com/p/get-flash-videos/
make sure you include the output with --debug enabled.
Couldn't download any videos.

What is the expected output? What do you see instead?

Expectation is that it will download, as it has before :)

What version of the product are you using? On what operating system?

1.2.4, os x 10.6

Please provide any additional information below.

Looks like something changed which broke the full episode handler.


get-flas...@googlecode.com

unread,
Feb 24, 2011, 12:20:44 PM2/24/11
to get-flas...@googlegroups.com

Comment #1 on issue 240 by ava...@yahoo.com: Daily Show Full Episode
Downloads Broken
http://code.google.com/p/get-flash-videos/issues/detail?id=240

This seems to fix the specific issue vis both feeds and full episodes on
thedailyshow/colbertreport etc, but I'm not sure if it breaks anything in
the general case.

Attachments:
Mtvnservices.patch 2.8 KB

get-flas...@googlecode.com

unread,
Feb 26, 2011, 2:38:39 AM2/26/11
to get-flas...@googlegroups.com

Comment #2 on issue 240 by enigma%t...@gtempaccount.com: Daily Show Full

I have verified this works.

get-flas...@googlecode.com

unread,
Mar 6, 2011, 4:51:21 PM3/6/11
to get-flas...@googlegroups.com

Comment #3 on issue 240 by mjbauer95: Daily Show Full Episode Downloads
Broken
http://code.google.com/p/get-flash-videos/issues/detail?id=240

Added aval57's patches to git.

get-flas...@googlecode.com

unread,
Mar 11, 2011, 7:18:27 AM3/11/11
to get-flas...@googlegroups.com

Comment #4 on issue 240 by dissentn...@gmail.com: Daily Show Full Episode
Downloads Broken
http://code.google.com/p/get-flash-videos/issues/detail?id=240

The Colbert Report full episodes haven't been working, even with the patch
as posted or with a git clone from yesterday. It's the mediagen error
that's been reported elsewhere.

Windows XP Home SP3, ActivePerl 5.12.2 Build 1202, get-flash-videos
1.25-dev (freshly cloned less than 10 minutes ago)

gfv --debug -f output.flv "http://www.colbertnation.c
om/full-episodes/tue-march-1-2011-evan-osnos"
~1~ ~p~l~u~g~i~n~ ~i~n~s~t~a~l~l~e~d~:~
~~-~ ~H~u~l~u~.~p~m~
~Downloading
http://www.colbertnation.com/full-episodes/tue-march-1-2011-evan-os
nos
-> GET
http://www.colbertnation.com/full-episodes/tue-march-1-2011-evan-osnos
<- 200 text/html (44550): UTF8 off, ASCII, 44550 characters 44550 bytes
Trying to open plugin C:\Documents and Settings\Stephen\Application
Data/get_fla
sh_videos/plugins/Www.pm
Trying to open plugin C:\Documents and Settings\Stephen\Application
Data/get_fla
sh_videos/plugins/Colbertnation.pm
Trying to open plugin C:\Documents and Settings\Stephen\Application
Data/get_fla
sh_videos/plugins/Com.pm
Trying to open plugin C:\Documents and Settings\Stephen\Application
Data/get_fla
sh_videos/plugins/Media.pm
Trying to open plugin C:\Documents and Settings\Stephen\Application
Data/get_fla
sh_videos/plugins/Mtvnservices.pm
Using method 'mtvnservices' for
http://media.mtvnservices.com/player/scripts/mtv
n_player_loadtime.js
-> GET
http://media.mtvnservices.com/mgid:cms:episode:colbertnation.com:375920
<- 302 text/html (153): UTF8 off, ASCII, 153 characters 153 bytes
-> GET
http://media.mtvnservices.com/pmt/e1/players/mgid:cms:episode:colbertnati
on.com:/context6/config.xml?uri=mgid:cms:episode:colbertnation.com:375920&type=n
etwork&ref=www.colbertnation.com&geo=US&group=entertainment&
<- 200 application/xml (2698): UTF8 off, ASCII, 2698 characters 2698 bytes
-> GET
http://shadow.comedycentral.com/feeds/video_player/mrss/?uri=mgid:cms:epi
sode:colbertnation.com:375920
<- 200 text/xml;charset=utf-8 (13539): UTF8 on, ASCII, 13539 characters
13539 by
tes
Error: Unable to find mediagen URL

Couldn't extract Flash movie URL. This site may need specific support
adding,
or fixing.

Please confirm the site is using Flash video and if you have Flash available
check that the URL really works(!).

Check for updates by running: C:\dap\BT\get-flash-videos\gfv.pl --update

get-flas...@googlecode.com

unread,
Mar 14, 2011, 12:44:37 AM3/14/11
to get-flas...@googlegroups.com

Comment #5 on issue 240 by ava...@yahoo.com: Daily Show Full Episode
Downloads Broken
http://code.google.com/p/get-flash-videos/issues/detail?id=240

A patch against my patched version above (since it's already added to git).
Colbert works again for me now.

Attachments:
Mtvnservices2.patch 1.5 KB

get-flas...@googlecode.com

unread,
Mar 17, 2011, 12:20:47 AM3/17/11
to get-flas...@googlegroups.com

Comment #6 on issue 240 by ava...@yahoo.com: Daily Show Full Episode
Downloads Broken
http://code.google.com/p/get-flash-videos/issues/detail?id=240

Previous patch revised slightly to accommodate some older feeds/episodes.
The brand-new feeds are throwing 'ERROR: RTMP_Connect1, handshake failed'
in rtmpdump, though, which is also being seen elswhere:

https://code.google.com/p/get-flash-videos/issues/detail?id=243

Attachments:
Mtvnservices3.patch 1.6 KB

get-flas...@googlecode.com

unread,
Mar 24, 2011, 12:32:52 AM3/24/11
to get-flas...@googlegroups.com

Comment #7 on issue 240 by ava...@yahoo.com: Daily Show Full Episode
Downloads Broken
http://code.google.com/p/get-flash-videos/issues/detail?id=240

Yet another patch against git. This fixes:
- "not well-formed (invalid token)" error from XML::Simple on latest
feeds/episodes.
- "Undefined subroutine &FlashVideo::Site::Mtvnservices::can_handle" error.
(mjbauer95: the last git commit cleaned things up nicely but
inadvertently deleted one line, see hunk 4 of this patch).

Good news on rtmpdumps 'Handshake 9' bug too:
https://code.google.com/p/get-flash-videos/issues/detail?id=243

Attachments:
Mtvnservices4.patch 2.2 KB

get-flas...@googlecode.com

unread,
Apr 14, 2011, 6:15:39 PM4/14/11
to get-flas...@googlegroups.com

Comment #8 on issue 240 by ava...@yahoo.com: Daily Show Full Episode
Downloads Broken
http://code.google.com/p/get-flash-videos/issues/detail?id=240

This patch adjusts the parsing of mediagen ids slightly so as not to fail
on encountering ampersands.

Attachments:
Mtvnservices5.patch 1.9 KB

get-flas...@googlecode.com

unread,
May 17, 2011, 12:23:26 AM5/17/11
to get-flas...@googlegroups.com
Updates:
Status: Fixed

Comment #9 on issue 240 by mjbauer95: Daily Show Full Episode Downloads
Broken
http://code.google.com/p/get-flash-videos/issues/detail?id=240

I believe this is fixed unless aval has some more patches up his sleeve.

get-flas...@googlecode.com

unread,
Jun 4, 2011, 9:20:41 AM6/4/11
to get-flas...@googlegroups.com

Comment #10 on issue 240 by ava...@yahoo.com: Daily Show Full Episode
Downloads Broken
http://code.google.com/p/get-flash-videos/issues/detail?id=240

'Fixed' is a little too optimistic in this line of work, alas. This patch
adjusts for the recent proliferation of ads in colbertnation feeds, causing
problems in locating the actual clip. There's another possible bug too,
will post if I learn anything useful.

Attachments:
Mtvnservices6.patch 5.9 KB

get-flas...@googlecode.com

unread,
Jun 4, 2011, 6:38:04 PM6/4/11
to get-flas...@googlegroups.com
Updates:
Status: Started

Comment #11 on issue 240 by mjbauer95: Daily Show Full Episode Downloads
Broken
http://code.google.com/p/get-flash-videos/issues/detail?id=240

Well, the original issue has been fixed but as long as you keep giving me
patches I'll keep applying them to git.

get-flas...@googlecode.com

unread,
Jun 6, 2011, 10:13:29 AM6/6/11
to get-flas...@googlegroups.com

Comment #12 on issue 240 by ava...@yahoo.com: Daily Show Full Episode
Downloads Broken
http://code.google.com/p/get-flash-videos/issues/detail?id=240

thanks mjbauer95, simpler to continue updating here unless you'd really
prefer to open a separate issue for every patch. Broadly speaking they're
all in the same category I think.

get-flas...@googlecode.com

unread,
Apr 15, 2012, 6:47:45 PM4/15/12
to get-flas...@googlegroups.com

Comment #13 on issue 240 by mjbauer95: Daily Show Full Episode Downloads
Broken
http://code.google.com/p/get-flash-videos/issues/detail?id=240

Issue 378 has been merged into this issue.

get-flas...@googlecode.com

unread,
Mar 12, 2014, 11:46:33 AM3/12/14
to get-flas...@googlegroups.com

Comment #16 on issue 240 by mitter...@gmail.com: Daily Show Full Episode
Downloads Broken
http://code.google.com/p/get-flash-videos/issues/detail?id=240

Seems like this is the only thread dealing with The Daily Show issues, and
I didn't want to open yet another one, even though this one is a bit old,
so I'll report my issue here:

Whenever I try to download videos from thedailyshow.com I get one of the
following error messages:

1) Full episode

---
$ get_flash_videos
http://www.thedailyshow.com/full-episodes/tue-march-11-2014-andrew-napolitano
--debug
No plugins installed
Trying to open plugin ~/.get_flash_videos/plugins/Www.pm
Trying to open plugin ~/.get_flash_videos/plugins/Thedailyshow.pm
Trying to open plugin ~/.get_flash_videos/plugins/Com.pm
Trying to open plugin ~/.get_flash_videos/plugins/Brightcove.pm
-> GET
http://www.thedailyshow.com/full-episodes/tue-march-11-2014-andrew-napolitano
<- 200 text/html (170574): UTF8 off, ASCII, 170574 characters 170574 bytes
Trying to open plugin ~/.get_flash_videos/plugins/Mtvnservices.pm
-> GET
http://www.thedailyshow.com/full-episodes/tue-march-11-2014-andrew-napolitano
<- 200 text/html (170574): UTF8 off, ASCII, 170574 characters 170574 bytes
Using method 'mtvnservices' for
http://www.thedailyshow.com/full-episodes/tue-march-11-2014-andrew-napolitano
Downloading
http://www.thedailyshow.com/full-episodes/tue-march-11-2014-andrew-napolitano
-> GET
http://www.thedailyshow.com/full-episodes/tue-march-11-2014-andrew-napolitano
<- 200 text/html (170574): UTF8 off, ASCII, 170574 characters 170574 bytes
-> GET http://media.mtvnservices.com/mgid:cms:content:thedailyshow.com:934
<- 302 text/html (153): UTF8 off, ASCII, 153 characters 153 bytes
Error: No config_url/id found

Couldn't extract Flash movie URL. This site may need specific support
adding,
or fixing.

Please confirm the site is using Flash video and if you have Flash available
check that the URL really works(!).

Check for updates by running: /usr/bin/get_flash_videos --update

If the latest version does not support this please open a bug (or
contribute a patch!) at http://code.google.com/p/get-flash-videos/
make sure you include the output with --debug enabled.
Couldn't download any videos.
---

2) Videos

$ get_flash_videos
http://www.thedailyshow.com/watch/tue-march-11-2014/crimea--we-hardly-knew-ye
--debug
No plugins installed
Trying to open plugin ~/.get_flash_videos/plugins/Www.pm
Trying to open plugin ~/.get_flash_videos/plugins/Thedailyshow.pm
Trying to open plugin ~/.get_flash_videos/plugins/Com.pm
Trying to open plugin ~/.get_flash_videos/plugins/Brightcove.pm
-> GET
http://www.thedailyshow.com/watch/tue-march-11-2014/crimea--we-hardly-knew-ye
<- 200 text/html (87422): UTF8 off, ASCII, 87422 characters 87422 bytes
Trying to open plugin ~/.get_flash_videos/plugins/Mtvnservices.pm
-> GET
http://www.thedailyshow.com/watch/tue-march-11-2014/crimea--we-hardly-knew-ye
<- 200 text/html (87422): UTF8 off, ASCII, 87422 characters 87422 bytes
Using method 'mtvnservices' for
http://www.thedailyshow.com/watch/tue-march-11-2014/crimea--we-hardly-knew-ye
Downloading
http://www.thedailyshow.com/watch/tue-march-11-2014/crimea--we-hardly-knew-ye
-> GET
http://www.thedailyshow.com/watch/tue-march-11-2014/crimea--we-hardly-knew-ye
<- 200 text/html (87422): UTF8 off, ASCII, 87422 characters 87422 bytes
-> GET http://media.mtvnservices.com/mgid:cms:video:thedailyshow.com:433664
<- 302 text/html (153): UTF8 off, ASCII, 153 characters 153 bytes
-> GET
http://media.mtvnservices.com/pmt/e1/players/mgid:cms:video:thedailyshow.com:/context12/config.xml?uri=mgid:cms:video:thedailyshow.com:433664&type=network&ref=www.thedailyshow.com&geo=AT&group=entertainment&network=dsl&device=Other
<- 200 application/xml (2740): UTF8 off, ASCII, 2740 characters 2740 bytes
-> GET
http://shadow.comedycentral.com/feeds/video_player/mrss/?uri=mgid:cms:video:thedailyshow.com:433664

<- 200 text/xml;charset=utf-8 (3884): UTF8 on, ASCII, 3884 characters 3884
bytes
Handling clip
-> GET
http://www.cc.com/feeds/mediagen/kramer?uri=mgid:cms:video:thedailyshow.com:433664&device={device}
<- 200 text/xml;charset=utf-8 (2961): UTF8 on, ASCII, 2961 characters 2961
bytes
-> GET
http://media.mtvnservices.com/http://www.cc.com/feeds/mediagen/kramer?uri=mgid:cms:video:thedailyshow.com:433664&device={device}
<- 404 text/html; charset=iso-8859-1 (236): UTF8 off, ASCII, 236 characters
236 bytes
FlashVideo::RTMPDownloader=HASH(0xaa5f938)
Running rtmpdump
--swfUrl 'http://media.mtvnservices.com/http://www.cc.com/feeds/mediagen/kramer?uri=mgid:cms:video:thedailyshow.com:433664&device={device}'
--pageUrl 'http://www.thedailyshow.com/watch/tue-march-11-2014/crimea--we-hardly-knew-ye'
--swfsize '8' --flv 'Crimea,_We_Hardly_Knew_Ye.flv'
--swfhash '3d20e8cb53e1828f4a0d482c0f8d8604a530536632761ce1d40cb34c38fc3082'
--verbose
--rtmp 'rtmpe://cp9950.edgefcs.net/ondemand/mtvnorigin/gsp.comedystor/com/dailyshow/TDS/season_19/episode_076/ds_19076_01_1280x720_3500_h32.mp4'
RTMPDump v2.4
(c) 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL
rtmpdump: DEBUG: Parsing...
rtmpdump: DEBUG: Parsed protocol: 2
BUG: Hostname : cp9950.edgefcs.net
DEBUG: Port : 1935
DEBUG: Playpath :
mp4:mtvnorigin/gsp.comedystor/com/dailyshow/TDS/season_19/episode_076/ds_19076_01_1280x720_3500_h32
DEBUG: tcUrl : rtmpe://cp9950.edgefcs.net:1935/ondemand
DEBUG: swfUrl :
http://media.mtvnservices.com/http://www.cc.com/feeds/mediagen/kramer?uri=mgid:cms:video:thedailyshow.com:433664&device={device}
DEBUG: pageUrl :
http://www.thedailyshow.com/watch/tue-march-11-2014/crimea--we-hardly-knew-ye
DEBUG: app : ondemand
DEBUG: live : no
DEBUG: timeout : 30 sec
DEBUG: SWFSHA256:
DEBUG: 3d 20 e8 cb 53 e1 82 8f 4a 0d 48 2c 0f 8d 86 04
DEBUG: a5 30 53 66 32 76 1c e1 d4 0c b3 4c 38 fc 30 82
DEBUG: SWFSize : 8
DEBUG: Setting buffer time to: 36000000ms
Connecting ...
rtmpdump: DEBUG: RTMP_Connect1, ... connected, handshaking
rtmpdump: DEBUG: HandShake: Client digest offset: 1383
rtmpdump: DEBUG: HandShake: Initial client digest:
82 6e c2 16 c9 94 4b 35
rtmpdump: DEBUG: HandShake: Type Answer : 09
rtmpdump: DEBUG: HandShake: Server Uptime : 668949087
rtmpdump: DEBUG: HandShake: Server DH public key offset: 407
rtmpdump: DEBUG: HandShake: Secret key:
rtmpdump: DEBUG: 48 90 57 40 36 74 00 62 aa 1d f2 f7 69 41 d5 ed
16 c9 2a b2 e9 9e ba aa 52 06 50 50
DEBUG: a5 0c a2 2d 33 86 70 dd 36 f9 8c aa be 7f df ff
DEBUG: e5 c7 7c 1a 63 3a a8 b6 fd e7 b1 4d 5e ab e8 19
DEBUG: 90 da b5 3d 44 64 db 01 b9 ea 97 ef f0 7b f9 9b
DEBUG: 5e e7 44 1f b8 48 94 0d e7 75 3a 74 e9 a5 ce cf
DEBUG: 49 f4 79 46 f4 81 93 c1 c4 d6 58 00 e9 1c 7c d4
DEBUG: RC4 Out Key:
rtmpdump: DEBUG: 1a 32 2a 3e fb a2 18 4a 27 75 9e 61 61 4a b2 57
rtmpdump: DEBUG: RC4 In Key:
rtmpdump: DEBUG: ce ce 6b 69 44 53 99 08 44 70 27 f2 bd cc 3a fd
rtmpdump: DEBUG: HandShake: Calculated digest key from secure key and
server digest:
rtmpdump: DEBUG: 5b 07 f1 a3 2f 36 6f cd 56 ec 7b 7c 4f 37 a1 21
rtmpdump: DEBUG: HandShake: Client signature calculated:
rtmpdump: DEBUG: ab 3e 1b f0 10 10 21 9e 8d 88 bb ce d4 65 fc 4a
rtmpdump: DEBUG: HandShake: Server sent signature:
rtmpdump: DEBUG: 07 fc 14 2c ff 34 8c f4 e7 d9 c1 02 16 7c 14 30
rtmpdump: DEBUG: HandShake: Digest key:
rtmpdump: DEBUG: 35 85 62 71 05 c5 6b b3 8c 04 26 85 e7 7a d6 8b
rtmpdump: DEBUG: HandShake: Signature calculated:
rtmpdump: DEBUG: 07 fc 14 2c ff 34 8c f4 e7 d9 c1 02 16 7c 14 30
Genuine Adobe Flash Media Server
rtmpdump: DEBUG: HandShake: Handshaking finished....
rtmpdump: DEBUG: Invoking connect
INFO: Connected...
rtmpdump: DEBUG: HandleChangeChunkSize, received: chunk size change to 128
rtmpdump: DEBUG: RTMP_ClientPacket, received: invoke 165 bytes
operty: <Name: level, STRING: error>
DEBUG: Property: <Name: code, STRING:
NetConnection.Connect.Rejected>
DEBUG: Property: <Name: description, STRING: Connection failed.>
DEBUG: Property: <Name: description, STRING: [ Server.Reject ] :
Connection failed.>
DEBUG: (object end)
DEBUG: (object end)
DEBUG: HandleInvoke, server invoking <_error>
rtmpdump: ERROR: rtmp server sent error
BUG: (object end)
DEBUG: HandleInvoke, server invoking <close>
ERROR: rtmp server requested close
rtmpdump: DEBUG: Closing connection.
Download failed, no valid file downloaded
Couldn't download any videos.
---

--
You received this message because this project is configured to send all
issue notifications to this address.
You may adjust your notification preferences at:
https://code.google.com/hosting/settings
Reply all
Reply to author
Forward
0 new messages