ADP conversion not working on Linux

[Cuthbert Milligen]

When I try to download a YouTube video with one of the ADP formats it downloads a Media.mp4 and a Media.tmp file successfully, but the conversion only produces a 32 byte file containing binary content (attached). 

The converter in the settings is /usr/bin/avconv which is installed and is up-to-date.

Any help greatly appreciated...

[Cuthbert Milligen]

Following is the log file:

Log details

Failed aggregating "10 Mysterious Artifacts That Should Not Exist - YouTube"

avconv version 9.18-6:9.18-0ubuntu0.14.04.1, Copyright (c) 2000-2014 the Libav developers

  built on Mar 16 2015 13:19:10 with gcc 4.8 (Ubuntu 4.8.2-19ubuntu1)

[matroska,webm @ 0x1949d60] Unknown entry 0x56AA

[matroska,webm @ 0x1949d60] Unknown entry 0x56BB

Input #0, matroska,webm, from '/tmp/media.tmp':

  Duration: 00:07:05.60, start: 0.000000, bitrate: N/A

    Stream #0.0(eng): Audio: libopus, 48000 Hz, stereo, s16 (default)

Input #1, mov,mp4,m4a,3gp,3g2,mj2, from '/tmp/media.mp4':

  Metadata:

    major_brand     : dash

    minor_version   : 0

    compatible_brands: iso6avc1mp41

    creation_time   : 2015-11-12 07:03:17

  Duration: 00:07:05.59, start: 0.000000, bitrate: 637 kb/s

    Stream #1.0(und): Video: h264 (Main), yuv420p, 854x480 [PAR 1:1 DAR 427:240], 634 kb/s, 29.97 fps, 29.97 tbr, 90k tbn, 59.94 tbc

    Metadata:

      creation_time   : 2015-11-12 07:03:17

[libx264 @ 0x19513e0] using SAR=1/1

[libx264 @ 0x19513e0] MB rate (48551) > level limit (40500)

[libx264 @ 0x19513e0] using cpu capabilities: MMX2 SSE2Fast SSSE3 Cache64 SlowShuffle

[libx264 @ 0x19513e0] profile Constrained Baseline, level 3.0

[libx264 @ 0x19513e0] 264 - core 142 r2389 956c8d8 - H.264/MPEG-4 AVC codec - Copyleft 2003-2014 - http://www.videolan.org/x264.html - options: cabac=0 ref=2 deblock=1:-1:-1 analyse=0x1:0x111 me=hex subme=6 psy=1 psy_rd=1.00:0.15 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=0 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-3 threads=6 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=0 weightp=0 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=30 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.25 aq=1:1.00

[mp4 @ 0x194f1e0] track 1: could not find tag, codec not currently supported in container

Output #0, mp4, to '/home/me/Downloads/10 Mysterious Artifacts That Should Not Exist - YouTube.mp4':

  Metadata:

    encoder         : Lavf54.20.4

    Stream #0.0(und): Video: libx264, yuv420p, 854x480 [PAR 1:1 DAR 427:240], q=-1--1, 30k tbn, 29.97 tbc

    Metadata:

      creation_time   : 2015-11-12 07:03:17

    Stream #0.1(eng): Audio: libopus, 48000 Hz, stereo (default)

Stream mapping:

  Stream #1:0 -> #0:0 (h264 -> libx264)

  Stream #0:0 -> #0:1 (copy)

Could not write header for output file #0 (incorrect codec parameters ?): Operation not permitted

[SAMS]

Save the video as .mkv to force matroska splitter or reencode audio.

[Cuthbert Milligen]

If I choose any non-ADP variant it works fine. 

What I really want is to be able just to click on the main button to get an automatic download process. But it seems lately that the default (i.e. top of the list) is always an ADP variant  And that does not work due to the aforementioned bug.

[Nakazo Moto]

I have the same issue.

Where can I change it to convert to MKV?

[Nakazo Moto]

Log in my case it looks like it is using fmppg instead but ether way I am getting the same issue

ffmpeg version 2.8.4 Copyright (c) 2000-2015 the FFmpeg developers
  built with gcc 5.3.0 (GCC)
  configuration: --prefix=/usr --disable-debug --disable-static --disable-stripping --enable-avisynth --enable-avresample --enable-fontconfig --enable-gnutls --enable-gpl --enable-ladspa --enable-libass --enable-libbluray --enable-libdcadec --enable-libfreetype --enable-libfribidi --enable-libgsm --enable-libmodplug --enable-libmp3lame --enable-libopencore_amrnb --enable-libopencore_amrwb --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-libschroedinger --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libv4l2 --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxvid --enable-shared --enable-version3 --enable-x11grab
  libavutil      54. 31.100 / 54. 31.100
  libavcodec     56. 60.100 / 56. 60.100
  libavformat    56. 40.101 / 56. 40.101
  libavdevice    56.  4.100 / 56.  4.100
  libavfilter     5. 40.101 /  5. 40.101
  libavresample   2.  1.  0 /  2.  1.  0
  libswscale      3.  1.101 /  3.  1.101
  libswresample   1.  2.101 /  1.  2.101
  libpostproc    53.  3.100 / 53.  3.100
Input #0, matroska,webm, from '/tmp/media.tmp':
  Metadata:
    encoder         : google
  Duration: 00:03:54.48, start: 0.007000, bitrate: 133 kb/s
    Stream #0:0(eng): Audio: opus, 48000 Hz, stereo, fltp (default)
Input #1, mov,mp4,m4a,3gp,3g2,mj2, from '/tmp/media-1.mp4':
  Metadata:
    major_brand     : dash
    minor_version   : 0
    compatible_brands: iso6avc1mp41
    creation_time   : 2016-01-05 11:00:08
  Duration: 00:03:54.47, start: 0.033367, bitrate: 960 kb/s
    Stream #1:0(und): Video: h264 (Main) (avc1 / 0x31637661), yuv420p, 1280x720 [SAR 1:1 DAR 16:9], 23 kb/s, 29.97 fps, 29.97 tbr, 90k tbn, 59.94 tbc (default)
    Metadata:
      creation_time   : 2016-01-05 11:00:08
      handler_name    : VideoHandler
[mp4 @ 0x55918078fd80] Codec for stream 0 does not use global headers but container format requires global headers
[mp4 @ 0x55918078fd80] Codec for stream 1 does not use global headers but container format requires global headers
[mp4 @ 0x55918078fd80] Could not find tag for codec opus in stream #1, codec not currently supported in container
Output #0, mp4, to '/home/gozes/Videos/KPOP/[MV] GARY(개리) _ Lonely Night(또 하루) (feat. GAEKO(개코)) - YouTu.mp4':
  Metadata:
    encoder         : Lavf56.40.101
    Stream #0:0(und): Video: h264 ([33][0][0][0] / 0x0021), yuv420p, 1280x720 [SAR 1:1 DAR 16:9], q=2-31, 23 kb/s, 29.97 fps, 29.97 tbr, 90k tbn, 90k tbc (default)
    Metadata:
      creation_time   : 2016-01-05 11:00:08
      handler_name    : VideoHandler
    Stream #0:1(eng): Audio: opus, 48000 Hz, stereo (default)
Stream mapping:
  Stream #1:0 -> #0:0 (copy)
  Stream #0:0 -> #0:1 (copy)

 

[Cuthbert Milligen]

Why do you want to convert it to MKV?

Just choose any non-ADP variant from the drop down lists to save it in MP4 format.

[Nakazo Moto]

sadly after on FF 43 I am not getting any MP4 just ADP. SAMS a few post back mention said "Save the video as .mkv to force matroska splitter or reencode audio." I am wandering how to that. I don't see an option to download and convert to MKV or did I miss something?

[Cuthbert Milligen]

re "I am not getting any MP4 just ADP"

There is another topic about this problem - do a search.

I've no idea what SAMS meant - he's rather cryptic...

[SAMS]

Sorry for the short answer I was on my phone when I saw this topic.
Long answer :
Apparently Youtube now use Matroska for audio stream on some video.

Input #0, matroska,webm, from '/tmp/media.tmp':
  Metadata:
    encoder         : google
  Duration: 00:03:54.48, start: 0.007000, bitrate: 133 kb/s
    Stream #0:0(eng): Audio: opus, 48000 Hz, stereo, fltp (default)

When ADP ask for a file name, use .mkv as extension, it will force ffmpeg/libav  to use a Matroska container. You can also probably do that automatically by creating a new profile in the conversion outputs settings.

[Cuthbert Milligen]

@SAMS Thank you for the extended explanation of your post.

But I don't see how you have addressed the actual problems...

a) The conversion/aggregation does not work

b) How to get VDH to skip ADP variants

Using Matroska is going off at a tangent.

[mig]

I am seeing the issue on some YouTube variants (the ones using Matroska) but others aggregate fine.

The workaround would be either to use non-matroska variants (you can move matroska to the bottom on the ADP list in the configuration) or to install a recent version of libav (currently 11.4). Since no Windows user complained about the problem and the Windows converter is based on 11.2, that should be ok. On my Ubuntu 14.04, the libav-tools is in version 9.18. I presume that uninstalling the default package (apt-get remove libav-tools), downloading, compiling and installing the latest source code from libav.org would work.

[Cuthbert Milligen]

@mig Thanks for the infos, I'll try that. Please regard this thread as closed now :-)