MKV RecorderEndpoint Error With IOS

[Nicholas Mitchell]

Hi,

I am using KMS 6.10 on ubuntu 16.04, and trying to record a H264 stream (using IOS) with a MKV file type. The problem is the CPU spikes, and doesn't record the video / audio. Here is the constant error messages i am receiving for the duration of the webrtc stream:

2019-04-28T20:31:36,592437 2072 0x00007f19dcff9700    info agnosticbin               kmsagnosticbin.c:774 kms_agnostic_bin2_link_pad() <kmsagnosticbin2-1359>  Upstream provided caps: ANY

2019-04-28T20:31:36,592524 2072 0x00007f19dcff9700    info agnosticbin               kmsagnosticbin.c:783 kms_agnostic_bin2_link_pad() <kmsagnosticbin2-1359>  Downstream wanted caps: EMPTY

2019-04-28T20:31:36,592756 2072 0x00007f19dcff9700   error recorderendpoint          kmsrecorderendpoint.c:1641 kms_recorder_endpoint_query_accept_caps() <kmsrecorderendpoint950>  Incompatbile caps audio/x-aac

2019-04-28T20:31:36,592800 2072 0x00007f19dcff9700   error agnosticbin               kmsagnosticbin.c:397 proxy_src_pad_query_function() <src_1:proxypad33028>  Caps not accepted: accept-caps query: 0x7f1a00d5bb70, GstQueryAcceptCaps, caps=(GstCaps)"audio/x-opus\,\ rate\=\(int\)48000\,\ channels\=\(int\)2\,\ channel-mapping-family\=\(int\)0\,\ stream-count\=\(int\)1\,\ coupled-count\=\(int\)1\,\ streamheader\=\(buffer\)\<\ 4f707573486561640102000080bb0000000000\,\ 4f707573546167731f0000004753747265616d657220656e636f64656420766f72626973636f6d6d656e740000000001\ \>", result=(boolean)false;

Additionally here is my sdp offer:

v=0
o=- 8234504620067609371 2 IN IP4 127.0.0.1
s=-
t=0 0
a=group:BUNDLE audio video
a=msid-semantic: WMS iOS_3625
m=audio 9 UDP/TLS/RTP/SAVPF 111 103 104 9 102 0 8 106 105 13 110 112 113 126
c=IN IP4 0.0.0.0
a=rtcp:9 IN IP4 0.0.0.0
a=ice-ufrag:2hVW
a=ice-pwd:p2SBSlnzdHsS78naHWB7t2CU
a=ice-options:trickle renomination
a=fingerprint:sha-256 27:CC:CC:D2:EC:66:D5:71:8D:6C:C2:72:AF:BE:F4:13:55:FC:6E:E5:00:7D:32:EC:CC:4F:4A:8E:1B:7D:FA:EF
a=setup:actpass
a=mid:audio
a=extmap:1 urn:ietf:params:rtp-hdrext:ssrc-audio-level
a=sendrecv
a=rtcp-mux
a=rtpmap:111 opus/48000/2
a=rtcp-fb:111 transport-cc
a=fmtp:111 minptime=10;useinbandfec=1
a=rtpmap:103 ISAC/16000
a=rtpmap:104 ISAC/32000
a=rtpmap:9 G722/8000
a=rtpmap:102 ILBC/8000
a=rtpmap:0 PCMU/8000
a=rtpmap:8 PCMA/8000
a=rtpmap:106 CN/32000
a=rtpmap:105 CN/16000
a=rtpmap:13 CN/8000
a=rtpmap:110 telephone-event/48000
a=rtpmap:112 telephone-event/32000
a=rtpmap:113 telephone-event/16000
a=rtpmap:126 telephone-event/8000
a=ssrc:4219582949 cname:dn7G1ezzvVOweOHS
a=ssrc:4219582949 msid:iOS_3625 LOCALa0
a=ssrc:4219582949 mslabel:iOS_3625
a=ssrc:4219582949 label:LOCALa0
m=video 9 UDP/TLS/RTP/SAVPF 96 97 98 99 100 101 127
c=IN IP4 0.0.0.0
a=rtcp:9 IN IP4 0.0.0.0
a=ice-ufrag:2hVW
a=ice-pwd:p2SBSlnzdHsS78naHWB7t2CU
a=ice-options:trickle renomination
a=fingerprint:sha-256 27:CC:CC:D2:EC:66:D5:71:8D:6C:C2:72:AF:BE:F4:13:55:FC:6E:E5:00:7D:32:EC:CC:4F:4A:8E:1B:7D:FA:EF
a=setup:actpass
a=mid:video
a=extmap:2 urn:ietf:params:rtp-hdrext:toffset
a=extmap:3 http://www.webrtc.org/experiments/rtp-hdrext/abs-send-time
a=extmap:4 urn:3gpp:video-orientation
a=extmap:5 http://www.ietf.org/id/draft-holmer-rmcat-transport-wide-cc-extensions-01
a=extmap:6 http://www.webrtc.org/experiments/rtp-hdrext/playout-delay
a=extmap:7 http://www.webrtc.org/experiments/rtp-hdrext/video-content-type
a=extmap:8 http://www.webrtc.org/experiments/rtp-hdrext/video-timing
a=extmap:10 http://tools.ietf.org/html/draft-ietf-avtext-framemarking-07
a=extmap:12 http://www.webrtc.org/experiments/rtp-hdrext/color-space
a=sendonly
a=rtcp-mux
a=rtcp-rsize
a=rtpmap:96 H264/90000
a=rtcp-fb:96 goog-remb
a=rtcp-fb:96 transport-cc
a=rtcp-fb:96 ccm fir
a=rtcp-fb:96 nack
a=rtcp-fb:96 nack pli
a=fmtp:96 level-asymmetry-allowed=1;packetization-mode=1;profile-level-id=640c2a
a=rtpmap:97 rtx/90000
a=fmtp:97 apt=96
a=rtpmap:98 H264/90000
a=rtcp-fb:98 goog-remb
a=rtcp-fb:98 transport-cc
a=rtcp-fb:98 ccm fir
a=rtcp-fb:98 nack
a=rtcp-fb:98 nack pli
a=fmtp:98 level-asymmetry-allowed=1;packetization-mode=1;profile-level-id=42e02a
a=rtpmap:99 rtx/90000
a=fmtp:99 apt=98
a=rtpmap:100 red/90000
a=rtpmap:101 rtx/90000
a=fmtp:101 apt=100
a=rtpmap:127 ulpfec/90000
a=ssrc-group:FID 1521411390 2379272433
a=ssrc:1521411390 cname:dn7G1ezzvVOweOHS
a=ssrc:1521411390 msid:iOS_3625 LOCALv0
a=ssrc:1521411390 mslabel:iOS_3625
a=ssrc:1521411390 label:LOCALv0
a=ssrc:2379272433 cname:dn7G1ezzvVOweOHS
a=ssrc:2379272433 msid:iOS_3625 LOCALv0
a=ssrc:2379272433 mslabel:iOS_3625
a=ssrc:2379272433 label:LOCALv0

[Paulo R. Lanzarin]

Can you confirm this happens only when recording?
I've been having trouble with the agnosticbin caps being EMPTY and 1) causing unnecessary or 2) generating an abort signal because
the bin tries to strip the caps features from an EMPTY caps, similar from your report. But it seems to happen without recording as well
(which I also do with MKV). Couldn't find a reliable way to reproduce it yet so I could try a fix, though.

--
You received this message because you are subscribed to the Google Groups "kurento" group.
To unsubscribe from this group and stop receiving emails from it, send an email to kurento+u...@googlegroups.com.
To post to this group, send email to kur...@googlegroups.com.
Visit this group at https://groups.google.com/group/kurento.
To view this discussion on the web visit https://groups.google.com/d/msgid/kurento/c5c21a5d-569f-4203-aa9a-6bb4f0a28fdd%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Nicholas Mitchell]

Yes i have confirmed this only happens when trying to record with the MKV file format. When i choose WEBM it works fine (minus the transcoding cpu cost). I have been looking for a way to reduce the cpu usage by using the new MKV format, but so far it fails. 

One thing i do notice is my audio in my sdp only has opus, but according to this line MKV profile uses audio/x-aac. Maybe that has something to do with the error?

To unsubscribe from this group and stop receiving emails from it, send an email to kur...@googlegroups.com.

[Sebastien Gauthier]

I have the same problem with kms 6.13.0 and the master branch. With H264 Codec and OPUS codec

There are a way to create a custom profil?

I really prefer to don't make any live transcoding and do a postprocessing.