Error when integrating AzureSR Plugin with res-speech-unimrcp

130 views
Skip to first unread message

Jatin Parekh

unread,
Nov 16, 2019, 1:48:06 AM11/16/19
to UniMRCP
Hi,
I am facing an issue while setting up Azure SR using the res-speech-unimrcp flow.
I do see 2 "Failed" messages in the asterisk logs. But I am unable to understand what I am missing here.
I've followed the docs as per this link: https://www.unimrcp.org/manuals/pdf/AsteriskBingUsageManual.pdf

If I run the command run bsr1, it does give the expected output as per this doc.
If someone can redirect me to what step I am missing, that would be really great!

extensions.conf
[res-speech-unimrcp-9]
exten => s,1,Answer()
exten => s,2,SpeechCreate()
exten => s,3,SpeechActivateGrammar(builtin:speech/transcribe)
exten => s,4,SpeechBackground(beep, 20)
exten => s,5,Verbose(1, "Recognition result count: ${SPEECH(results)}")
exten => s,6,GotoIf($["${SPEECH(results)}" = "0"]?7:9)
exten => s,7,Playback(error)
exten => s,8,Goto(3)
exten => s,9,Verbose(1, "Recognition result: ${SPEECH_TEXT(0)}, confidence score: ${SPEECH_SCORE(0)}, grammar-uri: ${SPEECH_GRAMMAR(0)}")
exten => s,10,SpeechDestroy()
exten => s,11,Hangup()



Logs from asterisk shell:
Packet timed out after 32000ms with no response
  == Using SIP RTP CoS mark 5
       > 0x7f41740ca380 -- Strict RTP learning after remote address set to: 192.168.1.83:25282
  == Setting global variable 'SIPDOMAIN' to 'devjatin.hellohaptik.com'
    -- Executing [709@internal:1] Goto("PJSIP/6001-00000005", "res-speech-unimrcp-9,s,1") in new stack
    -- Goto (res-speech-unimrcp-9,s,1)
    -- Executing [s@res-speech-unimrcp-9:1] Answer("PJSIP/6001-00000005", "") in new stack
       > 0x7f417000f7a0 -- Strict RTP learning after remote address set to: 192.168.1.94:49878
       > 0x7f417000f7a0 -- Strict RTP qualifying stream type: audio
       > 0x7f417000f7a0 -- Strict RTP switching source address to 103.235.121.112:49878
Got  RTP packet from    103.235.121.112:49878 (type 00, seq 063572, ts 1649535894, len 000160)
    -- Executing [s@res-speech-unimrcp-9:2] SpeechCreate("PJSIP/6001-00000005", "") in new stack
[Nov 16 06:19:26] DEBUG[9740][C-00000139]: res_speech_unimrcp.c:1138 uni_recog_sm_request_send: (RSU-1) Send session request type: 2
[Nov 16 06:19:26] DEBUG[9740][C-00000139]: src/apt_task.c:263  Signal Message to [MRCP Client] [0x7f4184004180;4;0]
[Nov 16 06:19:26] DEBUG[8676]: src/apt_task.c:335  Process Message [MRCP Client] [0x7f4184004180;4;0]
[Nov 16 06:19:26] DEBUG[8676]: src/mrcp_client_session.c:1277  Dispatch App Request RSU-1 <new> [2]
[Nov 16 06:19:26] DEBUG[8676]: src/apt_task.c:263  Signal Message to [MRCPv2-Agent-1] [0x7f41780032f0;1;0]
[Nov 16 06:19:26] DEBUG[8676]: src/mrcp_client_session.c:743  Add Media Termination RSU-1 <new@media-tm>
[Nov 16 06:19:26] DEBUG[8676]: src/mrcp_client_session.c:772  Add Media Termination RSU-1 <new@rtp-tm>
[Nov 16 06:19:26] DEBUG[8676]: src/apt_task.c:263  Signal Message to [Media-Engine-1] [0x7f417800ad80;1;0]
[Nov 16 06:19:26] DEBUG[8676]: src/apt_consumer_task.c:135  Wait for Messages [MRCP Client]
[Nov 16 06:19:26] DEBUG[8679]: src/apt_poller_task.c:259  Process Poller Wakeup [MRCPv2-Agent-1]
[Nov 16 06:19:26] DEBUG[8679]: src/apt_task.c:335  Process Message [MRCPv2-Agent-1] [0x7f41780032f0;1;0]
[Nov 16 06:19:26] DEBUG[8679]: src/apt_task.c:263  Signal Message to [MRCP Client] [0x7f4174051ec0;2;0]
[Nov 16 06:19:26] DEBUG[8679]: src/apt_poller_task.c:249  Wait for Messages [MRCPv2-Agent-1]
[Nov 16 06:19:26] DEBUG[8676]: src/apt_task.c:335  Process Message [MRCP Client] [0x7f4174051ec0;2;0]
[Nov 16 06:19:26] DEBUG[8676]: src/mrcp_client_session.c:292  Control Channel Added RSU-1 <new@speechrecog>
[Nov 16 06:19:26] DEBUG[8676]: src/apt_consumer_task.c:135  Wait for Messages [MRCP Client]
[Nov 16 06:19:26] DEBUG[9740][C-00000139]: res_speech_unimrcp.c:1164 uni_recog_sm_request_send: (RSU-1) Wait for session response type: 2
[Nov 16 06:19:26] DEBUG[8680]: src/apt_task.c:335  Process Message [Media-Engine-1] [0x7f417800ad80;1;0]
[Nov 16 06:19:26] DEBUG[8680]: src/mpf_context.c:180  Add Media Context RSU-1
[Nov 16 06:19:26] WARNING[8680]: src/mpf_rtp_stream.c:232  Failed to Match Codec List 10.6.0.16:4002
[Nov 16 06:19:26] DEBUG[8680]: src/apt_task.c:263  Signal Message to [MRCP Client] [0x7f415c0151d0;3;0]
[Nov 16 06:19:26] DEBUG[8676]: src/apt_task.c:335  Process Message [MRCP Client] [0x7f415c0151d0;3;0]
[Nov 16 06:19:26] DEBUG[8676]: src/mrcp_client_session.c:939  Media Termination Added RSU-1 <new@media-tm>
[Nov 16 06:19:26] DEBUG[8676]: src/mrcp_client_session.c:939  Media Termination Added RSU-1 <new@rtp-tm>
[Nov 16 06:19:26] DEBUG[8676]: src/apt_consumer_task.c:135  Wait for Messages [MRCP Client]
[Nov 16 06:19:26] DEBUG[8677]: src/apt_task.c:263  Signal Message to [MRCP Client] [0x7f417c027140;1;0]
[Nov 16 06:19:26] DEBUG[8676]: src/apt_task.c:335  Process Message [MRCP Client] [0x7f417c027140;1;0]
[Nov 16 06:19:26] DEBUG[8676]: src/mrcp_client_session.c:1136  Modify Control Channel RSU-1 <7109726152b14018>
[Nov 16 06:19:26] DEBUG[8676]: src/apt_task.c:263  Signal Message to [MRCPv2-Agent-1] [0x7f41780032f0;1;0]
[Nov 16 06:19:26] DEBUG[8679]: src/apt_poller_task.c:259  Process Poller Wakeup [MRCPv2-Agent-1]
[Nov 16 06:19:26] DEBUG[8679]: src/apt_task.c:335  Process Message [MRCPv2-Agent-1] [0x7f41780032f0;1;0]
[Nov 16 06:19:26] DEBUG[8679]: src/apt_task.c:263  Signal Message to [MRCP Client] [0x7f41740978f0;2;1]
[Nov 16 06:19:26] DEBUG[8679]: src/apt_poller_task.c:249  Wait for Messages [MRCPv2-Agent-1]
[Nov 16 06:19:26] DEBUG[8676]: src/mrcp_client_session.c:1174  Modify Media Termination RSU-1 <7109726152b14018@rtp-tm>
[Nov 16 06:19:26] DEBUG[8676]: src/apt_task.c:263  Signal Message to [Media-Engine-1] [0x7f4178007ee0;1;0]
[Nov 16 06:19:26] DEBUG[8676]: src/apt_consumer_task.c:135  Wait for Messages [MRCP Client]
[Nov 16 06:19:26] DEBUG[8676]: src/apt_task.c:335  Process Message [MRCP Client] [0x7f41740978f0;2;1]
[Nov 16 06:19:26] DEBUG[8676]: src/mrcp_client_session.c:309  Control Channel Modified RSU-1 <7109726152b14018@speechrecog>
[Nov 16 06:19:26] DEBUG[8676]: src/apt_consumer_task.c:135  Wait for Messages [MRCP Client]
[Nov 16 06:19:26] DEBUG[8680]: src/apt_task.c:335  Process Message [Media-Engine-1] [0x7f4178007ee0;1;0]
[Nov 16 06:19:26] DEBUG[8680]: src/apt_task.c:263  Signal Message to [MRCP Client] [0x7f415c0151d0;3;0]
[Nov 16 06:19:26] DEBUG[8676]: src/apt_task.c:335  Process Message [MRCP Client] [0x7f415c0151d0;3;0]
[Nov 16 06:19:26] DEBUG[8676]: src/mrcp_client_session.c:980  Media Termination Modified RSU-1 <7109726152b14018@rtp-tm>
[Nov 16 06:19:26] DEBUG[8676]: res_speech_unimrcp.c:921 on_channel_add: (RSU-1) Channel added status: 0
[Nov 16 06:19:26] DEBUG[8676]: src/apt_consumer_task.c:135  Wait for Messages [MRCP Client]
[Nov 16 06:19:26] DEBUG[9740][C-00000139]: res_speech_unimrcp.c:1169 uni_recog_sm_request_send: (RSU-1) Process session response type: 2 status: 0
[Nov 16 06:19:26] WARNING[9740][C-00000139]: res_speech_unimrcp.c:274 uni_recog_create_internal: (RSU-1) Failed to create media buffer
[Nov 16 06:19:26] DEBUG[9740][C-00000139]: res_speech_unimrcp.c:1138 uni_recog_sm_request_send: (RSU-1) Send session request type: 1
[Nov 16 06:19:26] DEBUG[9740][C-00000139]: src/apt_task.c:263  Signal Message to [MRCP Client] [0x7f4184003d40;4;0]
[Nov 16 06:19:26] DEBUG[8676]: src/apt_task.c:335  Process Message [MRCP Client] [0x7f4184003d40;4;0]
[Nov 16 06:19:26] DEBUG[8676]: src/mrcp_client_session.c:1277  Dispatch App Request RSU-1 <7109726152b14018> [1]
[Nov 16 06:19:26] DEBUG[8676]: src/mrcp_client_session.c:849  Remove Control Channel RSU-1 <7109726152b14018>
[Nov 16 06:19:26] DEBUG[8676]: src/apt_task.c:263  Signal Message to [MRCPv2-Agent-1] [0x7f4178007e30;1;0]
[Nov 16 06:19:26] DEBUG[8676]: src/mrcp_client_session.c:859  Subtract Media Termination RSU-1 <7109726152b14018@media-tm>
[Nov 16 06:19:26] DEBUG[8676]: src/mrcp_client_session.c:880  Subtract Media Termination RSU-1 <7109726152b14018@rtp-tm>
[Nov 16 06:19:26] DEBUG[8679]: src/apt_poller_task.c:259  Process Poller Wakeup [MRCPv2-Agent-1]
[Nov 16 06:19:26] DEBUG[8679]: src/apt_task.c:335  Process Message [MRCPv2-Agent-1] [0x7f4178007e30;1;0]
[Nov 16 06:19:26] DEBUG[8679]: src/apt_task.c:263  Signal Message to [MRCP Client] [0x7f41740978f0;2;2]
[Nov 16 06:19:26] DEBUG[8679]: src/apt_poller_task.c:249  Wait for Messages [MRCPv2-Agent-1]
[Nov 16 06:19:26] DEBUG[8676]: src/apt_task.c:263  Signal Message to [Media-Engine-1] [0x7f4178007ee0;1;0]
[Nov 16 06:19:26] DEBUG[8676]: src/apt_consumer_task.c:135  Wait for Messages [MRCP Client]
[Nov 16 06:19:26] DEBUG[8676]: src/apt_task.c:335  Process Message [MRCP Client] [0x7f41740978f0;2;2]
[Nov 16 06:19:26] DEBUG[8676]: src/mrcp_client_session.c:329  Control Channel Removed RSU-1 <7109726152b14018@speechrecog>
[Nov 16 06:19:26] DEBUG[8676]: src/apt_consumer_task.c:135  Wait for Messages [MRCP Client]
[Nov 16 06:19:26] DEBUG[9740][C-00000139]: res_speech_unimrcp.c:1164 uni_recog_sm_request_send: (RSU-1) Wait for session response type: 1
[Nov 16 06:19:26] DEBUG[8677]: src/apt_task.c:263  Signal Message to [MRCP Client] [0x7f417c027140;1;1]
[Nov 16 06:19:26] DEBUG[8676]: src/apt_task.c:335  Process Message [MRCP Client] [0x7f417c027140;1;1]
[Nov 16 06:19:26] DEBUG[8676]: src/apt_consumer_task.c:135  Wait for Messages [MRCP Client]
[Nov 16 06:19:26] DEBUG[8680]: src/apt_task.c:335  Process Message [Media-Engine-1] [0x7f4178007ee0;1;0]
[Nov 16 06:19:26] DEBUG[8680]: src/mpf_context.c:236  Remove Media Context RSU-1
[Nov 16 06:19:26] DEBUG[8680]: src/apt_task.c:263  Signal Message to [MRCP Client] [0x7f415c0151d0;3;0]
[Nov 16 06:19:26] DEBUG[8676]: src/apt_task.c:335  Process Message [MRCP Client] [0x7f415c0151d0;3;0]
[Nov 16 06:19:26] DEBUG[8676]: src/mrcp_client_session.c:1009  Media Termination Subtracted RSU-1 <7109726152b14018@media-tm>
[Nov 16 06:19:26] DEBUG[8676]: src/mrcp_client_session.c:1009  Media Termination Subtracted RSU-1 <7109726152b14018@rtp-tm>
[Nov 16 06:19:26] DEBUG[8676]: res_speech_unimrcp.c:912 on_session_terminate: (RSU-1) Session terminated status: 0
[Nov 16 06:19:26] DEBUG[8676]: src/apt_consumer_task.c:135  Wait for Messages [MRCP Client]
[Nov 16 06:19:26] DEBUG[9740][C-00000139]: res_speech_unimrcp.c:1169 uni_recog_sm_request_send: (RSU-1) Process session response type: 1 status: 0
    -- Executing [s@res-speech-unimrcp-9:3] SpeechActivateGrammar("PJSIP/6001-00000005", "builtin:speech/transcribe") in new stack
  == Spawn extension (res-speech-unimrcp-9, s, 3) exited non-zero on 'PJSIP/6001-00000005'
  == Using SIP RTP CoS mark 5


res-speech-unimrcp.conf
[general]
; UniMRCP named profile. Options are:
unimrcp-profile = uni2      ; UniMRCP MRCPv2 Server
;unimrcp-profile = uni1     ; UniMRCP MRCPv1 Server
;unimrcp-profile = lv2      ; LumenVox MRCPv2 Server
;unimrcp-profile = lv1      ; LumenVox MRCPv1 Server
;unimrcp-profile = nss2     ; Nuance MRCPv2 Server
;unimrcp-profile = nss1     ; Nuance MRCPv1 Server

; UniMRCP logging level.  Options are:
; EMERGENCY|ALERT|CRITICAL|ERROR|WARNING|NOTICE|INFO|DEBUG -->
log-level = DEBUG


; Preloaded grammars
[grammars]
;grammar-name = path-to-grammar-file

; MRCPv2 properties (recognizer and generic header fields)
[mrcpv2-properties]
Recognition-Timeout = 20000
No-Input-Timeout = 15000


; MRCPv1 properties (recognizer and generic header fields)
[mrcpv1-properties]
Recognition-Timeout = 20000
No-Input-Timeout = 15000


Please let me know if I need to share any other additional details.
Thanks.

Arsen Chaloyan

unread,
Nov 25, 2019, 8:45:05 PM11/25/19
to UniMRCP
Hi Jatin,

[Nov 16 06:19:26] WARNING[8680]: src/mpf_rtp_stream.c:232  Failed to Match Codec List 10.6.0.16:4002

The above statement would indicate no intersection (or no codec translation path) is available between codecs used in the incoming SIP leg and the ones configured to be used in the MRCP leg.

--
You received this message because you are subscribed to the Google Groups "UniMRCP" group.
To unsubscribe from this group and stop receiving emails from it, send an email to unimrcp+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/unimrcp/2ac25b4c-2ee3-46eb-b8f0-77d9ba938743%40googlegroups.com.


--
Arsen Chaloyan
Author of UniMRCP
http://www.unimrcp.org

Jatin Parekh

unread,
Dec 5, 2019, 1:50:31 AM12/5/19
to UniMRCP
Hey Arsen,
Sorry for the delay in reply here.

In an attempt to get it working, I had changed a lot of config files without understanding what they did.
I re-deployed all of it (asterisk, unimrcp, AzureSR and Azure SS plugins) from scratch as per the documentation and it started working as expected.
It was clearly some config issue, but I am not really sure which change broke it.


On Tuesday, November 26, 2019 at 7:15:05 AM UTC+5:30, Arsen Chaloyan wrote:
Hi Jatin,

[Nov 16 06:19:26] WARNING[8680]: src/mpf_rtp_stream.c:232  Failed to Match Codec List 10.6.0.16:4002

The above statement would indicate no intersection (or no codec translation path) is available between codecs used in the incoming SIP leg and the ones configured to be used in the MRCP leg.

To unsubscribe from this group and stop receiving emails from it, send an email to uni...@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages