UMS Azure Bot/SS - Asterisk no phrase repeat back.

[Onintsoa Razafimandimby]

hello, I followed the tutorial on https://docs.unispeech.io/en/ums/asterisk/azbot-azss until the end. I configured unimrcp and asterisk with a SIP account for a number 702 and with the agi code agi_azurebot.py. When I do the test and I call the number 702 from a softphone, the problem is when I speak, the speech to text works in the unimrcp log but the program is always on Completion-Cause: 001 no-match and can't repeat what I said. what is the solution please.

this is the unimrcp log

{"Offset":33400000} 2023-10-13 17:15:54:420414 [INFO] Received WS msg [1093 bytes] <8b839ede700040ee> X-RequestId:94d4d17829ca403d80e17bf64e15102f Path:speech.phrase Content-Type:application/json; charset=utf-8 {"Id":"956fc0bbb5f74b4e97cfb5368934ad75","RecognitionStatus":"Success","Offset":8400000,"Duration":19600000,"Channel":0,"DisplayText":"Hello. Hello. Hello.","NBest":[{"Confidence":0.8880908,"Lexical":"hello hello hello","ITN":"hello hello hello","MaskedITN":"hello hello hello","Display":"Hello. Hello. Hello."},{"Confidence":0.7509242,"Lexical":"hello hello hello hello","ITN":"hello hello hello hello","MaskedITN":"hello hello hello hello","Display":"hello hello hello hello"},{"Confidence":0.865138,"Lexical":"hello hello hello oh","ITN":"hello hello hello oh","MaskedITN":"hello hello hello oh","Display":"hello hello hello oh"},{"Confidence":0.8649486,"Lexical":"hello hello hello hi","ITN":"hello hello hello hi","MaskedITN":"hello hello hello hi","Display":"hello hello hello hi"},{"Confidence":0.701214,"Lexical":"hello hello hello hello hello","ITN":"hello hello hello hello hello","MaskedITN":"hello hello hello hello hello","Display":"hello hello hello hello hello"}]} 2023-10-13 17:15:54:420670 [INFO] Send Activity Async [{ "type": "message", "text" : "hello hello hello" }] <8b839ede700040ee@azurebot> 2023-10-13 17:15:54:429489 [INFO] Input Complete [stopped] size=168000 bytes, dur=10620 ms <8b839ede700040ee@azurebot> 2023-10-13 17:15:54:429675 [INFO] Received WS msg [111 bytes] <8b839ede700040ee> X-RequestId:94d4d17829ca403d80e17bf64e15102f Path:turn.end Content-Type:application/json; charset=utf-8 {} 2023-10-13 17:15:54:429730 [INFO] Send WS msg [582 bytes] <8b839ede700040ee> Path:telemetry X-RequestId:94d4d17829ca403d80e17bf64e15102f X-Timestamp:2023-10-13T17:15:54.429700 Content-Type:application/json; charset=utf-8 { "ReceivedMessages": [{ "speech.startDetected": "2023-10-13T17:15:52.425579" }, { "speech.hypothesis": ["2023-10-13T17:15:52.529807", "2023-10-13T17:15:53.429693"] }, { "speech.phrase": "2023-10-13T17:15:54.420546" }, { "speech.endDetected": "2023-10-13T17:15:54.404348" }, { "turn.start": "2023-10-13T17:15:50.879438" }, { "turn.end": "2023-10-13T17:15:54.429700" }] } 2023-10-13 17:15:59:421680 [WARN] Activity Timeout Elapsed <8b839ede700040ee@azurebot> 2023-10-13 17:15:59:421763 [WARN] No Activity Found <8b839ede700040ee@azurebot> 2023-10-13 17:15:59:421823 [INFO] Process RECOGNITION-COMPLETE Event <8b839ede700040ee@speechrecog> [1] 2023-10-13 17:15:59:421858 [INFO] State Transition RECOGNIZING -> RECOGNIZED <8b839ede700040ee@speechrecog> 2023-10-13 17:15:59:421917 [INFO] Send MRCPv2 Data 192.168.88.96:1544 <-> 192.168.88.96:35990 [130 bytes] MRCP/2.0 130 RECOGNITION-COMPLETE 1 COMPLETE Channel-Identifier: 8b839ede700040ee@speechrecog Completion-Cause: 001 no-match 2023-10-13 17:15:59:431503 [INFO] Receive MRCPv2 Data 192.168.88.96:1544 <-> 192.168.88.96:35990 [293 bytes] MRCP/2.0 293 RECOGNIZE 3 Channel-Identifier: 8b839ede700040ee@speechrecog Content-Type: text/uri-list Cancel-If-Queue: false Start-Input-Timers: false No-Input-Timeout: 10000 Speech-Complete-Timeout: 1000 Speech-Incomplete-Timeout: 15000 Content-Length: 25 builtin:speech/transcribe 2023-10-13 17:15:59:431587 [INFO] Process RECOGNIZE Request <8b839ede700040ee@speechrecog> [3]

this is asterisk log

Welcome to Azure Echo bot. Say something, and I will repeat your phrase back. [Oct 13 17:15:44] NOTICE[4701]: src/mrcp_client_connection.c:656 Receive MRCPv2 Data 192.168.88.96:36006 <-> 192.168.88.96:1544 [83 bytes] MRCP/2.0 83 1 200 IN-PROGRESS Channel-Identifier: 05beffa8b1124f05@speechsynth [Oct 13 17:15:44] NOTICE[4700]: src/mrcp_client_session.c:498 Raise App MRCP Response TTS-0 <05beffa8b1124f05> [Oct 13 17:15:45] NOTICE[4689]: chan_sip.c:28827 handle_request_subscribe: Received SIP subscribe for peer without mailbox: astums > 0x7fcd880088f0 -- Strict RTP learning complete - Locking on source address 192.168.88.108:14472 [Oct 13 17:15:49] NOTICE[4701]: src/mrcp_client_connection.c:656 Receive MRCPv2 Data 192.168.88.96:36006 <-> 192.168.88.96:1544 [122 bytes] MRCP/2.0 122 SPEAK-COMPLETE 1 COMPLETE Channel-Identifier: 05beffa8b1124f05@speechsynth Completion-Cause: 000 normal [Oct 13 17:15:49] NOTICE[4700]: src/mrcp_client_session.c:514 Raise App MRCP Event TTS-0 <05beffa8b1124f05> [Oct 13 17:15:49] NOTICE[4700]: src/mrcp_client_session.c:390 Receive App MRCP Request ASR-0 <8b839ede700040ee> [Oct 13 17:15:49] NOTICE[4700]: src/mrcp_client_session.c:620 Send MRCP Request ASR-0 <8b839ede700040ee@speechrecog> [2] [Oct 13 17:15:49] NOTICE[4701]: src/mrcp_client_connection.c:551 Send MRCPv2 Data 192.168.88.96:35990 <-> 192.168.88.96:1544 [86 bytes] MRCP/2.0 86 START-INPUT-TIMERS 2 Channel-Identifier: 8b839ede700040ee@speechrecog [Oct 13 17:15:49] NOTICE[4701]: src/mrcp_client_connection.c:656 Receive MRCPv2 Data 192.168.88.96:35990 <-> 192.168.88.96:1544 [80 bytes] MRCP/2.0 80 2 200 COMPLETE Channel-Identifier: 8b839ede700040ee@speechrecog [Oct 13 17:15:49] NOTICE[4700]: src/mrcp_client_session.c:498 Raise App MRCP Response ASR-0 <8b839ede700040ee> [Oct 13 17:15:52] NOTICE[4701]: src/mrcp_client_connection.c:656 Receive MRCPv2 Data 192.168.88.96:35990 <-> 192.168.88.96:1544 [115 bytes] MRCP/2.0 115 START-OF-INPUT 1 IN-PROGRESS Channel-Identifier: 8b839ede700040ee@speechrecog Input-Type: speech [Oct 13 17:15:52] NOTICE[4700]: src/mrcp_client_session.c:514 Raise App MRCP Event ASR-0 <8b839ede700040ee> [Oct 13 17:15:59] NOTICE[4701]: src/mrcp_client_connection.c:656 Receive MRCPv2 Data 192.168.88.96:35990 <-> 192.168.88.96:1544 [130 bytes] MRCP/2.0 130 RECOGNITION-COMPLETE 1 COMPLETE Channel-Identifier: 8b839ede700040ee@speechrecog Completion-Cause: 001 no-match [Oct 13 17:15:59] NOTICE[4700]: src/mrcp_client_session.c:514 Raise App MRCP Event ASR-0 <8b839ede700040ee> [Oct 13 17:15:59] NOTICE[4748][C-00000001]: app_synthandrecog.c:1307 synthandrecog_exit: SynthAndRecog() exiting status: OK on SIP/astums-00000000 agi_azurebot.py: got status OK agi_azurebot.py: got completion cause 001 -- AGI Script Executing Application: (SynthandRecog) Options: ("Welcome to Azure Echo bot. Say something, and I will repeat your phrase back.","builtin:speech/transcribe",nif=json&plt=1&b=1&sct=1000&sint=15000&nit=10000) [Oct 13 17:15:59] NOTICE[4748][C-00000001]: app_synthandrecog.c:1345 app_synthandrecog_exec: SynthAndRecog() prompt: Welcome to Azure Echo bot. Say something, and I will repeat your phrase back. [Oct 13 17:15:59] NOTICE[4748][C-00000001]: app_synthandrecog.c:1353 app_synthandrecog_exec: SynthAndRecog() grammar: builtin:speech/transcribe [Oct 13 17:15:59] NOTICE[4748][C-00000001]: app_synthandrecog.c:1369 app_synthandrecog_exec: SynthAndRecog() options: nif=json&plt=1&b=1&sct=1000&sint=15000&nit=10000 [Oct 13 17:15:59] NOTICE[4748][C-00000001]: app_synthandrecog.c:1662 app_synthandrecog_exec: (ASR-0) Recognizing, Start-Input-Timers: 0 [Oct 13 17:15:59] NOTICE[4700]: src/mrcp_client_session.c:390 Receive App MRCP Request ASR-0 <8b839ede700040ee> [Oct 13 17:15:59] NOTICE[4700]: src/mrcp_client_session.c:620 Send MRCP Request ASR-0 <8b839ede700040ee@speechrecog> [3] [Oct 13 17:15:59] NOTICE[4701]: src/mrcp_client_connection.c:551 Send MRCPv2 Data 192.168.88.96:35990 <-> 192.168.88.96:1544 [293 bytes] MRCP/2.0 293 RECOGNIZE 3 Channel-Identifier: 8b839ede700040ee@speechrecog Content-Type: text/uri-list Cancel-If-Queue: false Start-Input-Timers: false No-Input-Timeout: 10000 Speech-Complete-Timeout: 1000 Speech-Incomplete-Timeout: 15000 Content-Length: 25 builtin:speech/transcribe [Oct 13 17:15:59] NOTICE[4701]: src/mrcp_client_connection.c:656 Receive MRCPv2 Data 192.168.88.96:35990 <-> 192.168.88.96:1544 [83 bytes] MRCP/2.0 83 3 200 IN-PROGRESS Channel-Identifier: 8b839ede700040ee@speechrecog [Oct 13 17:15:59] NOTICE[4700]: src/mrcp_client_session.c:498 Raise App MRCP Response ASR-0 <8b839ede700040ee> [Oct 13 17:15:59] NOTICE[4700]: src/mrcp_client_session.c:390 Receive App MRCP Request TTS-0 <05beffa8b1124f05> [Oct 13 17:15:59] NOTICE[4700]: src/mrcp_client_session.c:620 Send MRCP Request TTS-0 <05beffa8b1124f05@speechsynth> [2] [Oct 13 17:15:59] NOTICE[4701]: src/mrcp_client_connection.c:551 Send MRCPv2 Data 192.168.88.96:36006 <-> 192.168.88.96:1544 [197 bytes] MRCP/2.0 197 SPEAK 2 Channel-Identifier: 05beffa8b1124f05@speechsynth Content-Type: text/plain Content-Length: 77

[Vahagn Kocharyan]

HI

please update your azure-bot version to latest. try and share logs

Thanks

Vahagn

[Onintsoa Razafimandimby]

What do you mean update my azure-bot version to latest?

--
You received this message because you are subscribed to a topic in the Google Groups "UniMRCP" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/unimrcp/YyhKC_LjdUg/unsubscribe.
To unsubscribe from this group and all its topics, send an email to unimrcp+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/unimrcp/32fbb062-7bc0-492b-8794-182472d50692n%40googlegroups.com.

[Arsen Chaloyan]

Here is what happened based on the provided logs.

The caller said "hello hello hello" and the activity was sent to the bot.

2023-10-13 17:15:54:420670 [INFO] Send Activity Async [{ "type": "message", "text" : "hello hello hello" }] <8b839ede700040ee@azurebot> 

There was no response received back from the bot within the default activity timeout of 5 seconds.

2023-10-13 17:15:59:421680 [WARN] Activity Timeout Elapsed <8b839ede700040ee@azurebot>

You received this message because you are subscribed to the Google Groups "UniMRCP" group.
To unsubscribe from this group and stop receiving emails from it, send an email to unimrcp+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/unimrcp/CAKPC0%3DRQQSiquAoePDCUzWcEyChsd4KRR5FFKN0G6Ofnrwp_pA%40mail.gmail.com.

--

Arsen Chaloyan
Author of UniMRCP
http://www.unimrcp.org

[Onintsoa Razafimandimby]

this is my azbot.subscription.key

{

"subscription-key": "******Speech Service Key**************",
"region": "eastus",
"service-endpoint": "",
"api": ""

}

and this is my cognitive.subscription.key

{
"auth-endpoint": "https://eastus.api.cognitive.microsoft.com/sts/v1.0/issuetoken",
"auth-key": "******Speech Service Key**************",
"service-endpoint": ""
}

I followed part 2 Azure Bot Service from the site https://docs.unispeech.io/en/ums/asterisk/azbot-azss exactly but I did not use an echo bot but I created my own robot. I tested my robot in web chat on Azure and it works.

please what is the problem? why there is no response received back from the bot within the default activity timeout of 5 seconds?

To view this discussion on the web visit https://groups.google.com/d/msgid/unimrcp/CAC5Usc%2BnJ5ay6mUstXxuPXmiSXRTvcJ7fCBX%3D5n0b0GUk1908g%40mail.gmail.com.