Azure ASR : Blank ASR transcriptions freezes the ASR service

[Shreelaxmi Khatagalli]

Hello,

We are using Unimrcp's Azure SR plugin for real-time call transcriptions.

Certain utterances like "hmm" that are really short are causing ASR to give blank transcriptions.

<result>
  <interpretation grammar="builtin:speech/abc" confidence="0">
    <instance></instance>
    <input mode="speech"></input>
  </interpretation>
</result>

These Blank ASR transcriptions are freezing the ASR transcription altogether. No utterances said in the call after that receive any transcriptions.

Any idea why is this happening? It is running in continuous recognition mode. Is it possible that the connection resets with blank recognition in continuous recognition mode? If yes, how to restore it without ending the call?

TIA

[Vahagn Kocharyan]

Hi can you share logs?

[Shreelaxmi Khatagalli]

Hello,

we resolved the black ASR transcription issue. But now there seems to be another issue.

ASR randomly throws the error : Completion-Cause: 006 recognizer-error

Here are the client side logs

2022-03-08 13:56:46.115722 98.57% [DEBUG] apt_task.c:265 () Signal Message to [MRCP Client] [0x7f8718255490;2;3]
2022-03-08 13:56:46.115722 98.57% [DEBUG] apt_poller_task.c:251 () Wait for Messages [MRCPv2ConnectionAgent]
2022-03-08 13:56:46.115722 98.57% [DEBUG] apt_task.c:337 () Process Message [MRCP Client] [0x7f8718255490;2;3]
2022-03-08 13:56:46.115722 98.57% [INFO] mrcp_client_session.c:516 (ASR-49) Raise App MRCP Event ASR-49 <31200095cdbf463e>
2022-03-08 13:56:46.115722 98.57% [DEBUG] mod_unimrcp.c:3694 (ASR-49) START OF INPUT
2022-03-08 13:56:46.115722 98.57% [DEBUG] mod_unimrcp.c:2594 (ASR-49) start of input
2022-03-08 13:56:46.115722 98.57% [DEBUG] apt_consumer_task.c:141 () Wait for Messages [MRCP Client]
2022-03-08 13:56:46.115722 98.57% [DEBUG] mod_unimrcp.c:2541 (ASR-49) SUCCESS, start of input
2022-03-08 13:56:46.115722 98.57% [DEBUG] mod_unimrcp.c:2541 (ASR-49) SUCCESS, start of input
2022-03-08 13:56:46.115722 98.57% [DEBUG] mod_unimrcp.c:2784 (ASR-49) start of input
2022-03-08 13:56:46.157590 98.57% [DEBUG] switch_ivr.c:632 sofia/external/+917892...@pstn.twilio.com:5060 Command Execute [depth=1] break()
EXECUTE [depth=1] sofia/external/+917892...@pstn.twilio.com:5060 break()
2022-03-08 13:56:46.157590 98.57% [DEBUG] switch_ivr.c:632 sofia/external/+917892...@pstn.twilio.com:5060 Command Execute [depth=1] playback(/usr/local/FsOutboundSocket/voice_files/fast-pace-Typing.mp3)
EXECUTE [depth=1] sofia/external/+917892...@pstn.twilio.com:5060 playback(/usr/local/FsOutboundSocket/voice_files/fast-pace-Typing.mp3)
2022-03-08 13:56:46.157590 98.57% [WARNING] switch_core_file.c:463 File has 2 channels, muxing to 1 channel will occur.
2022-03-08 13:56:46.157590 98.57% [DEBUG] switch_ivr_play_say.c:1556 Codec Activated L16@8000hz 1 channels 20ms
2022-03-08 13:56:54.055724 98.77% [DEBUG] apt_poller_task.c:269 () Process Signalled Descriptor [MRCPv2ConnectionAgent]
2022-03-08 13:56:54.055724 98.77% [INFO] mrcp_client_connection.c:635 () Receive MRCPv2 Data 165.227.58.15:47272 <-> 159.65.67.41:1544 [139 bytes]
MRCP/2.0 139 RECOGNITION-COMPLETE 38 COMPLETE
Channel-Identifier: 31200095cdbf463e@speechrecog
Completion-Cause: 006 recognizer-error


2022-03-08 13:56:54.055724 98.77% [DEBUG] apt_task.c:265 () Signal Message to [MRCP Client] [0x7f8718258050;2;3]
2022-03-08 13:56:54.055724 98.77% [DEBUG] apt_poller_task.c:251 () Wait for Messages [MRCPv2ConnectionAgent]
2022-03-08 13:56:54.055724 98.77% [DEBUG] apt_task.c:337 () Process Message [MRCP Client] [0x7f8718258050;2;3]
2022-03-08 13:56:54.055724 98.77% [INFO] mrcp_client_session.c:516 (ASR-49) Raise App MRCP Event ASR-49 <31200095cdbf463e>
2022-03-08 13:56:54.055724 98.77% [DEBUG] mod_unimrcp.c:3669 (ASR-49) RECOGNITION COMPLETE, Completion-Cause: 006
2022-03-08 13:56:54.055724 98.77% [DEBUG] mod_unimrcp.c:3687 (ASR-49) No result
2022-03-08 13:56:54.055724 98.77% [DEBUG] mod_unimrcp.c:2727 (ASR-49) ASR adding result headers
2022-03-08 13:56:54.055724 98.77% [DEBUG] mod_unimrcp.c:2622 (ASR-49) result:

Completion-Cause: 006
2022-03-08 13:56:54.055724 98.77% [DEBUG] mod_unimrcp.c:1578 (ASR-49) PROCESSING ==> READY
2022-03-08 13:56:54.055724 98.77% [DEBUG] apt_consumer_task.c:141 () Wait for Messages [MRCP Client]
2022-03-08 13:56:54.055724 98.77% [DEBUG] mod_unimrcp.c:2539 (ASR-49) SUCCESS, have result
2022-03-08 13:56:54.055724 98.77% [DEBUG] mod_unimrcp.c:2539 (ASR-49) SUCCESS, have result
2022-03-08 13:56:54.055724 98.77% [DEBUG] mod_unimrcp.c:2780 (ASR-49) result:

Completion-Cause: 006
2022-03-08 13:57:20.855723 98.87% [DEBUG] switch_ivr_play_say.c:2001 done playing file /usr/local/FsOutboundSocket/voice_files/fast-pace-Typing.mp3
2022-03-08 13:57:46.995730 99.10% [INFO] mrcp_sofiasip_client_agent.c:609 () Receive SIP Event [nua_i_state] Status 0 INVITE sent [uni2]
2022-03-08 13:57:46.995730 99.10% [NOTICE] mrcp_sofiasip_client_agent.c:547 (ASR-49) SIP Call State ASR-49 [calling]
2022-03-08 13:57:46.995730 99.10% [INFO] mrcp_sofiasip_client_agent.c:609 () Receive SIP Event [nua_r_invite] Status 200 OK [uni2]
2022-03-08 13:57:46.995730 99.10% [INFO] mrcp_sofiasip_client_agent.c:609 () Receive SIP Event [nua_i_state] Status 200 OK [uni2]
2022-03-08 13:57:46.995730 99.10% [NOTICE] mrcp_sofiasip_client_agent.c:547 (ASR-49) SIP Call State ASR-49 [ready]
2022-03-08 13:57:46.995730 99.10% [INFO] mrcp_sofiasip_client_agent.c:433 (ASR-49) Remote SDP ASR-49 <31200095cdbf463e>

[Vahagn Kocharyan]

there are many cases for  Completion-Cause: 006 . share also unimrcp server logs

[Arsen Chaloyan]

Sorry, but without logs, we can only guess. And my first guess would be the confidence threshold. Next - a grammar mismatch.

On Wed, Mar 9, 2022 at 7:42 PM Shreelaxmi Khatagalli <shree...@voiceplug.ai> wrote:

It was an issue with Azure subscription (it supported only one channel and we were using multiple) It is resolved now.

Now we have issues with Completion cause 001- No match. Once this error occurs, ASR doesn't provide any transcriptions even though there are utterances.

Why does this happen? Is there a way to fix it?

--
You received this message because you are subscribed to the Google Groups "UniMRCP" group.
To unsubscribe from this group and stop receiving emails from it, send an email to unimrcp+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/unimrcp/0b1c0996-b0e3-4251-8a6e-c87d1592cd0an%40googlegroups.com.

--

Arsen Chaloyan
Author of UniMRCP
http://www.unimrcp.org