From freeswitch Google ASR works, but TTS not working

244 views

Skip to first unread message

Rammohan Yadavalli

unread,

Dec 16, 2021, 11:09:41 AM12/16/21

to UniMRCP

Hi Team,

I am looking to integrate Freeswitch with UNIMRCP server and particularly Text-To-Speech I am unable to make it work. In freeswitch log I see " unexpected SPEAK response, request_state = 0"

I have attached both freeswitch log and UNIMRCP server log for your reference.

Appreciate if you can help resolve this issue, please let me know if you need further information, I will be happy to share.

Log from freeswitch

2021-12-16 14:35:54.296637 96.60% [NOTICE] switch_rtp.c:1314 Auto Changing audio stun/rtp/dtls port from 122.175.106.110:59179 to 192.168.3.3:59179 idx:-1
2021-12-16 14:35:54.296637 96.60% [DEBUG] sofia.c:7499 Channel sofia/internal/10...@192.168.3.3 entering state [completed][200]
2021-12-16 14:35:54.296637 96.60% [DEBUG] sofia.c:7499 Channel sofia/internal/10...@192.168.3.3 entering state [ready][200]
2021-12-16 14:35:54.296637 96.60% [INFO] switch_rtp.c:3425 Changing audio DTLS state from HANDSHAKE to SETUP
2021-12-16 14:35:54.316640 96.60% [INFO] switch_rtp.c:3332 audio Fingerprint Verified.
2021-12-16 14:35:54.316640 96.60% [INFO] switch_rtp.c:4423 Activating audio Secure RTP SEND
2021-12-16 14:35:54.316640 96.60% [INFO] switch_rtp.c:4401 Activating audio Secure RTP RECV
2021-12-16 14:35:54.316640 96.60% [DEBUG] switch_core_sqldb.c:2778 Secure Type: srtp:dtls:AES_CM_128_HMAC_SHA1_80
2021-12-16 14:35:54.316640 96.60% [INFO] switch_rtp.c:3374 Changing audio DTLS state from SETUP to READY
2021-12-16 14:35:54.316640 96.60% [DEBUG] switch_core_sqldb.c:2778 Secure Type: srtp:dtls:AES_CM_128_HMAC_SHA1_80
2021-12-16 14:35:54.316640 96.60% [NOTICE] mod_dptools.c:1419 Channel [sofia/internal/10...@192.168.3.3] has been answered
2021-12-16 14:35:54.316640 96.60% [DEBUG] switch_channel.c:3950 (sofia/internal/10...@192.168.3.3) Callstate Change EARLY -> ACTIVE
EXECUTE [depth=0] sofia/internal/10...@192.168.3.3 set(record_sample_rate=16000)
2021-12-16 14:35:54.316640 96.60% [DEBUG] mod_dptools.c:1685 SET sofia/internal/10...@192.168.3.3 [record_sample_rate]=[16000]
EXECUTE [depth=0] sofia/internal/10...@192.168.3.3 set(tts_engine=unimrcp:uni1)
2021-12-16 14:35:54.316640 96.60% [DEBUG] mod_dptools.c:1685 SET sofia/internal/10...@192.168.3.3 [tts_engine]=[unimrcp:uni1]
EXECUTE [depth=0] sofia/internal/10...@192.168.3.3 set(tts_voice=en-US-Wavenet-A)
2021-12-16 14:35:54.316640 96.60% [DEBUG] mod_dptools.c:1685 SET sofia/internal/10...@192.168.3.3 [tts_voice]=[en-US-Wavenet-A]
EXECUTE [depth=0] sofia/internal/10...@192.168.3.3 speak(Hello Welcome to Freeswitch UNIMRCP)
2021-12-16 14:35:54.316640 96.60% [INFO] mod_unimrcp.c:1625 speech_handle: name = unimrcp, rate = 48000, speed = 0, samples = 960, voice = , engine = unimrcp, param = uni1
2021-12-16 14:35:54.316640 96.60% [INFO] mod_unimrcp.c:1628 voice = en-US-Wavenet-A, rate = 48000
2021-12-16 14:35:54.316640 96.60% [DEBUG] mod_unimrcp.c:684 (TTS-0) audio queue created
2021-12-16 14:35:54.316640 96.60% [NOTICE] mrcp_application.c:96 (TTS-0) Create MRCP Handle 0x7f5210070040 [uni1]
2021-12-16 14:35:54.316640 96.60% [INFO] mrcp_client_session.c:133 (TTS-0) Create Channel TTS-0 <new>
2021-12-16 14:35:54.316640 96.60% [DEBUG] apt_task.c:265 () Signal Message to [MRCP Client] [0x7f52100065c0;4;0]
2021-12-16 14:35:54.316640 96.60% [DEBUG] apt_task.c:337 () Process Message [MRCP Client] [0x7f52100065c0;4;0]
2021-12-16 14:35:54.316640 96.60% [INFO] mrcp_client_session.c:387 (TTS-0) Receive App Request TTS-0 <new> [2]
2021-12-16 14:35:54.316640 96.60% [NOTICE] rtsp_client.c:298 () Create RTSP Handle 0x7f52340097a0
2021-12-16 14:35:54.316640 96.60% [INFO] mrcp_client.c:700 (TTS-0) Add MRCP Handle TTS-0 <new>
2021-12-16 14:35:54.316640 96.60% [DEBUG] mrcp_client_session.c:1283 (TTS-0) Dispatch App Request TTS-0 <new> [2]
2021-12-16 14:35:54.316640 96.60% [NOTICE] mrcp_client_session.c:719 (TTS-0) Add Control Channel TTS-0 <new@speechsynth>
2021-12-16 14:35:54.316640 96.60% [DEBUG] mrcp_client_session.c:745 (TTS-0) Add Media Termination TTS-0 <new@media-tm>
2021-12-16 14:35:54.316640 96.60% [DEBUG] mrcp_client_session.c:777 (TTS-0) Add Media Termination TTS-0 <new@rtp-tm>
2021-12-16 14:35:54.316640 96.60% [DEBUG] apt_task.c:265 () Signal Message to [MediaEngine] [0x7f523400bf40;1;0]
2021-12-16 14:35:54.316640 96.60% [DEBUG] apt_consumer_task.c:141 () Wait for Messages [MRCP Client]
2021-12-16 14:35:54.316640 96.60% [DEBUG] apt_task.c:337 () Process Message [MediaEngine] [0x7f523400bf40;1;0]
2021-12-16 14:35:54.316640 96.60% [DEBUG] mpf_context.c:182 () Add Media Context TTS-0
2021-12-16 14:35:54.316640 96.60% [DEBUG] apt_task.c:265 () Signal Message to [MRCP Client] [0x7f5204000c10;3;0]
2021-12-16 14:35:54.316640 96.60% [DEBUG] apt_task.c:337 () Process Message [MRCP Client] [0x7f5204000c10;3;0]
2021-12-16 14:35:54.316640 96.60% [DEBUG] mrcp_client_session.c:944 (TTS-0) Media Termination Added TTS-0 <new@media-tm>
2021-12-16 14:35:54.316640 96.60% [DEBUG] mrcp_client_session.c:944 (TTS-0) Media Termination Added TTS-0 <new@rtp-tm>
2021-12-16 14:35:54.316640 96.60% [INFO] mrcp_client_session.c:411 (TTS-0) Send Offer TTS-0 <new> [c:0 a:1 v:0] to 192.168.3.3:1554
2021-12-16 14:35:54.316640 96.60% [DEBUG] apt_task.c:265 () Signal Message to [uni1] [0x7f523400b8a0;1;0]
2021-12-16 14:35:54.316640 96.60% [DEBUG] apt_consumer_task.c:141 () Wait for Messages [MRCP Client]
2021-12-16 14:35:54.316640 96.60% [DEBUG] apt_poller_task.c:261 () Process Poller Wakeup [uni1]
2021-12-16 14:35:54.316640 96.60% [DEBUG] apt_task.c:337 () Process Message [uni1] [0x7f523400b8a0;1;0]
2021-12-16 14:35:54.316640 96.60% [NOTICE] rtsp_client.c:374 () Established RTSP Connection 192.168.3.3:34130 <-> 192.168.3.3:1554
2021-12-16 14:35:54.316640 96.60% [INFO] rtsp_client.c:573 () Add RTSP Handle 0x7f52340097a0
2021-12-16 14:35:54.316640 96.60% [INFO] rtsp_client.c:839 () Send RTSP Data 192.168.3.3:34130 <-> 192.168.3.3:1554 [354 bytes]
SETUP rtsp://192.168.3.3:1554/speechsynthesizer RTSP/1.0
CSeq: 1
Transport: RTP/AVP;unicast;client_port=4000-4001
Content-Type: application/sdp
Content-Length: 183

v=0
o=FreeSWITCH 0 0 IN IP4 192.168.3.3
s=-
c=IN IP4 192.168.3.3
t=0 0
m=audio 4000 RTP/AVP 0 8 96
a=rtpmap:0 PCMU/8000
a=rtpmap:8 PCMA/8000
a=rtpmap:96 L16/8000
a=recvonly

2021-12-16 14:35:54.316640 96.60% [INFO] rtsp_client.c:526 () Push RTSP Request to In-Progress Queue 0x7f52340097a0 <new> CSeq:1
2021-12-16 14:35:54.316640 96.60% [DEBUG] apt_poller_task.c:246 () Wait for Messages [uni1] timeout [3000]
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_poller_task.c:269 () Process Signalled Descriptor [uni1]
2021-12-16 14:35:54.336636 96.60% [INFO] rtsp_client.c:937 () Receive RTSP Data 192.168.3.3:34130 <-> 192.168.3.3:1554 [316 bytes]
RTSP/1.0 200 OK
CSeq: 1
Transport: RTP/AVP;unicast;client_port=4000-4001;server_port=5004-5005
Session: ee26cb9954094ffd
Content-Type: application/sdp
Content-Length: 137

v=0
o=UniMRCPServer 0 0 IN IP4 192.168.3.3
s=-
c=IN IP4 192.168.3.3
t=0 0
m=audio 5004 RTP/AVP 0
a=rtpmap:0 PCMU/8000
a=sendrecv

2021-12-16 14:35:54.336636 96.60% [INFO] rtsp_client.c:551 () Pop In-Progress RTSP Request 0x7f52340097a0 CSeq:1
2021-12-16 14:35:54.336636 96.60% [INFO] rtsp_client.c:688 () Add RTSP Session 0x7f52340097a0 <ee26cb9954094ffd>
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_task.c:265 () Signal Message to [MRCP Client] [0x7f52300008c0;1;0]
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_poller_task.c:251 () Wait for Messages [uni1]
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_task.c:337 () Process Message [MRCP Client] [0x7f52300008c0;1;0]
2021-12-16 14:35:54.336636 96.60% [INFO] mrcp_client_session.c:151 (TTS-0) Receive Answer TTS-0 <ee26cb9954094ffd> [c:0 a:1 v:0] Status 200
2021-12-16 14:35:54.336636 96.60% [DEBUG] mrcp_client_session.c:1180 (TTS-0) Modify Media Termination TTS-0 <ee26cb9954094ffd@rtp-tm>
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_task.c:265 () Signal Message to [MediaEngine] [0x7f5234004f90;1;0]
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_consumer_task.c:141 () Wait for Messages [MRCP Client]
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_task.c:337 () Process Message [MediaEngine] [0x7f5234004f90;1;0]
2021-12-16 14:35:54.336636 96.60% [INFO] mpf_rtp_stream.c:331 () Enable RTP Session 192.168.3.3:4000
2021-12-16 14:35:54.336636 96.60% [DEBUG] mpf_bridge.c:129 () Create Linear Audio Bridge TTS-0
2021-12-16 14:35:54.336636 96.60% [INFO] mpf_rtp_stream.c:509 () Open RTP Receiver 192.168.3.3:4000 <- 192.168.3.3:5004 playout [0 ms] bounds [0 - 600 ms] adaptive [0] skew detection [1]
2021-12-16 14:35:54.336636 96.60% [INFO] mpf_bridge.c:93 () Media Path TTS-0 Source->[PCMU/8000/1]->Decoder->[LPCM/8000/1]->Bridge->[LPCM/8000/1]->Sink
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_task.c:265 () Signal Message to [MRCP Client] [0x7f5204000b60;3;0]
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_task.c:337 () Process Message [MRCP Client] [0x7f5204000b60;3;0]
2021-12-16 14:35:54.336636 96.60% [DEBUG] mrcp_client_session.c:985 (TTS-0) Media Termination Modified TTS-0 <ee26cb9954094ffd@rtp-tm>
2021-12-16 14:35:54.336636 96.60% [INFO] mrcp_client_session.c:455 (TTS-0) Raise App Response TTS-0 <ee26cb9954094ffd> [2] SUCCESS [0]
2021-12-16 14:35:54.336636 96.60% [DEBUG] mod_unimrcp.c:1894 (TTS-0) SYNTHESIZER channel is ready, codec = LPCM, sample rate = 8000
2021-12-16 14:35:54.336636 96.60% [DEBUG] mod_unimrcp.c:1578 (TTS-0) CLOSED ==> READY
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_consumer_task.c:141 () Wait for Messages [MRCP Client]
2021-12-16 14:35:54.336636 96.60% [DEBUG] mod_unimrcp.c:1056 (TTS-0) channel is ready
2021-12-16 14:35:54.336636 96.60% [DEBUG] mod_unimrcp.c:1459 (TTS-0) param = Voice-Name, val = en-US-Wavenet-A
2021-12-16 14:35:54.336636 96.60% [DEBUG] switch_ivr_play_say.c:3099 OPEN TTS unimrcp:uni1
2021-12-16 14:35:54.336636 96.60% [DEBUG] switch_ivr_play_say.c:3109 Raw Codec Activated
2021-12-16 14:35:54.336636 96.60% [DEBUG] mod_unimrcp.c:1194 (TTS-0) Voice-Name: en-US-Wavenet-A
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_task.c:265 () Signal Message to [MRCP Client] [0x7f5210061160;4;0]
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_task.c:337 () Process Message [MRCP Client] [0x7f5210061160;4;0]
2021-12-16 14:35:54.336636 96.60% [INFO] mrcp_client_session.c:392 (TTS-0) Receive App MRCP Request TTS-0 <ee26cb9954094ffd>
2021-12-16 14:35:54.336636 96.60% [INFO] mrcp_client_session.c:622 (TTS-0) Send MRCP Request TTS-0 <ee26cb9954094ffd@speechsynth> [1]
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_task.c:265 () Signal Message to [uni1] [0x7f5234002d40;1;0]
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_consumer_task.c:141 () Wait for Messages [MRCP Client]
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_poller_task.c:261 () Process Poller Wakeup [uni1]
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_task.c:337 () Process Message [uni1] [0x7f5234002d40;1;0]
2021-12-16 14:35:54.336636 96.60% [INFO] rtsp_client.c:839 () Send RTSP Data 192.168.3.3:34130 <-> 192.168.3.3:1554 [282 bytes]
ANNOUNCE rtsp://192.168.3.3:1554/speechsynthesizer RTSP/1.0
CSeq: 2
Session: ee26cb9954094ffd
Content-Type: application/mrcp
Content-Length: 130

SPEAK 1 MRCP/1.0
Content-Type: text/plain
Voice-Name: en-US-Wavenet-A
Content-Length: 35

Hello Welcome to Freeswitch UNIMRCP
2021-12-16 14:35:54.336636 96.60% [INFO] rtsp_client.c:526 () Push RTSP Request to In-Progress Queue 0x7f52340097a0 <ee26cb9954094ffd> CSeq:2
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_poller_task.c:246 () Wait for Messages [uni1] timeout [3000]
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_poller_task.c:269 () Process Signalled Descriptor [uni1]
2021-12-16 14:35:54.336636 96.60% [INFO] rtsp_client.c:937 () Receive RTSP Data 192.168.3.3:34130 <-> 192.168.3.3:1554 [152 bytes]
RTSP/1.0 200 OK
CSeq: 2
Session: ee26cb9954094ffd
Content-Type: application/mrcp
Content-Length: 45

MRCP/1.0 1 406 COMPLETE
Voice-Variant: 0


2021-12-16 14:35:54.336636 96.60% [INFO] rtsp_client.c:551 () Pop In-Progress RTSP Request 0x7f52340097a0 CSeq:2
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_task.c:265 () Signal Message to [MRCP Client] [0x7f5230000b70;1;2]
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_poller_task.c:251 () Wait for Messages [uni1]
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_task.c:337 () Process Message [MRCP Client] [0x7f5230000b70;1;2]
2021-12-16 14:35:54.336636 96.60% [INFO] mrcp_client_session.c:500 (TTS-0) Raise App MRCP Response TTS-0 <ee26cb9954094ffd>
2021-12-16 14:35:54.336636 96.60% [DEBUG] mod_unimrcp.c:1971 (TTS-0) unexpected SPEAK response, request_state = 0
2021-12-16 14:35:54.336636 96.60% [DEBUG] mod_unimrcp.c:1578 (TTS-0) READY ==> ERROR
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_consumer_task.c:141 () Wait for Messages [MRCP Client]
2021-12-16 14:35:54.336636 96.60% [DEBUG] switch_ivr_play_say.c:2817 Speaking text: Hello Welcome to Freeswitch UNIMRCP
2021-12-16 14:35:54.336636 96.60% [DEBUG] mod_unimrcp.c:1578 (TTS-0) ERROR ==> READY
2021-12-16 14:35:54.336636 96.60% [DEBUG] switch_ivr_play_say.c:2981 done speaking text
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_task.c:265 () Signal Message to [MRCP Client] [0x7f5210061160;4;0]
2021-12-16 14:35:54.336636 96.60% [DEBUG] mod_unimrcp.c:924 (TTS-0) Waiting for MRCP session to terminate
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_task.c:337 () Process Message [MRCP Client] [0x7f5210061160;4;0]
2021-12-16 14:35:54.336636 96.60% [INFO] mrcp_client_session.c:387 (TTS-0) Receive App Request TTS-0 <ee26cb9954094ffd> [1]
2021-12-16 14:35:54.336636 96.60% [DEBUG] mrcp_client_session.c:1283 (TTS-0) Dispatch App Request TTS-0 <ee26cb9954094ffd> [1]
2021-12-16 14:35:54.336636 96.60% [INFO] mrcp_client_session.c:833 (TTS-0) Terminate Session TTS-0 <ee26cb9954094ffd>
2021-12-16 14:35:54.336636 96.60% [DEBUG] mrcp_client_session.c:864 (TTS-0) Subtract Media Termination TTS-0 <ee26cb9954094ffd@media-tm>
2021-12-16 14:35:54.336636 96.60% [DEBUG] mrcp_client_session.c:885 (TTS-0) Subtract Media Termination TTS-0 <ee26cb9954094ffd@rtp-tm>
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_task.c:265 () Signal Message to [MediaEngine] [0x7f523400bb40;1;0]
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_task.c:265 () Signal Message to [uni1] [0x7f523400b8a0;1;0]
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_consumer_task.c:141 () Wait for Messages [MRCP Client]
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_poller_task.c:261 () Process Poller Wakeup [uni1]
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_task.c:337 () Process Message [uni1] [0x7f523400b8a0;1;0]
2021-12-16 14:35:54.336636 96.60% [INFO] rtsp_client.c:839 () Send RTSP Data 192.168.3.3:34130 <-> 192.168.3.3:1554 [99 bytes]
TEARDOWN rtsp://192.168.3.3:1554/speechsynthesizer RTSP/1.0
CSeq: 3
Session: ee26cb9954094ffd


2021-12-16 14:35:54.336636 96.60% [INFO] rtsp_client.c:526 () Push RTSP Request to In-Progress Queue 0x7f52340097a0 <ee26cb9954094ffd> CSeq:3
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_poller_task.c:246 () Wait for Messages [uni1] timeout [3000]
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_poller_task.c:269 () Process Signalled Descriptor [uni1]
2021-12-16 14:35:54.336636 96.60% [INFO] rtsp_client.c:937 () Receive RTSP Data 192.168.3.3:34130 <-> 192.168.3.3:1554 [55 bytes]
RTSP/1.0 200 OK
CSeq: 3
Session: ee26cb9954094ffd


2021-12-16 14:35:54.336636 96.60% [INFO] rtsp_client.c:551 () Pop In-Progress RTSP Request 0x7f52340097a0 CSeq:3
2021-12-16 14:35:54.336636 96.60% [INFO] rtsp_client.c:706 () Remove RTSP Session 0x7f52340097a0 <ee26cb9954094ffd>
2021-12-16 14:35:54.336636 96.60% [INFO] rtsp_client.c:442 () Remove RTSP Handle 0x7f52340097a0
2021-12-16 14:35:54.336636 96.60% [NOTICE] rtsp_client.c:305 () Destroy RTSP Handle 0x7f52340097a0
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_task.c:265 () Signal Message to [MRCP Client] [0x7f5230000a30;1;1]
2021-12-16 14:35:54.336636 96.60% [INFO] rtsp_client.c:382 () Close RTSP Connection 192.168.3.3:34130 <-> 192.168.3.3:1554
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_task.c:337 () Process Message [MRCP Client] [0x7f5230000a30;1;1]
2021-12-16 14:35:54.336636 96.60% [INFO] mrcp_client_session.c:209 (TTS-0) Session Terminated TTS-0 <ee26cb9954094ffd>
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_consumer_task.c:141 () Wait for Messages [MRCP Client]
2021-12-16 14:35:54.336636 96.60% [NOTICE] rtsp_client.c:432 () Destroy RTSP Connection 192.168.3.3:34130 <-> 192.168.3.3:1554
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_poller_task.c:251 () Wait for Messages [uni1]
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_task.c:337 () Process Message [MediaEngine] [0x7f523400bb40;1;0]
2021-12-16 14:35:54.336636 96.60% [DEBUG] mpf_bridge.c:100 () Destroy Audio Bridge TTS-0
2021-12-16 14:35:54.336636 96.60% [INFO] mpf_rtp_stream.c:541 () Close RTP Receiver 192.168.3.3:4000 <- 192.168.3.3:5004 [r:0 l:0 j:0 p:0 d:0 i:0]
2021-12-16 14:35:54.336636 96.60% [DEBUG] mpf_context.c:238 () Remove Media Context TTS-0
2021-12-16 14:35:54.336636 96.60% [INFO] mpf_rtp_stream.c:418 () Remove RTP Session 192.168.3.3:4000
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_task.c:265 () Signal Message to [MRCP Client] [0x7f5204000b60;3;0]
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_task.c:337 () Process Message [MRCP Client] [0x7f5204000b60;3;0]
2021-12-16 14:35:54.336636 96.60% [DEBUG] mrcp_client_session.c:1014 (TTS-0) Media Termination Subtracted TTS-0 <ee26cb9954094ffd@media-tm>
2021-12-16 14:35:54.336636 96.60% [DEBUG] mrcp_client_session.c:1014 (TTS-0) Media Termination Subtracted TTS-0 <ee26cb9954094ffd@rtp-tm>
2021-12-16 14:35:54.336636 96.60% [INFO] mrcp_client.c:710 (TTS-0) Remove MRCP Handle TTS-0 <ee26cb9954094ffd>
2021-12-16 14:35:54.336636 96.60% [INFO] mrcp_client_session.c:455 (TTS-0) Raise App Response TTS-0 <ee26cb9954094ffd> [1] SUCCESS [0]
2021-12-16 14:35:54.336636 96.60% [DEBUG] mod_unimrcp.c:1829 (TTS-0) Destroying MRCP session
2021-12-16 14:35:54.336636 96.60% [NOTICE] mrcp_application.c:182 (TTS-0) Destroy MRCP Handle TTS-0
2021-12-16 14:35:54.336636 96.60% [DEBUG] mod_unimrcp.c:1578 (TTS-0) READY ==> CLOSED
2021-12-16 14:35:54.336636 96.60% [DEBUG] apt_consumer_task.c:141 () Wait for Messages [MRCP Client]
2021-12-16 14:35:54.336636 96.60% [DEBUG] mod_unimrcp.c:852 (TTS-0) audio queue destroyed
EXECUTE [depth=0] sofia/internal/10...@192.168.3.3 sleep(10000)
2021-12-16 14:35:54.356661 96.60% [DEBUG] switch_ivr.c:195 Codec Activated L16@48000hz 1 channels 20ms
2021-12-16 14:35:54.356661 96.60% [DEBUG] switch_rtp.c:1982 rtcp_stats_init: audio ssrc[1767261913] base_seq[17848]
2021-12-16 14:35:55.876671 95.50% [NOTICE] sofia.c:1065 Hangup sofia/internal/10...@192.168.3.3 [CS_EXECUTE] [NORMAL_CLEARING]
2021-12-16 14:35:55.876671 95.50% [DEBUG] switch_core_session.c:2983 sofia/internal/10...@192.168.3.3 skip receive message [PHONE_EVENT] (channel is hungup already)
2021-12-16 14:35:55.876671 95.50% [DEBUG] switch_core_state_machine.c:647 (sofia/internal/10...@192.168.3.3) State EXECUTE going to sleep
2021-12-16 14:35:55.876671 95.50% [DEBUG] switch_core_state_machine.c:581 (sofia/internal/10...@192.168.3.3) Running State Change CS_HANGUP (Cur 1 Tot 1)
2021-12-16 14:35:55.876671 95.50% [DEBUG] switch_core_state_machine.c:844 (sofia/internal/10...@192.168.3.3) Callstate Change ACTIVE -> HANGUP
2021-12-16 14:35:55.876671 95.50% [DEBUG] switch_core_state_machine.c:846 (sofia/internal/10...@192.168.3.3) State HANGUP
2021-12-16 14:35:55.876671 95.50% [DEBUG] mod_sofia.c:468 Channel sofia/internal/10...@192.168.3.3 hanging up, cause: NORMAL_CLEARING
2021-12-16 14:35:55.876671 95.50% [DEBUG] switch_core_state_machine.c:59 sofia/internal/10...@192.168.3.3 Standard HANGUP, cause: NORMAL_CLEARING
2021-12-16 14:35:55.876671 95.50% [DEBUG] switch_core_state_machine.c:846 (sofia/internal/10...@192.168.3.3) State HANGUP going to sleep
2021-12-16 14:35:55.876671 95.50% [DEBUG] switch_core_state_machine.c:616 (sofia/internal/10...@192.168.3.3) State Change CS_HANGUP -> CS_REPORTING
2021-12-16 14:35:55.876671 95.50% [DEBUG] switch_core_state_machine.c:581 (sofia/internal/10...@192.168.3.3) Running State Change CS_REPORTING (Cur 1 Tot 1)
2021-12-16 14:35:55.876671 95.50% [DEBUG] switch_core_state_machine.c:932 (sofia/internal/10...@192.168.3.3) State REPORTING
2021-12-16 14:35:55.876671 95.50% [DEBUG] switch_core_state_machine.c:168 sofia/internal/10...@192.168.3.3 Standard REPORTING, cause: NORMAL_CLEARING
2021-12-16 14:35:55.876671 95.50% [DEBUG] switch_core_state_machine.c:932 (sofia/internal/10...@192.168.3.3) State REPORTING going to sleep
2021-12-16 14:35:55.876671 95.50% [DEBUG] switch_core_state_machine.c:607 (sofia/internal/10...@192.168.3.3) State Change CS_REPORTING -> CS_DESTROY
2021-12-16 14:35:55.876671 95.50% [DEBUG] switch_core_session.c:1753 Session 1 (sofia/internal/10...@192.168.3.3) Locked, Waiting on external entities
2021-12-16 14:35:55.876671 95.50% [NOTICE] switch_core_session.c:1771 Session 1 (sofia/internal/10...@192.168.3.3) Ended
2021-12-16 14:35:55.876671 95.50% [NOTICE] switch_core_session.c:1775 Close Channel sofia/internal/10...@192.168.3.3 [CS_DESTROY]
2021-12-16 14:35:55.876671 95.50% [DEBUG] switch_core_state_machine.c:735 (sofia/internal/10...@192.168.3.3) Running State Change CS_DESTROY (Cur 0 Tot 1)
2021-12-16 14:35:55.876671 95.50% [DEBUG] switch_core_state_machine.c:745 (sofia/internal/10...@192.168.3.3) State DESTROY
2021-12-16 14:35:55.876671 95.50% [DEBUG] mod_sofia.c:379 sofia/internal/10...@192.168.3.3 SOFIA DESTROY
2021-12-16 14:35:55.876671 95.50% [DEBUG] mod_opus.c:725 Opus decoder stats: Frames[0] PLC[0] FEC[0]
2021-12-16 14:35:55.876671 95.50% [DEBUG] mod_opus.c:740 Opus encoder stats: Frames[0] Bytes encoded[0] Encoded length ms[0] Average encoded bitrate bps[0]
2021-12-16 14:35:55.876671 95.50% [DEBUG] mod_opus.c:725 Opus decoder stats: Frames[0] PLC[0] FEC[0]
2021-12-16 14:35:55.876671 95.50% [DEBUG] mod_opus.c:740 Opus encoder stats: Frames[77] Bytes encoded[2768] Encoded length ms[1540] Average encoded bitrate bps[22144]
2021-12-16 14:35:55.876671 95.50% [DEBUG] switch_core_state_machine.c:175 sofia/internal/10...@192.168.3.3 Standard DESTROY
2021-12-16 14:35:55.876671 95.50% [DEBUG] switch_core_state_machine.c:745 (sofia/internal/10...@192.168.3.3) State DESTROY going to sleep

LOG from UniMRCPServer

2021-12-16 14:35:54:336547 [NOTICE] Create RTSP Session <ee26cb9954094ffd>
2021-12-16 14:35:54:336557 [INFO]   Create Session 0x7f6e84007778 <new> [uni1]
2021-12-16 14:35:54:336561 [INFO]   Add RTSP Session <ee26cb9954094ffd>
2021-12-16 14:35:54:336600 [NOTICE] Add Session <ee26cb9954094ffd>
2021-12-16 14:35:54:336611 [INFO]   Receive Offer 0x7f6e84007778 <ee26cb9954094ffd> [c:0 a:1 v:0]
2021-12-16 14:35:54:336616 [INFO]   Found MRCP Engine [GSR-1] for Resource [speechsynth] 0x7f6e84007778 <ee26cb9954094ffd>
2021-12-16 14:35:54:339659 [INFO]   Enable RTP Session 192.168.3.3:5004
2021-12-16 14:35:54:339673 [INFO]   Open RTP Receiver 192.168.3.3:5004 <- 192.168.3.3:4000 playout [50 ms] bounds [0 - 600 ms] adaptive [1] skew detection [1]
2021-12-16 14:35:54:339680 [INFO]   Media Path 0x7f6e84007778 Source->[PCMU/8000/1]->Decoder->[LPCM/8000/1]->Bridge->[LPCM/8000/1]->Sink
2021-12-16 14:35:54:339708 [INFO]   Open <ee26cb9954094ffd@gsr>
2021-12-16 14:35:54:339720 [NOTICE] GSR Usage: 1/1/2
2021-12-16 14:35:54:339732 [INFO]   Send Answer 0x7f6e84007778 <ee26cb9954094ffd> [c:0 a:1 v:0] Status OK
2021-12-16 14:35:54:339793 [INFO]   Send RTSP Data 192.168.3.3:1554 <-> 192.168.3.3:34130 [316 bytes]
RTSP/1.0 200 OK
CSeq: 1
Transport: RTP/AVP;unicast;client_port=4000-4001;server_port=5004-5005
Session: ee26cb9954094ffd
Content-Type: application/sdp
Content-Length: 137

v=0
o=UniMRCPServer 0 0 IN IP4 192.168.3.3
s=-
c=IN IP4 192.168.3.3
t=0 0
m=audio 5004 RTP/AVP 0
a=rtpmap:0 PCMU/8000
a=sendrecv

2021-12-16 14:35:54:346605 [INFO]   Receive RTSP Data 192.168.3.3:1554 <-> 192.168.3.3:34130 [282 bytes]
ANNOUNCE rtsp://192.168.3.3:1554/speechsynthesizer RTSP/1.0
CSeq: 2
Session: ee26cb9954094ffd
Content-Type: application/mrcp
Content-Length: 130

SPEAK 1 MRCP/1.0
Content-Type: text/plain
Voice-Name: en-US-Wavenet-A
Content-Length: 35

Hello Welcome to Freeswitch UNIMRCP
2021-12-16 14:35:54:346668 [INFO]   Process SPEAK Request <ee26cb9954094ffd@speechsynth> [1]
2021-12-16 14:35:54:346699 [WARN]   Missing Content-Id <ee26cb9954094ffd@gsr>
2021-12-16 14:35:54:346715 [INFO]   Process SPEAK Response <ee26cb9954094ffd@speechsynth> [1]
2021-12-16 14:35:54:346778 [INFO]   Send RTSP Data 192.168.3.3:1554 <-> 192.168.3.3:34130 [152 bytes]
RTSP/1.0 200 OK
CSeq: 2
Session: ee26cb9954094ffd
Content-Type: application/mrcp
Content-Length: 45

MRCP/1.0 1 406 COMPLETE
Voice-Variant: 0


2021-12-16 14:35:54:347033 [INFO]   Receive RTSP Data 192.168.3.3:1554 <-> 192.168.3.3:34130 [99 bytes]
TEARDOWN rtsp://192.168.3.3:1554/speechsynthesizer RTSP/1.0
CSeq: 3
Session: ee26cb9954094ffd


2021-12-16 14:35:54:347074 [INFO]   Deactivate Session 0x7f6e84007778 <ee26cb9954094ffd>
2021-12-16 14:35:54:347083 [INFO]   Terminate Session 0x7f6e84007778 <ee26cb9954094ffd>
2021-12-16 14:35:54:347106 [INFO]   Close <ee26cb9954094ffd@gsr>
2021-12-16 14:35:54:347114 [DEBUG]  Send Close Response <ee26cb9954094ffd@gsr>
2021-12-16 14:35:54:347117 [NOTICE] GSR Usage: 0/1/2
2021-12-16 14:35:54:349680 [INFO]   Close RTP Receiver 192.168.3.3:5004 <- 192.168.3.3:4000 [r:0 l:0 j:0 p:50 d:0 i:0]
2021-12-16 14:35:54:349692 [INFO]   Remove RTP Session 192.168.3.3:5004
2021-12-16 14:35:54:349724 [NOTICE] Remove Session <ee26cb9954094ffd>
2021-12-16 14:35:54:349729 [INFO]   Session Terminated 0x7f6e84007778 <ee26cb9954094ffd>
2021-12-16 14:35:54:349733 [NOTICE] Destroy Session <ee26cb9954094ffd>
2021-12-16 14:35:54:349757 [INFO]   Send RTSP Data 192.168.3.3:1554 <-> 192.168.3.3:34130 [55 bytes]
RTSP/1.0 200 OK
CSeq: 3
Session: ee26cb9954094ffd


2021-12-16 14:35:54:349800 [INFO]   Remove RTSP Session <ee26cb9954094ffd>
2021-12-16 14:35:54:349804 [NOTICE] Destroy RTSP Session <ee26cb9954094ffd>
2021-12-16 14:35:54:349952 [INFO]   RTSP Peer Disconnected 192.168.3.3:1554 <-> 192.168.3.3:34130
2021-12-16 14:35:54:349955 [INFO]   Close RTSP Connection 192.168.3.3:1554 <-> 192.168.3.3:34130
2021-12-16 14:35:54:349991 [NOTICE] Destroy RTSP Connection 192.168.3.3:1554 <-> 192.168.3.3:34130

Arsen Chaloyan

unread,

Dec 20, 2021, 7:43:30 PM12/20/21

to UniMRCP

Hi Rammohan,

You seem to have the GSR plugin configured to be used for speech synthesis, which is not going to work.

2021-12-16 14:35:54:336616 [INFO] Found MRCP Engine [GSR-1] for Resource [speechsynth] 0x7f6e84007778 <ee26cb9954094ffd>

The GSR plugin implements the speech recognizer resource. You would need to use GSS or any other plugin implementing the speech synthesis resource.

--
You received this message because you are subscribed to the Google Groups "UniMRCP" group.
To unsubscribe from this group and stop receiving emails from it, send an email to unimrcp+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/unimrcp/55d639dc-9b2a-45f3-9ca7-d206d3f22bf8n%40googlegroups.com.