Thanks for the responses.
We don’t know how to reproduce this. If we did, then we could at least manage our client in some way.
The KMS setup was unchanged in the switch from staging to production (same box, same KMS version, same OS, etc). You can see the respective version information in Alex’s response above.
Kapa6ac79, can you please confirm that you see the same error on the very latest 2018-01-18 version of KMS?
Jon, are you aware if this is something that was specifically worked on in the 2018-01-18 version? I can’t see anything in the change logs that would indicate that is the case.
Regardless, it seems we are not the only ones experiencing this problem, and bug like is not something you want kicking around in production.
Any hints/experiences much appreciated!
g_socket_send_message
--
You received this message because you are subscribed to the Google Groups "kurento" group.
To unsubscribe from this group and stop receiving emails from it, send an email to kurento+u...@googlegroups.com.
To post to this group, send email to kur...@googlegroups.com.
Visit this group at https://groups.google.com/group/kurento.
To view this discussion on the web visit https://groups.google.com/d/msgid/kurento/61baf5e2-14ed-456f-815a-8537910e4f23%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Hi Micael,
Does this mean that you know how to reproduce it? If so, can you give us some more info about the conditions that trigger the error?
This client will be ramping up soon, and I'd like to take active steps to minimize the risk of this occurring, even if that means we have to cripple our application slightly in the short term.
Basically, is there a workaround we can use until you guys have fixed this?
If you need help with any specific testing, let me know.
Thanks & all the best,
Jorge Maiquez
Digital Samba
We are working on that right now.
--
You received this message because you are subscribed to the Google Groups "kurento" group.
To unsubscribe from this group and stop receiving emails from it, send an email to kurento+u...@googlegroups.com.
To post to this group, send email to kur...@googlegroups.com.
Visit this group at https://groups.google.com/group/kurento.
To view this discussion on the web visit https://groups.google.com/d/msgid/kurento/1ebc0389-2e71-4f82-adea-9d699bc9095b%40googlegroups.com.
We are digging into the problem right now... When we have somo advances we will publish more information about it
--
You received this message because you are subscribed to a topic in the Google Groups "kurento" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/kurento/_rf1ANq5Cm8/unsubscribe.
To unsubscribe from this group and all its topics, send an email to kurento+u...@googlegroups.com.
To post to this group, send email to kur...@googlegroups.com.
Visit this group at https://groups.google.com/group/kurento.
To view this discussion on the web visit https://groups.google.com/d/msgid/kurento/6c88bf15-99f4-4f0d-952a-77f01c8e9ddf%40googlegroups.com.
To unsubscribe from this group and all its topics, send an email to kurento+unsubscribe@googlegroups.com.
To post to this group, send email to kur...@googlegroups.com.
Visit this group at https://groups.google.com/group/kurento.
To view this discussion on the web visit https://groups.google.com/d/msgid/kurento/6c88bf15-99f4-4f0d-952a-77f01c8e9ddf%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "kurento" group.
To unsubscribe from this group and stop receiving emails from it, send an email to kurento+unsubscribe@googlegroups.com.
To post to this group, send email to kur...@googlegroups.com.
Visit this group at https://groups.google.com/group/kurento.
To view this discussion on the web visit https://groups.google.com/d/msgid/kurento/80BCC103-55C1-44E0-B5D6-918DA428ED1D%40gmail.com.
Hi Jorge,We have detected some problems in the libraries in Trusty version of KMS that leads to KMS crash. If you are using Trusty, please update to Xenial and report us if your problems are gone.By the way, KMS 6.7.1 is not still updated to recent library versions, as this update requires a lot of work.
Best regardsMicael GallegoKurento / OpenVidu Project Lead
If you aren't afraid of ignoring integration tests and such, and also ignore the ugliness of the workaround
(desperate times, desperate measures):
https://github.com/prlanzarin/libnice/tree/crash-fix-upstream.
This is merged with libnice upstream. I added checks for NULL gsocket occurrences and commented out an assertion regarding
ICE state transition that was aborting Kurento. I reckon the assert is there for a reason, and there's probably some underlying condition
making it fail; however, I lack the time to go deeper into that. Assertion abortions also shouldn't be used in production hehe.
If anyone digs what's the underlying condition for that btw, I'd appreciate news regarding the problem.
It's been working nice for me with heavy load sessions (~300 streams or more, sometimes). However, use at your own risk :).
s,
--
You received this message because you are subscribed to the Google Groups "kurento" group.
To unsubscribe from this group and stop receiving emails from it, send an email to kurento+unsubscribe@googlegroups.com.
To post to this group, send email to kur...@googlegroups.com.
Visit this group at https://groups.google.com/group/kurento.
To view this discussion on the web visit https://groups.google.com/d/msgid/kurento/ad868ff6-2d2c-4e1a-9d99-35b031b677f7%40googlegroups.com.
To unsubscribe from this group and stop receiving emails from it, send an email to kurento+u...@googlegroups.com.
To post to this group, send email to kur...@googlegroups.com.
Visit this group at https://groups.google.com/group/kurento.
You received this message because you are subscribed to a topic in the Google Groups "kurento" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/kurento/_rf1ANq5Cm8/unsubscribe.
To unsubscribe from this group and all its topics, send an email to kurento+u...@googlegroups.com.
To post to this group, send email to kur...@googlegroups.com.
Visit this group at https://groups.google.com/group/kurento.
To view this discussion on the web visit https://groups.google.com/d/msgid/kurento/a4c12a24-6696-4ac8-84d0-5aa4df264f74%40googlegroups.com.
Given the commotion in this topic I'll try to clean up the fix in the solution I posted before. I'll do that in my free time though, so no promises, starting this weekend. If anyone wanna join the effort please contact me or maintain the discussion in this thread. However, I'll just find the underlying cause and turn it into a real fix instead of a workaround. I really can't give a damn about integration tests because I don't really know what those are about, nor do I know where tests those are.
Juan, if you can link me the tests procedures I'd be happy to have a look. Also, feel free to give a look at the branch because the breaking points inside libnice were pinpointed and that's a hell of a start.
Jorge, if you're desperate I'd recommend to try out that branch. Despite the ugliness and my bad marketing skills, it works perfectly. Haven't seen any leaks nor crashes around libnice, and we've been running it for some time now and with some high stress involved.
To unsubscribe from this group and stop receiving emails from it, send an email to kurento+unsubscribe@googlegroups.com.
To post to this group, send email to kur...@googlegroups.com.
Visit this group at https://groups.google.com/group/kurento.
To view this discussion on the web visit https://groups.google.com/d/msgid/kurento/468f2998-8e23-4102-91f0-893cc6306141%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
<d
--
You received this message because you are subscribed to the Google Groups "kurento" group.
To unsubscribe from this group and stop receiving emails from it, send an email to kurento+u...@googlegroups.com.
To post to this group, send email to kur...@googlegroups.com.
Visit this group at https://groups.google.com/group/kurento.
To view this discussion on the web visit https://groups.google.com/d/msgid/kurento/b372640b-98f4-4e92-bcdd-0cbd4fea746b%40googlegroups.com.
You received this message because you are subscribed to a topic in the Google Groups "kurento" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/kurento/_rf1ANq5Cm8/unsubscribe.
To unsubscribe from this group and all its topics, send an email to kurento+u...@googlegroups.com.
To post to this group, send email to kur...@googlegroups.com.
Visit this group at https://groups.google.com/group/kurento.
To view this discussion on the web visit https://groups.google.com/d/msgid/kurento/1e61044f-0b17-408d-856f-600d0e2620fe%40googlegroups.com.
# lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 16.04.4 LTS
Release: 16.04
Codename: xenial
# kurento-media-server -v
Kurento Media Server version: 6.7.1
Found modules:
'core' version 6.7.1
'elements' version 6.7.1
'filters' version 6.7.1
# dpkg -L libnice10 | grep so
/usr/lib/x86_64-linux-gnu/libnice.so.10.7.0
/usr/lib/x86_64-linux-gnu/libnice.so.10
--
You received this message because you are subscribed to the Google Groups "kurento" group.
To unsubscribe from this group and stop receiving emails from it, send an email to kurento+u...@googlegroups.com.
To post to this group, send email to kur...@googlegroups.com.
Visit this group at https://groups.google.com/group/kurento.
To view this discussion on the web visit https://groups.google.com/d/msgid/kurento/cf078d7c-b20d-47be-ad61-73fa5b7fa39f%40googlegroups.com.
You received this message because you are subscribed to a topic in the Google Groups "kurento" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/kurento/_rf1ANq5Cm8/unsubscribe.
To unsubscribe from this group and all its topics, send an email to kurento+u...@googlegroups.com.
To post to this group, send email to kur...@googlegroups.com.
Visit this group at https://groups.google.com/group/kurento.
To view this discussion on the web visit https://groups.google.com/d/msgid/kurento/CADG0wOC%2BT2E117X8s3V_kMiqw0P8UVDcfuXBTB2P3wJM9P5cUQ%40mail.gmail.com.
--
You received this message because you are subscribed to the Google Groups "kurento" group.
To unsubscribe from this group and stop receiving emails from it, send an email to kurento+u...@googlegroups.com.
To post to this group, send email to kur...@googlegroups.com.
Visit this group at https://groups.google.com/group/kurento.
To view this discussion on the web visit https://groups.google.com/d/msgid/kurento/2fd55789-6197-40d9-8caf-e4950ddc4d08%40googlegroups.com.
libnice is a third-party library that implements ICE connectivity, but the project seems to be understaffed. If you benefit in any form from it (directly or indirectly by using Kurento), then consider contributing in any way you can, as they have a good number of issues pending to be solved. One crash that has affected users of Kurento before seems to be well known and tracked here: https://gitlab.freedesktop.org/libnice/libnice/issues/20
We've been working at Kurento on the issue of this thread, and found out that the latest development branch of libnice seems to work better. In our tests, either versions 0.1.13 and 0.1.14 crashed, but the development branch for 0.1.15 (or as libnice creators like to put it, "0.1.14.1") is currently working pretty well.
It would help a lot if we could confirm with more people if this improvement is only due to our specific test environment, or if this latest version of libnice does actually solve problems that are being encountered by KMS users.
I've prepared Debian package files from upstream libnice commit 090d3dba, the latest as of this week. If you have a staging server where you could try out this version, it would help us all to know whether this version is a good candidate to be included in the upcoming release of Kurento 6.8.
Installation steps in a clean Ubuntu 16.04 (Xenial) server:
Download the experimental packages:
https://www.dropbox.com/sh/525depzmhj2vt47/AADcgc4o_QwjcZpaBlQWqgspa?dl=1
Install the media server:
sudo apt-get update
sudo apt-get install kurento-media-server
Install the debug symbols. These will provide needed information in case of a crash. Run the apt-get steps to install all -dbg
symbols, as explained in https://doc-kurento.readthedocs.io/en/latest/user/troubleshooting.html#media-server-crashed
Install the experimental version of libnice:
unzip libnice-0.1.15-snapshot.zip
sudo dpkg -i ./*.*deb
sudo apt-get install -f
sudo dpkg -i ./*.*deb
Test again your use case and let us know if it failed again with the same issue.
--
You received this message because you are subscribed to a topic in the Google Groups "kurento" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/kurento/_rf1ANq5Cm8/unsubscribe.
To unsubscribe from this group and all its topics, send an email to kurento+u...@googlegroups.com.
To post to this group, send email to kur...@googlegroups.com.
Visit this group at https://groups.google.com/group/kurento.
To view this discussion on the web visit https://groups.google.com/d/msgid/kurento/f88fe08f-eee3-40d7-93c3-a55bfe3f11b8%40googlegroups.com.
/usr/lib/x86_64-linux-gnu/libgstreamer-1.5.so.0^[[32;1m:0x76533^[[0m<br style="line-height:1;color:rgb(43,43,48);font-family:"Segoe UI Local","Segoe WP","Segoe UI Web",SkypeUISymbol,Tahoma,"Helvetica Neue",Helvetica,"Me
--
You received this message because you are subscribed to a topic in the Google Groups "kurento" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/kurento/_rf1ANq5Cm8/unsubscribe.
To unsubscribe from this group and all its topics, send an email to kurento+u...@googlegroups.com.
To post to this group, send email to kur...@googlegroups.com.
Visit this group at https://groups.google.com/group/kurento.
To view this discussion on the web visit https://groups.google.com/d/msgid/kurento/204a811a-bcb5-4a93-999a-034b8a6f121c%40googlegroups.com.
--
You received this message because you are subscribed to a topic in the Google Groups "kurento" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/kurento/_rf1ANq5Cm8/unsubscribe.
To unsubscribe from this group and all its topics, send an email to kurento+u...@googlegroups.com.
To post to this group, send email to kur...@googlegroups.com.
Visit this group at https://groups.google.com/group/kurento.
To view this discussion on the web visit https://groups.google.com/d/msgid/kurento/ea536237-829a-4087-af63-3ba538ac5d3f%40googlegroups.com.
<span style="color:rgb(43,43,48);font-family:"Segoe UI Local","Segoe WP","Segoe UI Web",SkypeUISymbol,Tahoma,"Helvetica Neue",Helvetica,"Meiryo UI",Meiryo,&q
libnice:ERROR:agent.c:2342:agent_signal_component_state_change: assertion failed: (TRANSITION (DISCONNECTED, FAILED) || TRANSITION (GATHERING, FAILED) || TRANSITION (CONNECTING, FAILED) || TRANSITION (CONNECTED, FAILED) || TRANSITION (READY, FAILED) || TRANSITION (DISCONNECTED, GATHERING) || TRANSITION (GATHERING, CONNECTING) || TRANSITION (CONNECTING, CONNECTED) || TRANSITION (CONNECTED, READY) || TRANSITION (READY, CONNECTED) || TRANSITION (FAILED, CONNECTING) || TRANSITION (FAILED, GATHERING) || TRANSITION (DISCONNECTED, CONNECTING))
Jorge
<span style="color:rgb(43,43,48);font-family:"Segoe UI Local","Segoe WP","Segoe UI Web",SkypeUISymbol,Tahoma,"Helvetica Neue",Helvetica,"Meiryo UI",Meiryo,"Arial Unicode MS",sans-serif;white-space:p
--
You received this message because you are subscribed to the Google Groups "kurento" group.
To unsubscribe from this group and stop receiving emails from it, send an email to kurento+u...@googlegroups.com.
To post to this group, send email to kur...@googlegroups.com.
Visit this group at https://groups.google.com/group/kurento.
To view this discussion on the web visit https://groups.google.com/d/msgid/kurento/19a0011e-f876-490d-a6ae-df50b579cef4%40googlegroups.com.
--
You received this message because you are subscribed to a topic in the Google Groups "kurento" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/kurento/_rf1ANq5Cm8/unsubscribe.
To unsubscribe from this group and all its topics, send an email to kurento+u...@googlegroups.com.
To post to this group, send email to kur...@googlegroups.com.
Visit this group at https://groups.google.com/group/kurento.
To view this discussion on the web visit https://groups.google.com/d/msgid/kurento/19a0011e-f876-490d-a6ae-df50b579cef4%40googlegroups.com.
KMS 6.7.2~19.g181284d
libnice 0.1.13.1.xenial~20170725160546.81.eebfdab