Janus crashing due to increase the no. of open files in a high volume and not releasing the resources
463 views
Skip to first unread message
Saif
Apr 24, 2020, 12:12:29 AM4/24/20
to meetecho-janus
Hi,
We are facing a critical issue that is the no. of opened files related to Janus is increasing in a high volume in the Janus server. What we found that the opened files are not releasing after use. Thus causes crashing of Janus server. So that we are getting a continuous Janus crash due to this.
Please anyone can help or provide any information regarding this issue.
Thanks in advance
Varun James
Apr 24, 2020, 7:54:11 AM4/24/20
to meetecho-janus
Where you able to identify this issue. I have also seen this issue but not sure why.
Mayank Aggarwal
Apr 24, 2020, 10:16:10 AM4/24/20
to Saif, meetecho-janus
Trying increasing the number of file descriptors and test again.
-Mayank
--
You received this message because you are subscribed to the Google Groups "meetecho-janus" group.
To unsubscribe from this group and stop receiving emails from it, send an email to meetecho-janu...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/meetecho-janus/a8e51af7-07f0-4cad-ba92-c710b2456205%40googlegroups.com.
Saif
Apr 24, 2020, 11:54:24 AM4/24/20
to meetecho-janus
Hi Mayank,
Thanks for responding. I have increased the ulimit to 10,00,000 for now as the total no.of opened files reaches 8,08,441 now. What I observe that is once we restart the Janus server, it will reduce. Could you have any idea why this opened files are increasing in a high volume? Is there any way can we prevent this rather than increasing the ulimit continuously.
Thanks.
On Friday, April 24, 2020 at 7:46:10 PM UTC+5:30, Mayank Aggarwal wrote:
Trying increasing the number of file descriptors and test again.-Mayank
On Fri, Apr 24, 2020 at 12:12 AM Saif <saifu...@gmail.com> wrote:
Hi,--We are facing a critical issue that is the no. of opened files related to Janus is increasing in a high volume in the Janus server. What we found that the opened files are not releasing after use. Thus causes crashing of Janus server. So that we are getting a continuous Janus crash due to this.Please anyone can help or provide any information regarding this issue.Thanks in advance
You received this message because you are subscribed to the Google Groups "meetecho-janus" group.
To unsubscribe from this group and stop receiving emails from it, send an email to meetech...@googlegroups.com.
Saif
Apr 24, 2020, 12:00:56 PM4/24/20
to meetecho-janus
Hello James,
Thank you for your response. We are experiencing continuous Janus crash due to this open files. If the no.of opened files are increasing, we are increasing the ulimit as of now to prevent the Janus crash. Currently we have increased the ulimit to 10,00,000 as the total no.of opened files in the Janus are reaches 7,58,284. We are not able to identify why these open files are increasing in a high volume.
It would be very helpful if you can able to provide any information.
Thank you.
Mirko Brankovic
Apr 24, 2020, 12:07:59 PM4/24/20
to meetecho-janus
Maybe share the version of Janus you are using, also libwebsockets, libsrtp, libnice.
Double check if you are cleaning all handles, sessions, rooms,...
To unsubscribe from this group and stop receiving emails from it, send an email to meetecho-janu...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/meetecho-janus/bf8620d2-90f3-49a2-b835-64d2ee74a78c%40googlegroups.com.
Regards,
Mirko
Mayank Aggarwal
Apr 24, 2020, 2:30:51 PM4/24/20
to Saif, meetecho-janus
Hi Saif,
Regards,
Mayank
To unsubscribe from this group and stop receiving emails from it, send an email to meetecho-janu...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/meetecho-janus/bf8620d2-90f3-49a2-b835-64d2ee74a78c%40googlegroups.com.
Alessandro Amirante
Apr 24, 2020, 2:44:03 PM4/24/20
to Mayank Aggarwal, Saif, meetecho-janus
100,000 files descriptors is way too much. There's likely something wrong with the client code.
A.
To view this discussion on the web visit https://groups.google.com/d/msgid/meetecho-janus/CAOqW8KSvpv0WsJR6N3tEmcghYjXy5-itXrDuG%2BB9CqEW80J-Jg%40mail.gmail.com.
Saif
Apr 25, 2020, 1:50:29 PM4/25/20
to meetecho-janus
Hi Mirko,
We are using janus 0.6.0 version of the janus.
Other version are :-
libwebsockets : 3.2.2
libsrtp : 2.1.0
libnice : 0.1.16.1
Thank you.
-Saif
On Friday, April 24, 2020 at 9:37:59 PM UTC+5:30, Mirko Brankovic wrote:
Maybe share the version of Janus you are using, also libwebsockets, libsrtp, libnice.Double check if you are cleaning all handles, sessions, rooms,...
On Fri, Apr 24, 2020 at 5:54 PM Saif <saifu...@gmail.com> wrote:
Hi Mayank,--Thanks for responding. I have increased the ulimit to 10,00,000 for now as the total no.of opened files reaches 8,08,441 now. What I observe that is once we restart the Janus server, it will reduce. Could you have any idea why this opened files are increasing in a high volume? Is there any way can we prevent this rather than increasing the ulimit continuously.Thanks.
On Friday, April 24, 2020 at 7:46:10 PM UTC+5:30, Mayank Aggarwal wrote:Trying increasing the number of file descriptors and test again.-MayankOn Fri, Apr 24, 2020 at 12:12 AM Saif <saifu...@gmail.com> wrote:Hi,--We are facing a critical issue that is the no. of opened files related to Janus is increasing in a high volume in the Janus server. What we found that the opened files are not releasing after use. Thus causes crashing of Janus server. So that we are getting a continuous Janus crash due to this.Please anyone can help or provide any information regarding this issue.Thanks in advance
You received this message because you are subscribed to the Google Groups "meetecho-janus" group.
To unsubscribe from this group and stop receiving emails from it, send an email to meetech...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/meetecho-janus/a8e51af7-07f0-4cad-ba92-c710b2456205%40googlegroups.com.
You received this message because you are subscribed to the Google Groups "meetecho-janus" group.
To unsubscribe from this group and stop receiving emails from it, send an email to meetech...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/meetecho-janus/bf8620d2-90f3-49a2-b835-64d2ee74a78c%40googlegroups.com.
--Regards,Mirko
Saif
Apr 25, 2020, 1:51:06 PM4/25/20
to meetecho-janus
On analysing the number of open files related to a single session/stream, noticed that the same recording file ( mjr file ) is opened with 916 instances.
Also noticed that different processes like libmicroh, sip\x20ha, hloop\x20 have opened several instances of the same file.
Any idea what could be possibly wrong ? It was working fine until last month. The rapid increase in the count of open files started since last 3 weeks . We survived by increasing the ulimit, but the limit has reached over a million.
Thanks
-Saif
On Friday, April 24, 2020 at 9:42:29 AM UTC+5:30, Saif wrote:
Serhat Sakarya
Apr 25, 2020, 2:07:13 PM4/25/20
to Saif, meetecho-janus
Hi Saif,
It seems you're not using master, is that correct? Can you try with the latest version (e.g. from github) and see if you're still having the same issue? Maybe it got fixed already?
Regards,
Serhat
--
You received this message because you are subscribed to the Google Groups "meetecho-janus" group.
To unsubscribe from this group and stop receiving emails from it, send an email to meetecho-janu...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/meetecho-janus/441e8844-daac-40af-8896-9d7dbbfcb761%40googlegroups.com.
Mirko Brankovic
Apr 25, 2020, 3:48:17 PM4/25/20
to Saif, meetecho-janus
That is at least 3 years old code, you have to upgrade
To unsubscribe from this group and stop receiving emails from it, send an email to meetecho-janu...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/meetecho-janus/425efe1a-f948-4ea0-bb53-2fe9ce9dac62%40googlegroups.com.
Message has been deleted
Saif
May 26, 2020, 10:10:03 AM5/26/20
to meetecho-janus
Hi Mirko,
I have upgraded the Janus to the latest version now. But still have the issue with open files. The number of open files are getting almost same as previous. Is there anything I should do on my end.
Please assist me to solve this issue.
Thank you.
To view this discussion on the web visit https://groups.google.com/d/msgid/meetecho-janus/425efe1a-f948-4ea0-bb53-2fe9ce9dac62%40googlegroups.com.
Mirko Brankovic
May 26, 2020, 10:49:55 AM5/26/20
to meetecho-janus
I think you have to move to latest version or fing one stable enough, since 0.6 is quite old and no one will help you troubleshoot it.
To unsubscribe from this group and stop receiving emails from it, send an email to meetecho-janu...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/meetecho-janus/8840cd4c-41c1-47b7-a829-eefb5e5a35d5%40googlegroups.com.
Regards,
Mirko
Saif
May 27, 2020, 8:23:12 AM5/27/20
to meetecho-janus
Hi Mirko,
Thanks for replying.
I have upgraded the Janus to the latest version. Now My Janus version is 0.10.0 (installed from git). But the open files issue is still persist.
Do you have any idea about this open files issue as this issue is critical and getting in PRODUCTION environment.
It would be very helpful if anyone can provide the ideas.
Thanks.
To view this discussion on the web visit https://groups.google.com/d/msgid/meetecho-janus/8840cd4c-41c1-47b7-a829-eefb5e5a35d5%40googlegroups.com.
--Regards,Mirko
Mirko Brankovic
May 27, 2020, 11:36:18 AM5/27/20
to meetecho-janus
Sorry I'm out of ideas :/
To unsubscribe from this group and stop receiving emails from it, send an email to meetecho-janu...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/meetecho-janus/384f16d5-33d2-49fc-b0f4-8a679ceffa69%40googlegroups.com.
Regards,
Mirko
Serhat Sakarya
May 27, 2020, 11:54:37 AM5/27/20
to Mirko Brankovic, meetecho-janus
To be clear: is the no. of fds increasing monotonically? On my setup, if I open a room, the number will increase and when I close it, it will decrease again. Does it ever decrease with you? 1M fds is really way too high.
If things were fine before and you are suddenly having major issues with the same Janus version, then I would look into what changed in your overall setup. Maybe some other code changed or you updated libraries on the server, etc. Or maybe you left some port open that someone is scanning.
Did you check your client code to make sure they're closing connections properly? You can also verify this in debug logs.
Did you check your client code to make sure they're closing connections properly? You can also verify this in debug logs.
Regards,
Serhat
To view this discussion on the web visit https://groups.google.com/d/msgid/meetecho-janus/CAND18T39maKd5AL140xTFL1yxhX-PYkujP2u_jWwSOHR%3DupKGg%40mail.gmail.com.
Mirko Brankovic
May 27, 2020, 12:05:01 PM5/27/20
to meetecho-janus
Yeah seems like some destruction of room is not happening.
Serhat Sakarya
May 27, 2020, 12:17:12 PM5/27/20
to Mirko Brankovic, meetecho-janus
Other ideas could be to disable all plugins that aren't being used, set passwords on API access, pin or tokens on the rooms, etc. This would seem like reasonable security steps anyway.
Also maybe investigate which rooms are currently open and perhaps with which participants. It could be something as simple as a script that keeps generating new rooms but never reclaiming or deleting old ones. Or maybe play around with the various timeouts to see if that has an effect, it could be of diagnostic value.
Just some ideas... without other data, it's hard to diagnose. I hope one of the ideas helps track down the issue for you.
To view this discussion on the web visit https://groups.google.com/d/msgid/meetecho-janus/CAND18T2P8te3DbVvdXO4k54At3iDAQ4L57R_iY2KxKTcXEP7-g%40mail.gmail.com.
Serhat Sakarya
May 27, 2020, 2:45:05 PM5/27/20
to Saif, meetecho-janus
Just to be sure, what do you get when you check /proc/X/fd ? (X being your janus process id which you can get easily with 'pidof janus')
Also, it's probably a better idea to use: 'lsof -p X'.
You might also want to use 'lsof -i' to see which network connections you have going on (and this is something you always want to check out, esp. for listening ports for the sake of security). I should note that on a test server, I got a connection on port 8089 from an unknown IP. It does happen.
I think the above will give a clearer idea of what's going on.
To unsubscribe from this group and stop receiving emails from it, send an email to meetecho-janu...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/meetecho-janus/384f16d5-33d2-49fc-b0f4-8a679ceffa69%40googlegroups.com.
Saif
Jun 4, 2020, 11:11:42 AM6/4/20
to meetecho-janus
Thank you Serhat Sakarya.
Below is the result while running 'lsof -p X' in our testing environment. There were two users shared their screen and web cam. The total no.of open files were 12777 at this time.
Please let me know if this will help.
Result :-
COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME
janus 2048 root cwd DIR 259,2 4096 256049 /home/ubuntu
janus 2048 root rtd DIR 259,2 4096 2 /
janus 2048 root txt REG 259,2 3109968 269982 /opt/janus/bin/janus
janus 2048 root mem REG 259,2 80496 2036 /lib/x86_64-linux-gnu/libgpg-error.so.0.17.0
janus 2048 root mem REG 259,2 919168 6723 /lib/x86_64-linux-gnu/libgcrypt.so.20.0.5
janus 2048 root mem REG 259,2 97232 52947 /usr/lib/x86_64-linux-gnu/libmicrohttpd.so.10.34.0
janus 2048 root mem REG 259,2 406472 270120 /opt/janus/lib/janus/transports/libjanus_http.so.0.0.0
janus 2048 root mem REG 259,2 34624 51336 /usr/lib/x86_64-linux-gnu/libogg.so.0.8.2
janus 2048 root mem REG 259,2 287296 270100 /opt/janus/lib/janus/plugins/libjanus_voicemail.so.0.0.0
janus 2048 root mem REG 259,2 967864 270084 /opt/janus/lib/janus/plugins/libjanus_nosip.so.0.0.0
janus 2048 root mem REG 259,2 1333840 270096 /opt/janus/lib/janus/plugins/libjanus_videoroom.so.0.0.0
janus 2048 root mem REG 259,2 361816 270092 /opt/janus/lib/janus/plugins/libjanus_videocall.so.0.0.0
janus 2048 root mem REG 259,2 1640368 53117 /usr/lib/libsofia-sip-ua.so.0.6.0
janus 2048 root mem REG 259,2 1290672 270080 /opt/janus/lib/janus/plugins/libjanus_sip.so.0.0.0
janus 2048 root mem REG 259,2 445064 270076 /opt/janus/lib/janus/plugins/libjanus_recordplay.so.0.0.0
janus 2048 root mem REG 259,2 487504 270104 /opt/janus/lib/janus/plugins/libjanus_textroom.so.0.0.0
janus 2048 root mem REG 259,2 1515048 270088 /opt/janus/lib/janus/plugins/libjanus_streaming.so.0.0.0
janus 2048 root mem REG 259,2 320936 270072 /opt/janus/lib/janus/plugins/libjanus_echotest.so.0.0.0
janus 2048 root mem REG 259,2 301288 51869 /usr/lib/x86_64-linux-gnu/libopus.so.0.5.2
janus 2048 root mem REG 259,2 1220728 270068 /opt/janus/lib/janus/plugins/libjanus_audiobridge.so.0.0.0
janus 2048 root mem REG 259,2 27000 2013 /lib/x86_64-linux-gnu/libnss_dns-2.23.so
janus 2048 root mem REG 259,2 47600 2016 /lib/x86_64-linux-gnu/libnss_files-2.23.so
janus 2048 root mem REG 259,2 39224 2025 /lib/x86_64-linux-gnu/libcrypt-2.23.so
janus 2048 root mem REG 259,2 870240 2796 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6
janus 2048 root mem REG 259,2 304072 25944 /usr/lib/x86_64-linux-gnu/libhx509.so.5.0.0
janus 2048 root mem REG 259,2 60928 25939 /usr/lib/x86_64-linux-gnu/libheimbase.so.1.0.0
janus 2048 root mem REG 259,2 166128 25941 /usr/lib/x86_64-linux-gnu/libwind.so.0.0.0
janus 2048 root mem REG 259,2 89904 25933 /usr/lib/x86_64-linux-gnu/libroken.so.18.1.0
janus 2048 root mem REG 259,2 204168 25937 /usr/lib/x86_64-linux-gnu/libhcrypto.so.4.1.0
janus 2048 root mem REG 259,2 661872 25935 /usr/lib/x86_64-linux-gnu/libasn1.so.8.0.0
janus 2048 root mem REG 259,2 560808 25947 /usr/lib/x86_64-linux-gnu/libkrb5.so.26.0.0
janus 2048 root mem REG 259,2 35920 25949 /usr/lib/x86_64-linux-gnu/libheimntlm.so.0.1.0
janus 2048 root mem REG 259,2 14256 2198 /lib/x86_64-linux-gnu/libkeyutils.so.1.5
janus 2048 root mem REG 259,2 264256 25951 /usr/lib/x86_64-linux-gnu/libgssapi.so.3.0.0
janus 2048 root mem REG 259,2 109296 6799 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25
janus 2048 root mem REG 259,2 43664 4671 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1
janus 2048 root mem REG 259,2 14648 5242 /lib/x86_64-linux-gnu/libcom_err.so.2.1
janus 2048 root mem REG 259,2 186872 6509 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1
janus 2048 root mem REG 259,2 860392 2417 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3
janus 2048 root mem REG 259,2 101200 2007 /lib/x86_64-linux-gnu/libresolv-2.23.so
janus 2048 root mem REG 259,2 130224 2105 /lib/x86_64-linux-gnu/libselinux.so.1
janus 2048 root mem REG 259,2 14656 18795 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.4800.2
janus 2048 root mem REG 259,2 522664 25839 /usr/lib/x86_64-linux-gnu/libgmp.so.10.3.0
janus 2048 root mem REG 259,2 207640 25787 /usr/lib/x86_64-linux-gnu/libhogweed.so.4.2
janus 2048 root mem REG 259,2 219336 25789 /usr/lib/x86_64-linux-gnu/libnettle.so.6.2
janus 2048 root mem REG 259,2 76192 25795 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.5.1
janus 2048 root mem REG 259,2 408472 25793 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.1.0
janus 2048 root mem REG 259,2 104864 7082 /lib/x86_64-linux-gnu/libz.so.1.2.8
janus 2048 root mem REG 259,2 322928 5243 /usr/lib/x86_64-linux-gnu/libldap_r-2.4.so.2.10.5
janus 2048 root mem REG 259,2 59640 4725 /usr/lib/x86_64-linux-gnu/liblber-2.4.so.2.10.5
janus 2048 root mem REG 259,2 301376 2381 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2
janus 2048 root mem REG 259,2 113584 25983 /usr/lib/x86_64-linux-gnu/librtmp.so.1
janus 2048 root mem REG 259,2 207208 25791 /usr/lib/x86_64-linux-gnu/libidn.so.11.6.15
janus 2048 root mem REG 259,2 456632 2098 /lib/x86_64-linux-gnu/libpcre.so.3.13.2
janus 2048 root mem REG 259,2 31104 25835 /usr/lib/x86_64-linux-gnu/libffi.so.6.0.4
janus 2048 root mem REG 259,2 1599368 18696 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.4800.2
janus 2048 root mem REG 259,2 1239440 11846 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.6.2
janus 2048 root mem REG 259,2 31712 2024 /lib/x86_64-linux-gnu/librt-2.23.so
janus 2048 root mem REG 259,2 1868984 2003 /lib/x86_64-linux-gnu/libc-2.23.so
janus 2048 root mem REG 259,2 138696 2002 /lib/x86_64-linux-gnu/libpthread-2.23.so
janus 2048 root mem REG 259,2 452992 28222 /usr/lib/x86_64-linux-gnu/libcurl.so.4.4.0
janus 2048 root mem REG 259,2 1650776 58036 /usr/lib/libusrsctp.so.1.0.0
janus 2048 root mem REG 259,2 111288 58034 /usr/lib/libsrtp2.so.1
janus 2048 root mem REG 259,2 14608 2005 /lib/x86_64-linux-gnu/libdl-2.23.so
janus 2048 root mem REG 259,2 1088952 1999 /lib/x86_64-linux-gnu/libm-2.23.so
janus 2048 root mem REG 259,2 2365984 16755 /lib/x86_64-linux-gnu/libcrypto.so.1.0.0
janus 2048 root mem REG 259,2 428384 16766 /lib/x86_64-linux-gnu/libssl.so.1.0.0
janus 2048 root mem REG 259,2 51600 52065 /usr/lib/x86_64-linux-gnu/libjansson.so.4.7.0
janus 2048 root mem REG 259,2 1115136 18636 /lib/x86_64-linux-gnu/libglib-2.0.so.0.4800.2
janus 2048 root mem REG 259,2 339000 18792 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4800.2
janus 2048 root mem REG 259,2 1355288 57581 /usr/lib/libnice.so.10.8.0
janus 2048 root mem REG 259,2 47352 53082 /usr/lib/x86_64-linux-gnu/libconfig.so.9.2.0
janus 2048 root mem REG 259,2 162632 2001 /lib/x86_64-linux-gnu/ld-2.23.so
janus 2048 root mem REG 259,2 26258 24747 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache
janus 2048 root 0u CHR 136,0 0t0 3 /dev/pts/0
janus 2048 root 1w REG 259,2 319624 257791 /opt/janus/JanusLog/janus04062020.log
janus 2048 root 2w REG 259,2 319624 257791 /opt/janus/JanusLog/janus04062020.log
janus 2048 root 3r CHR 1,9 0t0 11 /dev/urandom
janus 2048 root 4u raw 0t0 18254 00000000:0084->00000000:0000 st=07
janus 2048 root 5u IPv4 18255 0t0 UDP *:55124
janus 2048 root 6u raw6 0t0 18256 00000000000000000000000000000000:0084->00000000000000000000000000000000:0000 st=07
janus 2048 root 7u IPv6 18257 0t0 UDP *:43334
janus 2048 root 8u a_inode 0,11 0 7996 [eventfd]
janus 2048 root 9u sock 0,8 0t0 19755 protocol: TCPv6
janus 2048 root 10u IPv4 18259 0t0 UDP *:rfe
janus 2048 root 11u IPv4 18260 0t0 UDP *:5004
janus 2048 root 12r FIFO 0,10 0t0 18261 pipe
janus 2048 root 13w FIFO 0,10 0t0 18261 pipe
janus 2048 root 14r REG 259,2 2925714 270116 /opt/janus/share/janus/streams/radio.alaw
janus 2048 root 15u a_inode 0,11 0 7996 [eventfd]
janus 2048 root 16u IPv6 19426 0t0 TCP *:omniorb (LISTEN)
janus 2048 root 17u IPv6 19430 0t0 TCP *:https (LISTEN)
janus 2048 root 18u unix 0xffff880211482c00 0t0 19431 type=STREAM
janus 2048 root 19u unix 0xffff880211482800 0t0 19432 type=STREAM
janus 2048 root 20u IPv6 21527 0t0 TCP [PRIVATE DNS]:[MACHINE IP]:62885 (ESTABLISHED)
janus 2048 root 21u a_inode 0,11 0 7996 [eventfd]
janus 2048 root 22u sock 0,8 0t0 21557 protocol: TCPv6
janus 2048 root 23u sock 0,8 0t0 21560 protocol: TCPv6
janus 2048 root 24u sock 0,8 0t0 18316 protocol: TCPv6
janus 2048 root 25u sock 0,8 0t0 18319 protocol: TCPv6
janus 2048 root 26u a_inode 0,11 0 7996 [eventfd]
janus 2048 root 27u IPv4 19761 0t0 UDP [PRIVATE DNS]:51507
janus 2048 root 28w REG 259,2 19316736 1043589 /opt/janus/share/janus/recordings/8787_05222020084824/videoRoom/webcam_06-04-2020_19-7-19-video.mjr
janus 2048 root 29u a_inode 0,11 0 7996 [eventfd]
janus 2048 root 30u a_inode 0,11 0 7996 [eventfd]
janus 2048 root 31u IPv4 18392 0t0 UDP [PRIVATE DNS]:56172
janus 2048 root 32w REG 259,2 8269824 1043591 /opt/janus/share/janus/recordings/8787_05222020084824/screenShare/screen1_06-04-2020_19-7-54-video.mjr
janus 2048 root 33w REG 259,2 0 1043592 /opt/janus/share/janus/recordings/8787_05222020084824/screenShare/screen1_06-04-2020_19-7-54-data.mjr
janus 2048 root 34u IPv6 21805 0t0 TCP [PRIVATE DNS]:https->103.70.199.90:22699 (ESTABLISHED)
janus 2048 root 35u IPv6 19775 0t0 TCP [PRIVATE DNS]:https->103.70.199.90:16711 (ESTABLISHED)
janus 2048 root 36u a_inode 0,11 0 7996 [eventfd]
janus 2048 root 37u IPv6 21811 0t0 TCP [PRIVATE DNS]:https->103.70.199.90:34913 (ESTABLISHED)
janus 2048 root 38u IPv6 19783 0t0 TCP [PRIVATE DNS]:https->103.70.199.90:6974 (ESTABLISHED)
janus 2048 root 39u IPv6 19786 0t0 TCP [PRIVATE DNS]:https->103.70.199.90:31090 (ESTABLISHED)
janus 2048 root 40u IPv6 22635 0t0 TCP [PRIVATE DNS]:https->103.70.199.90:canna (ESTABLISHED)
janus 2048 root 41u a_inode 0,11 0 7996 [eventfd]
janus 2048 root 42u IPv4 21212 0t0 UDP [PRIVATE DNS]:49521
janus 2048 root 43w REG 259,2 13262848 1043595 /opt/janus/share/janus/recordings/33333_06042020093815/videoRoom/webcam_06-04-2020_19-9-35-video.mjr
janus 2048 root 44u a_inode 0,11 0 7996 [eventfd]
janus 2048 root 45u a_inode 0,11 0 7996 [eventfd]
janus 2048 root 46u IPv4 22845 0t0 UDP [PRIVATE DNS]:42609
janus 2048 root 47w REG 259,2 4153344 1043598 /opt/janus/share/janus/recordings/33333_06042020093815/screenShare/screen1_06-04-2020_19-10-20-video.mjr
janus 2048 root 48w REG 259,2 0 1043599 /opt/janus/share/janus/recordings/33333_06042020093815/screenShare/screen1_06-04-2020_19-10-20-data.mjr
janus 2048 root 49u IPv6 19805 0t0 TCP [PRIVATE DNS]:[MACHINE IP]:63056 (ESTABLISHED)
janus 2048 root 50u IPv6 19809 0t0 TCP [PRIVATE DNS]:[MACHINE IP]:63057 (ESTABLISHED)
janus 2048 root 51u IPv6 19813 0t0 TCP [PRIVATE DNS]:[MACHINE IP]:63063 (ESTABLISHED)
janus 2048 root 52u IPv6 21885 0t0 TCP [PRIVATE DNS]:[MACHINE IP]:63065 (ESTABLISHED)
janus 2048 root 53u a_inode 0,11 0 7996 [eventfd]
janus 2048 root 54u a_inode 0,11 0 7996 [eventfd]
janus 2048 root 55u a_inode 0,11 0 7996 [eventfd]
janus 2048 root 56u a_inode 0,11 0 7996 [eventfd]
janus 2048 root 57u IPv4 19822 0t0 UDP [PRIVATE DNS]:36070
janus 2048 root 58u IPv6 21892 0t0 TCP [PRIVATE DNS]:[MACHINE IP]:63071 (ESTABLISHED)
janus 2048 root 59u IPv6 22909 0t0 TCP [PRIVATE DNS]:[MACHINE IP]:63070 (ESTABLISHED)
janus 2048 root 60u IPv6 22915 0t0 TCP [PRIVATE DNS]:[MACHINE IP]:63073 (ESTABLISHED)
janus 2048 root 61u sock 0,8 0t0 21897 protocol: TCPv6
janus 2048 root 62u a_inode 0,11 0 7996 [eventfd]
janus 2048 root 63u a_inode 0,11 0 7996 [eventfd]
janus 2048 root 64u IPv4 19825 0t0 UDP [PRIVATE DNS]:34324
janus 2048 root 65u a_inode 0,11 0 7996 [eventfd]
janus 2048 root 66u a_inode 0,11 0 7996 [eventfd]
janus 2048 root 67u a_inode 0,11 0 7996 [eventfd]
janus 2048 root 68u a_inode 0,11 0 7996 [eventfd]
janus 2048 root 69u a_inode 0,11 0 7996 [eventfd]
janus 2048 root 70u IPv4 23056 0t0 UDP [PRIVATE DNS]:58645
janus 2048 root 71u a_inode 0,11 0 7996 [eventfd]
janus 2048 root 72u IPv4 23059 0t0 UDP [PRIVATE DNS]:47268
Note :- I have removed IP address for security reasons.
To view this discussion on the web visit https://groups.google.com/d/msgid/meetecho-janus/384f16d5-33d2-49fc-b0f4-8a679ceffa69%40googlegroups.com.
Serhat Sakarya
Jun 4, 2020, 12:26:14 PM6/4/20
to Saif, meetecho-janus
What do you see in /proc? That is: /proc/X/fd
What I would do as a first test in your case would be something simple like looking at the number of fds before any activity, then during a session and then after. That way you can see if it's being reclaimed or not and how quickly. Or maybe it's reclaimed after some timeouts, which could indicate that the clients aren't behaving properly.
Your textfile only seems to show about 150 entries, which would seem to be consistent with a normally operating Janus instance. This seems like something that should be pretty easy to track.
By the way, longer dumps are usually best done through pastebin, otherwise some might find it spammy here.
To unsubscribe from this group and stop receiving emails from it, send an email to meetecho-janu...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/meetecho-janus/50f4fddc-84b4-4f6c-a49f-4891b1717ea1%40googlegroups.com.
Reply all
Reply to author
Forward
0 new messages