error 2200 media server failed to process request

389 views
Skip to first unread message

Anuar Nadraliev

unread,
Nov 21, 2019, 12:14:01 AM11/21/19
to bigbluebutton-users
Good day!
1) Yesterday we got the error "error 2200 media server failed to process request". What is the problem?
 
2) We will send a message when creating a webinar, but the message does not reach. What is the problem?
 
3) There was a problem with disconnecting and connecting the microphone. What is the problem?

Fred Dixon

unread,
Nov 21, 2019, 6:14:17 AM11/21/19
to BigBlueButton-users
Hi Anuar,

While you didn't specify, I think you are referring to https://demo.bigbluebutton.org/.  We were doing some updates to the server.  Can you try it again and let us know if you still encounter any of (1), (2), or (3).

Regards,... Fred
 

--
You received this message because you are subscribed to the Google Groups "bigbluebutton-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/bigbluebutton-users/6324aa02-6005-4ec2-b28e-4a8ba1d96050%40googlegroups.com.


--
BigBlueButton Developer

Like BigBlueButton?  Tweet us at @bigbluebutton

Ioannis Paraskevopoulos

unread,
Dec 12, 2019, 6:52:52 AM12/12/19
to bigbluebutton-users
Hi Fred!
Firstly allow me to congratulate you and your team for this great effort of yours on BBB project.

We have installed BBB in a bare metal server (self-hosted) with these specs

BigBlueButton Server 2.2.0-beta-20 (1416)
                    Kernel version: 4.4.0-161-generic
                    Distribution: Ubuntu 16.04.6 LTS (64-bit)
                    Memory: 32903 MB
                    CPU cores: 24 (Intel(R) Xeon(R) CPU E5-2640 0 @ 2.50GHz)
                    Network Bandwith : 1Gbps

On this instance of BBB we are running multiple concurrent meetings for educational purposes (university classes). For the history,
  • we have conducted a BBB meeting with 110 users (109 students and 1 moderator - there was only 1 webcam streaming)
  • we have conducted 10 concurrent meetings with a total of around 250 users participating in those (60 participants to one meeting, 10 to another meeting etc...)
Yesterday while there were about 5-6 meetings running (no more than a total of 150 participants) from one point and further if someone was trying to share his cam he was getting the error "error 2200 media server failed to process request"

Running top command on the server the kurento-media-server s process was getting all the cpu power (the server got up to load average of 717!!!) At that point i was expecting the server to just crush. Instead of crushing, all the meetings kept going on normally (without audio problems) except the video feature.

In two meetings out of total the users shared about 10 webcams per meeting. In the other meeting there was only one cam shared per meeting.
Because i didn't want to interrupt all these meetings i didn't run "bbb-conf --restart" (taking into consideration that on all other aspects the meetings had a normal flow). At some time the kurento process stopped (without human intervention) and cpu load average came back to normal. Running systemctl status kurento-media-server the result was that it was running fine (didn't expect that). I did a systemctl restart kurento-media-server while the meetings were running but it didn't help.

Finally after all meetings ended i did "bbb-conf --restart" and problem was solved (Didn't have to reboot server)

I reviewed all logs but didn't manage to find what caused the problem. Searched the internet and found out that this is appearing the last month also to your demo server.

  • Could you please provide me with any hint in order to be prepared and avoid it the next time? Maybe help me where to search in logs in order to dig out the real cause?
  • Is it something (except bbb-conf --restart") that a sys-admin can do in order to correct it live (without breaking the running meetings) if it happens again?
  • I think that the specs of the BBB instance could hold a great load. I didn't expect that day a problem to show up. Your thoughts on that?
I am planning to run a meeting with 500 users and 1 moderator (one webcam - only the moderator) with no other concurrent meetings running the same time. Doing the math on cpu and bandwith (1 Gbps line) i am assuming that it has great chances to go out well. I would be very happy if i could record any data (system  or app data) that could help your effort on developing and troubleshooting and maybe some advice of yours based on your experience in order to avoid disruptions or degradations of quality.

Thanks in advance.

Regards,

Ioannis



Τη Πέμπτη, 21 Νοεμβρίου 2019 - 1:14:17 μ.μ. UTC+2, ο χρήστης Fred Dixon έγραψε:
Hi Anuar,

While you didn't specify, I think you are referring to https://demo.bigbluebutton.org/.  We were doing some updates to the server.  Can you try it again and let us know if you still encounter any of (1), (2), or (3).

Regards,... Fred
 

On Thu, Nov 21, 2019 at 6:14 AM Anuar Nadraliev <nadral...@gmail.com> wrote:
Good day!
1) Yesterday we got the error "error 2200 media server failed to process request". What is the problem?
 
2) We will send a message when creating a webinar, but the message does not reach. What is the problem?
 
3) There was a problem with disconnecting and connecting the microphone. What is the problem?

--
You received this message because you are subscribed to the Google Groups "bigbluebutton-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-users+unsub...@googlegroups.com.

Chad Pilkey

unread,
Dec 12, 2019, 3:31:49 PM12/12/19
to bigbluebutton-users
I've seen Kurento get into bad states when under high load. There have been improvements to Kurento since 2.2-beta20 (Sept 20) and it's possible that the issue you hit is fixed in the newer builds.

If you do hit the problem again it's actually possible to restart just Kurento/SFU without interrupting the meetings that are running. Running "systemctl restart bbb-webrtc-sfu" will restart just Kurento. If there happen to be streams that are working they will get disconnected, but the meetings themselves will live.

Fred Dixon

unread,
Dec 12, 2019, 5:57:29 PM12/12/19
to BigBlueButton-users
Is it an option for you to upgrade your server to the latest build of BigBlueButton 2.2, see


See also


Regards,... Fred

To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-u...@googlegroups.com.


--
BigBlueButton Developer

Like BigBlueButton?  Tweet us at @bigbluebutton

--
You received this message because you are subscribed to the Google Groups "bigbluebutton-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/bigbluebutton-users/c9af5f1f-358d-4d2f-9614-9bf18d6978e3%40googlegroups.com.

Ioannis Paraskevopoulos

unread,
Dec 13, 2019, 4:04:19 AM12/13/19
to bigbluebutton-users
Thank you for you advice. I will have that in mind next time. Chad, given the opportunity of the high load you mentioned, from your  experience what situation would you consider more to as high load from the following:

1. 500 participants with just one webcam open in a meeting.
2. 100 participants with 5 webcams open

I know that when it comes to BBB performance, hardware specs are very important but given this configuration

BigBlueButton Server 2.2.0-beta-20 (1416)
                    Kernel version: 4.4.0-161-generic
                    Distribution: Ubuntu 16.04.6 LTS (64-bit)
                    Memory: 32903 MB
                    CPU cores: 24 (Intel(R) Xeon(R) CPU E5-2640 0 @ 2.50GHz)
                    Network Bandwith : 1Gbps

and from your experience do you thing that a meeting with 500 participants, 1 webcam is feasible?

Is there any former experience in meetings of that size?

Fred Dixon

unread,
Dec 13, 2019, 6:41:38 AM12/13/19
to BigBlueButton-users
Hi Ioannis,

> 1. 500 participants with just one webcam open in a meeting.
> 2. 100 participants with 5 webcams open
based 
You should be able to do scenario (2).  We recommend using BigBlueButton for sessions of 100 users (or less), see


However that is not hard-coded.  Your server is quite powerful.  We would recommend upgrading to the last build of 2.2.  In both Scenario (1) and (2) the total number of streams is under 500, which should also be fine.

> and from your experience do you thing that a meeting with 500 participants, 1 webcam is feasible?

That one is going to be tricky -- the client does well for 100 users (and slightly higher), but BigBlueButton is not ready for 500 users in a single session yet.  There is work underway to increase the capacity in BigBlueButton 2.3 (the next version we're working on), see


Also, in BigBlueButton 2.3, we're going to put some parameters on the server to let you set a maximum number of simultaneous streams based on the capacity of the server.  Nonetheless, we would recommend upgrading to the latest build and let us know the results of another round of usage.

Regards,... Fred


To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-u...@googlegroups.com.


--
BigBlueButton Developer

Like BigBlueButton?  Tweet us at @bigbluebutton

--
You received this message because you are subscribed to the Google Groups "bigbluebutton-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/bigbluebutton-users/68f608d9-ab1d-4c34-b6b1-84b3f7d7bd51%40googlegroups.com.

Ioannis Paraskevopoulos

unread,
Dec 13, 2019, 8:07:31 AM12/13/19
to bigbluebutton-users
Hi Fred,

i would like to thank you for your immediate reply. It is quite informative. I will plan to upgrade to BigBlueButton 2.2-RC-4 during holidays when no meetings are taking place.For the time being i am monitoring the system and have preventively locked the webcams on startup in bigbluebutton.properties. Its up to the moderator allowing users to share webcams. I will be glad to provide you with whatever info will be helpful for the project. I will keep in touch.

Regards
Ioannis
To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-users+unsub...@googlegroups.com.


--
BigBlueButton Developer

Like BigBlueButton?  Tweet us at @bigbluebutton

--
You received this message because you are subscribed to the Google Groups "bigbluebutton-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-users+unsub...@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages