The best BBB performance on a server

580 views
Skip to first unread message

Seyed Sobhan

unread,
Dec 5, 2020, 1:37:04 AM12/5/20
to BigBlueButton-dev
Hello
I have BBB on a variety of dedicated servers.
Example:
RAM: 96G
CPU: 40 Core
SSD 1TB

How many virtual servers do you offer on this server?
And how much capacity should each one allocate?

Thank you

basisbit

unread,
Dec 5, 2020, 5:34:35 PM12/5/20
to BigBlueButton-dev
Depends. Probably something between 0 and 6.

You are welcome.

basisbit

unread,
Dec 5, 2020, 5:44:26 PM12/5/20
to BigBlueButton-dev
Your request basically was like "I have a green truck with 6 wheels and 6 windows and some people might say that it is rather big. How many heavy boxes would you transport with it? What size of boxes should I use?". Imagine you asked that question in a car manufacturer forum for car engineers. What answer would you get? They'd probably send you to a library to read about basics of transportation business.


You did not specify what CPU that system is using, how you want to run the virtual BBB servers (I hope it is containerd or KVM, and not VMWare...), what features your users will need how much, what session sizes you want to support, what internet uplink bandwidth the server has, if you need session recording features, what your target user profle looks like and so on.
Please read the BigBlueButton documentation, set up your first few BBB servers, put some users on there and see how it works. You'll have to learn the basics first, learn what usage profile/pattern your users usually have and then plan the size. Please start here: https://docs.bigbluebutton.org/2.2/install.html#minimum-server-requirements

Also, please do not spam the developers forum, but instead use the bigblurbutton-setup forum: https://groups.google.com/g/bigbluebutton-setup

beti...@gmail.com

unread,
Dec 5, 2020, 7:20:39 PM12/5/20
to BigBlueButton-dev
I use 4 cores, 8GB ram and 150GB HDD - I see now docs saying 16 GB ram and 8 CPU but that sounds a bit high for me...with such values I am using for each vm I can handle meetings with up to 350 participants per server and I use hyper-v virtualization which I believe KVM is even a bit better -> my host hardware is ddr4 ram, ssd-s combined with hdd-s and cpu AMD EPYC 7502P then you have to take care recordings to process at night or some time when you have no live meetings.

basisbit

unread,
Dec 5, 2020, 8:21:56 PM12/5/20
to BigBlueButton-dev
Those minimum server requirements could probably be renamed to recommended server requirements or supported production server requirements, yes. Main problem is that many people look at CPU threads count and think that is their cpu core count. Or they use heavily over-subscription'ed VMs... Additionally, processing recording while meetings are running will consume 2 CPU cores usually. So, if you don't do processing of recordings (or have disabled recordings), a 6 core machine might be okay for many use cases, except if you have a bunch of those typical 20 webcams in one "classroom" users.

Regarding RAM, I'd consider 12GB the minimum for production because otherwise processing of presentation files will fail quite often at upload (or use your swap partition and be slow) and at high load it will spend considerable amount of time doing garbage-collection. Thus not scaling as well. Processing recordings also requires a bit of peak RAM.

just my 2ct,
basisbit

sd...@distancelearning.cloud

unread,
Dec 7, 2020, 6:59:46 AM12/7/20
to bigblueb...@googlegroups.com

Something does not compute 350 users  4cores?    Freeswitch only can only mix a few users in 4cores, let alone kurento/meteor cpu requirements.

Is everyone listen only? Stock bbb 2.2.x is not going to handle 350 meteor users.

 

Would be nice if you could describe your exact use cases, and modifications needed to get your 350 users in production

Regards,

Sephen

--
You received this message because you are subscribed to the Google Groups "BigBlueButton-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/bigbluebutton-dev/4d545d75-1c7a-47e8-a36d-ae65cb2b8c1fn%40googlegroups.com.

Seyed Sobhan

unread,
Dec 15, 2020, 5:38:52 AM12/15/20
to BigBlueButton-dev
Thank you for your attention and response.
I have 5 virtual machines on one of the dedicated servers (Specifications: 128G ram - E5-2670 v2 , 40Core - 1TB SSD).
I have specified the capacity of each VM is 120 people. In my rooms, there is approximately 1 camera on and each room has an average capacity of 10 people.
However (each BBB VM has about 12 cameras and about 30 bright sounds) While I do not record any sessions, I unfortunately do not have good performance.
RAM and CPU usage are not very high, but if I increase the capacity I will have trouble transmitting audio & other problems such as the sudden expulsion of some users from the meeting!
My problem is:
multiple Bigbluebutton virtual machines on a dedicated server (with configuration listed) can perform better.
Of course, I know that virtualization consumes little server resources.
Please note that the Intel Xeon Processor E5-2670 v2 has 25M Cache and 2.50 GHz.

Respectfully
Sobhan

basisbit

unread,
Dec 15, 2020, 3:09:37 PM12/15/20
to BigBlueButton-dev
The  E5-2670 v2 has 10 CPU cores and can be installed in a two CPU configuration at most. So I assume your system actually has 20 cores, not 40. I'd suggest to use 2 or 3 virtual machines running BBB on that system. Each of them should be able to handle ~200, maybe 250 users. You probably currently only get 120 because of those virtual machines all fighting for CPU time, thus the single-threaded NodeJS probably getting less than 50% of time of one CPU.
The E5-2670 v2 is a rather old CPU which is quite slow for single-threaded tasks. An AMD Ryzen 3800X or 3900X will handle approximately twice as many concurrent users for your workload.

If you upgrade to BigBlueButton 2.2.31 (probably releases this week, but you can already try it, see https://groups.google.com/g/bigbluebutton-dev/c/roeuj95mFUQ ), your server should be able to handle quite a bit more users.
Reply all
Reply to author
Forward
0 new messages