bbb 2.0 html5 stress test

[leandro....@redtecnologica.org]

Hi!

I need to try BBB 2 html5 with 200 users, does anyone have any script?

Thanks!

[Fred Dixon]

Hi Leandro,

While the docs say to use BigBlueButton for 100 users (or less), the numbers are conservative.  There is no hard-coded number in BigBlueButton for a max size of 100.

For what it's worth, we know of some companies that have seen class sizes of 250 users with a single webcam.

Regards,... Fred

--
You received this message because you are subscribed to the Google Groups "BigBlueButton-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-...@googlegroups.com.
To post to this group, send email to bigblueb...@googlegroups.com.
Visit this group at https://groups.google.com/group/bigbluebutton-dev.
For more options, visit https://groups.google.com/d/optout.

--

BigBlueButton Developer

http://bigbluebutton.org/

@bigbluebutton

[Leandro De Mestico]

Is there any active member of this community that I could ask about the experience of testing BBB with this amount of users in production?

Do you have an estimated hardware requirement for this scenario? 

Regards,

 

_________________________________________________________________________________

________________________________Leandro De Mestico_____________________________

leandro....@redtecnologica.org

Cel. 54 11 3916 4438

Horario de contacto: 10-16hs, emergencias 8-23hs (Cel.)

_________________________________________________________________________________

2018-05-31 17:44 GMT-03:00 Fred Dixon <ffd...@gmail.com>:

Hi Leandro,

While the docs say to use BigBlueButton for 100 users (or less), the numbers are conservative.  There is no hard-coded number in BigBlueButton for a max size of 100.

For what it's worth, we know of some companies that have seen class sizes of 250 users with a single webcam.

Regards,... Fred

On Thu, May 31, 2018 at 4:33 PM <leandro.demestico@redtecnologica.org> wrote:

Hi!

I need to try BBB 2 html5 with 200 users, does anyone have any script?

Thanks!

--
You received this message because you are subscribed to the Google Groups "BigBlueButton-dev" group.

To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-dev+unsubscribe@googlegroups.com.
To post to this group, send email to bigbluebutton-dev@googlegroups.com.

Visit this group at https://groups.google.com/group/bigbluebutton-dev.
For more options, visit https://groups.google.com/d/optout.

--

BigBlueButton Developer

http://bigbluebutton.org/

@bigbluebutton

--

You received this message because you are subscribed to the Google Groups "BigBlueButton-dev" group.

To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-dev+unsubscribe@googlegroups.com.
To post to this group, send email to bigbluebutton-dev@googlegroups.com.

[Chad Pilkey]

I don't have any hard numbers, but as of right now the the HTML5 client doesn't scale quite as well as the Flash client in certain scenarios. One of the notable scaling issues is that the current HTML5 listen-only audio actually just uses full two-way audio so FreeSWTICH ends up having to do a lot more work to handle the increasing number of users because they get individually mixed. We've got a potential solution that will just re-stream the audio instead of mixing, but it's still a work in progress. Scaling issues like the previously mentioned one are dealt with as we identify them, but the HTML5 client has had a lot less hardening time so I wouldn't expect it to scale quite as well as the older Flash client. We're working on it though.

On Tuesday, July 24, 2018 at 3:25:19 PM UTC-4, Leandro De Mestico wrote:

Is there any active member of this community that I could ask about the experience of testing BBB with this amount of users in production?

Do you have an estimated hardware requirement for this scenario? 

Regards,

 

_________________________________________________________________________________

________________________________Leandro De Mestico_____________________________

leandro....@redtecnologica.org

Cel. 54 11 3916 4438

Horario de contacto: 10-16hs, emergencias 8-23hs (Cel.)

_________________________________________________________________________________

2018-05-31 17:44 GMT-03:00 Fred Dixon <ffd...@gmail.com>:

Hi Leandro,

While the docs say to use BigBlueButton for 100 users (or less), the numbers are conservative.  There is no hard-coded number in BigBlueButton for a max size of 100.

For what it's worth, we know of some companies that have seen class sizes of 250 users with a single webcam.

Regards,... Fred

On Thu, May 31, 2018 at 4:33 PM <leandro....@redtecnologica.org> wrote:

Hi!

I need to try BBB 2 html5 with 200 users, does anyone have any script?

Thanks!

--
You received this message because you are subscribed to the Google Groups "BigBlueButton-dev" group.

To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-...@googlegroups.com.
To post to this group, send email to bigblueb...@googlegroups.com.

Visit this group at https://groups.google.com/group/bigbluebutton-dev.
For more options, visit https://groups.google.com/d/optout.

--

BigBlueButton Developer

http://bigbluebutton.org/

@bigbluebutton

--
You received this message because you are subscribed to the Google Groups "BigBlueButton-dev" group.

To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-...@googlegroups.com.
To post to this group, send email to bigblueb...@googlegroups.com.

[a.og...@entouch.co.jp]

Hi Leandro,

I've been doing a fair about of testing recently so perhaps I can help you out a bit, please let me know;

- are you using VMs or bare metal?

- are you using Flash or HTML5 client or both?

- are you recording the session?

- how many webcams will be operational?

- are you using the multi user drawing tool?

Ally.

[Leandro De Mestico]

Hi Ally, thanks for your help,

I need BBB to replace Wiziq in an e-learning platform for a major university in Argentina.

- are you using VMs or bare metal?

Now it's in a DigitalOcean dropplet, but migrating to a bare metal is a possibility.

- are you using Flash or HTML5 client or both?

HTML5 is indispensable.

- are you recording the session?

Yes, I'm actually working on an option to allow the user to download recordings as well.

- how many webcams will be operational?

1 per meeting but there may be up to 15 meetings at the same time

- are you using the multi user drawing tool?

No

Thanks!

_________________________________________________________________________________

________________________________Leandro De Mestico_____________________________

leandro....@redtecnologica.org

Cel. 54 11 3916 4438

Horario de contacto: 10-16hs, emergencias 8-23hs (Cel.)

_________________________________________________________________________________

--

[Leandro De Mestico]

Chad, thanks for your answer,

Can the freeswitch problem be solved with better hardware? Or can the audio just begin to fail in this scenario?

_________________________________________________________________________________

________________________________Leandro De Mestico_____________________________

leandro....@redtecnologica.org

Cel. 54 11 3916 4438

Horario de contacto: 10-16hs, emergencias 8-23hs (Cel.)

_________________________________________________________________________________

To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-dev+unsubscribe@googlegroups.com.
To post to this group, send email to bigbluebutton-dev@googlegroups.com.

[Chad Pilkey]

Better hardware is definitely better when you want to scale a single server up, but there's always going to be a limit. I don't have any hard numbers, but I suspect that 200 users in one meeting would be more intensive than 200 users spread across 15 meetings. Operations isn't really my area so I'm not really sure why kind of CPU you would need to support 200 people.

[a.og...@entouch.co.jp]

Leandro,

Thanks for giving me some more info.

 

- are you using VMs or bare metal?

Now it's in a DigitalOcean dropplet, but migrating to a bare metal is a possibility.

Bare metal is really recommended not just by me but by the BBB devs too.

However, my company is currently using Google Cloud VMs at the moment while we assess whether to use BBB officially.

 

- are you using Flash or HTML5 client or both?

HTML5 is indispensable.

You should note that some features are not inter-operable between Flash and HTML5 in the same client. HTML5 also seems to hog a lot more bandwidth at the moment.

 

- are you recording the session?

Yes, I'm actually working on an option to allow the user to download recordings as well.

When recording we noticed a significant increase in server resource (around 20-30% extra CPU load), so if you decide to record I would double the CPU server spec.

 

- how many webcams will be operational?

1 per meeting but there may be up to 15 meetings at the same time

if you have 100 participants and 1 webcam per meeting, we calculated on Google Compute this would be achievable with Google Cloud n1-standard-4 (4 vCPUs, 15 GB memory) - ubuntu-1604-xenial-v20180109

However this is for a single meeting. Running meetings in parallel requires serious hardware and serious bandwidth. We currently use front end software for meeting management and load balance between many BBB servers. 1 meeting per server (VM). I have not spoken to the BBB devs on whether this is good practice or not, but it does at fail over capability in case we lose a VM we dont have to setup SSL certificates each time etc.

 

- are you using the multi user drawing tool?

No

That helps, we noticed this gets very laggy with large numbers of participants.

 

Notes:

Each cloud provider has very different hardware and different specs. For Google Compute:

A vCPU is implemented as a single hardware hyper-thread on a physical CPU

So it's always good to carry out the tests yourself anyway.

Also (perhaps obviously) make sure that your servers/vms are as local (same geographical region) to your participants as possible.

At large scale it is quite a large investment in resource to use BBB: 

- developers are probably needed to use the API

- if you go local bare metal you need staff to manage these machines - i'm sure BBB devs can recommend a bare metal hosted service if you require it.

- if you go VMs monthly costs can get very high -  2,000-4,000 USD for the 16 CPU vms that would run 20 webcams per meeting, in 20 meetings at the same time.

- be care of some providers charging extra for bandwidth or providing poor bandwidth (not had any issues with G Compute, but you should't use their load balancer$$$ )

Recently I released a tool to help simulating many users or run GUI tests that can be done on a remote server, but you'll need some know-how about docker and JavaScript to get it working. https://github.com/aogilvie/Chrombie

Good luck.

[Leandro De Mestico]

Thank you very much for your reply,

Yesterday I did a basic stress test in my office, I upgraded my BBB virtual server to 16 cores, and started connecting several computers with several windows, and reached 90 users in the same meeting.
Without using anything other than audio it worked fine, 30% of the CPU usage, but with a load of 3.5 (I could not get much info because my terminal was with too many sessions of BBB ...).
When the owner shared his screen, the CPU usage was > 95%, L.A. 18 and the BBB meeting began to collapse.

With your latest information and this testing, I will try a good bare metal hosting and maybe Google Cloud. We still do not have a bare metal server in production , so this could be a good excuse.

I will keep posting if I get any update that could help others or any other question.

Thank you all, I really like this community.

_________________________________________________________________________________

________________________________Leandro De Mestico_____________________________

leandro....@redtecnologica.org

Cel. 54 11 3916 4438

Horario de contacto: 10-16hs, emergencias 8-23hs (Cel.)

_________________________________________________________________________________

--