Scalelite: severs needed for 800 users and a lot of recordings?

[German Acevedo]

Hi,

I need to plan a configuration for one school where they are expecting a peak of 800 students connected at the same time distributed in 30 sessions with 25 students in each one and some other small meetings for staff sessions.

In a whole day they are expecting to record about 150 sessions with an average duration of 45 minutes each one (about 112.5 hours recorded each day).  The recordings of the whole year should remain available for the students through Moodle.

So please let me know if the following configuration should work for this scenario:

• 1 Moodle Server (Ryzen 5, hexacore, 64 GB RAM, 2x2 TB, 1Gbit/s)
• 1 Greenlight server (VPS with: 4 cores, 8 GB RAM, 200 GB SSD, 200 Mbit/s)
• 1 Scalelite server (VPS with: 4 cores, 8 GB RAM, 200 GB SSD, 200 Mbit/s)
• 5 BigBlueButton servers (Bare metal, 2 Intel Xeon 8 cores, 16 GB RAM, 2x1 TB SATA, 1 Gbit/s)
• 1 Recordings server (Do I need to have a central server for all the recordings or are they stored in the server where the session was created?)

My main doubt is how the recordings work. Can I have a single server with for example 8 TB HDD to store all the recordings? Can I delete the recordings on each BBB server once they are transfered to the recordings server? Does it happen in an automatic way?

Thanks in advance for any guidance,

Regards,

German Acevedo

[Mauricio Garcia]

Hi German, all students per room with webcam and audio simultaneously? 

In this case maybe you need 3 more BBB's machines. 100 users per machine aprox, I recommend you do a test first to make sure how many rooms each server supports 25

For records, you can setup centraliced NFS and scripts to clean BBB's. 

In my tests, 10000-15000 hours of record need 4TB aprox.

[German Acevedo]

Hi Mauricio,

Can I setup the 4 TB for the recordings in the same server used for Scalelite and use the server planned only for recordings as a 4th BigBlueButton server?

Can I run the BBB's servers on VPS's?

Thanks in advance for your support

[Martin Thomas Schrott]

Am 21.05.2020 um 08:31 schrieb German Acevedo:
> Hi Mauricio,
> Can I setup the 4 TB for the recordings in the same server used for
> Scalelite and use the server planned only for recordings as a 4th
> BigBlueButton server?

yes, you don't even need nfs, you can rsync the files via ssh to
scalelite. see the postprocess script, it supports nfs or sync via ssh
directly.

> Can I run the BBB's servers on VPS's?

I would not suggest that, audio quality and av-sync is better on bare
metal. But if you use dedicated cpu on vm it may work quite well though.

cheers

Martin

[Mauricio Garcia]

if you use VPS try with KVM with dedicated cpu!!! Use Virtual Machines, not containners.

[German Acevedo]

Thank you all for your help.
I belive that we will be using vps while getting familiar to install scalelite but for production we will move to bare metal.

Regards,

German Acevedo

[basisbit]

on a side note, (assuming your customer is from Europe) please take a look at https://docs.bigbluebutton.org/admin/privacy.html

Usually you'll want to disable the recording feature on BBB servers for users in Europe because it is quite difficult to get all the stuff done in compliance with GDPR if you do not disable session recording.

[German Acevedo]

Thanks for the advice!
Fortunately all our users are from a small university and a school in Guatemala, Central America.

Regards,

German Acevedo

Libre de virus. www.avg.com

--
You received this message because you are subscribed to a topic in the Google Groups "BigBlueButton-dev" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/bigbluebutton-dev/oyAQGSiNsy4/unsubscribe.
To unsubscribe from this group and all its topics, send an email to bigbluebutton-...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/bigbluebutton-dev/2606c3a6-a7e9-4e52-aaa4-56efc4ca4f30%40googlegroups.com.

Libre de virus. www.avg.com

[Nicolás López]

Hello German,

I've been using virtual severs with 8vCPUs for a while without problem. Just bear in mind the number of enabled cameras you expect to have at the same time, will affect the sizing a lot. Recording processing uses a lot of CPU as well, but you can schedule that to run at night, or use a separate server.

[Mudreka Bohra]

Hi sir,

can u please elaborate on how one can achieve that the recording process will be done at night and also if we wan to setup different server for processing how that can be done thank you

[Nicolás López]

Check the BBB Config google group, there are a couple of threads explaining that: https://groups.google.com/forum/#!forum/bigbluebutton-setup

[German Acevedo]

Thanks for the info Nicolás.

Can you share how can I setup a server just to process the recordings?

Regards,

German

[Jibon Costa]

Have a look here: http://docs.bigbluebutton.org/dev/recording.html#enable-a-workflow

Now you can set cronjob

[beti...@gmail.com]

I am running same case just with 2000+ students per day for a complete semester with Hyper-V Virtualized VM-s and had no problems with recordings or anything else.

[Amit Saxena]

I would add a load balancer in front of your scalelite server(s), as scalelite will become the bottleneck because it will be used for joining all of the meetings as well as playing all of the recordings

[Matias Silva]

Hi,

You can host multiple instances of the scalelite parts (not all) for a
high availability deployment. An HTTP loadbalancer could help as well, I
suppose.

---
Thanks, Matias

[Fred Dixon]

HI Amit,

> as scalelite will become the bottleneck because it will be used for joining all of the meetings as well as playing all of the recordings

At what point (how many servers) did you see Scalelite becoming a bottleneck in your setup?  There are some fairly large deployments (much larger than 800 concurrent users) using a single Scalelite server.

Regards,... Fred

--
You received this message because you are subscribed to the Google Groups "BigBlueButton-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/bigbluebutton-dev/9770ecd7f3d64f235325dd4d93cef944%40srcf.net.

--

BigBlueButton Developer

http://bigbluebutton.org/

Like BigBlueButton?  Tweet us at @bigbluebutton

[boo...@gmail.com]

Hey Fred,
We are running 10 BBB servers, but starting/joining a meeting wasn't the problem, we started noticing a problem once we hit 3000 recordings... specifically in Greenlight when accessing "all of the recordings" the scalelite server would lock up trying to process those requests and not be available to do anything else until it was done... adding a load balancer to be able to add scalelite servers has helped resolve the issue that we were facing...

[Stefan T. Ruehl]

Hi There,

I am with the BBB@Scale team (https://gitlab.com/bbbatscale/bbbatscale), we recently published our home grown solution replacing Greenlight and Scalelite with a single tool. The application ist containerized and horizontally scalable, thus, having more scheduling capacity is a matter of deploying more pods in a K8s cluster (OpenShift in our case). We have a total of 66 BBB servers (VMs) running - however we are quite overprovisioned. 

Regarding recordings: we facilitate a approach where we have different types of BBB servers - regular meeting servers, processing servers (recording post processing), and playback servers (well... playback). However, to be frank, we are still in the process of cleaning up and documenting BBB@Scale. And the recording handling part of our application is still a mess (however, it works on our machines ;D). We are working hard on improving and generalizing for external use. 

Maybe you want to take a look besides the shortcomings of our project. 

Cheers,

Stefan

[bayden10]

Hi Stefan, will swing on by.. thanks

Jim

[Fazal Md Khan]

Hello Stefan

i tried to install your solution but stuck on git clone

git clone g...@gitlab.com:bbbatscale/bbbatscale.git 

Its output error

 Cloning into 'bbbatscale'...

g...@gitlab.com: Permission denied (publickey).

fatal: Could not read from remote repository.

Please make sure you have the correct access rights

and the repository exists.

[Matias Silva]

Hi,

From first glance, that looks like an SSH clone link. If you're just
cloning, then https://gitlab.com/bbbatscale/bbbatscale.git is the URL to
use after git clone.

---
Thanks, Matias

> https://groups.google.com/d/msgid/bigbluebutton-dev/5b458df6-b22f-459c-959a-595f7e883921n%40googlegroups.com
> [1].
>
>
> Links:
> ------
> [1]
> https://groups.google.com/d/msgid/bigbluebutton-dev/5b458df6-b22f-459c-959a-595f7e883921n%40googlegroups.com?utm_medium=email&utm_source=footer

[Fazal Md Khan]

Hello Stefan

i have installed BBB and scalelite  but after adding server its showing waiting_response and when trying to start meeting getting 500 error

Thanks Fazal

On Thursday, July 16, 2020 at 11:59:09 PM UTC+6 Stefan T. Ruehl wrote:

[Ragesh Antony]

Hello Stefan ,

I saw the screenshots and it's awesome .. Good admin panel

I have a question

IF i use this , does this assign separate roles for each servers to reduce burden

I need a server for meeting and a server for recording the meeting in 1st server and a server to stream playback files

So 3 servers (or 3 server groups)

Please guide me

To view this discussion on the web visit https://groups.google.com/d/msgid/bigbluebutton-dev/a9de211f-f230-48cd-857f-c4d40204dc70n%40googlegroups.com.