"The voice application may not have registered with the sip server" in bbb-conf --check

[Roberto Greiner]

Hi,

I've installed BBB 1.1Beta in a server, and everything seems to be working properly. But when we made a test conference with ~10 users, many participants started having problems with audio after about 20 minutes, and a few minutoes later BBB crashed completely (server side), forcing me to do a restart using 'bbb-conf --restart'.

When I run 'bbb-conf --check', I get the following output:

BigBlueButton Server 1.1.0-beta (516)
                    Kernel version: 4.4.0-72-generic
                      Distribution: Ubuntu 16.04.2 LTS (64-bit)
                            Memory: 32933 MB

/var/www/bigbluebutton/client/conf/config.xml (bbb-client)
                Port test (tunnel): <servername>
                              red5: <servername>
              useWebrtcIfAvailable: true

/opt/freeswitch/etc/freeswitch/sip_profiles/external.xml (FreeSWITCH)
                    websocket port: 7443
                    WebRTC enabled: true

/etc/nginx/sites-available/bigbluebutton (nginx)
                       server name: <servername>
                              port: 80, [::]:80
                              port: 443 ssl
                    bbb-client dir: /var/www/bigbluebutton

/var/lib/tomcat7/webapps/bigbluebutton/WEB-INF/classes/bigbluebutton.properties (bbb-web)
                      bbb-web host: <servername>

/var/lib/tomcat7/webapps/demo/bbb_api_conf.jsp (API demos)
                               url: <servername>

/var/www/bigbluebutton/check/conf/config.xml (client check)
                      client check: <servername>

/usr/share/red5/webapps/bigbluebutton/WEB-INF/red5-web.xml (red5)
                  voice conference: FreeSWITCH

/usr/local/bigbluebutton/core/scripts/bigbluebutton.yml (record and playback)
                     playback host: <servername>


** Potential problems described below **
# IP does not match:
#                           IP from ifconfig: <serverIP>
#   /etc/nginx/sites-available/bigbluebutton: <servername>
# Warning: API URL IPs do not match host:
#
#                                IP from ifconfig: <serverIP>
#  /var/lib/tomcat7/webapps/demo/bbb_api_conf.jsp: <servername>

# Warning: The voice application may not have registered with the sip server.
#   Try running:
#
#      sudo bbb-conf --clean
#


# Warning: The API demos are installed and accessible from:
#
#    https://<servername>/demo/demo1.jsp
#
# These API demos allow anyone to access your server without authentication
# to create/manage meetings and recordings. They are for testing purposes only.
# If you are running a production system, remove them by running:
#
#    sudo apt-get purge bbb-demo

# Warning: The client self check is installed and accessible from:
#
#    https://<servername>/check
#


The software was installed in an HP DL-380G6 server (no virtualization), with 32GBRAM and 400GB disk. After installing via APT, I've set SSL using a valid certificate, and https://<servername>/check gives me a full OK, except for 'java enabled', which is expected on Firefox 53. Should I worry about that "Warning: The voice application may not have registered with the sip server" message? Is the crash I got related?

Tks,

Roberto

[HostBBB.com]

Roberto,

Sounds like freeswitch may have crashed which is very unusual.

sudo bbb-conf --debug will give you bbb logs.

do a ps aux | grep freeswtich and see if freeswitch is running,

the logs for freeswitch are /opt/freeswitch/logs freeswitch.log

you can also go to /opt/freeswitch/bin/fs_cli to connect to freeswitch console.

if it fails freeswitch is not running.

Also if you continue to have issue, check Ubuntu and HP to make sure the G6 is certified to run 16.04

regards.

Stephen

hostbbb.com

[Roberto]

On 25/04/2017 17:22, HostBBB.com wrote:

Roberto,

Sounds like freeswitch may have crashed which is very unusual.

sudo bbb-conf --debug will give you bbb logs.

Didn't show much of use:
   -- ERRORS found in /usr/share/red5/log/* --
/usr/share/red5/log/sip.log:2017-04-25 16:36:38,942-03:00 [Thread-13] ERROR o.b.voiceconf.sip.SipPeer - Failed to register with Sip Server.


# The hostname in <link> .. </link> (    <link>https://bigbluebutton.ead.unesp.br/playback/presentation/0.9.0/playback.html?meetingId=587b2b7c26e40038b2514e07eacb0a0719456be6-1489603472270</link>)
#     /var/bigbluebutton/published/presentation/587b2b7c26e40038b2514e07eacb0a0719456be6-1489603472270/metadata.xml
# do not match the hostname for bigbluebutton.web.serverURL (irwin.ead.unesp.br)
#     /usr/share/red5/webapps/bigbluebutton/WEB-INF/bigbluebutton.properties
....

The presentation file above is repeated in many files. But since this file was imported following http://docs.bigbluebutton.org/1.1/install.html#transfer-existing-published-recordings, I don't think there is much to it. The first line, doesn't say more to me than 'bbb-conf --check' already had.

do a ps aux | grep freeswtich and see if freeswitch is running,

the logs for freeswitch are /opt/freeswitch/logs freeswitch.log

ps aux didn't show freeswitch running. But since there are recent logs in /opt/freeswitch/logs/freeswitch.log, I checked again with ps -ef:
freeswi+ 16852     1  0 Apr25 ?        00:03:29 /opt/freeswitch/bin/freeswitch -u freeswitch -g daemon -ncwait -nonat
root     23159 22840  0 08:10 pts/0    00:00:00 grep --color=auto freesw

Yes, freeswitch is running.

As for freeswitch.log, the file is huge. With 5.3MB of log, I took some time looking into it at the time frame of the crash. I found some messages about running state, codecs,  and things like that. No obvious "I crashed" message. What messages should I look for? The log is way to large to post here.

you can also go to /opt/freeswitch/bin/fs_cli to connect to freeswitch console.

if it fails freeswitch is not running.

Yes, fs_cli does connect to freeswitch.

Also if you continue to have issue, check Ubuntu and HP to make sure the G6 is certified to run 16.04

Hmm, maybe not. https://certification.ubuntu.com/server/models/?release=16.04%20LTS&vendors=HPE shows only G9 as certified.....

--
You received this message because you are subscribed to a topic in the Google Groups "BigBlueButton-Setup" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/bigbluebutton-setup/voICtwWVI0k/unsubscribe.
To unsubscribe from this group and all its topics, send an email to bigbluebutton-s...@googlegroups.com.
To post to this group, send email to bigbluebu...@googlegroups.com.
Visit this group at https://groups.google.com/group/bigbluebutton-setup.
For more options, visit https://groups.google.com/d/optout.

-- 
  -----------------------------------------------------
                Marcos Roberto Greiner

   Os otimistas acham que estamos no melhor dos mundos
    Os pessimistas tem medo de que isto seja verdade
                                  James Branch Cabell
  -----------------------------------------------------

[Roberto Greiner]

Running "bbb-conf --debug" again, this time, gave me a somewhat different answer:
# bbb-conf --debug

   -- ERRORS found in /usr/share/red5/log/* --

/usr/share/red5/log/sip.log:2017-04-26 14:28:48,959-03:00 [Thread-13] ERROR o.b.voiceconf.sip.SipPeer - Failed to register with Sip Server.

   -- Errors found in /var/log/syslog --
Apr 26 12:34:46 irwin bbb-fsesl-akka[728]: java.net.ConnectException: Connection refused
Apr 26 12:34:46 irwin bbb-fsesl-akka[728]: WARNING: EXCEPTION, please implement org.freeswitch.esl.client.inbound.InboundClientHandler.exceptionCaught() for proper handling.
Apr 26 12:34:46 irwin bbb-fsesl-akka[728]: java.net.ConnectException: Connection refused
Apr 26 14:28:03 irwin red5-shutdown.sh[3557]: Exception connecting to 127.0.0.1
Apr 26 14:28:03 irwin red5-shutdown.sh[3557]: java.lang.ArrayIndexOutOfBoundsException: 0
....

Not connecting with localhost made me think of iptables. I did shut it down  (iptables -F, -Z and -X), and restartet everything (bbb-conf --clean).

Freeswitch no longer complained. I added the following rule to iptables:
iptables -A INPUT -s <serverIP> -d <serverIP> -j ACCEPT
iptables -A OUTPUT -s <serverIP> -d <serverIP> -j ACCEPT

I already had a similar rule for localhost. With this rule added, I reloaded all the rules, ran "bbb-conf  -clean", and "bbb-conf --check" is no longer showing the Freeswitch warning message.

Tks for the Help,

Roberto

[Fred Dixon]

Hi Roberto,

Could you (temporarily) turn off the iptables firewall and try restarting again.  

Regards,... Fred

--

You received this message because you are subscribed to the Google Groups "BigBlueButton-Setup" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-setup+unsub...@googlegroups.com.
To post to this group, send email to bigbluebutton-setup@googlegroups.com.

Visit this group at https://groups.google.com/group/bigbluebutton-setup.
For more options, visit https://groups.google.com/d/optout.

--

BigBlueButton Developer

http://bigbluebutton.org/

@bigbluebutton

[Fred Dixon]

Hi Reberto,

> I've installed BBB 1.1Beta in a server, and everything seems to be working properly. But when we made a test conference with ~10 users, many participants started having problems with audio after about 20 minutes, and a few minutoes later BBB crashed completely (server side),

Also, can you be more specific what you mean by crash?  Did a process exit?  What happened during the meeting (or after the meeting) that indicated there was a problem?  

We run our demo server for long periods of time with many sessions concurrently and over many weeks.  We monitor processes (as does sudo bbb-conf --check) and are very interested if you have a case where a process stopped.

Any more information you can give would be very helpful.  

Regards,... Fred

To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-setup+unsubscribe...@googlegroups.com.

To post to this group, send email to bigbluebutton-setup@googlegroups.com.
Visit this group at https://groups.google.com/group/bigbluebutton-setup.
For more options, visit https://groups.google.com/d/optout.

--

BigBlueButton Developer

http://bigbluebutton.org/

@bigbluebutton

[Roberto Greiner]

Fred,

As I wrote in the previous email, I did turn the firewall off and it did solve the problem. Freeswitch is working perfectly. I added rules to allow full access <serverIP> to <serverIP> (localhost was already open), and now everything works fine.

Tks,

Roberto

[Roberto Greiner]

On Wednesday, April 26, 2017 at 3:40:52 PM UTC-3, Fred Dixon wrote:

Hi Reberto,

> I've installed BBB 1.1Beta in a server, and everything seems to be working properly. But when we made a test conference with ~10 users, many participants started having problems with audio after about 20 minutes, and a few minutoes later BBB crashed completely (server side),

Also, can you be more specific what you mean by crash?  Did a process exit?  What happened during the meeting (or after the meeting) that indicated there was a problem?  

We run our demo server for long periods of time with many sessions concurrently and over many weeks.  We monitor processes (as does sudo bbb-conf --check) and are very interested if you have a case where a process stopped.

Any more information you can give would be very helpful.  

I didn't find much in the logs, but when I found about the crash, 'lsof -i' did show only the Ubuntu native ports open: SSH, SNMP, Syslog and the like. Everything from BBB was not available (nginx, Java, etc), but I didn't take a screenshot, so I'm not sure if it was really everything. In any case, at the time, "bbb-conf --restart" did bring the processes back, although with the Freeswitch error (at the time).

[Fred Dixon]

Hi Roberto,

> but when I found about the crash ... Everything from BBB was not available (nginx, Java, etc) ... so I'm not sure if it was really everything

That's very strange for most of the processes to stop.  One of the processes might quit, but never more than one.  While this doesn't make any sense, let us know if you see something similar happen again.

Regards,.. Fred

--
You received this message because you are subscribed to the Google Groups "BigBlueButton-Setup" group.

To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-setup+unsub...@googlegroups.com.

To post to this group, send email to bigbluebutton-setup@googlegroups.com.
Visit this group at https://groups.google.com/group/bigbluebutton-setup.
For more options, visit https://groups.google.com/d/optout.

[Roberto Greiner]

To problem of everything crashing has not happened again.

But, I noticed the following problems:
- There is something wrong with libreoffice.server. Everyday, it gives an the following error messages in syslog:
systemd[1]: libreoffice.service: Unit entered failed state.
systemd[1]: libreoffice.service: Failed with result 'exit-code'.

This happens always at 6:25 in the morning, exactly when syslog rotates the logs, so it is very likely that libreoffice.service is having some problem with logrotate.

- Today, in a conference, we noticed that everybody who connected using "Listen only" could not hear anything. I've tried the instructions in http://docs.bigbluebutton.org/install/install.html#users-not-able-to-join-listen-only-mode, but it didn't help.

- bbb-conf --check is still reporting "Warning: The voice application may not have registered with the sip server.".

The main problem now is that when somebody connects selecting "listen-only", he hears nothing?

Any ideas of what I should check? bbb-conf --debug is below.

Tks,

Roberto


  -- ERRORS found in /var/log/bigbluebutton/* --
/var/log/bigbluebutton/bbb-rap-worker.log:E, [2017-05-11T16:38:37.009088 #9198] ERROR -- : SIGTERM
/var/log/bigbluebutton/bbb-rap-worker.log:E, [2017-05-11T16:38:37.009229 #9198] ERROR -- : /usr/local/bigbluebutton/core/lib/recordandplayback.rb:128:in `each_line'
/var/log/bigbluebutton/bbb-rap-worker.log:E, [2017-05-11T16:38:37.009254 #9198] ERROR -- : /usr/local/bigbluebutton/core/lib/recordandplayback.rb:128:in `block in exec_ret'
/var/log/bigbluebutton/bbb-rap-worker.log:E, [2017-05-11T16:38:37.009274 #9198] ERROR -- : /usr/local/bigbluebutton/core/lib/recordandplayback.rb:127:in `popen'
/var/log/bigbluebutton/bbb-rap-worker.log:E, [2017-05-11T16:38:37.009294 #9198] ERROR -- : /usr/local/bigbluebutton/core/lib/recordandplayback.rb:127:in `exec_ret'
/var/log/bigbluebutton/bbb-rap-worker.log:E, [2017-05-11T16:38:37.009312 #9198] ERROR -- : /usr/local/bigbluebutton/core/scripts/rap-process-worker.rb:57:in `block (2 levels) in process_archived_meetings'
/var/log/bigbluebutton/bbb-rap-worker.log:E, [2017-05-11T16:38:37.009331 #9198] ERROR -- : /usr/local/bigbluebutton/core/scripts/rap-process-worker.rb:38:in `each'
/var/log/bigbluebutton/bbb-rap-worker.log:E, [2017-05-11T16:38:37.009351 #9198] ERROR -- : /usr/local/bigbluebutton/core/scripts/rap-process-worker.rb:38:in `block in process_archived_meetings'
/var/log/bigbluebutton/bbb-rap-worker.log:E, [2017-05-11T16:38:37.009370 #9198] ERROR -- : /usr/local/bigbluebutton/core/scripts/rap-process-worker.rb:30:in `each'
/var/log/bigbluebutton/bbb-rap-worker.log:E, [2017-05-11T16:38:37.009390 #9198] ERROR -- : /usr/local/bigbluebutton/core/scripts/rap-process-worker.rb:30:in `process_archived_meetings'
/var/log/bigbluebutton/bbb-rap-worker.log:E, [2017-05-11T16:38:37.009409 #9198] ERROR -- : /usr/local/bigbluebutton/core/scripts/rap-process-worker.rb:128:in `<main>'

   -- ERRORS found in /usr/share/red5/log/* --

/usr/share/red5/log/sip.log:2017-05-11 16:35:50,609-03:00 [Thread-13] ERROR o.b.voiceconf.sip.SipPeer - Failed to register with Sip Server.
/usr/share/red5/log/sip.log:2017-05-11 16:39:22,478-03:00 [Thread-13] ERROR o.b.voiceconf.sip.SipPeer - Failed to register with Sip Server.

   -- Errors found in /var/log/nginx/error.log --
2017/05/11 16:35:23 [error] 9213#9213: *8 open() "/var/www/bigbluebutton-default/html5client/check" failed (2: No such file or directory), client: 200.131.226.147, server: <servername>, request: "GET /html5client/check HTTP/1.1", host: "<servername>", referrer: "https://<servername>/client/BigBlueButton.html?sessionToken=dnxyunf3ongz9yyp"
2017/05/11 16:35:49 [error] 9213#9213: *6 open() "/var/www/bigbluebutton-default/html5client/check" failed (2: No such file or directory), client: 200.131.226.147, server: <servername>, request: "GET /html5client/check HTTP/1.1", host: "<servername>", referrer: "https://<servername>/client/BigBlueButton.html?sessionToken=jv4lhj58xouizdar"

   -- Errors found in /var/log/syslog --

May 11 14:16:53 <server> red5.sh[2058]: java.lang.InterruptedException: null
May 11 14:39:23 <server> red5-shutdown.sh[4138]: Exception connecting to 127.0.0.1
May 11 14:39:23 <server> red5-shutdown.sh[4138]: java.lang.ArrayIndexOutOfBoundsException: 0
May 11 14:39:36 <server> red5.sh[4612]: org.red5.server.exception.ScopeNotFoundException: Scope not found: bigbluebutton in null
May 11 14:46:15 <server> red5.sh[4612]: 2017-05-11 14:46:15,896-03:00 [RTMPConnectionExecutor-12] o.r.s.m.InMemoryPushPushPipe - Exception pushing message to consumer
May 11 14:46:15 <server> red5.sh[4612]: java.lang.ArrayIndexOutOfBoundsException: 0
May 11 14:48:44 <server> red5.sh[4612]: 2017-05-11 14:48:44,596-03:00 [RTMPConnectionExecutor-13] o.r.s.m.InMemoryPushPushPipe - Exception pushing message to consumer
May 11 14:48:44 <server> red5.sh[4612]: java.lang.ArrayIndexOutOfBoundsException: null
May 11 14:55:58 <server> red5.sh[4612]: 2017-05-11 14:55:58,535-03:00 [RTMPConnectionExecutor-20] o.r.s.m.InMemoryPushPushPipe - Exception pushing message to consumer
May 11 14:55:58 <server> red5.sh[4612]: java.lang.ArrayIndexOutOfBoundsException: null
May 11 15:03:09 <server> red5.sh[4612]: 2017-05-11 15:03:09,007-03:00 [RTMPConnectionExecutor-30] o.r.s.m.InMemoryPushPushPipe - Exception pushing message to consumer
May 11 15:03:09 <server> red5.sh[4612]: java.lang.ArrayIndexOutOfBoundsException: null
May 11 15:15:39 <server> red5.sh[2014]: 2017-05-11 15:15:39,496-03:00 [RTMPConnectionExecutor-9] o.r.s.m.InMemoryPushPushPipe - Exception pushing message to consumer
May 11 15:15:39 <server> red5.sh[2014]: java.lang.ArrayIndexOutOfBoundsException: 1
May 11 15:16:05 <server> red5.sh[2014]: java.lang.InterruptedException: null
May 11 16:19:35 <server> red5-shutdown.sh[4617]: Exception connecting to 127.0.0.1
May 11 16:19:35 <server> red5-shutdown.sh[4617]: java.lang.ArrayIndexOutOfBoundsException: 0
May 11 16:33:42 <server> red5-shutdown.sh[7156]: Exception connecting to 127.0.0.1
May 11 16:33:42 <server> red5-shutdown.sh[7156]: java.lang.ArrayIndexOutOfBoundsException: 0
May 11 16:34:22 <server> red5-shutdown.sh[8167]: Exception connecting to 127.0.0.1
May 11 16:34:22 <server> red5-shutdown.sh[8167]: java.lang.ArrayIndexOutOfBoundsException: 0
May 11 16:35:04 <server> red5-shutdown.sh[9050]: Exception connecting to 127.0.0.1
May 11 16:35:04 <server> red5-shutdown.sh[9050]: java.lang.ArrayIndexOutOfBoundsException: 0
May 11 16:38:37 <server> red5-shutdown.sh[10541]: Exception connecting to 127.0.0.1
May 11 16:38:37 <server> red5-shutdown.sh[10541]: java.lang.ArrayIndexOutOfBoundsException: 0

   -- Errors found in /var/log/bigbluebutton --
/var/log/bigbluebutton/bbb-rap-worker.log:E, [2017-05-11T16:38:37.009088 #9198] ERROR -- : SIGTERM
/var/log/bigbluebutton/bbb-rap-worker.log:E, [2017-05-11T16:38:37.009229 #9198] ERROR -- : /usr/local/bigbluebutton/core/lib/recordandplayback.rb:128:in `each_line'
/var/log/bigbluebutton/bbb-rap-worker.log:E, [2017-05-11T16:38:37.009254 #9198] ERROR -- : /usr/local/bigbluebutton/core/lib/recordandplayback.rb:128:in `block in exec_ret'
/var/log/bigbluebutton/bbb-rap-worker.log:E, [2017-05-11T16:38:37.009274 #9198] ERROR -- : /usr/local/bigbluebutton/core/lib/recordandplayback.rb:127:in `popen'
/var/log/bigbluebutton/bbb-rap-worker.log:E, [2017-05-11T16:38:37.009294 #9198] ERROR -- : /usr/local/bigbluebutton/core/lib/recordandplayback.rb:127:in `exec_ret'
/var/log/bigbluebutton/bbb-rap-worker.log:E, [2017-05-11T16:38:37.009312 #9198] ERROR -- : /usr/local/bigbluebutton/core/scripts/rap-process-worker.rb:57:in `block (2 levels) in process_archived_meetings'
/var/log/bigbluebutton/bbb-rap-worker.log:E, [2017-05-11T16:38:37.009331 #9198] ERROR -- : /usr/local/bigbluebutton/core/scripts/rap-process-worker.rb:38:in `each'
/var/log/bigbluebutton/bbb-rap-worker.log:E, [2017-05-11T16:38:37.009351 #9198] ERROR -- : /usr/local/bigbluebutton/core/scripts/rap-process-worker.rb:38:in `block in process_archived_meetings'
/var/log/bigbluebutton/bbb-rap-worker.log:E, [2017-05-11T16:38:37.009370 #9198] ERROR -- : /usr/local/bigbluebutton/core/scripts/rap-process-worker.rb:30:in `each'
/var/log/bigbluebutton/bbb-rap-worker.log:E, [2017-05-11T16:38:37.009390 #9198] ERROR -- : /usr/local/bigbluebutton/core/scripts/rap-process-worker.rb:30:in `process_archived_meetings'
/var/log/bigbluebutton/bbb-rap-worker.log:E, [2017-05-11T16:38:37.009409 #9198] ERROR -- : /usr/local/bigbluebutton/core/scripts/rap-process-worker.rb:128:in `<main>'


# The hostname in <link> .. </link> (    <link>https://<servername>/playback/presentation/0.9.0/playback.html?meetingId=587b2b7c26e40038b2514e07eacb0a0719456be6-1489603472270</link>)
#     /var/bigbluebutton/published/presentation/587b2b7c26e40038b2514e07eacb0a0719456be6-1489603472270/metadata.xml
# do not match the hostname for bigbluebutton.web.serverURL (<servername>)
#     /usr/share/red5/webapps/bigbluebutton/WEB-INF/bigbluebutton.properties


# The hostname in <link> .. </link> (    <link>https://<servername>/playback/presentation/0.9.0/playback.html?meetingId=2b4c49c909b4341395dfcd7d6f0eecb9a0680916-1490273121874</link>)
#     /var/bigbluebutton/published/presentation/2b4c49c909b4341395dfcd7d6f0eecb9a0680916-1490273121874/metadata.xml
# do not match the hostname for bigbluebutton.web.serverURL (<servername>)
#     /usr/share/red5/webapps/bigbluebutton/WEB-INF/bigbluebutton.properties

On Wednesday, April 26, 2017 at 8:06:12 PM UTC-3, Fred Dixon wrote:

Hi Roberto,

> but when I found about the crash ... Everything from BBB was not available (nginx, Java, etc) ... so I'm not sure if it was really everything

That's very strange for most of the processes to stop.  One of the processes might quit, but never more than one.  While this doesn't make any sense, let us know if you see something similar happen again.

Regards,.. Fred

On Wed, Apr 26, 2017 at 2:46 PM, Roberto Greiner <mrgr...@gmail.com> wrote:

On Wednesday, April 26, 2017 at 3:40:52 PM UTC-3, Fred Dixon wrote:

Hi Reberto,

> I've installed BBB 1.1Beta in a server, and everything seems to be working properly. But when we made a test conference with ~10 users, many participants started having problems with audio after about 20 minutes, and a few minutoes later BBB crashed completely (server side),

Also, can you be more specific what you mean by crash?  Did a process exit?  What happened during the meeting (or after the meeting) that indicated there was a problem?  

We run our demo server for long periods of time with many sessions concurrently and over many weeks.  We monitor processes (as does sudo bbb-conf --check) and are very interested if you have a case where a process stopped.

Any more information you can give would be very helpful.  

I didn't find much in the logs, but when I found about the crash, 'lsof -i' did show only the Ubuntu native ports open: SSH, SNMP, Syslog and the like. Everything from BBB was not available (nginx, Java, etc), but I didn't take a screenshot, so I'm not sure if it was really everything. In any case, at the time, "bbb-conf --restart" did bring the processes back, although with the Freeswitch error (at the time).

--
You received this message because you are subscribed to the Google Groups "BigBlueButton-Setup" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-setup+unsub...@googlegroups.com.

To post to this group, send email to bigbluebu...@googlegroups.com.

Visit this group at https://groups.google.com/group/bigbluebutton-setup.
For more options, visit https://groups.google.com/d/optout.

[Fred Dixon]

Hi Roberto,

> (1) But, I noticed the following problems:

> - There is something wrong with libreoffice.server. Everyday, it gives an the following error messages in syslog:

> systemd[1]: libreoffice.service: Unit entered failed state.

> systemd[1]: libreoffice.service: Failed with result 'exit-code'.

You can ignore it -- systemd should automatically restart LibreOiffice

# systemctl cat libreoffice.service

# /lib/systemd/system/libreoffice.service

[Unit]

Description=LibreOffice

After=network.target

[Service]

Type=simple

ExecStart=/usr/lib/libreoffice/program/soffice.bin --headless \

    --nologo --nofirststartwizard '--accept=socket,host=127.0.0.1,port=8100;urp' --pidfile=/var/run/soffice.pid

Restart=always

MemoryLimit=1G

CPUQuota=20%

[Install]

WantedBy=multi-user.target

> - (2) Today, in a conference, we noticed that everybody who connected using "Listen only" could not hear anything. I've tried the instructions in http://docs.bigbluebutton.org/install/install.html#users-not-able-to-join-listen-only-mode, but it didn't help.

Is this just a specific conference or all conferences? Can you reproduce?

> - bbb-conf --check is still reporting "Warning: The voice application may not have registered with the sip server.".

Yes, it's scanning a log file for a specific message.  

               if cat /usr/share/red5/log/sip.log | grep -q "Failed to register with Sip Server"; then

                        echo "# Warning: The voice application may not have registered with the sip server."

                        echo "#   Try running: "

                        echo "#"

                        echo "#      sudo bbb-conf --clean"

                        echo "#"

                        echo

                fi

Usually that message should also rotate out -- but it does indicated an issue with Audio.  Interested in what you found with (2).

Regards,... Fred

To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-setup+unsubscribe...@googlegroups.com.

To post to this group, send email to bigbluebu...@googlegroups.com.
Visit this group at https://groups.google.com/group/bigbluebutton-setup.
For more options, visit https://groups.google.com/d/optout.

--

BigBlueButton Developer

http://bigbluebutton.org/

@bigbluebutton

--
You received this message because you are subscribed to the Google Groups "BigBlueButton-Setup" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-setup+unsub...@googlegroups.com.

To post to this group, send email to bigbluebutton-setup@googlegroups.com.

Visit this group at https://groups.google.com/group/bigbluebutton-setup.
For more options, visit https://groups.google.com/d/optout.

[Richard Alam]

On Thu, May 11, 2017 at 3:50 PM, Roberto Greiner <mrgr...@gmail.com> wrote:

To problem of everything crashing has not happened again.

But, I noticed the following problems:
- There is something wrong with libreoffice.server. Everyday, it gives an the following error messages in syslog:
systemd[1]: libreoffice.service: Unit entered failed state.
systemd[1]: libreoffice.service: Failed with result 'exit-code'.

This happens always at 6:25 in the morning, exactly when syslog rotates the logs, so it is very likely that libreoffice.service is having some problem with logrotate.

- Today, in a conference, we noticed that everybody who connected using "Listen only" could not hear anything. I've tried the instructions in http://docs.bigbluebutton.org/install/install.html#users-not-able-to-join-listen-only-mode, but it didn't help.

- bbb-conf --check is still reporting "Warning: The voice application may not have registered with the sip server.".

The main problem now is that when somebody connects selecting "listen-only", he hears nothing?

Any ideas of what I should check? bbb-conf --debug is below.

What is the contents of /usr/share/red5/webapps/sip/WEB-INF/bigbluebutton-sip.properties

Does bbb.sip.app.ip and freeswitch.ip have the correct IP address?

ubuntu@ubuntu:~$ cat /usr/share/red5/webapps/sip/WEB-INF/bigbluebutton-sip.properties

# The ip and port the BBB SIP app is going to use

bbb.sip.app.ip=192.168.246.131

bbb.sip.app.port=5070

# The ip and port of the FreeSWITCH server

freeswitch.ip=192.168.246.131

freeswitch.port=5060

 

Tks,

Roberto

--

-----
BigBlueButton Developer
http://www.bigbluebutton.org
https://github.com/bigbluebutton

[Roberto Greiner]

On Thursday, May 11, 2017 at 6:03:38 PM UTC-3, Richard Alam wrote:

On Thu, May 11, 2017 at 3:50 PM, Roberto Greiner <mrgr...@gmail.com> wrote:

To problem of everything crashing has not happened again.

But, I noticed the following problems:
- There is something wrong with libreoffice.server. Everyday, it gives an the following error messages in syslog:
systemd[1]: libreoffice.service: Unit entered failed state.
systemd[1]: libreoffice.service: Failed with result 'exit-code'.

This happens always at 6:25 in the morning, exactly when syslog rotates the logs, so it is very likely that libreoffice.service is having some problem with logrotate.

- Today, in a conference, we noticed that everybody who connected using "Listen only" could not hear anything. I've tried the instructions in http://docs.bigbluebutton.org/install/install.html#users-not-able-to-join-listen-only-mode, but it didn't help.

- bbb-conf --check is still reporting "Warning: The voice application may not have registered with the sip server.".

The main problem now is that when somebody connects selecting "listen-only", he hears nothing?

Any ideas of what I should check? bbb-conf --debug is below.

What is the contents of /usr/share/red5/webapps/sip/WEB-INF/bigbluebutton-sip.properties

# The ip and port the BBB SIP app is going to use

bbb.sip.app.ip=<ipv4 server addres>
bbb.sip.app.port=5070

# The username and password the BBB SIP app to use to
# register with FreeSWITCH
sip.server.username=bbbuser
sip.server.password=secret

# Alteracao baseada em
# http://docs.bigbluebutton.org/install/install.html#users-not-able-to-join-listen-only-mode
#sip.server.host=<ipv4 server addres>

# The ip and port of the FreeSWITCH server

freeswitch.ip=<ipv4 server addres>
#freeswitch.ip=127.0.0.1
freeswitch.port=5060

# The start/stop RTP port the application is going to use
# for the media stream.
startAudioPort=15000
stopAudioPort=16383

redis.host=127.0.0.1
redis.port=6379
redis.pass=


# If you want mjsip stack (red5/log/*access*.log) to minimize the amount of logs it
# generates, set this to a lower value (e.g. 3).
sipStackDebugLevel=3
 

Does bbb.sip.app.ip and freeswitch.ip have the correct IP address?

Yes, both have the IPv4 address of the server. I had IPv6 fully configured, and suspected that could be part of the problem. But I removed the IPv6 from the DNS, and a couple of hours later (to avoid old DNS information still being available) we tested again, with no change.

As a curiosity, in the install FAQ mentioned above (section "Users not able to join listen only mode"), it mentions using Freeswitch on localhost, but I couldn't find information where to set it so. Could you indicate to me where that information is? I would like to try and see if that solves the problem.

A side note: I just noticed that 'bbb-conf --check' is no longer complaining that "The voice application may not have registered with the sip serve". It's possible that removing IPv6 from the DNS solved that. Unfortunately, that didn't solve the "listen only" problem.

[Roberto Greiner]

Please disregard that last note. For another test I restarted BBB and it's complaining again....

[Richard Alam]

It is set in vars.xml

========

root@ubuntu:/opt/freeswitch/conf# cat vars.xml

  <X-PRE-PROCESS cmd="set" data="local_ip_v4=192.168.211.128"/>

  <X-PRE-PROCESS cmd="set" data="domain=$${local_ip_v4}"/>

  <X-PRE-PROCESS cmd="set" data="domain_name=$${domain}"/>

========

Also, make sure that the following matches with what is in bbbuser.xml

# The username and password the BBB SIP app to use to
# register with FreeSWITCH
sip.server.username=bbbuser
sip.server.password=secret

===

root@ubuntu:/opt/freeswitch/conf# cat directory/default/bbbuser.xml

<include>

  <!--

      ipauth if you have an cidr= in the user attributes ie cidr="1.2.3.4/32"

      see <node type="allow" domain="$${domain}"/> in default acl.conf.xml

  -->

  <user id="bbbuser">

    <params>

      <!-- omit password for authless registration -->

      <param name="password" value="secret"/>

      <!-- What this user is allowed to acces -->

      <!--<param name="http-allowed-api" value="jsapi,voicemail,status"/> -->

    </params>

    <variables>

      <!--all variables here will be set on all inbound calls that originate from this user -->

      <variable name="user_context" value="default"/>

      <variable name="effective_caller_id_name" value="BigBlueButton"/>

      <variable name="effective_caller_id_number" value="1000"/>

      <!-- Don't write a CDR if this is false valid values are: true, false, a_leg and b_leg -->

      <variable name="process_cdr" value="true"/>

      <!-- sip_secure_media will offer mandatory SRTP on invite AES_CM_128_HMAC_SHA1_32, AES_CM_128_HMAC_SHA1_80 or true-->

      <variable name="rtp_secure_media" value="false"/>

    </variables>

    <vcard>

      <!-- insert optional compliant vcard xml here-->

    </vcard>

  </user>

</include>

=====

 

A side note: I just noticed that 'bbb-conf --check' is no longer complaining that "The voice application may not have registered with the sip serve". It's possible that removing IPv6 from the DNS solved that. Unfortunately, that didn't solve the "listen only" problem.

To look at what is happening when you join listen only, connect to FS CLI and watch the logs when you try to join using Flash

 

--
You received this message because you are subscribed to the Google Groups "BigBlueButton-Setup" group.

To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-setup+unsubscribe...@googlegroups.com.
To post to this group, send email to bigbluebutton-setup@googlegroups.com.

Visit this group at https://groups.google.com/group/bigbluebutton-setup.
For more options, visit https://groups.google.com/d/optout.

[Roberto Greiner]

 

A side note: I just noticed that 'bbb-conf --check' is no longer complaining that "The voice application may not have registered with the sip serve". It's possible that removing IPv6 from the DNS solved that. Unfortunately, that didn't solve the "listen only" problem.

To look at what is happening when you join listen only, connect to FS CLI and watch the logs when you try to join using Flash

How do I connect to the FS command line? Couldn't find that information.

Tks,

Roberto

[Richard Alam]

I thought it was on the email. I lost internet connection while typing. Looks like gmail wasn't able to save it.

ubuntu@ubuntu:~$ sudo su -l

[sudo] password for ubuntu:

root@ubuntu:~# cd /opt/freeswitch/bin

root@ubuntu:/opt/freeswitch/bin# ./fs_cli

On the FS CLI prompt, display all sip messages

freeswitch@ubuntu> sofia global siptrace on

 

Tks,

Roberto

--
You received this message because you are subscribed to the Google Groups "BigBlueButton-Setup" group.

To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-setup+unsub...@googlegroups.com.

To post to this group, send email to bigbluebutton-setup@googlegroups.com.
Visit this group at https://groups.google.com/group/bigbluebutton-setup.
For more options, visit https://groups.google.com/d/optout.

[Roberto Greiner]

Couldn't find, yet, the FS cli, But I found something interesting. While tailing the freeswitch log file (/opt/freeswitch/var/log/freeswitch/freeswitch.log), I connected to the demo room, and tried to activate the microphone using Flash. It didn't work at all. WebRTC works fine, but if I refuse WebRTC and try Flash, it passes the first screen (microphone selection). But when I press 'Next' in the second Audio test screen, it keeps saying 'Connecting', but nothing happens. Also, during the entire time, freeswitch logs nothing.

Roberto

[Roberto Greiner]

I THINK I found what the problem was: a firewall setup.

My iptables setting has the following entries, taken mostly from http://www.linuxhomenetworking.com/wiki/index.php/Quick_HOWTO_:_Ch14_:_Linux_Firewalls_Using_iptables:

# The line below automatically grabs the IP addres from ifconfig. Nice for using the same script on multiples machines
ipaddr=`/sbin/ifconfig  | /bin/grep  -E 'inet addr:|inet end.:'| /bin/grep -v '127.0.0.1' | /usr/bin/cut -d: -f2 | /usr/bin/awk '{ print $1}'|/usr/bin/head -n 1`
ifext="eth0"
iptables=/sbin/iptables

$iptables -A INPUT   -i $ifext -j valid-src
$iptables -A FORWARD -i $ifext -j valid-src
$iptables -A OUTPUT  -o $ifext -j valid-dst
$iptables -A FORWARD -o $ifext -j valid-dst

$iptables -A valid-src -s 10.0.0.0/8     -j DROP
$iptables -A valid-src -s 172.16.0.0/12  -j DROP
$iptables -A valid-src -s 192.168.0.0/16 -j DROP
$iptables -A valid-src -s 224.0.0.0/4    -j DROP
$iptables -A valid-src -s 240.0.0.0/5    -j DROP
$iptables -A valid-src -s 127.0.0.0/8    -j DROP
$iptables -A valid-src -s 0.0.0.0/8       -j DROP
$iptables -A valid-src -d 255.255.255.255 -j DROP
$iptables -A valid-src -s 169.254.0.0/16  -j DROP
$iptables -A valid-src -s $ipaddr        -j DROP
$iptables -A valid-dst -d 224.0.0.0/4    -j DROP

With the VM, it worked fine. When I migrated to a physical server, Ubuntu does not use the name 'eth0' for ethernet, but enp2s0f0. So, the setting was not working, because the variable 'ifext' was wrong, breaking the whole thing. For now, with the corrected entry, BBB seems to be working.

[Fred Dixon]

Hi Roberto,

Thanks for sharing this!

If it helps, here's some code we use for calculation of the IP address for the host (this is taken from bbb-conf).

if LANG=c ifconfig | grep -q 'venet0:0'; then

        # IP detection for OpenVZ environment

        IP=$(ifconfig | grep -v '127.0.0.1' | grep -E "[0-9]*\.[0-9]*\.[0-9]*\.[0-9]*" | tail -1 | cut -d: -f2 | awk '{ print $1}')

else

        # IP detection for et* and en* networks

        IP=$(echo "$(LANG=c ifconfig  | awk -v RS="" '{gsub (/\n[ ]*inet /," ")}1' | grep ^et.* | head -n1 | sed 's/.*addr://g' | sed 's/ .*//g')$(LANG=c ifconfig  | awk -v RS="" '{gsub (/\n[ ]*inet /," ")}1' | grep ^en.* | head -n1 | sed 's/.*addr://g' | sed 's/ .*//g')" | head -n1)

fi

Regards,.. Fred

--

You received this message because you are subscribed to the Google Groups "BigBlueButton-Setup" group.

To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-setup+unsub...@googlegroups.com.

To post to this group, send email to bigbluebutton-setup@googlegroups.com.
Visit this group at https://groups.google.com/group/bigbluebutton-setup.
For more options, visit https://groups.google.com/d/optout.

--

[Roberto]

Tks, but I like my version more for a simple reason: It's easier to adapt to IPv6:
IPv4 version:

/sbin/ifconfig  | /bin/grep  -E 'inet addr:|inet end.:'| /bin/grep -v '127.0.0.1' | /usr/bin/cut -d: -f2 | /usr/bin/awk '{ print $1}'|/usr/bin/head -n 1

IPv6 version:
/sbin/ifconfig  | /bin/grep  -E 'inet6 addr:|o inet6'| /bin/grep -vE 'fe80|::1/128'| /usr/bin/awk '{ print $3}'|/usr/bin/cut -d/  -f1

Roberto Greiner

You received this message because you are subscribed to a topic in the Google Groups "BigBlueButton-Setup" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/bigbluebutton-setup/voICtwWVI0k/unsubscribe.
To unsubscribe from this group and all its topics, send an email to bigbluebutton-s...@googlegroups.com.

To post to this group, send email to bigbluebu...@googlegroups.com.

Visit this group at https://groups.google.com/group/bigbluebutton-setup.
For more options, visit https://groups.google.com/d/optout.

-- 
  -----------------------------------------------------
                Marcos Roberto Greiner

   Os otimistas acham que estamos no melhor dos mundos
    Os pessimistas tem medo de que isto seja verdade
                                  James Branch Cabell
  -----------------------------------------------------