bbb-rap-archive-worker.service failure in BBB 2.2-beta

German Acevedo

unread,

Mar 5, 2019, 7:45:12 AM3/5/19

to BigBlueButton-dev

Hi,

I'm testing BBB 2.2.0-beta and everything was working fine until end of February when I made an update. Since then, the recording publishing is not working, I can see many recordings waiting to be published but bbb-record --watch is throwing this error:

ExecStart=/usr/local/bigbluebutton/core/scripts/rap-archive-worker.rb (code=exited, status=1/FAILURE)

This is the result of sudo journalctl -u bbb-rap-archive-worker.service:

root@conferencias:~# sudo journalctl -u bbb-rap-archive-worker.service

-- Logs begin at Tue 2019-03-05 13:26:33 CET, end at Tue 2019-03-05 13:31:55 CET. --

Mar 05 13:26:34 conferencias.usac.edu.gt systemd[1]: Started BigBlueButton recording and playback archive worker.

Mar 05 13:26:36 conferencias.usac.edu.gt rap-archive-worker.rb[1000]: /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require': cannot load su

Mar 05 13:26:36 conferencias.usac.edu.gt rap-archive-worker.rb[1000]: from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require'

Mar 05 13:26:36 conferencias.usac.edu.gt rap-archive-worker.rb[1000]: from /usr/local/bigbluebutton/core/lib/recordandplayback/generators/events.rb:25:in `<top

Mar 05 13:26:36 conferencias.usac.edu.gt rap-archive-worker.rb[1000]: from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require'

Mar 05 13:26:36 conferencias.usac.edu.gt rap-archive-worker.rb[1000]: from /usr/local/bigbluebutton/core/lib/recordandplayback.rb:27:in `<top (required)>'

Mar 05 13:26:36 conferencias.usac.edu.gt rap-archive-worker.rb[1000]: from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require'

Mar 05 13:26:36 conferencias.usac.edu.gt rap-archive-worker.rb[1000]: from /usr/local/bigbluebutton/core/scripts/rap-archive-worker.rb:21:in `<main>'

Mar 05 13:26:36 conferencias.usac.edu.gt systemd[1]: bbb-rap-archive-worker.service: Main process exited, code=exited, status=1/FAILURE

Mar 05 13:26:36 conferencias.usac.edu.gt systemd[1]: bbb-rap-archive-worker.service: Unit entered failed state.

Mar 05 13:26:36 conferencias.usac.edu.gt systemd[1]: bbb-rap-archive-worker.service: Failed with result 'exit-code'.

Mar 05 13:27:08 conferencias.usac.edu.gt systemd[1]: Started BigBlueButton recording and playback archive worker.

Mar 05 13:27:09 conferencias.usac.edu.gt rap-archive-worker.rb[2206]: /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require': cannot load su

Mar 05 13:27:09 conferencias.usac.edu.gt rap-archive-worker.rb[2206]: from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require'

Mar 05 13:27:09 conferencias.usac.edu.gt rap-archive-worker.rb[2206]: from /usr/local/bigbluebutton/core/lib/recordandplayback/generators/events.rb:25:in `<top

Mar 05 13:27:09 conferencias.usac.edu.gt rap-archive-worker.rb[2206]: from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require'

Mar 05 13:27:09 conferencias.usac.edu.gt rap-archive-worker.rb[2206]: from /usr/local/bigbluebutton/core/lib/recordandplayback.rb:27:in `<top (required)>'

Mar 05 13:27:09 conferencias.usac.edu.gt rap-archive-worker.rb[2206]: from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require'

Mar 05 13:27:09 conferencias.usac.edu.gt rap-archive-worker.rb[2206]: from /usr/local/bigbluebutton/core/scripts/rap-archive-worker.rb:21:in `<main>'

Mar 05 13:27:09 conferencias.usac.edu.gt systemd[1]: bbb-rap-archive-worker.service: Main process exited, code=exited, status=1/FAILURE

Mar 05 13:27:09 conferencias.usac.edu.gt systemd[1]: bbb-rap-archive-worker.service: Unit entered failed state.

Mar 05 13:27:09 conferencias.usac.edu.gt systemd[1]: bbb-rap-archive-worker.service: Failed with result 'exit-code'.

Mar 05 13:27:43 conferencias.usac.edu.gt systemd[1]: Started BigBlueButton recording and playback archive worker.

Mar 05 13:27:43 conferencias.usac.edu.gt rap-archive-worker.rb[2679]: /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require': cannot load su

Mar 05 13:27:43 conferencias.usac.edu.gt rap-archive-worker.rb[2679]: from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require'

Mar 05 13:27:43 conferencias.usac.edu.gt rap-archive-worker.rb[2679]: from /usr/local/bigbluebutton/core/lib/recordandplayback/generators/events.rb:25:in `<top

Mar 05 13:27:43 conferencias.usac.edu.gt rap-archive-worker.rb[2679]: from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require'

Mar 05 13:27:43 conferencias.usac.edu.gt rap-archive-worker.rb[2679]: from /usr/local/bigbluebutton/core/lib/recordandplayback.rb:27:in `<top (required)>'

Mar 05 13:27:43 conferencias.usac.edu.gt rap-archive-worker.rb[2679]: from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require'

Mar 05 13:27:43 conferencias.usac.edu.gt rap-archive-worker.rb[2679]: from /usr/local/bigbluebutton/core/scripts/rap-archive-worker.rb:21:in `<main>'

Mar 05 13:27:43 conferencias.usac.edu.gt systemd[1]: bbb-rap-archive-worker.service: Main process exited, code=exited, status=1/FAILURE

Mar 05 13:27:43 conferencias.usac.edu.gt systemd[1]: bbb-rap-archive-worker.service: Unit entered failed state.

Mar 05 13:27:43 conferencias.usac.edu.gt systemd[1]: bbb-rap-archive-worker.service: Failed with result 'exit-code'.

Mar 05 13:28:17 conferencias.usac.edu.gt systemd[1]: Started BigBlueButton recording and playback archive worker.

And this is the result of bbb-conf --check:

root@conferencias:~# bbb-conf --check

BigBlueButton Server 2.2.0-beta (681)

Kernel version: 4.4.0-142-generic

Distribution: Ubuntu 16.04.6 LTS (64-bit)

Memory: 20560 MB

/usr/share/bbb-web/WEB-INF/classes/bigbluebutton.properties (bbb-web)

bigbluebutton.web.serverURL: https://conferencias.usac.edu.gt

defaultGuestPolicy: ALWAYS_ACCEPT

/etc/nginx/sites-available/bigbluebutton (nginx)

server name: conferencias.usac.edu.gt

port: 80, [::]:80

port: 443 ssl

bbb-client dir: /var/www/bigbluebutton

/var/www/bigbluebutton/client/conf/config.xml (bbb-client)

Port test (tunnel): rtmp://conferencias.usac.edu.gt

red5: conferencias.usac.edu.gt

useWebrtcIfAvailable: true

/opt/freeswitch/etc/freeswitch/vars.xml (FreeSWITCH)

local_ip_v4: 173.212.253.132

external_rtp_ip: stun:stun.freeswitch.org

external_sip_ip: stun:stun.freeswitch.org

/opt/freeswitch/etc/freeswitch/sip_profiles/external.xml (FreeSWITCH)

ext-rtp-ip: $${local_ip_v4}

ext-sip-ip: $${local_ip_v4}

ws-binding: :5066

wss-binding: 173.212.253.132:7443

/usr/local/bigbluebutton/core/scripts/bigbluebutton.yml (record and playback)

playback_host: conferencias.usac.edu.gt

playback_protocol: https

ffmpeg: 4.1.1-0york1~16.04

/etc/bigbluebutton/nginx/sip.nginx (sip.nginx)

proxy_pass: https://173.212.253.132:7443

/usr/local/bigbluebutton/bbb-webrtc-sfu/config/default.yml (Kurento SFU)

kurento.ip: 173.212.253.132

kurento.url: ws://conferencias.usac.edu.gt:8888/kurento

localIpAddress: 173.212.253.132

recordScreenSharing: true

recordWebcams: true

codec_video_main: H264

codec_video_content: H264

/usr/share/meteor/bundle/programs/server/assets/app/config/settings.yml (HTML5 client)

build: 277

kurentoUrl: wss://conferencias.usac.edu.gt/bbb-webrtc-sfu

enableListenOnly: false

** Potential problems described below **

# Warning: The API demos are installed and accessible from:

#

# https://conferencias.usac.edu.gt/demo/demo1.jsp

#

# These API demos allow anyone to access your server without authentication

# to create/manage meetings and recordings. They are for testing purposes only.

# If you are running a production system, remove them by running:

#

# apt-get purge bbb-demo

Any help will be very appreciated.

Regards,

German Acevedo

Fred Dixon

unread,

Mar 5, 2019, 8:03:37 AM3/5/19

to BigBlueButton-dev

HI German,

Can you post the output of

cd /usr/local/bigbluebutton/core/scripts

./rap-archive-worker.rb

Regards,... Fred

--
You received this message because you are subscribed to the Google Groups "BigBlueButton-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-...@googlegroups.com.
To post to this group, send email to bigblueb...@googlegroups.com.
Visit this group at https://groups.google.com/group/bigbluebutton-dev.
For more options, visit https://groups.google.com/d/optout.

--

BigBlueButton Developer

http://bigbluebutton.org/

@bigbluebutton

German Acevedo

unread,

Mar 5, 2019, 8:34:13 AM3/5/19

to BigBlueButton-dev

Hi Fred,

This is the output:

root@conferencias:~# cd /usr/local/bigbluebutton/core/scripts

root@conferencias:/usr/local/bigbluebutton/core/scripts# ./rap-archive-worker.rb

German Acevedo

unread,

Mar 5, 2019, 8:45:22 AM3/5/19

to BigBlueButton-dev

Sorry, this is the full output:

root@conferencias:~# cd /usr/local/bigbluebutton/core/scripts

root@conferencias:/usr/local/bigbluebutton/core/scripts# ./rap-archive-worker.rb

Ignoring bcrypt-3.1.12 because its extensions are not built. Try: gem pristine bcrypt --version 3.1.12

Ignoring bindex-0.5.0 because its extensions are not built. Try: gem pristine bindex --version 0.5.0

Ignoring byebug-10.0.2 because its extensions are not built. Try: gem pristine byebug --version 10.0.2

Ignoring executable-hooks-1.4.2 because its extensions are not built. Try: gem pristine executable-hooks --version 1.4.2

Ignoring ffi-1.9.25 because its extensions are not built. Try: gem pristine ffi --version 1.9.25

Ignoring gem-wrappers-1.4.0 because its extensions are not built. Try: gem pristine gem-wrappers --version 1.4.0

Ignoring gem-wrappers-1.3.2 because its extensions are not built. Try: gem pristine gem-wrappers --version 1.3.2

Ignoring jaro_winkler-1.5.1 because its extensions are not built. Try: gem pristine jaro_winkler --version 1.5.1

Ignoring nio4r-2.3.1 because its extensions are not built. Try: gem pristine nio4r --version 2.3.1

Ignoring nokogiri-1.8.5 because its extensions are not built. Try: gem pristine nokogiri --version 1.8.5

Ignoring nokogiri-1.8.3 because its extensions are not built. Try: gem pristine nokogiri --version 1.8.3

Ignoring pg-0.21.0 because its extensions are not built. Try: gem pristine pg --version 0.21.0

Ignoring puma-3.11.4 because its extensions are not built. Try: gem pristine puma --version 3.11.4

Ignoring redcarpet-3.4.0 because its extensions are not built. Try: gem pristine redcarpet --version 3.4.0

Ignoring sqlite3-1.3.13 because its extensions are not built. Try: gem pristine sqlite3 --version 1.3.13

Ignoring therubyracer-0.12.3 because its extensions are not built. Try: gem pristine therubyracer --version 0.12.3

Ignoring unf_ext-0.0.7.5 because its extensions are not built. Try: gem pristine unf_ext --version 0.0.7.5

Ignoring websocket-driver-0.7.0 because its extensions are not built. Try: gem pristine websocket-driver --version 0.7.0

Ignoring websocket-driver-0.6.5 because its extensions are not built. Try: gem pristine websocket-driver --version 0.6.5

Fred Dixon

unread,

Mar 5, 2019, 10:12:43 AM3/5/19

to BigBlueButton-dev

Hi,

Did you get any errors on upgrade to 2.2-dev? Could you post the output of the following:

gem -v

gem update --system --no-document

gem install bundler --no-document

cd /usr/local/bigbluebutton/core

/usr/local/bin/bundle

Regards,... Fred

German Acevedo

unread,

Mar 5, 2019, 9:09:25 PM3/5/19

to BigBlueButton-dev

Hi Fred,

Sorry for my late response but I had to travel to the countryside of Guatemala, and just now I'm comming back to my home and have to the internet and a computer.

I didn't get any errors reported during the upgrade.

This is the output of the requested commands:

root@conferencias:~# gem -v

Ignoring absolute_time-1.0.0 because its extensions are not built. Try: gem pristine absolute_time --version 1.0.0

3.0.2

root@conferencias:~# gem update --system --no-document

Ignoring absolute_time-1.0.0 because its extensions are not built. Try: gem pristine absolute_time --version 1.0.0

Updating rubygems-update

Fetching rubygems-update-3.0.3.gem

Successfully installed rubygems-update-3.0.3

Installing RubyGems 3.0.3

Ignoring absolute_time-1.0.0 because its extensions are not built. Try: gem pristine absolute_time --version 1.0.0

Bundler 1.17.3 installed

RubyGems 3.0.3 installed

Regenerating binstubs

=== 3.0.2 / 2019-01-01

Minor enhancements:

* Use Bundler-1.17.3. Pull request #2556 by SHIBATA Hiroshi.

* Fix document flag description. Pull request #2555 by Luis Sagastume.

Bug fixes:

* Fix tests when ruby --program-suffix is used without rubygems

--format-executable. Pull request #2549 by Jeremy Evans.

* Fix Gem::Requirement equality comparison when ~> operator is used. Pull

request #2554 by Grey Baker.

* Unset SOURCE_DATE_EPOCH in the test cases. Pull request #2558 by Sorah

Fukumori.

* Restore SOURCE_DATE_EPOCH. Pull request #2560 by SHIBATA Hiroshi.

------------------------------------------------------------------------------

RubyGems installed the following executables:

/usr/local/rvm/rubies/ruby-2.5.1/bin/gem

/usr/local/rvm/rubies/ruby-2.5.1/bin/bundle

RubyGems system software updated

root@conferencias:~# gem install bundler --no-document

Ignoring absolute_time-1.0.0 because its extensions are not built. Try: gem pristine absolute_time --version 1.0.0

Successfully installed bundler-2.0.1

1 gem installed

root@conferencias:~# cd /usr/local/bigbluebutton/core

root@conferencias:/usr/local/bigbluebutton/core# /usr/local/bin/bundle

Don't run Bundler as root. Bundler can ask for sudo if it is needed, and installing your bundle as root will break this application for all non-root users on this

machine.