bbb-rap-archive-worker.service failure in BBB 2.2-beta

1,432 views
Skip to first unread message

German Acevedo

unread,
Mar 5, 2019, 7:45:12 AM3/5/19
to BigBlueButton-dev
Hi,
I'm testing BBB 2.2.0-beta and everything was working fine until end of February when I made an update.  Since then, the recording publishing is not working, I can see many recordings waiting to be published but bbb-record --watch is throwing this error:

ExecStart=/usr/local/bigbluebutton/core/scripts/rap-archive-worker.rb (code=exited, status=1/FAILURE)


This is the result of sudo journalctl -u bbb-rap-archive-worker.service:

root@conferencias:~# sudo journalctl -u bbb-rap-archive-worker.service
-- Logs begin at Tue 2019-03-05 13:26:33 CET, end at Tue 2019-03-05 13:31:55 CET. --
Mar 05 13:26:34 conferencias.usac.edu.gt systemd[1]: Started BigBlueButton recording and playback archive worker.
Mar 05 13:26:36 conferencias.usac.edu.gt rap-archive-worker.rb[1000]: /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require': cannot load su
Mar 05 13:26:36 conferencias.usac.edu.gt rap-archive-worker.rb[1000]:         from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require'
Mar 05 13:26:36 conferencias.usac.edu.gt rap-archive-worker.rb[1000]:         from /usr/local/bigbluebutton/core/lib/recordandplayback/generators/events.rb:25:in `<top
Mar 05 13:26:36 conferencias.usac.edu.gt rap-archive-worker.rb[1000]:         from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require'
Mar 05 13:26:36 conferencias.usac.edu.gt rap-archive-worker.rb[1000]:         from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require'
Mar 05 13:26:36 conferencias.usac.edu.gt rap-archive-worker.rb[1000]:         from /usr/local/bigbluebutton/core/lib/recordandplayback.rb:27:in `<top (required)>'
Mar 05 13:26:36 conferencias.usac.edu.gt rap-archive-worker.rb[1000]:         from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require'
Mar 05 13:26:36 conferencias.usac.edu.gt rap-archive-worker.rb[1000]:         from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require'
Mar 05 13:26:36 conferencias.usac.edu.gt rap-archive-worker.rb[1000]:         from /usr/local/bigbluebutton/core/scripts/rap-archive-worker.rb:21:in `<main>'
Mar 05 13:26:36 conferencias.usac.edu.gt systemd[1]: bbb-rap-archive-worker.service: Main process exited, code=exited, status=1/FAILURE
Mar 05 13:26:36 conferencias.usac.edu.gt systemd[1]: bbb-rap-archive-worker.service: Unit entered failed state.
Mar 05 13:26:36 conferencias.usac.edu.gt systemd[1]: bbb-rap-archive-worker.service: Failed with result 'exit-code'.
Mar 05 13:27:08 conferencias.usac.edu.gt systemd[1]: Started BigBlueButton recording and playback archive worker.
Mar 05 13:27:09 conferencias.usac.edu.gt rap-archive-worker.rb[2206]: /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require': cannot load su
Mar 05 13:27:09 conferencias.usac.edu.gt rap-archive-worker.rb[2206]:         from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require'
Mar 05 13:27:09 conferencias.usac.edu.gt rap-archive-worker.rb[2206]:         from /usr/local/bigbluebutton/core/lib/recordandplayback/generators/events.rb:25:in `<top
Mar 05 13:27:09 conferencias.usac.edu.gt rap-archive-worker.rb[2206]:         from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require'
Mar 05 13:27:09 conferencias.usac.edu.gt rap-archive-worker.rb[2206]:         from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require'
Mar 05 13:27:09 conferencias.usac.edu.gt rap-archive-worker.rb[2206]:         from /usr/local/bigbluebutton/core/lib/recordandplayback.rb:27:in `<top (required)>'
Mar 05 13:27:09 conferencias.usac.edu.gt rap-archive-worker.rb[2206]:         from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require'
Mar 05 13:27:09 conferencias.usac.edu.gt rap-archive-worker.rb[2206]:         from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require'
Mar 05 13:27:09 conferencias.usac.edu.gt rap-archive-worker.rb[2206]:         from /usr/local/bigbluebutton/core/scripts/rap-archive-worker.rb:21:in `<main>'
Mar 05 13:27:09 conferencias.usac.edu.gt systemd[1]: bbb-rap-archive-worker.service: Main process exited, code=exited, status=1/FAILURE
Mar 05 13:27:09 conferencias.usac.edu.gt systemd[1]: bbb-rap-archive-worker.service: Unit entered failed state.
Mar 05 13:27:09 conferencias.usac.edu.gt systemd[1]: bbb-rap-archive-worker.service: Failed with result 'exit-code'.
Mar 05 13:27:43 conferencias.usac.edu.gt systemd[1]: Started BigBlueButton recording and playback archive worker.
Mar 05 13:27:43 conferencias.usac.edu.gt rap-archive-worker.rb[2679]: /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require': cannot load su
Mar 05 13:27:43 conferencias.usac.edu.gt rap-archive-worker.rb[2679]:         from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require'
Mar 05 13:27:43 conferencias.usac.edu.gt rap-archive-worker.rb[2679]:         from /usr/local/bigbluebutton/core/lib/recordandplayback/generators/events.rb:25:in `<top
Mar 05 13:27:43 conferencias.usac.edu.gt rap-archive-worker.rb[2679]:         from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require'
Mar 05 13:27:43 conferencias.usac.edu.gt rap-archive-worker.rb[2679]:         from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require'
Mar 05 13:27:43 conferencias.usac.edu.gt rap-archive-worker.rb[2679]:         from /usr/local/bigbluebutton/core/lib/recordandplayback.rb:27:in `<top (required)>'
Mar 05 13:27:43 conferencias.usac.edu.gt rap-archive-worker.rb[2679]:         from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require'
Mar 05 13:27:43 conferencias.usac.edu.gt rap-archive-worker.rb[2679]:         from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require'
Mar 05 13:27:43 conferencias.usac.edu.gt rap-archive-worker.rb[2679]:         from /usr/local/bigbluebutton/core/scripts/rap-archive-worker.rb:21:in `<main>'
Mar 05 13:27:43 conferencias.usac.edu.gt systemd[1]: bbb-rap-archive-worker.service: Main process exited, code=exited, status=1/FAILURE
Mar 05 13:27:43 conferencias.usac.edu.gt systemd[1]: bbb-rap-archive-worker.service: Unit entered failed state.
Mar 05 13:27:43 conferencias.usac.edu.gt systemd[1]: bbb-rap-archive-worker.service: Failed with result 'exit-code'.
Mar 05 13:28:17 conferencias.usac.edu.gt systemd[1]: Started BigBlueButton recording and playback archive worker.

And this is the result of bbb-conf --check:

root@conferencias:~# bbb-conf --check

BigBlueButton Server 2.2.0-beta (681)
                    Kernel version: 4.4.0-142-generic
                      Distribution: Ubuntu 16.04.6 LTS (64-bit)
                            Memory: 20560 MB

/usr/share/bbb-web/WEB-INF/classes/bigbluebutton.properties (bbb-web)
       bigbluebutton.web.serverURL: https://conferencias.usac.edu.gt
                defaultGuestPolicy: ALWAYS_ACCEPT

/etc/nginx/sites-available/bigbluebutton (nginx)
                       server name: conferencias.usac.edu.gt
                              port: 80, [::]:80
                              port: 443 ssl
                    bbb-client dir: /var/www/bigbluebutton

/var/www/bigbluebutton/client/conf/config.xml (bbb-client)
                Port test (tunnel): rtmp://conferencias.usac.edu.gt
                              red5: conferencias.usac.edu.gt
              useWebrtcIfAvailable: true

/opt/freeswitch/etc/freeswitch/vars.xml (FreeSWITCH)
                       local_ip_v4: 173.212.253.132
                   external_rtp_ip: stun:stun.freeswitch.org
                   external_sip_ip: stun:stun.freeswitch.org

/opt/freeswitch/etc/freeswitch/sip_profiles/external.xml (FreeSWITCH)
                        ext-rtp-ip: $${local_ip_v4}
                        ext-sip-ip: $${local_ip_v4}
                        ws-binding: :5066
                       wss-binding: 173.212.253.132:7443

/usr/local/bigbluebutton/core/scripts/bigbluebutton.yml (record and playback)
                     playback_host: conferencias.usac.edu.gt
                 playback_protocol: https
                            ffmpeg: 4.1.1-0york1~16.04

/etc/bigbluebutton/nginx/sip.nginx (sip.nginx)
                        proxy_pass: https://173.212.253.132:7443

/usr/local/bigbluebutton/bbb-webrtc-sfu/config/default.yml (Kurento SFU)
                        kurento.ip: 173.212.253.132
                       kurento.url: ws://conferencias.usac.edu.gt:8888/kurento
                    localIpAddress: 173.212.253.132
               recordScreenSharing: true
                     recordWebcams: true
                  codec_video_main: H264
               codec_video_content: H264

/usr/share/meteor/bundle/programs/server/assets/app/config/settings.yml (HTML5 client)
                             build: 277
                        kurentoUrl: wss://conferencias.usac.edu.gt/bbb-webrtc-sfu
                  enableListenOnly: false


** Potential problems described below **

# Warning: The API demos are installed and accessible from:
#
#
# These API demos allow anyone to access your server without authentication
# to create/manage meetings and recordings. They are for testing purposes only.
# If you are running a production system, remove them by running:
#
#    apt-get purge bbb-demo


Any help will be very appreciated.

Regards,

German Acevedo






Fred Dixon

unread,
Mar 5, 2019, 8:03:37 AM3/5/19
to BigBlueButton-dev
HI German,

Can you post the output of

  cd /usr/local/bigbluebutton/core/scripts
  ./rap-archive-worker.rb

Regards,... Fred


--
You received this message because you are subscribed to the Google Groups "BigBlueButton-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-...@googlegroups.com.
To post to this group, send email to bigblueb...@googlegroups.com.
Visit this group at https://groups.google.com/group/bigbluebutton-dev.
For more options, visit https://groups.google.com/d/optout.


--
BigBlueButton Developer
@bigbluebutton

German Acevedo

unread,
Mar 5, 2019, 8:34:13 AM3/5/19
to BigBlueButton-dev
Hi Fred,
This is the output:

root@conferencias:~# cd /usr/local/bigbluebutton/core/scripts
root@conferencias:/usr/local/bigbluebutton/core/scripts#   ./rap-archive-worker.rb

German Acevedo

unread,
Mar 5, 2019, 8:45:22 AM3/5/19
to BigBlueButton-dev
Sorry, this is the full output:

root@conferencias:~# cd /usr/local/bigbluebutton/core/scripts
root@conferencias:/usr/local/bigbluebutton/core/scripts#   ./rap-archive-worker.rb
Ignoring bcrypt-3.1.12 because its extensions are not built. Try: gem pristine bcrypt --version 3.1.12
Ignoring bindex-0.5.0 because its extensions are not built. Try: gem pristine bindex --version 0.5.0
Ignoring byebug-10.0.2 because its extensions are not built. Try: gem pristine byebug --version 10.0.2
Ignoring executable-hooks-1.4.2 because its extensions are not built. Try: gem pristine executable-hooks --version 1.4.2
Ignoring ffi-1.9.25 because its extensions are not built. Try: gem pristine ffi --version 1.9.25
Ignoring gem-wrappers-1.4.0 because its extensions are not built. Try: gem pristine gem-wrappers --version 1.4.0
Ignoring gem-wrappers-1.3.2 because its extensions are not built. Try: gem pristine gem-wrappers --version 1.3.2
Ignoring jaro_winkler-1.5.1 because its extensions are not built. Try: gem pristine jaro_winkler --version 1.5.1
Ignoring nio4r-2.3.1 because its extensions are not built. Try: gem pristine nio4r --version 2.3.1
Ignoring nokogiri-1.8.5 because its extensions are not built. Try: gem pristine nokogiri --version 1.8.5
Ignoring nokogiri-1.8.3 because its extensions are not built. Try: gem pristine nokogiri --version 1.8.3
Ignoring pg-0.21.0 because its extensions are not built. Try: gem pristine pg --version 0.21.0
Ignoring puma-3.11.4 because its extensions are not built. Try: gem pristine puma --version 3.11.4
Ignoring redcarpet-3.4.0 because its extensions are not built. Try: gem pristine redcarpet --version 3.4.0
Ignoring sqlite3-1.3.13 because its extensions are not built. Try: gem pristine sqlite3 --version 1.3.13
Ignoring therubyracer-0.12.3 because its extensions are not built. Try: gem pristine therubyracer --version 0.12.3
Ignoring unf_ext-0.0.7.5 because its extensions are not built. Try: gem pristine unf_ext --version 0.0.7.5
Ignoring websocket-driver-0.7.0 because its extensions are not built. Try: gem pristine websocket-driver --version 0.7.0
Ignoring websocket-driver-0.6.5 because its extensions are not built. Try: gem pristine websocket-driver --version 0.6.5

Fred Dixon

unread,
Mar 5, 2019, 10:12:43 AM3/5/19
to BigBlueButton-dev
Hi,

Did you get any errors on upgrade to 2.2-dev?  Could you post the output of the following:

  gem -v
  gem update --system --no-document
  gem install bundler --no-document
 
  cd /usr/local/bigbluebutton/core
  /usr/local/bin/bundle


Regards,... Fred

German Acevedo

unread,
Mar 5, 2019, 9:09:25 PM3/5/19
to BigBlueButton-dev
Hi Fred, 
Sorry for my late response but I had to travel to the countryside of Guatemala, and just now I'm comming back to my home and have to the internet and a computer.

I didn't get any errors reported during the upgrade.

This is the output of the requested commands:

root@conferencias:~# gem -v
Ignoring absolute_time-1.0.0 because its extensions are not built. Try: gem pristine absolute_time --version 1.0.0
3.0.2


root@conferencias:~# gem update --system --no-document
Ignoring absolute_time-1.0.0 because its extensions are not built. Try: gem pristine absolute_time --version 1.0.0
Updating rubygems-update
Fetching rubygems-update-3.0.3.gem
Successfully installed rubygems-update-3.0.3
Installing RubyGems 3.0.3
Ignoring absolute_time-1.0.0 because its extensions are not built. Try: gem pristine absolute_time --version 1.0.0
Bundler 1.17.3 installed
RubyGems 3.0.3 installed
Regenerating binstubs

=== 3.0.2 / 2019-01-01

Minor enhancements:

* Use Bundler-1.17.3. Pull request #2556 by SHIBATA Hiroshi.
* Fix document flag description. Pull request #2555 by Luis Sagastume.

Bug fixes:

* Fix tests when ruby --program-suffix is used without rubygems
  --format-executable. Pull request #2549 by Jeremy Evans.
* Fix Gem::Requirement equality comparison when ~> operator is used. Pull
  request #2554 by Grey Baker.
* Unset SOURCE_DATE_EPOCH in the test cases. Pull request #2558 by Sorah
  Fukumori.
* Restore SOURCE_DATE_EPOCH. Pull request #2560 by SHIBATA Hiroshi.


------------------------------------------------------------------------------

RubyGems installed the following executables:
        /usr/local/rvm/rubies/ruby-2.5.1/bin/gem
        /usr/local/rvm/rubies/ruby-2.5.1/bin/bundle

RubyGems system software updated



root@conferencias:~# gem install bundler --no-document
Ignoring absolute_time-1.0.0 because its extensions are not built. Try: gem pristine absolute_time --version 1.0.0
Successfully installed bundler-2.0.1
1 gem installed



root@conferencias:~#  cd /usr/local/bigbluebutton/core
root@conferencias:/usr/local/bigbluebutton/core# /usr/local/bin/bundle
Don't run Bundler as root. Bundler can ask for sudo if it is needed, and installing your bundle as root will break this application for all non-root users on this
machine.
Ignoring bcrypt-3.1.12 because its extensions are not built. Try: gem pristine bcrypt --version 3.1.12
Ignoring bindex-0.5.0 because its extensions are not built. Try: gem pristine bindex --version 0.5.0
Ignoring byebug-10.0.2 because its extensions are not built. Try: gem pristine byebug --version 10.0.2
Ignoring executable-hooks-1.4.2 because its extensions are not built. Try: gem pristine executable-hooks --version 1.4.2
Ignoring ffi-1.9.25 because its extensions are not built. Try: gem pristine ffi --version 1.9.25
Ignoring gem-wrappers-1.4.0 because its extensions are not built. Try: gem pristine gem-wrappers --version 1.4.0
Ignoring gem-wrappers-1.3.2 because its extensions are not built. Try: gem pristine gem-wrappers --version 1.3.2
Ignoring jaro_winkler-1.5.1 because its extensions are not built. Try: gem pristine jaro_winkler --version 1.5.1
Ignoring nio4r-2.3.1 because its extensions are not built. Try: gem pristine nio4r --version 2.3.1
Ignoring nokogiri-1.8.5 because its extensions are not built. Try: gem pristine nokogiri --version 1.8.5
Ignoring nokogiri-1.8.3 because its extensions are not built. Try: gem pristine nokogiri --version 1.8.3
Ignoring pg-0.21.0 because its extensions are not built. Try: gem pristine pg --version 0.21.0
Ignoring puma-3.11.4 because its extensions are not built. Try: gem pristine puma --version 3.11.4
Ignoring redcarpet-3.4.0 because its extensions are not built. Try: gem pristine redcarpet --version 3.4.0
Ignoring sqlite3-1.3.13 because its extensions are not built. Try: gem pristine sqlite3 --version 1.3.13
Ignoring therubyracer-0.12.3 because its extensions are not built. Try: gem pristine therubyracer --version 0.12.3
Ignoring unf_ext-0.0.7.5 because its extensions are not built. Try: gem pristine unf_ext --version 0.0.7.5
Ignoring websocket-driver-0.7.0 because its extensions are not built. Try: gem pristine websocket-driver --version 0.7.0
Ignoring websocket-driver-0.6.5 because its extensions are not built. Try: gem pristine websocket-driver --version 0.6.5
Using absolute_time 1.0.0
Using builder 3.2.3
Using bundler 1.17.3
Using crass 1.0.4
Using fastimage 2.1.5
Using java_properties 0.0.4
Using jwt 2.1.0
Using mini_portile2 2.4.0
Using nokogiri 1.10.1
Using loofah 2.2.3
Using open4 1.3.4
Using redis 4.1.0
Using rubyzip 1.2.2
Using trollop 2.1.3
Bundle complete! 11 Gemfile dependencies, 14 gems now installed.
Use `bundle info [gemname]` to see where a bundled gem is installed.

Thanks for your support,

Regards,

German





German Acevedo

unread,
Mar 5, 2019, 9:11:54 PM3/5/19
to BigBlueButton-dev
This is the output of bbb-record --watch after running the commands:

Every 2.0s: bbb-record --list-recent                                                                                                            Wed Mar  6 03:10:19 2019

Internal MeetingID                                               Time                APVD APVDE RAS Slides Processed            Published           External MeetingID
------------------------------------------------------  ---------------------------- ---- ----- --- ------ -------------------- ------------------  -------------------
629fa54cc9a6cd34f421d1f53641242e1e8560c6-1551788908992  Tue Mar 5 13:28:28 CET 2019  XX         X        4
cd99dabd1c7ecc45cfc9cb91c2f5e3ea6fbf94e1-1551449289084  Fri Mar 1 15:08:09 CET 2019  XX         X      169
cd99dabd1c7ecc45cfc9cb91c2f5e3ea6fbf94e1-1551383713225  Thu Feb 28 20:55:13 CET 2019 XX         X        4
cd99dabd1c7ecc45cfc9cb91c2f5e3ea6fbf94e1-1551383584807  Thu Feb 28 20:53:04 CET 2019 XX         X        4
cd99dabd1c7ecc45cfc9cb91c2f5e3ea6fbf94e1-1551383402431  Thu Feb 28 20:50:02 CET 2019 XX         X        4
183f0bf3a0982a127bdb8161e0c44eb696b3e75c-1551383260057  Thu Feb 28 20:47:40 CET 2019  X                  4
629fa54cc9a6cd34f421d1f53641242e1e8560c6-1551382743799  Thu Feb 28 20:39:03 CET 2019 XX                  4
cd99dabd1c7ecc45cfc9cb91c2f5e3ea6fbf94e1-1551382193309  Thu Feb 28 20:29:53 CET 2019 XX                  4
cd99dabd1c7ecc45cfc9cb91c2f5e3ea6fbf94e1-1550869053649  Fri Feb 22 21:57:33 CET 2019      XXX X  X       4                                          6f360e4bdd7eee839f7e
9298f8e89d6ac3824366
cd99dabd1c7ecc45cfc9cb91c2f5e3ea6fbf94e1-1550866776966  Fri Feb 22 21:19:36 CET 2019      XXX X  X       4                                          6f360e4bdd7eee839f7e
9298f8e89d6ac3824366
cd99dabd1c7ecc45cfc9cb91c2f5e3ea6fbf94e1-1550866133043  Fri Feb 22 21:08:53 CET 2019      XXX X  X       4                                          6f360e4bdd7eee839f7e
9298f8e89d6ac3824366
cd99dabd1c7ecc45cfc9cb91c2f5e3ea6fbf94e1-1550865818058  Fri Feb 22 21:03:38 CET 2019      XXX X  X       4                                          6f360e4bdd7eee839f7e
9298f8e89d6ac3824366
cd99dabd1c7ecc45cfc9cb91c2f5e3ea6fbf94e1-1550865598931  Fri Feb 22 20:59:58 CET 2019      XXX X  X       4                                          6f360e4bdd7eee839f7e
9298f8e89d6ac3824366
6e35e3b2778883f5db637d7a5dba0a427f692e91-1550845807099  Fri Feb 22 15:30:07 CET 2019      XXXXX          4                      presentation        English 101
629fa54cc9a6cd34f421d1f53641242e1e8560c6-1550844466629  Fri Feb 22 15:07:46 CET 2019      XXXXX          4                      presentation        491a0f8f43d6c2dddb4a
39e03e3037e291ed6e47
7bff035c316039fc6335f4a1a9332eab69116e89-1550716966854  Thu Feb 21 03:42:46 CET 2019      XXX X          1                                          7f70bab86049226c4a47
3271f1af3203bdd401c1-8-16
7bff035c316039fc6335f4a1a9332eab69116e89-1550711067714  Thu Feb 21 02:04:27 CET 2019      XXXXX          1                      presentation        7f70bab86049226c4a47
3271f1af3203bdd401c1-8-16
7bff035c316039fc6335f4a1a9332eab69116e89-1550705724631  Thu Feb 21 00:35:24 CET 2019      XXXXX          1                                          7f70bab86049226c4a47
3271f1af3203bdd401c1-8-16

--
NEXT                         LEFT    LAST                         PASSED  UNIT                  ACTIVATES
Wed 2019-03-06 03:10:24 CET  4s left Wed 2019-03-06 03:09:54 CET  25s ago bbb-record-core.timer bbb-record-core.target

1 timers listed.
--
● bbb-rap-archive-worker.service - BigBlueButton recording and playback archive worker
   Loaded: loaded (/usr/lib/systemd/system/bbb-rap-archive-worker.service; static; vendor preset: enabled)
   Active: failed (Result: exit-code) since Wed 2019-03-06 03:09:54 CET; 25s ago
  Process: 13077 ExecStart=/usr/local/bigbluebutton/core/scripts/rap-archive-worker.rb (code=exited, status=1/FAILURE)

German Acevedo

unread,
Mar 5, 2019, 9:14:06 PM3/5/19
to BigBlueButton-dev
And this is the output of bbb-record --debug:

root@conferencias:/usr/local/bigbluebutton/core# bbb-record --debug
I, [2019-03-05T14:43:56.897438 #15321]  INFO -- : /usr/local/rvm/rubies/ruby-2.5.1/lib/ruby/site_ruby/2.5.0/rubygems/core_ext/kernel_require.rb:54:in `require': incompatible library version - /usr/local/rvm/gems/ruby-2.5.1/gems/nokogiri-1.10.1/lib/nokogiri/nokogiri.so (LoadError)
E, [2019-03-05T14:43:56.899572 #15321] ERROR -- : Failed to archive a774930410258311e69376fd87eb09cb484a21ce-1551151938193
I, [2019-03-05T14:43:57.083104 #15321]  INFO -- : /usr/local/rvm/rubies/ruby-2.5.1/lib/ruby/site_ruby/2.5.0/rubygems/core_ext/kernel_require.rb:54:in `require': incompatible library version - /usr/local/rvm/gems/ruby-2.5.1/gems/nokogiri-1.10.1/lib/nokogiri/nokogiri.so (LoadError)
E, [2019-03-05T14:43:57.085042 #15321] ERROR -- : Failed to archive 629fa54cc9a6cd34f421d1f53641242e1e8560c6-1551185488517
I, [2019-03-05T14:43:57.285701 #15321]  INFO -- : /usr/local/rvm/rubies/ruby-2.5.1/lib/ruby/site_ruby/2.5.0/rubygems/core_ext/kernel_require.rb:54:in `require': incompatible library version - /usr/local/rvm/gems/ruby-2.5.1/gems/nokogiri-1.10.1/lib/nokogiri/nokogiri.so (LoadError)
E, [2019-03-05T14:43:57.289264 #15321] ERROR -- : Failed to archive a774930410258311e69376fd87eb09cb484a21ce-1551141833634
I, [2019-03-05T14:43:57.471111 #15321]  INFO -- : /usr/local/rvm/rubies/ruby-2.5.1/lib/ruby/site_ruby/2.5.0/rubygems/core_ext/kernel_require.rb:54:in `require': incompatible library version - /usr/local/rvm/gems/ruby-2.5.1/gems/nokogiri-1.10.1/lib/nokogiri/nokogiri.so (LoadError)
E, [2019-03-05T14:43:57.473190 #15321] ERROR -- : Failed to archive 629fa54cc9a6cd34f421d1f53641242e1e8560c6-1551150196371
I, [2019-03-05T14:43:57.660354 #15321]  INFO -- : /usr/local/rvm/rubies/ruby-2.5.1/lib/ruby/site_ruby/2.5.0/rubygems/core_ext/kernel_require.rb:54:in `require': incompatible library version - /usr/local/rvm/gems/ruby-2.5.1/gems/nokogiri-1.10.1/lib/nokogiri/nokogiri.so (LoadError)
E, [2019-03-05T14:43:57.662398 #15321] ERROR -- : Failed to archive cd99dabd1c7ecc45cfc9cb91c2f5e3ea6fbf94e1-1551449289084-77111579
I, [2019-03-05T14:43:57.841057 #15321]  INFO -- : /usr/local/rvm/rubies/ruby-2.5.1/lib/ruby/site_ruby/2.5.0/rubygems/core_ext/kernel_require.rb:54:in `require': incompatible library version - /usr/local/rvm/gems/ruby-2.5.1/gems/nokogiri-1.10.1/lib/nokogiri/nokogiri.so (LoadError)
E, [2019-03-05T14:43:57.842999 #15321] ERROR -- : Failed to archive cd99dabd1c7ecc45cfc9cb91c2f5e3ea6fbf94e1-1551383402431
I, [2019-03-05T14:43:58.017829 #15321]  INFO -- : /usr/local/rvm/rubies/ruby-2.5.1/lib/ruby/site_ruby/2.5.0/rubygems/core_ext/kernel_require.rb:54:in `require': incompatible library version - /usr/local/rvm/gems/ruby-2.5.1/gems/nokogiri-1.10.1/lib/nokogiri/nokogiri.so (LoadError)
E, [2019-03-05T14:43:58.019701 #15321] ERROR -- : Failed to archive a774930410258311e69376fd87eb09cb484a21ce-1551142916305
I, [2019-03-05T14:43:58.203679 #15321]  INFO -- : /usr/local/rvm/rubies/ruby-2.5.1/lib/ruby/site_ruby/2.5.0/rubygems/core_ext/kernel_require.rb:54:in `require': incompatible library version - /usr/local/rvm/gems/ruby-2.5.1/gems/nokogiri-1.10.1/lib/nokogiri/nokogiri.so (LoadError)
E, [2019-03-05T14:43:58.206144 #15321] ERROR -- : Failed to archive 629fa54cc9a6cd34f421d1f53641242e1e8560c6-1551788908992
I, [2019-03-05T14:43:58.390713 #15321]  INFO -- : /usr/local/rvm/rubies/ruby-2.5.1/lib/ruby/site_ruby/2.5.0/rubygems/core_ext/kernel_require.rb:54:in `require': incompatible library version - /usr/local/rvm/gems/ruby-2.5.1/gems/nokogiri-1.10.1/lib/nokogiri/nokogiri.so (LoadError)
E, [2019-03-05T14:43:58.392889 #15321] ERROR -- : Failed to archive a774930410258311e69376fd87eb09cb484a21ce-1551142060902
I, [2019-03-05T14:43:58.586241 #15321]  INFO -- : /usr/local/rvm/rubies/ruby-2.5.1/lib/ruby/site_ruby/2.5.0/rubygems/core_ext/kernel_require.rb:54:in `require': incompatible library version - /usr/local/rvm/gems/ruby-2.5.1/gems/nokogiri-1.10.1/lib/nokogiri/nokogiri.so (LoadError)
E, [2019-03-05T14:43:58.588197 #15321] ERROR -- : Failed to archive cd99dabd1c7ecc45cfc9cb91c2f5e3ea6fbf94e1-1551383713225
I, [2019-03-05T14:43:58.772253 #15321]  INFO -- : /usr/local/rvm/rubies/ruby-2.5.1/lib/ruby/site_ruby/2.5.0/rubygems/core_ext/kernel_require.rb:54:in `require': incompatible library version - /usr/local/rvm/gems/ruby-2.5.1/gems/nokogiri-1.10.1/lib/nokogiri/nokogiri.so (LoadError)
E, [2019-03-05T14:43:58.774155 #15321] ERROR -- : Failed to archive 629fa54cc9a6cd34f421d1f53641242e1e8560c6-1551150733147
I, [2019-03-05T14:43:58.950007 #15321]  INFO -- : /usr/local/rvm/rubies/ruby-2.5.1/lib/ruby/site_ruby/2.5.0/rubygems/core_ext/kernel_require.rb:54:in `require': incompatible library version - /usr/local/rvm/gems/ruby-2.5.1/gems/nokogiri-1.10.1/lib/nokogiri/nokogiri.so (LoadError)
E, [2019-03-05T14:43:58.951964 #15321] ERROR -- : Failed to archive cd99dabd1c7ecc45cfc9cb91c2f5e3ea6fbf94e1-1551383584807
   -- Ingest and Processing: found recorded meeting but no archive files--
  /var/bigbluebutton/recording/status/recorded/629fa54cc9a6cd34f421d1f53641242e1e8560c6-1551150196371.done
  /var/bigbluebutton/recording/status/recorded/629fa54cc9a6cd34f421d1f53641242e1e8560c6-1551150733147.done
  /var/bigbluebutton/recording/status/recorded/629fa54cc9a6cd34f421d1f53641242e1e8560c6-1551185488517.done
  /var/bigbluebutton/recording/status/recorded/629fa54cc9a6cd34f421d1f53641242e1e8560c6-1551788908992.done
  /var/bigbluebutton/recording/status/recorded/a774930410258311e69376fd87eb09cb484a21ce-1551141833634.done
  /var/bigbluebutton/recording/status/recorded/a774930410258311e69376fd87eb09cb484a21ce-1551142060902.done
  /var/bigbluebutton/recording/status/recorded/a774930410258311e69376fd87eb09cb484a21ce-1551142916305.done
  /var/bigbluebutton/recording/status/recorded/a774930410258311e69376fd87eb09cb484a21ce-1551151938193.done
  /var/bigbluebutton/recording/status/recorded/cd99dabd1c7ecc45cfc9cb91c2f5e3ea6fbf94e1-1551383402431.done
  /var/bigbluebutton/recording/status/recorded/cd99dabd1c7ecc45cfc9cb91c2f5e3ea6fbf94e1-1551383584807.done
  /var/bigbluebutton/recording/status/recorded/cd99dabd1c7ecc45cfc9cb91c2f5e3ea6fbf94e1-1551383713225.done
  /var/bigbluebutton/recording/status/recorded/cd99dabd1c7ecc45cfc9cb91c2f5e3ea6fbf94e1-1551449289084-77111579.done
  /var/bigbluebutton/recording/status/recorded/cd99dabd1c7ecc45cfc9cb91c2f5e3ea6fbf94e1-1551449289084.done

Fred Dixon

unread,
Mar 5, 2019, 9:26:55 PM3/5/19
to BigBlueButton-dev
Hi German,

There is something wrong with your gems.

> Ignoring absolute_time-1.0.0 because its extensions are not built. Try: gem pristine absolute_time --version 1.0.0 3.0.2

Until we fix this, none of the recording processing scripts will run and finish successfully.

I've googled the error message and it suggests your server is missing some components to build the gems.  Let's take this step-by-step.  Can you post the output of the command

  gem list

and 

  gem install absolute_time


Regards,... Fred
  




--
You received this message because you are subscribed to the Google Groups "BigBlueButton-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-...@googlegroups.com.
To post to this group, send email to bigblueb...@googlegroups.com.
Visit this group at https://groups.google.com/group/bigbluebutton-dev.
For more options, visit https://groups.google.com/d/optout.

German Acevedo

unread,
Mar 5, 2019, 9:32:21 PM3/5/19
to bigblueb...@googlegroups.com
Hi,
this is the output of gem list:
root@conferencias:/usr/local/bigbluebutton/core# gem list
Ignoring absolute_time-1.0.0 because its extensions are not built. Try: gem pristine absolute_time --version 1.0.0

*** LOCAL GEMS ***

absolute_time (1.0.0)
action-cable-testing (0.3.1)
actioncable (5.2.2, 5.0.7)
actionmailer (5.2.2, 5.0.7)
actionpack (5.2.2, 5.0.7)
actionview (5.2.2, 5.0.7)
activejob (5.2.2, 5.0.7)
activemodel (5.2.2, 5.0.7)
activerecord (5.2.2, 5.0.7)
activestorage (5.2.2)
activesupport (5.2.2, 5.0.7)
addressable (2.5.2)
arel (9.0.0, 7.1.4)
ast (2.4.0)
autoprefixer-rails (8.6.4)
bcrypt (3.1.12)
bigbluebutton-api-ruby (1.7.0, 1.6.0)
bigdecimal (default: 1.3.4)
bindex (0.5.0)
bootstrap (4.1.3, 4.1.1)
builder (3.2.3)
bundler (2.0.1, default: 1.17.3, 1.16.1)
bundler-unload (1.0.2)
byebug (10.0.2)
cmath (default: 1.0.0)
coffee-rails (4.2.2)
coffee-script (2.4.1)
coffee-script-source (1.12.2)
concurrent-ruby (1.1.4, 1.0.5)
coveralls (0.7.1)
crack (0.4.3)
crass (1.0.4)
csv (default: 1.0.0)
date (default: 1.0.0)
dbm (default: 1.0.0)
did_you_mean (1.2.0)
diff-lcs (1.3)
docile (1.3.1)
domain_name (0.5.20180417)
dotenv (2.5.0)
dotenv-rails (2.5.0)
erubi (1.8.0)
erubis (2.7.0)
etc (default: 1.0.0)
execjs (2.7.0)
executable-hooks (1.4.2)
factory_bot (4.10.0)
factory_bot_rails (4.10.0)
faker (1.8.7)
faraday (0.12.2)
fastimage (2.1.5)
fcntl (default: 1.0.0)
ffi (1.9.25)
fiddle (default: 1.0.0)
fileutils (default: 1.0.2)
gdbm (default: 2.0.0)
gem-wrappers (1.4.0, 1.3.2)
globalid (0.4.2, 0.4.1)
hashdiff (0.3.7)
hashie (3.5.7)
health_check (3.0.0)
http-cookie (1.0.3)
http_accept_language (2.1.1)
i18n (1.5.2, 1.0.1)
io-console (default: 0.4.6)
ipaddr (default: 1.2.0)
jaro_winkler (1.5.1)
java_properties (0.0.4)
jbuilder (2.7.0)
jquery-rails (4.3.3)
json (default: 2.1.0)
jwt (2.1.0, 1.5.6)
libv8 (3.16.14.19 x86_64-linux)
listen (3.0.8)
loofah (2.2.3, 2.2.2)
mail (2.7.1, 2.7.0)
marcel (0.3.3)
method_source (0.9.2, 0.9.0)
mime-types (3.2.2)
mime-types-data (3.2018.0812)
mimemagic (0.3.3)
mini_mime (1.0.1, 1.0.0)
mini_portile2 (2.4.0, 2.3.0)
minitest (5.11.3, 5.10.3)
multi_json (1.13.1)
multi_xml (0.6.0)
multipart-post (2.0.0)
net-ldap (0.16.1)
net-telnet (0.1.1)
netrc (0.11.0)
nio4r (2.3.1)
nokogiri (1.10.1, 1.8.5, 1.8.3)
oauth (0.5.4)
oauth2 (1.4.0)
omniauth (1.8.1)
omniauth-bn-launcher (0.1.0)
omniauth-google-oauth2 (0.5.3)
omniauth-ldap (2.0.0)
omniauth-microsoft-office365 (0.0.7)
omniauth-oauth (1.1.0)
omniauth-oauth2 (1.5.0)
omniauth-twitter (1.4.0)
open4 (1.3.4)
openssl (default: 2.1.0)
parallel (1.12.1)
parser (2.5.1.0)
pg (0.21.0)
popper_js (1.14.3, 1.12.9)
power_assert (1.1.1)
powerpack (0.1.2)
psych (default: 3.0.2)
public_suffix (3.0.3)
puma (3.11.4)
pyu-ruby-sasl (0.0.3.3)
rack (2.0.6, 2.0.5)
rack-test (1.1.0, 0.6.3)
rails (5.2.2, 5.0.7)
rails-controller-testing (1.0.2)
rails-dom-testing (2.0.3)
rails-html-sanitizer (1.0.4)
railties (5.2.2, 5.0.7)
rainbow (3.0.0)
rake (12.3.1, 12.3.0)
rb-fsevent (0.10.3)
rb-inotify (0.9.10)
rdoc (default: 6.0.1)
redcarpet (3.4.0)
redis (4.1.0, 3.3.5)
ref (2.0.0)
rest-client (2.0.2)
rspec-core (3.7.1)
rspec-expectations (3.7.0)
rspec-mocks (3.7.0)
rspec-rails (3.7.2)
rspec-support (3.7.1)
rubocop (0.57.2)
ruby-progressbar (1.9.0)
rubygems-bundler (1.4.4)
rubygems-update (3.0.3, 3.0.2)
rubyntlm (0.6.2)
rubyzip (1.2.2)
rvm (1.11.3.9)
safe_yaml (1.0.4)
sass (3.5.6)
sass-listen (4.0.0)
sass-rails (5.0.7)
scanf (default: 1.0.0)
sdbm (default: 1.0.0)
shoulda-matchers (3.1.2)
simplecov (0.16.1)
simplecov-html (0.10.2)
spring (2.0.2)
spring-watcher-listen (2.0.1)
sprockets (3.7.2)
sprockets-rails (3.2.1)
sqlite3 (1.3.13)
stringio (default: 0.0.1)
strscan (default: 1.0.0)
tabler-rubygem (0.1.2)
term-ansicolor (1.6.0)
test-unit (3.2.7)
therubyracer (0.12.3)
thor (0.20.3, 0.20.0)
thread_safe (0.3.6)
tilt (2.0.8)
tins (1.16.3)
trollop (2.1.3)
turbolinks (5.1.1)
turbolinks-source (5.1.0)
tzinfo (1.2.5)
uglifier (4.1.12)
unf (0.1.4)
unf_ext (0.0.7.5)
unicode-display_width (1.4.0)
web-console (3.6.2)
webmock (3.4.2)
webrick (default: 1.4.2)
websocket-driver (0.7.0, 0.6.5)
websocket-extensions (0.1.3)
xml-simple (1.1.5)
xmlrpc (0.3.0)
zlib (default: 1.0.0)



You received this message because you are subscribed to a topic in the Google Groups "BigBlueButton-dev" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/bigbluebutton-dev/tEWERkppbM8/unsubscribe.
To unsubscribe from this group and all its topics, send an email to bigbluebutton-...@googlegroups.com.

German Acevedo

unread,
Mar 5, 2019, 9:33:22 PM3/5/19
to bigblueb...@googlegroups.com
And this is the output of  gem install absolute_time:

root@conferencias:/usr/local/bigbluebutton/core# gem install absolute_time
Ignoring absolute_time-1.0.0 because its extensions are not built. Try: gem pristine absolute_time --version 1.0.0
Building native extensions. This could take a while...
Successfully installed absolute_time-1.0.0
Parsing documentation for absolute_time-1.0.0
Installing ri documentation for absolute_time-1.0.0
Done installing documentation for absolute_time after 0 seconds
1 gem installed

El mar., 5 de mar. de 2019 a la(s) 20:26, Fred Dixon (ffd...@gmail.com) escribió:
You received this message because you are subscribed to a topic in the Google Groups "BigBlueButton-dev" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/bigbluebutton-dev/tEWERkppbM8/unsubscribe.
To unsubscribe from this group and all its topics, send an email to bigbluebutton-...@googlegroups.com.

Fred Dixon

unread,
Mar 5, 2019, 10:34:33 PM3/5/19
to BigBlueButton-dev
Hi German,

If you run the install script a second time 

 gem install absolute_time

do you still get the error message?

Regards,... Fred

German Acevedo

unread,
Mar 5, 2019, 10:57:28 PM3/5/19
to BigBlueButton-dev
Hi Fred,
This time it succeeded with the installation:

root@conferencias:/usr/local/bigbluebutton/core# gem install absolute_time
Building native extensions. This could take a while...
Successfully installed absolute_time-1.0.0
Parsing documentation for absolute_time-1.0.0
Done installing documentation for absolute_time after 0 seconds
1 gem installed

German Acevedo

unread,
Mar 5, 2019, 11:01:27 PM3/5/19
to BigBlueButton-dev
I executed again the commands:
  gem update --system --no-document
  gem install bundler --no-document
 
  cd /usr/local/bigbluebutton/core
  /usr/local/bin/bundle

Everything ended without errors, but bbb-record --watch stills showing the Failure:

Every 2.0s: bbb-record --list-recent                                                                                                            Wed Mar  6 05:00:55 2019
Wed 2019-03-06 05:01:16 CET  20s left Wed 2019-03-06 05:00:46 CET  9s ago bbb-record-core.timer bbb-record-core.target

1 timers listed.
--
● bbb-rap-archive-worker.service - BigBlueButton recording and playback archive worker
   Loaded: loaded (/usr/lib/systemd/system/bbb-rap-archive-worker.service; static; vendor preset: enabled)
   Active: failed (Result: exit-code) since Wed 2019-03-06 05:00:47 CET; 9s ago
  Process: 4232 ExecStart=/usr/local/bigbluebutton/core/scripts/rap-archive-worker.rb (code=exited, status=1/FAILURE)

German Acevedo

unread,
Mar 5, 2019, 11:44:36 PM3/5/19
to BigBlueButton-dev
After rebooting the server and making a bbb-conf --clean it seems that the error is gone!

--
NEXT                         LEFT     LAST                         PASSED  UNIT                  ACTIVATES
Wed 2019-03-06 05:43:24 CET  15s left Wed 2019-03-06 05:42:54 CET  14s ago bbb-record-core.timer bbb-record-core.target

1 timers listed.
--
● bbb-rap-archive-worker.service - BigBlueButton recording and playback archive worker
   Loaded: loaded (/usr/lib/systemd/system/bbb-rap-archive-worker.service; static; vendor preset: enabled)

There is no Failure message when I run bbb-record --watch

I'll wait to see if the past recordings are processed now. Thanks for your support Fred!

German Acevedo

unread,
Mar 9, 2019, 11:29:38 PM3/9/19
to BigBlueButton-dev
Hi,
I get rid of the error, but now the meetings aren't recorded at all!  There are no new files inside the raw folder.
Do you think that I should reinstall all? 

German Acevedo

unread,
Mar 9, 2019, 11:31:10 PM3/9/19
to BigBlueButton-dev
This is the result of bbb-record --debug:

root@conferencias:~# bbb-record --debug
   -- Ingest and Processing: found recorded meeting but no archive files--
  /var/bigbluebutton/recording/status/recorded/0bfb346b71a2de530981f00d15ca26932d9c5b0f-1552063262297.done
  /var/bigbluebutton/recording/status/recorded/629fa54cc9a6cd34f421d1f53641242e1e8560c6-1551150196371.done
  /var/bigbluebutton/recording/status/recorded/629fa54cc9a6cd34f421d1f53641242e1e8560c6-1551150733147.done
  /var/bigbluebutton/recording/status/recorded/629fa54cc9a6cd34f421d1f53641242e1e8560c6-1551185488517.done
  /var/bigbluebutton/recording/status/recorded/629fa54cc9a6cd34f421d1f53641242e1e8560c6-1551788908992.done
  /var/bigbluebutton/recording/status/recorded/629fa54cc9a6cd34f421d1f53641242e1e8560c6-1551847115872.done
  /var/bigbluebutton/recording/status/recorded/629fa54cc9a6cd34f421d1f53641242e1e8560c6-1551877992512.done
  /var/bigbluebutton/recording/status/recorded/629fa54cc9a6cd34f421d1f53641242e1e8560c6-1551907795444.done
  /var/bigbluebutton/recording/status/recorded/7bff035c316039fc6335f4a1a9332eab69116e89-1551915523569.done
  /var/bigbluebutton/recording/status/recorded/7bff035c316039fc6335f4a1a9332eab69116e89-1551920680652.done
  /var/bigbluebutton/recording/status/recorded/7bff035c316039fc6335f4a1a9332eab69116e89-1551970024095.done
  /var/bigbluebutton/recording/status/recorded/7bff035c316039fc6335f4a1a9332eab69116e89-1551970348521.done
  /var/bigbluebutton/recording/status/recorded/7bff035c316039fc6335f4a1a9332eab69116e89-1551970593051.done
  /var/bigbluebutton/recording/status/recorded/a774930410258311e69376fd87eb09cb484a21ce-1551141833634.done
  /var/bigbluebutton/recording/status/recorded/a774930410258311e69376fd87eb09cb484a21ce-1551142060902.done
  /var/bigbluebutton/recording/status/recorded/a774930410258311e69376fd87eb09cb484a21ce-1551142916305.done
  /var/bigbluebutton/recording/status/recorded/a774930410258311e69376fd87eb09cb484a21ce-1551151938193.done
  /var/bigbluebutton/recording/status/recorded/cd99dabd1c7ecc45cfc9cb91c2f5e3ea6fbf94e1-1551383402431.done
  /var/bigbluebutton/recording/status/recorded/cd99dabd1c7ecc45cfc9cb91c2f5e3ea6fbf94e1-1551383584807.done
  /var/bigbluebutton/recording/status/recorded/cd99dabd1c7ecc45cfc9cb91c2f5e3ea6fbf94e1-1551383713225.done
  /var/bigbluebutton/recording/status/recorded/cd99dabd1c7ecc45cfc9cb91c2f5e3ea6fbf94e1-1551449289084-77111579.done
  /var/bigbluebutton/recording/status/recorded/cd99dabd1c7ecc45cfc9cb91c2f5e3ea6fbf94e1-1551449289084.done

Fred Dixon

unread,
Mar 9, 2019, 11:35:21 PM3/9/19
to BigBlueButton-dev
Hi German,

Check the contents of

  /var/log/bigbluebutton/bbb-rap-worker.log

and pick one of the recordings, such as

  0bfb346b71a2de530981f00d15ca26932d9c5b0f-1552063262297

and check the contents of the associated processing log

  /var/log/bigbluebutton/archive-0bfb346b71a2de530981f00d15ca26932d9c5b0f-1552063262297.log

and the contents of the processed folder for errors.

Regards,... Fred


  /var/bigbluebutton/recording/status/processed

Regards,... fred


--
You received this message because you are subscribed to the Google Groups "BigBlueButton-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-...@googlegroups.com.
To post to this group, send email to bigblueb...@googlegroups.com.
Visit this group at https://groups.google.com/group/bigbluebutton-dev.
For more options, visit https://groups.google.com/d/optout.

German Acevedo

unread,
Mar 10, 2019, 12:01:35 AM3/10/19
to BigBlueButton-dev
Hi Fredm
First of all, thanks for your help!
I tried to follow your instructions, but there is no bbb-rap-worker.log file inside my /var/log/bigbluebutton folder as you can see in this screenshot:

log.png


Is there other place were I can find this log?

Regards,

German

Fred Dixon

unread,
Mar 10, 2019, 12:19:21 AM3/10/19
to BigBlueButton-dev
Hi German,


> I tried to follow your instructions, but there is no bbb-rap-worker.log file inside my /var/log/bigbluebutton folder as you can see in this screenshot:

There should be a log file there at

  /var/log/bigbluebutton/bbb-rap-worker.log

The fact it's missing may mean that rap-process-worker.rb isn't able to write to that file, which would prevent it from running, which would explain why your recordings are not processing.  What is the ownership for the directory /var/log/bigbluebutton?

Also, what are the output of the commands

  systemctl status bbb-rap-process-worker.service
  journalctl -u bbb-rap-process-worker.service


Regards,... Fred

German Acevedo

unread,
Mar 10, 2019, 12:28:48 AM3/10/19
to BigBlueButton-dev
Hi Fred,

The ownership of /var/bigbluebutton is bigbluebutton:bigbluebutton

This is the result of the commands:

root@conferencias:~# systemctl status bbb-rap-process-worker.service
● bbb-rap-process-worker.service - BigBlueButton recording and playback process worker
   Loaded: loaded (/usr/lib/systemd/system/bbb-rap-process-worker.service; static; vendor preset: en
   Active: inactive (dead)
Condition: start condition failed at Sun 2019-03-10 06:25:31 CET; 16s ago
           ConditionPathExistsGlob=/var/bigbluebutton/recording/status/sanity/*.done was not met
lines 1-5/5 (END)


root@conferencias:~#  journalctl -u bbb-rap-process-worker.service
-- No entries --
root@conferencias:~#

Fred Dixon

unread,
Mar 10, 2019, 9:44:44 AM3/10/19
to BigBlueButton-dev
Hi German,

>  The ownership of /var/bigbluebutton is bigbluebutton:bigbluebutton

Good, but it's this directory that we're asking about ownership

What is the ownership for the directory /var/log/bigbluebutton?  


> root@conferencias:~#  journalctl -u bbb-rap-process-worker.service
> -- No entries --

Hmm .. it looks like 

# journalctl -u bbb-rap-process-worker.service
-- Logs begin at Wed 2019-03-06 07:52:01 UTC, end at Sun 2019-03-10 13:38:47 UTC. --
Mar 10 12:48:46 test-923 systemd[1]: Stopped BigBlueButton recording and playback process worker.
Mar 10 12:53:13 test-923 systemd[1]: Stopped BigBlueButton recording and playback process worker.

What is the output of the command

  sudo -u bigbluebutton touch  /var/log/bigbluebutton/test.file


Regards,... Fred

German Acevedo

unread,
Mar 10, 2019, 11:44:54 AM3/10/19
to BigBlueButton-dev
Hi Fred,
It returns nothing:

root@conferencias:~# sudo -u bigbluebutton touch  /var/log/bigbluebutton/test.file
root@conferencias:~#

Fred Dixon

unread,
Mar 10, 2019, 12:23:12 PM3/10/19
to BigBlueButton-dev
HI German,

> sudo -u bigbluebutton touch  /var/log/bigbluebutton/test.file

After you run that command, did it create test.file in /var/log/bigbluebutton?

Regards,... Fred

German Acevedo

unread,
Mar 10, 2019, 12:28:35 PM3/10/19
to BigBlueButton-dev
Yes, there is a test.file in /var/log/bigbluebutton

root@conferencias:~# ls -l /var/log/bigbluebutton
total 292
-rw-r--r-- 1 bigbluebutton bigbluebutton  55732 Mar  6 22:52 bbb-web.2019-03-06.log
-rw-r--r-- 1 bigbluebutton bigbluebutton 188549 Mar  7 22:13 bbb-web.2019-03-07.log
-rw-r--r-- 1 bigbluebutton bigbluebutton  17445 Mar  8 18:21 bbb-web.log
drwxrwxrwx 2 bigbluebutton bigbluebutton   4096 Mar  4 06:27 download
drwxr-xr-x 2 bigbluebutton bigbluebutton   4096 Jan  4 03:04 html5
drwxr-xr-x 2 bigbluebutton bigbluebutton   4096 Feb 25 16:25 presentation
-rw-r--r-- 1 bigbluebutton bigbluebutton   2064 Feb 22 15:34 sanity.log.1
-rw-r--r-- 1 bigbluebutton bigbluebutton    310 Feb 14 03:25 sanity.log.2.gz
-rw-r--r-- 1 bigbluebutton bigbluebutton      0 Mar 10 16:44 test.file
root@conferencias:~#


Fred Dixon

unread,
Mar 10, 2019, 1:38:30 PM3/10/19
to BigBlueButton-dev
Hi German,

Thanks for giving us a quick look at your server.  The problem turned out to be multiple versions of ruby installed, which resulted from our install steps for GreenLight which direct the user to install rails using a third-party site that, in turn, instructs the reader to install rvm. Doing this caused the record and playback scripts to not run with an error

I could see this error by logging in as the user bigbluebutton (needed to temporarily allow this account to login by editing /etc/password), and then trying to run

bigbluebutton@conferencias:/usr/local/bigbluebutton/core/scripts$ ./rap-process-worker.rb
Ignoring bcrypt-3.1.12 because its extensions are not built. Try: gem pristine bcrypt --version 3.1.12
Ignoring bindex-0.5.0 because its extensions are not built. Try: gem pristine bindex --version 0.5.0
Ignoring byebug-10.0.2 because its extensions are not built. Try: gem pristine byebug --version 10.0.2
Ignoring executable-hooks-1.4.2 because its extensions are not built. Try: gem pristine executable-hooks --version 1.4.2
Ignoring ffi-1.9.25 because its extensions are not built. Try: gem pristine ffi --version 1.9.25
Ignoring gem-wrappers-1.4.0 because its extensions are not built. Try: gem pristine gem-wrappers --version 1.4.0
Ignoring gem-wrappers-1.3.2 because its extensions are not built. Try: gem pristine gem-wrappers --version 1.3.2
Ignoring jaro_winkler-1.5.1 because its extensions are not built. Try: gem pristine jaro_winkler --version 1.5.1
Ignoring nio4r-2.3.1 because its extensions are not built. Try: gem pristine nio4r --version 2.3.1
Ignoring nokogiri-1.8.5 because its extensions are not built. Try: gem pristine nokogiri --version 1.8.5
Ignoring nokogiri-1.8.3 because its extensions are not built. Try: gem pristine nokogiri --version 1.8.3
Ignoring pg-0.21.0 because its extensions are not built. Try: gem pristine pg --version 0.21.0
Ignoring puma-3.11.4 because its extensions are not built. Try: gem pristine puma --version 3.11.4
Ignoring redcarpet-3.4.0 because its extensions are not built. Try: gem pristine redcarpet --version 3.4.0
Ignoring sqlite3-1.3.13 because its extensions are not built. Try: gem pristine sqlite3 --version 1.3.13
Ignoring therubyracer-0.12.3 because its extensions are not built. Try: gem pristine therubyracer --version 0.12.3
Ignoring unf_ext-0.0.7.5 because its extensions are not built. Try: gem pristine unf_ext --version 0.0.7.5
Ignoring websocket-driver-0.7.0 because its extensions are not built. Try: gem pristine websocket-driver --version 0.7.0
Ignoring websocket-driver-0.6.5 because its extensions are not built. Try: gem pristine websocket-driver --version 0.6.5
/usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require': incompatible library version - /usr/local/rvm/gems/ruby-2.5.1/gems/nokogiri-1.10.1/lib/nokogiri/nokogiri.so (LoadError)
        from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require'
        from /usr/local/rvm/gems/ruby-2.5.1/gems/nokogiri-1.10.1/lib/nokogiri.rb:32:in `rescue in <top (required)>'
        from /usr/local/rvm/gems/ruby-2.5.1/gems/nokogiri-1.10.1/lib/nokogiri.rb:28:in `<top (required)>'
        from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:130:in `require'
        from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:130:in `rescue in require'
        from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:35:in `require'
        from /usr/local/bigbluebutton/core/lib/recordandplayback/generators/events.rb:24:in `<top (required)>'
        from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require'
        from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require'
        from /usr/local/bigbluebutton/core/lib/recordandplayback.rb:27:in `<top (required)>'
        from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require'
        from /usr/local/lib/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:54:in `require'
        from ./rap-process-worker.rb:21:in `<main>'

The solution was to uninstall rvm using the following commands

rvm implode
gem uninstall rvm
rm -rf ~/.rvm
rm -rf ~/.rvmrc
cd /usr/local/bigbluebutton/core/
bundle install

And then to move to your greenlight directory and install rails using the built-in version of ruby using the commands

gem install rails
bundle install

We've updated the documentation at 


to have the user skip the step that has them install rvm.  We'll probably pull in the steps to setup Ruby on Rails into the Green Light docs itself so we can provide the reader the minimal steps.


Thanks again German for giving us a quick look at your server.  And thanks for helping us latest version of BigBlueButton 2.2-beta!

Regards,... Fred

--
You received this message because you are subscribed to the Google Groups "BigBlueButton-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-...@googlegroups.com.
To post to this group, send email to bigblueb...@googlegroups.com.
Visit this group at https://groups.google.com/group/bigbluebutton-dev.
For more options, visit https://groups.google.com/d/optout.

German Acevedo

unread,
Mar 12, 2019, 12:52:43 AM3/12/19
to BigBlueButton-dev
Hi Fred,
First of all thank you for your help and support.
We have been testing after your intervention, and found that the webcam and screen share are not being presented in the playback.
We have de demo running in the server if you want to try it.
Regards,
German

Fred Dixon

unread,
Mar 12, 2019, 6:40:31 AM3/12/19
to BigBlueButton-dev
Hi German,


What is the output of the command

   sudo ls -al /var/kurento

Regards,... Fred

German Acevedo

unread,
Mar 12, 2019, 9:35:05 AM3/12/19
to bigblueb...@googlegroups.com
Hi Fred,
This is the output:

root@conferencias:~# sudo ls -al /var/kurento
total 20
drwxrwxrwx  5 kurento root    4096 Mar  6 05:37 .
drwxr-xr-x 16 root    root    4096 Jan 15 04:44 ..
drwxr-xr-x  3 kurento kurento 4096 Jan 15 04:44 .cache
drwxr-xr-t  6 kurento kurento 4096 Mar 11 06:26 recordings
drwxr-xr-t  4 kurento kurento 4096 Mar 11 06:26 screenshare
root@conferencias:~#

Regards,
German

You received this message because you are subscribed to a topic in the Google Groups "BigBlueButton-dev" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/bigbluebutton-dev/tEWERkppbM8/unsubscribe.
To unsubscribe from this group and all its topics, send an email to bigbluebutton-...@googlegroups.com.

Fred Dixon

unread,
Mar 12, 2019, 10:22:56 AM3/12/19
to BigBlueButton-dev
Hi German,

What's the content of 

  /var/kurento/recordings

Regards,... Fred

German Acevedo

unread,
Mar 12, 2019, 10:48:50 AM3/12/19
to bigblueb...@googlegroups.com
Hi Fred,
This is the content:

root@conferencias:~# ls -la /var/kurento/recordings
total 24
drwxr-xr-t 6 kurento kurento 4096 Mar 11 06:26 .
drwxrwxrwx 5 kurento root    4096 Mar  6 05:37 ..
drwxr-xr-t 2 kurento kurento 4096 Mar  7 06:26 cd99dabd1c7ecc45cfc9cb91c2f5e3ea6fbf94e1-1551383402431
drwxr-xr-t 2 kurento kurento 4096 Mar  7 06:26 cd99dabd1c7ecc45cfc9cb91c2f5e3ea6fbf94e1-1551383584807
drwxr-xr-t 2 kurento kurento 4096 Mar  7 06:26 cd99dabd1c7ecc45cfc9cb91c2f5e3ea6fbf94e1-1551383713225
drwxr-xr-t 2 kurento kurento 4096 Mar  8 06:26 cd99dabd1c7ecc45cfc9cb91c2f5e3ea6fbf94e1-1551449289084
root@conferencias:~#

Regards,
German

Fred Dixon

unread,
Mar 12, 2019, 11:18:14 AM3/12/19
to BigBlueButton-dev
Hi German,

It might be an issue with the ruby install from rvm still giving problems to the record and playback scripts.  Do you see any errors in

  /var/log/syslog

related to recordings?


Regards,... Fred

German Acevedo

unread,
Mar 12, 2019, 11:26:35 AM3/12/19
to bigblueb...@googlegroups.com
Hi Fred,
I can´t see any error message in syslog.
If you want to look at it, you can login to the server (I didn't remove your key to access it)
Regards,
German

German Acevedo

unread,
Mar 18, 2019, 10:34:54 AM3/18/19
to BigBlueButton-dev
SOLVED
With the last dist-upgrade and after reboot the webcams, screen sharing, audio and presentation are being recorded as expected.
Thanks Fred for all your support.
Regards,
German
To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-dev+unsubscribe@googlegroups.com.
To post to this group, send email to bigbluebutton-dev@googlegroups.com.


--
BigBlueButton Developer
@bigbluebutton

--
You received this message because you are subscribed to a topic in the Google Groups "BigBlueButton-dev" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/bigbluebutton-dev/tEWERkppbM8/unsubscribe.
To unsubscribe from this group and all its topics, send an email to bigbluebutton-dev+unsubscribe@googlegroups.com.
To post to this group, send email to bigbluebutton-dev@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "BigBlueButton-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-dev+unsubscribe@googlegroups.com.
To post to this group, send email to bigbluebutton-dev@googlegroups.com.


--
BigBlueButton Developer
@bigbluebutton

--
You received this message because you are subscribed to a topic in the Google Groups "BigBlueButton-dev" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/bigbluebutton-dev/tEWERkppbM8/unsubscribe.
To unsubscribe from this group and all its topics, send an email to bigbluebutton-dev+unsubscribe@googlegroups.com.
To post to this group, send email to bigbluebutton-dev@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "BigBlueButton-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-dev+unsubscribe@googlegroups.com.
To post to this group, send email to bigbluebutton-dev@googlegroups.com.


--
BigBlueButton Developer
@bigbluebutton

--
You received this message because you are subscribed to a topic in the Google Groups "BigBlueButton-dev" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/bigbluebutton-dev/tEWERkppbM8/unsubscribe.
To unsubscribe from this group and all its topics, send an email to bigbluebutton-dev+unsubscribe@googlegroups.com.
To post to this group, send email to bigbluebutton-dev@googlegroups.com.

Fred Dixon

unread,
Mar 18, 2019, 5:15:05 PM3/18/19
to BigBlueButton-dev
:-)

Regards,... Fred

German
You received this message because you are subscribed to a topic in the Google Groups "BigBlueButton-dev" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/bigbluebutton-dev/tEWERkppbM8/unsubscribe.
To unsubscribe from this group and all its topics, send an email to bigbluebutton-...@googlegroups.com.

To post to this group, send email to bigblueb...@googlegroups.com.
Visit this group at https://groups.google.com/group/bigbluebutton-dev.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "BigBlueButton-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-...@googlegroups.com.
To post to this group, send email to bigblueb...@googlegroups.com.
Visit this group at https://groups.google.com/group/bigbluebutton-dev.
For more options, visit https://groups.google.com/d/optout.


--
BigBlueButton Developer
@bigbluebutton

--
You received this message because you are subscribed to a topic in the Google Groups "BigBlueButton-dev" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/bigbluebutton-dev/tEWERkppbM8/unsubscribe.
To unsubscribe from this group and all its topics, send an email to bigbluebutton-...@googlegroups.com.

To post to this group, send email to bigblueb...@googlegroups.com.
Visit this group at https://groups.google.com/group/bigbluebutton-dev.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "BigBlueButton-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-...@googlegroups.com.
To post to this group, send email to bigblueb...@googlegroups.com.
Visit this group at https://groups.google.com/group/bigbluebutton-dev.
For more options, visit https://groups.google.com/d/optout.


--
BigBlueButton Developer
@bigbluebutton

--
You received this message because you are subscribed to a topic in the Google Groups "BigBlueButton-dev" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/bigbluebutton-dev/tEWERkppbM8/unsubscribe.
To unsubscribe from this group and all its topics, send an email to bigbluebutton-...@googlegroups.com.

To post to this group, send email to bigblueb...@googlegroups.com.
Visit this group at https://groups.google.com/group/bigbluebutton-dev.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "BigBlueButton-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-...@googlegroups.com.
To post to this group, send email to bigblueb...@googlegroups.com.
Visit this group at https://groups.google.com/group/bigbluebutton-dev.
For more options, visit https://groups.google.com/d/optout.
Reply all
Reply to author
Forward
0 new messages