issue: Recording taken from last night not processing?

1,033 views
Skip to first unread message

shawn mckibben

unread,
Sep 14, 2019, 3:01:38 PM9/14/19
to BigBlueButton-dev
I think this is the first this has happened to me. Not sure what to do next. Class was last night, but the recording didnt show this morning as is norm. I ran a rebuild but still isn't working. I'm going to look at it on Monday again, so thought I'd post it in the meantime in case there is something I need to do, or somewhere I need to look at further. Here's what Ive done so far. 

BBB 2.2 r19


/var/bigbluebutton/recording/status/recorded$ ls -l
total 1
-rw-r--r-- 1 bigbluebutton bigbluebutton 0 Aug 19 06:18 46ff343e0688d3f7bccbff21fedb7343532692ca-1566195198656.done
-rw-r--r-- 1 bigbluebutton bigbluebutton 0 Sep 14 01:43 e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029.done



bbb-record --watch --withDesc

very 2.0s: bbb-record --list-recent 1                                                                           Sat Sep 14 18:44:58 2019

Internal MeetingID                                               Time                APVD APVDE RAS Slides Processed            Published
           External MeetingID  Description
------------------------------------------------------  ---------------------------- ---- ----- --- ------ -------------------- ---------
---------  ------------------- -----------
e6af1609dd9ad6d716f470585fe3b6864beed040-1568469679309  Sat Sep 14 14:01:19 UTC 2019  X    XX X          0
           7476fddfbae4579638b54d1a91af41d2938226a2
e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029  Fri Sep 13 22:07:33 UTC 2019 XX       X X X      0
           7476fddfbae4579638b54d1a91af41d2938226a2
46ff343e0688d3f7bccbff21fedb7343532692ca-1568338695636  Fri Sep 13 01:38:15 UTC 2019  X    XX X          0
           a3457cd019d23a6d9f29d3ee94b05f681878931e
46ff343e0688d3f7bccbff21fedb7343532692ca-1568336375897  Fri Sep 13 00:59:35 UTC 2019  X    XX X          0
           a3457cd019d23a6d9f29d3ee94b05f681878931e
--
NEXT                         LEFT    LAST                         PASSED  UNIT                  ACTIVATES
Sat 2019-09-14 18:45:06 UTC  8s left Sat 2019-09-14 18:44:36 UTC  21s ago bbb-record-core.timer bbb-record-core.target

1 timers listed.
--
? bbb-rap-archive-worker.service - BigBlueButton recording and playback archive worker
   Loaded: loaded (/usr/lib/systemd/system/bbb-rap-archive-worker.service; static; vendor preset: enabled)
   Active: inactive (dead) since Sat 2019-09-14 18:44:37 UTC; 21s ago




tail /var/log/bigbluebutton/bbb-rap-worker.log
I, [2019-09-14T18:36:56.095733 #32517]  INFO -- : I, [2019-09-14T18:36:56.094543 #32520]  INFO -- : setting captions dir
I, [2019-09-14T18:36:56.098410 #32517]  INFO -- : Exit status: 0
I, [2019-09-14T18:37:26.048720 #839]  INFO -- : Executing: ruby utils/captions.rb -m e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029
I, [2019-09-14T18:37:26.354679 #839]  INFO -- : I, [2019-09-14T18:37:26.353259 #867]  INFO -- : Setting process dir
I, [2019-09-14T18:37:26.354799 #839]  INFO -- : I, [2019-09-14T18:37:26.353353 #867]  INFO -- : setting captions dir
I, [2019-09-14T18:37:26.357664 #839]  INFO -- : Exit status: 0
I, [2019-09-14T18:37:57.539912 #5195]  INFO -- : Executing: ruby utils/captions.rb -m e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029
I, [2019-09-14T18:37:57.829601 #5195]  INFO -- : I, [2019-09-14T18:37:57.828447 #5200]  INFO -- : Setting process dir
I, [2019-09-14T18:37:57.829699 #5195]  INFO -- : I, [2019-09-14T18:37:57.828515 #5200]  INFO -- : setting captions dir
I, [2019-09-14T18:37:57.832348 #5195]  INFO -- : Exit status: 0


Regards,
Shawn

Fred Dixon

unread,
Sep 15, 2019, 9:18:59 AM9/15/19
to BigBlueButton-dev
Hi Shawn,

Can you do a quick recording test on your server and create a 30 second recording (making sure you click the Start/Stop Record button to start the recording), and confirm that it publishes.

Regards,... Fred

--
You received this message because you are subscribed to the Google Groups "BigBlueButton-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/bigbluebutton-dev/c1a59cb9-4f38-4144-9c02-7352ca4d4d1d%40googlegroups.com.


--
BigBlueButton Developer
@bigbluebutton

shawn mckibben

unread,
Sep 15, 2019, 11:33:37 AM9/15/19
to BigBlueButton-dev

Thanks Fred,

I created a quick on as requested and it published fine. Hmmm..
-S


On Sunday, September 15, 2019 at 8:18:59 AM UTC-5, Fred Dixon wrote:
Hi Shawn,

Can you do a quick recording test on your server and create a 30 second recording (making sure you click the Start/Stop Record button to start the recording), and confirm that it publishes.

Regards,... Fred

To unsubscribe from this group and stop receiving emails from it, send an email to bigblueb...@googlegroups.com.

Fred Dixon

unread,
Sep 15, 2019, 5:23:05 PM9/15/19
to BigBlueButton-dev
Hi Shawn,

If you can locate your recording in the list from 'bbb-record --list', then use the recording ID to look up all the log files associated with the recording, such as

  locate 46ff343e0688d3f7bccbff21fedb7343532692ca-1566195198656

If you then grep for files ending in 'log'

  locate 46ff343e0688d3f7bccbff21fedb7343532692ca-1566195198656 | grep log

then check the log files for any errors in processing.

Also, check that the server has sufficient free disk space to process recordings.


Regards,... Fred


To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/bigbluebutton-dev/c50d830e-2ed9-41a8-873e-dc9ed44585d9%40googlegroups.com.

shawn mckibben

unread,
Sep 15, 2019, 7:48:55 PM9/15/19
to BigBlueButton-dev
Fred,

This is what I see, and when I did the bbb-record --list, at the very bottom, I saw something that Im not sure I should be concerened with or not so I'll paste that in first, then the locate of the log, and tail of the .log

 bbb-rap-sanity-worker.service - BigBlueButton recording and playback sanity check worker
   Loaded: loaded (/usr/lib/systemd/system/bbb-rap-sanity-worker.service; static; vendor preset: enabled)
   Active: inactive (dead) since Sun 2019-09-15 14:53:49 UTC; 8h ago
Condition: start condition failed at Sun 2019-09-15 23:26:47 UTC; 5s ago
           ConditionPathExistsGlob=/var/bigbluebutton/recording/status/archived/*.done was not met
  Process: 23514 ExecStart=/usr/local/bigbluebutton/core/scripts/rap-sanity-worker.rb (code=exited, status=0/SUCCESS)
 Main PID: 23514 (code=exited, status=0/SUCCESS)


locate e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029  | grep log
/var/log/bigbluebutton/archive-e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029.log
/var/log/bigbluebutton/presentation/process-e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029.log

tail /var/log/bigbluebutton/presentation/process-e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029.log
E, [2019-09-14T15:50:26.459548 #26135] ERROR -- : /usr/lib/ruby/2.3.0/fileutils.rb:1498:in `wrap_traverse'
E, [2019-09-14T15:50:26.459596 #26135] ERROR -- : /usr/lib/ruby/2.3.0/fileutils.rb:469:in `copy_entry'
E, [2019-09-14T15:50:26.459642 #26135] ERROR -- : /usr/lib/ruby/2.3.0/fileutils.rb:444:in `block in cp_r'
E, [2019-09-14T15:50:26.459697 #26135] ERROR -- : /usr/lib/ruby/2.3.0/fileutils.rb:1571:in `block in fu_each_src_dest'
E, [2019-09-14T15:50:26.459745 #26135] ERROR -- : /usr/lib/ruby/2.3.0/fileutils.rb:1587:in `fu_each_src_dest0'
E, [2019-09-14T15:50:26.459795 #26135] ERROR -- : /usr/lib/ruby/2.3.0/fileutils.rb:1569:in `fu_each_src_dest'
E, [2019-09-14T15:50:26.459840 #26135] ERROR -- : /usr/lib/ruby/2.3.0/fileutils.rb:443:in `cp_r'
E, [2019-09-14T15:50:26.459898 #26135] ERROR -- : process/presentation.rb:198:in `block in <main>'
E, [2019-09-14T15:50:26.459966 #26135] ERROR -- : process/presentation.rb:153:in `each'
E, [2019-09-14T15:50:26.460026 #26135] ERROR -- : process/presentation.rb:153:in `<main>'




On Sunday, September 15, 2019 at 4:23:05 PM UTC-5, Fred Dixon wrote:
Hi Shawn,

If you can locate your recording in the list from 'bbb-record --list', then use the recording ID to look up all the log files associated with the recording, such as

  locate 46ff343e0688d3f7bccbff21fedb7343532692ca-1566195198656

If you then grep for files ending in 'log'

  locate 46ff343e0688d3f7bccbff21fedb7343532692ca-1566195198656 | grep log

then check the log files for any errors in processing.

Also, check that the server has sufficient free disk space to process recordings.


Regards,... Fred

Fred Dixon

unread,
Sep 15, 2019, 8:17:56 PM9/15/19
to BigBlueButton-dev
Hi Shawn,

We're getting closer.  Can you post the full contents of

   /var/log/bigbluebutton/presentation/process-e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029.log

Regards,... Fred

To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/bigbluebutton-dev/bb96c659-02b5-4388-bc82-ee0767d24fcc%40googlegroups.com.

shawn mckibben

unread,
Sep 15, 2019, 10:19:19 PM9/15/19
to BigBlueButton-dev
Will do, and here you are:


cat process-e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029.log
# Logfile created on 2019-09-14 15:45:13 +0000 by logger.rb/v1.2.7
I, [2019-09-14T15:45:13.988052 #26132]  INFO -- : Processing script captions.rb
I, [2019-09-14T15:45:13.988218 #26132]  INFO -- : Generating closed captions
I, [2019-09-14T15:45:13.988808 #26132]  INFO -- : Executing: utils/gen_webvtt -i /var/bigbluebutton/recording/raw/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029 -o /var/bigbluebutton/captions/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029
I, [2019-09-14T15:45:14.139679 #26132]  INFO -- : INFO:__main__:Reading recording events file
I, [2019-09-14T15:45:14.167742 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantJoinEvent
I, [2019-09-14T15:45:14.167879 #26132]  INFO -- : DEBUG:__main__:Unhandled event: AssignPresenterEvent
I, [2019-09-14T15:45:14.167930 #26132]  INFO -- : DEBUG:__main__:Unhandled event: AssignPresenterEvent
I, [2019-09-14T15:45:14.167979 #26132]  INFO -- : DEBUG:__main__:Unhandled event: AssignPresenterEvent
I, [2019-09-14T15:45:14.168922 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantJoinEvent
I, [2019-09-14T15:45:14.169037 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantJoinEvent
I, [2019-09-14T15:45:14.169121 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantJoinEvent
I, [2019-09-14T15:45:14.169215 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantJoinEvent
I, [2019-09-14T15:45:14.169392 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantJoinEvent
I, [2019-09-14T15:45:14.169491 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantJoinEvent
I, [2019-09-14T15:45:14.169707 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantJoinEvent
I, [2019-09-14T15:45:14.169870 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantLeftEvent
I, [2019-09-14T15:45:14.170661 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantStatusChangeEvent
I, [2019-09-14T15:45:14.174307 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantJoinEvent
I, [2019-09-14T15:45:14.174578 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantLeftEvent
I, [2019-09-14T15:45:14.174677 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantJoinEvent
I, [2019-09-14T15:45:14.175177 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantLeftEvent
I, [2019-09-14T15:45:14.175280 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantJoinEvent
I, [2019-09-14T15:45:14.175874 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantStatusChangeEvent
I, [2019-09-14T15:45:14.175952 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantLeftEvent
I, [2019-09-14T15:45:14.176014 #26132]  INFO -- : DEBUG:__main__:Unhandled event: AssignPresenterEvent
I, [2019-09-14T15:45:14.176065 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantLeftEvent
I, [2019-09-14T15:45:14.176113 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantLeftEvent
I, [2019-09-14T15:45:14.176188 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantLeftEvent
I, [2019-09-14T15:45:14.176336 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantJoinEvent
I, [2019-09-14T15:45:14.176400 #26132]  INFO -- : DEBUG:__main__:Unhandled event: AssignPresenterEvent
I, [2019-09-14T15:45:14.176463 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantJoinEvent
I, [2019-09-14T15:45:14.176543 #26132]  INFO -- : DEBUG:__main__:Unhandled event: AssignPresenterEvent
I, [2019-09-14T15:45:14.176613 #26132]  INFO -- : DEBUG:__main__:Unhandled event: AssignPresenterEvent
I, [2019-09-14T15:45:14.176715 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantLeftEvent
I, [2019-09-14T15:45:14.176774 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantLeftEvent
I, [2019-09-14T15:45:14.176843 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantLeftEvent
I, [2019-09-14T15:45:14.176990 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantLeftEvent
I, [2019-09-14T15:45:14.177640 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantJoinEvent
I, [2019-09-14T15:45:14.177732 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantJoinEvent
I, [2019-09-14T15:45:14.177831 #26132]  INFO -- : DEBUG:__main__:Unhandled event: AssignPresenterEvent
I, [2019-09-14T15:45:14.178037 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantJoinEvent
I, [2019-09-14T15:45:14.178219 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantJoinEvent
I, [2019-09-14T15:45:14.178697 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantJoinEvent
I, [2019-09-14T15:45:14.178878 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantStatusChangeEvent
I, [2019-09-14T15:45:14.178963 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantStatusChangeEvent
I, [2019-09-14T15:45:14.179737 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantStatusChangeEvent
I, [2019-09-14T15:45:14.183272 #26132]  INFO -- : DEBUG:__main__:Unhandled event: AssignPresenterEvent
I, [2019-09-14T15:45:14.183414 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantJoinEvent
I, [2019-09-14T15:45:14.183521 #26132]  INFO -- : DEBUG:__main__:Unhandled event: AssignPresenterEvent
I, [2019-09-14T15:45:14.183952 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantLeftEvent
I, [2019-09-14T15:45:14.184634 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantLeftEvent
I, [2019-09-14T15:45:14.184708 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantJoinEvent
I, [2019-09-14T15:45:14.185277 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantLeftEvent
I, [2019-09-14T15:45:14.185434 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantLeftEvent
I, [2019-09-14T15:45:14.185521 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantJoinEvent
I, [2019-09-14T15:45:14.187214 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantLeftEvent
I, [2019-09-14T15:45:14.188160 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantJoinEvent
I, [2019-09-14T15:45:14.188331 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantLeftEvent
I, [2019-09-14T15:45:14.189623 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantLeftEvent
I, [2019-09-14T15:45:14.189941 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantJoinEvent
I, [2019-09-14T15:45:14.191068 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantJoinEvent
I, [2019-09-14T15:45:14.191456 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantLeftEvent
I, [2019-09-14T15:45:14.191996 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantLeftEvent
I, [2019-09-14T15:45:14.192148 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantJoinEvent
I, [2019-09-14T15:45:14.192883 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantLeftEvent
I, [2019-09-14T15:45:14.193304 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantJoinEvent
I, [2019-09-14T15:45:14.194158 #26132]  INFO -- : DEBUG:__main__:Unhandled event: ParticipantLeftEvent
I, [2019-09-14T15:45:14.194475 #26132]  INFO -- : DEBUG:__main__:Unhandled event: EndAndKickAllEvent
I, [2019-09-14T15:45:14.194808 #26132]  INFO -- : INFO:__main__:Generating caption data from recording events
I, [2019-09-14T15:45:14.194990 #26132]  INFO -- : INFO:__main__:Generated 0 caption stream(s)
I, [2019-09-14T15:45:14.195049 #26132]  INFO -- : INFO:__main__:Writing captions index file to /var/bigbluebutton/captions/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029/captions.json
I, [2019-09-14T15:45:14.209427 #26132]  INFO -- : Exit status: 0
I, [2019-09-14T15:45:14.209805 #26132]  INFO -- : Generating closed captions for API
I, [2019-09-14T15:45:14.564771 #26135]  INFO -- : Processing script presentation.rb
I, [2019-09-14T15:45:14.569663 #26135]  INFO -- : Created inital metadata.xml
I, [2019-09-14T15:45:14.569747 #26135]  INFO -- : AudioProcessor.process: Processing audio...
D, [2019-09-14T15:45:14.639535 #26135] DEBUG -- : EDL Dump:
D, [2019-09-14T15:45:14.639658 #26135] DEBUG -- : ---
D, [2019-09-14T15:45:14.639712 #26135] DEBUG -- :   Timestamp: 0
D, [2019-09-14T15:45:14.639758 #26135] DEBUG -- :   Audio:
D, [2019-09-14T15:45:14.639820 #26135] DEBUG -- :     silence
D, [2019-09-14T15:45:14.639879 #26135] DEBUG -- : ---
D, [2019-09-14T15:45:14.639925 #26135] DEBUG -- :   Timestamp: 10270
D, [2019-09-14T15:45:14.639969 #26135] DEBUG -- :   Audio:
D, [2019-09-14T15:45:14.640020 #26135] DEBUG -- :     /var/bigbluebutton/recording/process/presentation/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029/temp/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029/audio/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029-23682514690.wav at 0
D, [2019-09-14T15:45:14.640077 #26135] DEBUG -- : ---
D, [2019-09-14T15:45:14.640126 #26135] DEBUG -- :   Timestamp: 12961356
D, [2019-09-14T15:45:14.640169 #26135] DEBUG -- :   Audio:
D, [2019-09-14T15:45:14.640213 #26135] DEBUG -- :     silence
I, [2019-09-14T15:45:14.640259 #26135]  INFO -- : Applying recording start stop events:
I, [2019-09-14T15:45:14.649286 #26135]  INFO -- : Getting start and stop rec button events
I, [2019-09-14T15:45:14.649384 #26135]  INFO -- : Getting record status events
I, [2019-09-14T15:45:14.669052 #26135]  INFO -- : Matching record events
D, [2019-09-14T15:45:14.669198 #26135] DEBUG -- : Recording interval: 3390974 to 12908457
D, [2019-09-14T15:45:14.669253 #26135] DEBUG -- : Offset is now 3390974
D, [2019-09-14T15:45:14.669305 #26135] DEBUG -- : Found last event prior to recording start:
D, [2019-09-14T15:45:14.669728 #26135] DEBUG -- : {:timestamp=>10270,
 :audio=>
  {:filename=>
    "/var/bigbluebutton/recording/process/presentation/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029/temp/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029/audio/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029-23682514690.wav",
   :timestamp=>0}}

D, [2019-09-14T15:45:14.669799 #26135] DEBUG -- : Have to trim 3380704
D, [2019-09-14T15:45:14.669852 #26135] DEBUG -- : New event at recording start:
D, [2019-09-14T15:45:14.670197 #26135] DEBUG -- : {:audio=>
  {:filename=>
    "/var/bigbluebutton/recording/process/presentation/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029/temp/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029/audio/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029-23682514690.wav",
   :timestamp=>3380704},
 :timestamp=>0}

D, [2019-09-14T15:45:14.675359 #26135] DEBUG -- : EDL Dump:
D, [2019-09-14T15:45:14.675424 #26135] DEBUG -- : ---
D, [2019-09-14T15:45:14.675484 #26135] DEBUG -- :   Timestamp: 0
D, [2019-09-14T15:45:14.675530 #26135] DEBUG -- :   Audio:
D, [2019-09-14T15:45:14.675576 #26135] DEBUG -- :     /var/bigbluebutton/recording/process/presentation/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029/temp/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029/audio/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029-23682514690.wav at 3380704
D, [2019-09-14T15:45:14.675632 #26135] DEBUG -- : ---
D, [2019-09-14T15:45:14.675680 #26135] DEBUG -- :   Timestamp: 9517483
D, [2019-09-14T15:45:14.675723 #26135] DEBUG -- :   Audio:
D, [2019-09-14T15:45:14.675767 #26135] DEBUG -- :     silence
I, [2019-09-14T15:45:14.675843 #26135]  INFO -- : Pre-processing EDL
I, [2019-09-14T15:45:14.675900 #26135]  INFO -- : Reading source audio information
D, [2019-09-14T15:45:14.675950 #26135] DEBUG -- :   /var/bigbluebutton/recording/process/presentation/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029/temp/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029/audio/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029-23682514690.wav
D, [2019-09-14T15:45:14.776258 #26135] DEBUG -- :     sample rate: , duration: 
W, [2019-09-14T15:45:14.776374 #26135]  WARN -- :     This audio file is corrupt! It will be removed from the output.
I, [2019-09-14T15:45:14.776436 #26135]  INFO -- : Removing corrupt audio files from EDL
D, [2019-09-14T15:45:14.776492 #26135] DEBUG -- : EDL Dump:
D, [2019-09-14T15:45:14.776540 #26135] DEBUG -- : ---
D, [2019-09-14T15:45:14.776588 #26135] DEBUG -- :   Timestamp: 0
D, [2019-09-14T15:45:14.776632 #26135] DEBUG -- :   Audio:
D, [2019-09-14T15:45:14.776723 #26135] DEBUG -- :     silence
D, [2019-09-14T15:45:14.776779 #26135] DEBUG -- : ---
D, [2019-09-14T15:45:14.776828 #26135] DEBUG -- :   Timestamp: 9517483
D, [2019-09-14T15:45:14.776886 #26135] DEBUG -- :   Audio:
D, [2019-09-14T15:45:14.776943 #26135] DEBUG -- :     silence
I, [2019-09-14T15:45:14.776986 #26135]  INFO -- : Generating ffmpeg command
I, [2019-09-14T15:45:14.777032 #26135]  INFO -- :   Generating silence
I, [2019-09-14T15:45:14.777109 #26135]  INFO -- : Running audio processing...
I, [2019-09-14T15:45:14.777180 #26135]  INFO -- : Executing: ffmpeg -y -v warning -nostats -max_error_rate 1.0 -filter_complex aevalsrc=s=48000:c=stereo:exprs=0|0,aformat=sample_fmts=s16:sample_rates=48000:channel_layouts=stereo,atrim=end=9517.483 [out0] ; [out0] anull -c:a flac -f flac /var/bigbluebutton/recording/process/presentation/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029/recording.flac
I, [2019-09-14T15:45:50.776838 #26135]  INFO -- : Exit status: 0
I, [2019-09-14T15:45:50.777005 #26135]  INFO -- : Performing video encode pass 0
I, [2019-09-14T15:45:50.858899 #26135]  INFO -- : Executing: ffmpeg -y -v warning -nostats -max_error_rate 1.0 -i /var/bigbluebutton/recording/process/presentation/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029/recording.flac -c:a libvorbis -q:a 2 -f ogg -passlogfile /var/bigbluebutton/recording/process/presentation/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029/audio /var/bigbluebutton/recording/process/presentation/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029/audio.encode.ogg
I, [2019-09-14T15:47:59.316019 #26135]  INFO -- : Exit status: 0
I, [2019-09-14T15:47:59.316428 #26135]  INFO -- : Performing video encode pass 0
I, [2019-09-14T15:47:59.389204 #26135]  INFO -- : Executing: ffmpeg -y -v warning -nostats -max_error_rate 1.0 -i /var/bigbluebutton/recording/process/presentation/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029/recording.flac -c:a libvorbis -q:a 2 -f webm -passlogfile /var/bigbluebutton/recording/process/presentation/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029/audio /var/bigbluebutton/recording/process/presentation/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029/audio.encode.webm
I, [2019-09-14T15:50:07.988066 #26135]  INFO -- : Exit status: 0
I, [2019-09-14T15:50:07.988257 #26135]  INFO -- : Performing post-processing step 0
I, [2019-09-14T15:50:07.988348 #26135]  INFO -- : Executing: mkclean --quiet /var/bigbluebutton/recording/process/presentation/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029/audio.encode.webm /var/bigbluebutton/recording/process/presentation/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029/audio.pp0.webm
I, [2019-09-14T15:50:13.870430 #26135]  INFO -- : The MinCache element at -1 is not part of profile 'webm', skipping
I, [2019-09-14T15:50:13.870612 #26135]  INFO -- : The TrackTimecodeScale element at -1 is not part of profile 'webm', skipping
I, [2019-09-14T15:50:13.870669 #26135]  INFO -- : The MaxBlockAdditionID element at -1 is not part of profile 'webm', skipping
I, [2019-09-14T15:50:13.870719 #26135]  INFO -- : The CodecDecodeAll element at -1 is not part of profile 'webm', skipping
I, [2019-09-14T15:50:26.257659 #26135]  INFO -- : Exit status: 0
I, [2019-09-14T15:50:26.262969 #26135]  INFO -- : Task: Getting presentations from events
I, [2019-09-14T15:50:26.404559 #26135]  INFO -- : Task: Getting meeting metadata
I, [2019-09-14T15:50:26.458453 #26135]  INFO -- : Created an updated metadata.xml with start_time and end_time
I, [2019-09-14T15:50:26.458583 #26135]  INFO -- : Task: Getting number of pages in presentation
W, [2019-09-14T15:50:26.459138 #26135]  WARN -- : Could not find pdf file for presentation d2d9a672040fbde2a47a10bf6c37b6a4b5ae187f-1568412453106
E, [2019-09-14T15:50:26.459357 #26135] ERROR -- : unknown file type: /var/bigbluebutton/recording/process/presentation/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029/temp/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029/presentation/d2d9a672040fbde2a47a10bf6c37b6a4b5ae187f-1568412453106/thumbnails
E, [2019-09-14T15:50:26.459435 #26135] ERROR -- : /usr/lib/ruby/2.3.0/fileutils.rb:1387:in `copy'
E, [2019-09-14T15:50:26.459498 #26135] ERROR -- : /usr/lib/ruby/2.3.0/fileutils.rb:472:in `block in copy_entry'
E, [2019-09-14T15:50:26.459548 #26135] ERROR -- : /usr/lib/ruby/2.3.0/fileutils.rb:1498:in `wrap_traverse'
E, [2019-09-14T15:50:26.459596 #26135] ERROR -- : /usr/lib/ruby/2.3.0/fileutils.rb:469:in `copy_entry'
E, [2019-09-14T15:50:26.459642 #26135] ERROR -- : /usr/lib/ruby/2.3.0/fileutils.rb:444:in `block in cp_r'
E, [2019-09-14T15:50:26.459697 #26135] ERROR -- : /usr/lib/ruby/2.3.0/fileutils.rb:1571:in `block in fu_each_src_dest'
E, [2019-09-14T15:50:26.459745 #26135] ERROR -- : /usr/lib/ruby/2.3.0/fileutils.rb:1587:in `fu_each_src_dest0'
E, [2019-09-14T15:50:26.459795 #26135] ERROR -- : /usr/lib/ruby/2.3.0/fileutils.rb:1569:in `fu_each_src_dest'
E, [2019-09-14T15:50:26.459840 #26135] ERROR -- : /usr/lib/ruby/2.3.0/fileutils.rb:443:in `cp_r'
E, [2019-09-14T15:50:26.459898 #26135] ERROR -- : process/presentation.rb:198:in `block in <main>'
E, [2019-09-14T15:50:26.459966 #26135] ERROR -- : process/presentation.rb:153:in `each'
E, [2019-09-14T15:50:26.460026 #26135] ERROR -- : process/presentation.rb:153:in `<main>'

On Sunday, September 15, 2019 at 7:17:56 PM UTC-5, Fred Dixon wrote:
Hi Shawn,

We're getting closer.  Can you post the full contents of

   /var/log/bigbluebutton/presentation/process-e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029.log

Regards,... Fred

Chad Pilkey

unread,
Sep 16, 2019, 11:46:17 AM9/16/19
to BigBlueButton-dev
What are the contents of the following directory?

/var/bigbluebutton/recording/process/presentation/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029/temp/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029/presentation/d2d9a672040fbde2a47a10bf6c37b6a4b5ae187f-1568412453106/thumbnails

shawn mckibben

unread,
Sep 16, 2019, 12:16:44 PM9/16/19
to BigBlueButton-dev
Hello Chad!

I don't see a */thumbnails, but it does show /textfiles, and it's empty?

/var/bigbluebutton/recording/process/presentation/e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029/presentation/d2d9a672040fbde2a47a10bf6c37b6a4b5ae187f-1568412453106$ ls
textfiles

Regards,
-S

Henri Urpalainen

unread,
Sep 17, 2019, 4:41:43 AM9/17/19
to BigBlueButton-dev
Hi,

We have same kind of problem with recordings they were not prosessed automatically and when i used rebuild command recording was published without voice. Events.xml file has no audio events only screenshare activation and stopping events.
I managed to repair one meeting using audacity to cut the audio track and add also events to events.xml file for it.

I'm not anymore sure if we had 2.2.18 or 2.2.19 version installed when those records were recorded. 

Henri Urpalainen

sd...@207me.com

unread,
Sep 17, 2019, 7:47:30 AM9/17/19
to bigblueb...@googlegroups.com

Check diskspace,  with  df

 

If you have not set firewall rules, freeswitch.log may be growing from sip hackers and filling up disk drive.

 

Regards,

Stephen

To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/bigbluebutton-dev/505ab260-9dd1-43fe-a7a0-213e529e214e%40googlegroups.com.

Fred Dixon

unread,
Sep 17, 2019, 8:09:22 AM9/17/19
to BigBlueButton-dev

shawn mckibben

unread,
Sep 17, 2019, 10:09:29 AM9/17/19
to BigBlueButton-dev
Still haven't been able to get the recording recovered?

Here's my DF:
Filesystem                  1K-blocks     Used Available Use% Mounted on
px7_fpool/subvol-120-disk-0  31457280 21241088  10216192  68% /
none                              492        0       492   0% /dev
tmpfs                        32966808      232  32966576   1% /dev/shm
tmpfs                        32966808   164088  32802720   1% /run
tmpfs                            5120        0      5120   0% /run/lock
tmpfs                        32966808        0  32966808   0% /sys/fs/cgroup
tmpfs                          524288    22072    502216   5% /mnt/mongo-ramdisk
tmpfs                         6593364        0   6593364   0% /run/user/1000

--
You received this message because you are subscribed to the Google Groups "BigBlueButton-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bigblueb...@googlegroups.com.

shawn mckibben

unread,
Sep 18, 2019, 9:53:17 AM9/18/19
to BigBlueButton-dev
Any help is appreciated on this, I still don't have a published file?

Regards,
Shawn

Henri Urpalainen

unread,
Sep 18, 2019, 10:09:14 AM9/18/19
to BigBlueButton-dev
Hi,

How your meetings events.xml looks like? Mine was corrupt when meetings was not published.

Henri Urpalainen

shawn mckibben

unread,
Sep 18, 2019, 4:39:00 PM9/18/19
to BigBlueButton-dev
This is what I'm showing for Friday's class recording in /raw. Not sure which one is which, there is only one class taught on Friday? But each have an events.xml file and looks good. **bashes head on desk**

/var/bigbluebutton/recording/raw ls
Sep 13 01:05 46ff343e0688d3f7bccbff21fedb7343532692ca-1568336375897
Sep 13 01:43 46ff343e0688d3f7bccbff21fedb7343532692ca-1568338695636
Sep 14 01:45 e6af1609dd9ad6d716f470585fe3b6864beed040-1568412453029
Sep 14 14:06 e6af1609dd9ad6d716f470585fe3b6864beed040-1568469679309

Richard Alam

unread,
Sep 18, 2019, 7:37:20 PM9/18/19
to BigBlueButton-dev
Maybe FreeSWITCH crashed and the connection between akka-fsesl and FSESL is broken. We ran into this issue which causes missing audio, cannot mute/unmute, because ESL commands cannot be sent to FreeSWITCH.

To confirm, please check if there is a file named 'core' in /opt/freeswitch directory and that it happened around the time you have issue with recording.
To double confirm, check if there is an exception in /var/log/bbb-fsesl-akka/ log for that time.

We are working with FreeSWITCH devs to determine the root cause and develop a fix. 

A workaround is to restart bbb-fsesl-akka
  systemctl restart bbb-fsesl-akka

Better yet, write a systemd service script which monitors the presence of the core dump file then rename the core file and restart bbb-fsesl-akka.
We'll ask Calvin to share the script he wrote for this.

Richard


To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/bigbluebutton-dev/4a6bbbd6-8eab-4c8f-b79f-1624bf08b4f6%40googlegroups.com.


--

shawn mckibben

unread,
Sep 18, 2019, 8:17:03 PM9/18/19
to BigBlueButton-dev
Thank you Richard,

I don't have a file named "core" in /opt/freeswitch. hmmm

Search for exceptions found nothing in the log at /var/log/bbb-fsesl-akka

Thanks,

-Shawn



On Wednesday, September 18, 2019 at 6:37:20 PM UTC-5, Richard Alam wrote:
Maybe FreeSWITCH crashed and the connection between akka-fsesl and FSESL is broken. We ran into this issue which causes missing audio, cannot mute/unmute, because ESL commands cannot be sent to FreeSWITCH.

To confirm, please check if there is a file named 'core' in /opt/freeswitch directory and that it happened around the time you have issue with recording.
To double confirm, check if there is an exception in /var/log/bbb-fsesl-akka/ log for that time.

We are working with FreeSWITCH devs to determine the root cause and develop a fix. 

A workaround is to restart bbb-fsesl-akka
  systemctl restart bbb-fsesl-akka

Better yet, write a systemd service script which monitors the presence of the core dump file then rename the core file and restart bbb-fsesl-akka.
We'll ask Calvin to share the script he wrote for this.

Richard


Reply all
Reply to author
Forward
0 new messages