/var/redis/tmp-???.rdb eating too much disk space

[MauBBB]

Hello,

I've found my BBB drive out of disk space today.

Searching for big directories, I've seen that /var/redis was using >30 GB

-rw-rw----  1 redis redis 2.0M Jan 19 12:06 temp-1002.rdb

-rw-rw----  1 redis redis  23M Jan 17 07:06 temp-1027.rdb

-rw-rw----  1 redis redis 544M Jan 12 12:06 temp-1029.rdb

-rw-rw----  1 redis redis 542M Jan 12 09:06 temp-1030.rdb

-rw-rw----  1 redis redis  95M Jan 16 22:06 temp-1041.rdb

-rw-rw----  1 redis redis 414M Jan 18 22:06 temp-1046.rdb

-rw-rw----  1 redis redis 545M Jan 18 23:06 temp-1049.rdb

-rw-rw----  1 redis redis 242M Jan 14 07:06 temp-1054.rdb

-rw-rw----  1 redis redis 105M Jan 14 14:06 temp-1055.rdb

-rw-rw----  1 redis redis 5.8M Jan 17 01:06 temp-1056.rdb

-rw-rw----  1 redis redis 416M Jan 18 05:06 temp-1057.rdb

-rw-rw----  1 redis redis 109M Jan 14 17:06 temp-1059.rdb

-rw-rw----  1 redis redis 377M Dec  3 20:11 temp-1062.rdb

-rw-rw----  1 redis redis  27M Jan 17 10:06 temp-1063.rdb

-rw-rw----  1 redis redis 506M Jan 13 12:06 temp-1066.rdb

-rw-rw----  1 redis redis 450M Jan 14 11:06 temp-1067.rdb

-rw-rw----  1 redis redis 558M Jan 13 02:06 temp-1069.rdb

-rw-rw----  1 redis redis 509M Jan 19 00:06 temp-1072.rdb

-rw-rw----  1 redis redis 327M Jan 17 09:06 temp-1073.rdb

-rw-rw----  1 redis redis 105M Jan 14 19:06 temp-1074.rdb

-rw-rw----  1 redis redis 227M Jan 19 18:06 temp-1081.rdb

-rw-rw----  1 redis redis 446M Jan 13 01:06 temp-1085.rdb

-rw-rw----  1 redis redis 581M Jan 12 06:06 temp-1086.rdb

-rw-rw----  1 redis redis 282M Jan 18 21:06 temp-1087.rdb

-rw-rw----  1 redis redis  30M Jan 17 16:06 temp-1088.rdb

-rw-rw----  1 redis redis 587M Jan 14 03:06 temp-1091.rdb

-rw-rw----  1 redis redis  44M Jan 18 00:06 temp-1099.rdb

-rw-rw----  1 redis redis 163M Jan 18 02:06 temp-1103.rdb

-rw-rw----  1 redis redis 484M Jan 18 20:06 temp-1104.rdb

-rw-rw----  1 redis redis 542M Jan 13 11:06 temp-1105.rdb

-rw-rw----  1 redis redis 336M Jan 15 00:06 temp-1107.rdb

-rw-rw----  1 redis redis 507M Jan 19 02:06 temp-1108.rdb

-rw-rw----  1 redis redis 492M Jan 18 17:06 temp-1110.rdb

-rw-rw----  1 redis redis 588M Jan 18 14:06 temp-1111.rdb

-rw-rw----  1 redis redis  23M Jan 17 13:06 temp-1112.rdb

-rw-rw----  1 redis redis 108M Jan 13 14:06 temp-1113.rdb

-rw-rw----  1 redis redis 537M Jan 14 12:06 temp-1114.rdb

-rw-rw----  1 redis redis 225M Jan 13 07:06 temp-1115.rdb

-rw-rw----  1 redis redis 549M Jan 18 12:06 temp-1116.rdb

-rw-rw----  1 redis redis 511M Jan 18 04:06 temp-1117.rdb

-rw-rw----  1 redis redis  97M Jan 12 11:06 temp-1119.rdb

-rw-rw----  1 redis redis 388M Jan 15 01:06 temp-1122.rdb

-rw-rw----  1 redis redis 423M Jan 19 04:06 temp-1123.rdb

-rw-rw----  1 redis redis 116M Jan 12 14:06 temp-1124.rdb

-rw-rw----  1 redis redis 453M Jan 18 06:06 temp-1125.rdb

-rw-rw----  1 redis redis 165M Jan 15 07:06 temp-1126.rdb

-rw-rw----  1 redis redis 428M Jan 18 15:06 temp-1127.rdb

-rw-rw----  1 redis redis  99M Jan 19 10:06 temp-1128.rdb

-rw-rw----  1 redis redis 552M Jan 18 11:06 temp-1130.rdb

-rw-rw----  1 redis redis 460M Jan 14 04:06 temp-1131.rdb

-rw-rw----  1 redis redis 442M Jan 15 08:06 temp-1134.rdb

-rw-rw----  1 redis redis 516M Jan 12 20:06 temp-1135.rdb

-rw-rw----  1 redis redis 100M Jan 17 08:06 temp-1138.rdb

-rw-rw----  1 redis redis 384M Jan 17 22:06 temp-1141.rdb

-rw-rw----  1 redis redis 408M Jan 18 01:11 temp-1146.rdb

-rw-rw----  1 redis redis 612M Jan 14 02:06 temp-1148.rdb

-rw-rw----  1 redis redis 478M Jan 18 10:06 temp-1151.rdb

-rw-rw----  1 redis redis 475M Jan 13 05:06 temp-1156.rdb

-rw-rw----  1 redis redis 614M Jan 12 03:06 temp-1158.rdb

-rw-rw----  1 redis redis 106M Jan 14 10:06 temp-1160.rdb

-rw-rw----  1 redis redis 103M Jan 13 18:06 temp-1161.rdb

-rw-rw----  1 redis redis 533M Jan 14 06:06 temp-1162.rdb

-rw-rw----  1 redis redis  29M Jan 17 06:06 temp-1165.rdb

-rw-rw----  1 redis redis 502M Jan 13 08:06 temp-1171.rdb

-rw-rw----  1 redis redis 473M Jan 15 06:06 temp-1178.rdb

-rw-rw----  1 redis redis 198M Jan 16 23:06 temp-1181.rdb

-rw-rw----  1 redis redis 327M Jan 19 05:06 temp-1185.rdb

-rw-rw----  1 redis redis 552M Jan 13 00:06 temp-1207.rdb

-rw-rw----  1 redis redis 460M Jan 13 09:06 temp-1213.rdb

-rw-rw----  1 redis redis 588M Jan 12 21:06 temp-835.rdb

-rw-rw----  1 redis redis 218M Jan 19 14:06 temp-858.rdb

-rw-rw----  1 redis redis 477M Jan 13 04:06 temp-862.rdb

-rw-rw----  1 redis redis 462M Jan 14 23:06 temp-867.rdb

-rw-rw----  1 redis redis 439M Jan 18 16:06 temp-874.rdb

-rw-rw----  1 redis redis 369M Jan 19 07:06 temp-876.rdb

-rw-rw----  1 redis redis 507M Jan 18 13:06 temp-878.rdb

-rw-rw----  1 redis redis 435M Jan 14 09:06 temp-880.rdb

-rw-rw----  1 redis redis  66M Jan 17 04:06 temp-883.rdb

-rw-rw----  1 redis redis 448M Jan 15 03:06 temp-884.rdb

-rw-rw----  1 redis redis 511M Jan 12 08:06 temp-889.rdb

-rw-rw----  1 redis redis 522M Jan 18 09:06 temp-895.rdb

-rw-rw----  1 redis redis 124M Jan 17 23:06 temp-898.rdb

-rw-rw----  1 redis redis 553M Jan 13 03:06 temp-906.rdb

-rw-rw----  1 redis redis 304M Jan 12 07:06 temp-907.rdb

-rw-rw----  1 redis redis 101M Jan 12 02:08 temp-915.rdb

-rw-rw----  1 redis redis 467M Jan 14 08:06 temp-921.rdb

-rw-rw----  1 redis redis 590M Jan 18 08:06 temp-924.rdb

-rw-rw----  1 redis redis 420M Jan 17 03:06 temp-931.rdb

-rw-rw----  1 redis redis  87M Jan 17 18:06 temp-934.rdb

-rw-rw----  1 redis redis  51M Jan 16 21:06 temp-942.rdb

-rw-rw----  1 redis redis  99M Jan 14 21:06 temp-944.rdb

-rw-rw----  1 redis redis  87M Jan 13 21:06 temp-946.rdb

-rw-rw----  1 redis redis  20M Jan 19 09:06 temp-961.rdb

-rw-rw----  1 redis redis 481M Jan 14 00:06 temp-962.rdb

-rw-rw----  1 redis redis 527M Jan 18 03:06 temp-965.rdb

-rw-rw----  1 redis redis 421M Jan 13 23:06 temp-967.rdb

-rw-rw----  1 redis redis 464M Jan 19 06:06 temp-972.rdb

-rw-rw----  1 redis redis 110M Jan 16 20:06 temp-974.rdb

-rw-rw----  1 redis redis 484M Jan 17 14:06 temp-991.rdb

-rw-rw----  1 redis redis  40M Jan 19 11:06 temp-993.rdb

-rw-rw----  1 redis redis 335M Jan 19 01:06 temp-994.rdb

-rw-rw----  1 redis redis 493M Jan 14 05:06 temp-995.rdb

-rw-rw----  1 redis redis  27M Jan 17 11:06 temp-997.rdb

The server is not too busy. May hold 10 to 15 daily meetings.

Any hint on what can I do to stop these files being created ?

Thank you !

[Fred Dixon]

Hi Sergio,

What version of the BigBlueButton server are you running?

Regards,... Fred

--
You received this message because you are subscribed to the Google Groups "bigbluebutton-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-u...@googlegroups.com.
To post to this group, send email to bigbluebu...@googlegroups.com.
Visit this group at http://groups.google.com/group/bigbluebutton-users.
For more options, visit https://groups.google.com/d/optout.

--

BigBlueButton Developer

http://bigbluebutton.org/
http://code.google.com/p/bigbluebutton

BigBlueButton on twitter: @bigbluebutton

[Calvin Walton]

On Mon, 2015-01-19 at 11:31 -0800, MauBBB wrote:
> Hello,
>
> I've found my BBB drive out of disk space today.
>
> Searching for big directories, I've seen that /var/redis was using
> >30 GB

Normally, redis should only create a single "dump" file at
/var/redis/dump.rdb (on BigBlueButton 0.81) or /var/lib/redis/dump.rdb
(on BigBlueButton 0.9)

These "temp" files are created during the dump process, and then
replace the dump file once the writing is complete. If you are
accumulating temp files, that means that the redis process is probably
failing when attempting to save state. Possibly it's run out of
memory? Check your system log to see if the kernel has run the OOM-
killer or if there are other errors, and note that we recommend 4GB or
more ram in the server.

In 0.81 (which you seem to be using) there are some known memory leaks
in the bbb-web component. Depending on your level of usage, you should
probably restart BigBlueButton every month or so.

In the mean time, it should be safe to delete all the temp files. I'd
go through the following steps (all as root):

# bbb-conf --stop

# rm /var/redis/temp-*.rdb

At this point, check to make sure that all recordings have completed
processing (use bbb-record --list20 to verify this). This is because
I'm going to clear the redis db, which holds temporary data for
recordings.

# redis-cli flushall
# redis-cli save
(These should both print "OK")

And finally,
# bbb-conf --start

--
Calvin Walton <calvin...@kepstin.ca>

[MauBBB]

Well, I forgot to mention that I am still using 0.80 in this server, because I couldn't upgrade to Ubuntu 64 bits.

> In 0.81 (which you seem to be using) there are some known memory leaks 
> in the bbb-web component. Depending on your level of usage, you should 
> probably restart BigBlueButton every month or so. 

Actually, I've to restart BBB daily (or even more), as SIP server has issues and participants disappear from the audio conference (they are able to chat and see presentation, though)

> Check your system log to see if the kernel has run the OOM-killer or if there are other errors, and note that we recommend 4GB or more ram in the server. 

Checked. No memory issues (This server has 4GB RAM) 

I am forcing a server upgrade, but requirements for 0.90 are different from 0.81, so this leads me to a question. Is 0.90 production ready ? :)

Thank you for your help !!!

[Fred Dixon]

Hi,

> Well, I forgot to mention that I am still using 0.80 in this server, because I couldn't upgrade to Ubuntu 64 bits.

Wow -- that's quite an old version.

We definitely recommend you setup a Ubuntu 14.04 64-bit server and run 0.9.0-beta.  You'll find it quite solid.  

Regards,... Fred

--

You received this message because you are subscribed to the Google Groups "bigbluebutton-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-u...@googlegroups.com.
To post to this group, send email to bigbluebu...@googlegroups.com.
Visit this group at http://groups.google.com/group/bigbluebutton-users.
For more options, visit https://groups.google.com/d/optout.