29,838,027 MySQL Rows and the Pi is OK.

Steve

unread,

May 27, 2014, 12:13:35 PM5/27/14

to meas...@googlegroups.com

My MeasureIt database is up to 29,838,027 lines is it a record?

The Raspberry Pi is handling it OK although the MeasureIt home page is a little slow to initially load, but once it does all is ok. Retrieving data via the webpage is ok too. I have the Pi slightly overclocked to 800MHz and it averages 27% CPU usage running my data acquisition needs.

My Raspberry Pi also monitors, logs and uploads my Weather Station data too, although the database for that is small compared to the MeasureIt one. :)

17,544,205 rows of Watts, 12,198,396 rows of temperatures.

Steve

unread,

May 27, 2014, 12:38:22 PM5/27/14

to meas...@googlegroups.com

Thomas,

Do we need so much temperature data? There's only one temperature sensor and that's in the EnviR base station, but to me, it appears that the same temperature value is logged for every sensor that records a watt value?

Regards,

Steve.

Thomas

unread,

May 27, 2014, 1:52:10 PM5/27/14

to meas...@googlegroups.com

Hi Steve,

maybe this is a record... I do not spy out measureit users so I do not know how much datasets are normal ;)

But it is much more than mine so congratulations. It is the record from all users I know the records :D

You are right. I need to do a lot of modifications to speed up measureit. I startet last weekend to rewrite the complete data creation process which will increase the speed and the creation from the graphs to get more options for example to cop are or display multiple datasets...

The progress is 0.2 % from 100 :/

Thomas

unread,

May 27, 2014, 2:07:38 PM5/27/14

to meas...@googlegroups.com

Oh Steve.... you old bug hunter... ;)

you are right. Foreach sensor a temperature entry is created and the cron functions that delete old data does not delete watt entries...

The deletion is fixed with the latest grabber version online.

Replace it and your record is gone :D

The multiple inserts I will fix later. This is not a urgent problem and takes more time to fix

Steve

unread,

May 28, 2014, 9:14:57 AM5/28/14

to meas...@googlegroups.com

New grabber running.

I have mine set to 365 days, I think I have close to 40 days to go before I have a full year, so I didn't really know the temperature data would not have been removed. I just noticed there is a lot of temperature data.