How large is your database with how many entries? (mysql / sqlite)

[Pat]

Hi 

during weex data logging I got in ~4 days with every minute ~4500 mysql database entries. The Database is round about 4mb large.

Is this size normal? My friend use also a te923 (tfa nexus) with ~every 3 seconds capture and 7 years of logging and his csv export about 700.000 entries is about 70mb!

br

Pat 

[Thomas Keffer]

Your friend's numbers don't add up. A record every 3 seconds is 10 million records a year (not 700k). They would have to be 7 bytes each to fit in 70 MB.

In any case, my sqlite database is now 10 years old, with a 5 minute archive record. It has about a million records and is about 70 MB big. My antique fit-PC easily handles it.

Switch to a 5 minute archive interval and you'll be happier.

-tk

--
You received this message because you are subscribed to the Google Groups "weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Steve]

Just for numbers,

I've been running Weewx on a RPi using MySQL since November 2013 with a Fine Offset station and 5 minute interval and according to phpMyAdmin:

WeeWx is 52 tables, 229,023 rows, 45.4MB

Archive is 197,971 rows at 41.1MB

[mwall]

remember that your database includes daily summaries, not just the archive records.  a few data points:

8 years of data from vantage pro, including daily summaries uses about 307MB; archive interval is 5 minutes; x86_64

here are a few weewx databases running on arm6.  acurite has been running just under a year, te923 about 3 years, ws1080 almost 4 years, ws23xx about 2 years.  the arm (from circa 2011) runs all 4 with no problems.

-rw-r--r-- 1 root root 10208256 Sep 29 09:10 weewx-acurite.sdb
-rw-r--r-- 1 root root 42141696 Sep 29 09:10 weewx-te923.sdb
-rw-r--r-- 1 root root 51289088 Sep 29 09:10 weewx-ws1080.sdb
-rw-r--r-- 1 root root 35315712 Sep 29 09:10 weewx-ws23xx.sdb

generating reports, on the other hand, is slow on the old arm.

m

[vince]

Mine is 798k records, 34MB gzipped, 150 MB unzipped
Running 5 minute interval, dating back to the end of Nov-2006.

My weewx host is a 5+ year old Seagate Dockstar (ie, a original Pogoplug with half the memory)

[Steve]

Ratio wise, we're reasonably close, well close enough for me even though I have a lot less data. (My figures are for MySQL)

798k / 150MB

229K / 45.4MB

[Pat]

fyi I convertet my 4500 entries mysql db via https://github.com/weewx/weewx/wiki/Transfer from MySQL to sqlite

"Dumping to SQLite"

In mysql there are no daily reports, it contains only the 4500 entries from "archive" table!