yet another cleaning up bad data question

32 views
Skip to first unread message

vince

unread,
Jun 21, 2019, 7:01:41 PM6/21/19
to weewx-user
In playing with the Belchertown skin, I'm getting a bad result for max alltime days in a row without rain, basically for a couple years at the beginning of my data before I got my VP2.   While my recollection is long gone, my 'guess' is that I previously cleared bad data and did so incorrectly literally years ago.

Question-1:
I notice that all my archive_day_whatever tables have a bad dateTime field ala:
$ echo "select * from archive_day_windchill limit 1"|sqlite3 weewx.sdb
-57600|49.9|301|49.9|301|0.0|0|0.0|0
Yet the archive table is what I'd expect, pointing to my first spinup of wview back in late 2006 (wow).

I can certainly remove the bad records from all the archive_day_* tables via sqlite3, that's not a problem.

Using a test copy:
$ echo "select * from archive_day_windchill where dateTime < 0" | sqlite3 weewx.sdb
-57600|49.9|301|49.9|301|0.0|0|0.0|0
 
$ echo "delete from archive_day_windchill where dateTime < 0" | sqlite3 weewx.sdb
vince@air:fixvp2$ echo "select * from archive_day_windchill where dateTime < 0" | sqlite3 weewx.sdb
# (nothing is found)

Question is will anything bad happen if I just hand-fix the archive_day_xyz tables ?

Or is a more modern approach to use the semi-new --rebuild-daily option with a specified date range (ie, 11/22/2006 to 11/30/2006) to get to the beginning of my data only ?

Question-2:

I know I previously clearing up the insanely wrong rain prior to me getting my VP2 a couple years later.  If I wanted to make it look like I had no rain sensor at all, is the right thing to have the rain and rainRate = 0.00 or '' (ie, NULL) for that time period.   Currently it looks like both fields are null for all records prior to the end of 2008, which matches my hazy recollection of what I tried to do years ago.

In other words, if I want my alltime record for consecutive days without rain to start 2 years after my earliest archive record, how would I hack my legacy archive records to basically say "no rain sensor here dude" for those archive records ?





Reply all
Reply to author
Forward
0 new messages