Rainfall not recorded

[Powerin]

Hi All,

Yesterday weewx (3.5) seems to have missed recording some of the rain that fell during the day. The station (Vantage Pro2) has correctly recorded 20mm but weewx only shows 10.8mm on its webpages and database. Is it possible to get weewx to re-read the correct data from the station or datalogger or do I have to manually change the database?

At the time of the rain event weewx was busy catching up on a few days backlog because I had just re-started it after an un-noticed crash a few days ago. I've looked through the utilities but don't quite know which one might help. Thanks.

Peter

[Andrew Milner]

what did the log say when weewx was restarted until first archive period has passed?

not being funny, but if it took 3 days to discover weewx was not updating are you 100% sure the 20mm you saw on the console was for the same day that you have compared with on reports and database?

what is actually in the database for a) daily summary and b) archive periods

are you using hardware records or weewx software records?

[Powerin]

Hi Andrew, thanks for the reply. Yes the 20mm definitely fell during the 24hrs yesterday as reported by the console (and a manual rain gauge). Weewx was restarted a couple hours before the rain event.

The log shows it failed updating the database for a period of 50mins during the rain. Every 5mins it reported a new failure plus the previous ones. This is the final block of ten for that period:

Nov  3 16:00:16 viking weewx[21343]: manager: unable to add record 2019-11-03 15:15:00 AEDT (1572754500) to database 'weewx.sdb': UNIQUE constraint failed: archive.dateTime
Nov  3 16:00:16 viking weewx[21343]: manager: unable to add record 2019-11-03 15:20:00 AEDT (1572754800) to database 'weewx.sdb': UNIQUE constraint failed: archive.dateTime
Nov  3 16:00:16 viking weewx[21343]: manager: unable to add record 2019-11-03 15:25:00 AEDT (1572755100) to database 'weewx.sdb': UNIQUE constraint failed: archive.dateTime
Nov  3 16:00:16 viking weewx[21343]: manager: unable to add record 2019-11-03 15:30:00 AEDT (1572755400) to database 'weewx.sdb': UNIQUE constraint failed: archive.dateTime
Nov  3 16:00:16 viking weewx[21343]: manager: unable to add record 2019-11-03 15:35:00 AEDT (1572755700) to database 'weewx.sdb': UNIQUE constraint failed: archive.dateTime
Nov  3 16:00:16 viking weewx[21343]: manager: unable to add record 2019-11-03 15:40:00 AEDT (1572756000) to database 'weewx.sdb': UNIQUE constraint failed: archive.dateTime
Nov  3 16:00:16 viking weewx[21343]: manager: unable to add record 2019-11-03 15:45:00 AEDT (1572756300) to database 'weewx.sdb': UNIQUE constraint failed: archive.dateTime
Nov  3 16:00:16 viking weewx[21343]: manager: unable to add record 2019-11-03 15:50:00 AEDT (1572756600) to database 'weewx.sdb': UNIQUE constraint failed: archive.dateTime
Nov  3 16:00:16 viking weewx[21343]: manager: unable to add record 2019-11-03 15:55:00 AEDT (1572756900) to database 'weewx.sdb': UNIQUE constraint failed: archive.dateTime
Nov  3 16:00:16 viking weewx[21343]: manager: unable to add record 2019-11-03 16:00:00 AEDT (1572757200) to database 'weewx.sdb': UNIQUE constraint failed: archive.dateTime

After this it seems to continue OK:

Nov  3 16:10:16 viking weewx[21343]: manager: added record 2019-11-03 16:10:00 AEDT (1572757800) to database 'weewx.sdb'
Nov  3 16:10:16 viking weewx[21343]: manager: added record 2019-11-03 16:10:00 AEDT (1572757800) to daily summary in 'weewx.sdb'

I don't have the tools at the moment to browse the database directly but "Yesterday's" rainfall, the "weekly" and "monthly" web page, the NOAA monthy summary and a custom local PHP page that queries the database directly all show incorrect rainfall. The PHP page reports hourly obs and there is no rainfall for the hour at 1500 but there is for 1400 and 1600. So I assume the database doesn't have the data.

The main thing I want to know is if I can ask weewx to restore the data for me from the station. Accurate rainfall records are important for a farmer :-)

[Andrew Milner]

Just seeing a small bit of log is not very helpful!!

The constraint failure at 1600 when trying to add records from 1515 onwrds means there is already a record in the database for 1515 (and 1520 and 1525 etc)

without seeing more log it is impossible to know what happened, when data was written, when weewx was restarted and so on.

If the data is still in the station the simplest thing to do is probably stop weewx, backup the database, delete all archive records > say 1400, restart weewx and it should recover from the logger.  To recreate NOAA correctly you will need to delete the appropriate NOAA file(s) and weewx will recreate them on the next report cycle.

[Powerin]

Well I'm not sure what you want to see. But if you want, literally, the several thousand lines of updating Wunderground and WOW records:

Nov  3 16:07:56 viking weewx[21343]: restx: Wunderground-PWS: Published record 2019-11-01 19:50:00 AEDT (1572598200)
Nov  3 16:07:56 viking weewx[21343]: restx: WOW: Published record 2019-10-28 17:55:00 AEDT (1572245700)

which surround that "small bit" with no other errors that I can see, I'm happy to oblige. I'm really not concerned with the cause, it seems to have recovered and is successfully recording rainfall from the station as I write this. It hasn't happened before in the 4 years I've been running weewx.  I just haven't got time at the moment to re-learn the weewx database structure and how to edit it (or read all the docs again) so I was hoping weewx could recover the data for me. Weewx is so reliable that I haven't had to touch it in a couple years so honestly I've forgotten how it all works. In the meantime you've given me some clues to recover the data, for which I thank you.