Migration woes - extension and upload services

[kon...@gmail.com]

Within the past 6 months, I migrated my weewx from 3.9.2 to 4.2.0 on the same hardware for about 5 months, then earlier today I upgraded to weewx 4.4.0 on Rpi 4. 

After the upgrade, I transcribed what I think was the updated entries from the new weewx.conf file in the original 3.9.2 > 4.2.0 file that is now running under 4.4.0

The problem is that now that none of my uploads except for wunderground are working.  I had these uploads working - in fact they say they're working in the log file, shown below, but I never see these entries in the log after initialization, nor do these services (other than WU) get updates.

pwsweather

cwop

awekas

openweathermap

My NOAA report txt files aren't updating either.

Mar 16 21:19:47 weewx weewx[24269]:  * Starting weewx weather system weewx
Mar 16 21:19:47 weewx weewx[24281] INFO __main__: Initializing weewx version 4.4.0
Mar 16 21:19:47 weewx weewx[24281] INFO __main__: Using Python 3.8.6 (default, Jan 27 2021, 15:42:20) #012[GCC 10.2.0]
Mar 16 21:19:47 weewx weewx[24281] INFO __main__: Platform Linux-5.8.0-1016-raspi-aarch64-with-glibc2.32
Mar 16 21:19:47 weewx weewx[24281] INFO __main__: Locale is 'en_CA.UTF-8'
Mar 16 21:19:47 weewx weewx[24281] INFO __main__: PID file is /var/run/weewx.pid
Mar 16 21:19:47 weewx weewx[24269]:    ...done.
Mar 16 21:19:47 weewx weewx[24284] INFO __main__: Using configuration file /etc/weewx/weewx.conf
Mar 16 21:19:47 weewx weewx[24284] INFO __main__: Debug is 0
Mar 16 21:19:47 weewx weewx[24284] INFO weewx.engine: Loading station type Vantage (weewx.drivers.vantage)
Mar 16 21:19:48 weewx weewx[24284] INFO weewx.engine: StdConvert target unit is 0x1
Mar 16 21:19:48 weewx weewx[24284] INFO weewx.engine: Archive will use data binding wx_binding
Mar 16 21:19:48 weewx weewx[24284] INFO weewx.engine: Record generation will be attempted in 'hardware'
Mar 16 21:19:48 weewx weewx[24284] INFO weewx.engine: Using archive interval of 300 seconds (specified by hardware)
Mar 16 21:19:48 weewx weewx[24284] INFO weewx.restx: StationRegistry: Registration not requested.
Mar 16 21:19:48 weewx weewx[24284] INFO weewx.restx: Wunderground-RF: Data for station KTXXXXXX00 will be posted
Mar 16 21:19:48 weewx weewx[24284] INFO weewx.restx: PWSWeather: Data for station MyStation6 will be posted
Mar 16 21:19:48 weewx weewx[24284] INFO weewx.restx: CWOP: Data for station XX1234 will be posted
Mar 16 21:19:48 weewx weewx[24284] INFO weewx.restx: WOW: Posting not enabled.
Mar 16 21:19:48 weewx weewx[24284] INFO weewx.restx: AWEKAS: Data will be uploaded for user ********
Mar 16 21:19:48 weewx weewx[24284] INFO user.owm: service version is 0.9
Mar 16 21:19:48 weewx weewx[24284] INFO user.owm: Data will be uploaded for 031d46c10c59n
Mar 16 21:19:48 weewx weewx[24284] INFO __main__: Starting up weewx version 4.4.0
Mar 16 21:19:48 weewx weewx[24284] INFO weewx.engine: Clock error is 0.73 seconds (positive is fast)
Mar 16 21:19:48 weewx weewx[24284] INFO weewx.engine: Using binding 'wx_binding' to database 'weewx.sdb'
Mar 16 21:19:48 weewx weewx[24284] INFO weewx.manager: Starting backfill of daily summaries
Mar 16 21:19:48 weewx weewx[24284] INFO weewx.manager: Daily summaries up to date
Mar 16 21:19:48 weewx weewx[24284] INFO weewx.engine: Starting main packet loop.
Mar 16 21:19:48 weewx weewx[24284] INFO weewx.restx: Wunderground-RF: Published record 2021-03-16 21:19:49 CDT (1615947589)
Mar 16 21:20:02 weewx weewx[24284] INFO weewx.restx: Wunderground-RF: Published record 2021-03-16 21:20:02 CDT (1615947602)
Mar 16 21:20:14 weewx weewx[24284] INFO weewx.restx: Wunderground-RF: Published record 2021-03-16 21:20:14 CDT (1615947614)
Mar 16 21:20:19 weewx weewx[24284] INFO weewx.cheetahgenerator: Generated 8 files for report SeasonsReport in 2.55 seconds
Mar 16 21:20:19 weewx weewx[24284] INFO weewx.imagegenerator: Generated 15 images for report SeasonsReport in 0.60 seconds
Mar 16 21:20:19 weewx weewx[24284] INFO weewx.reportengine: Copied 5 files to /var/www/html/weewx
Mar 16 21:20:26 weewx weewx[24284] INFO weewx.restx: Wunderground-RF: Published record 2021-03-16 21:20:26 CDT (1615947626)
Mar 16 21:20:30 weewx weewx[24284] INFO weewx.reportengine: ftpgenerator: Ftp'd 28 files in 10.54 seconds

[gjr80]

Hi,

It looks like WeeWX is not getting any archive records from your station (there should have been a log entry at 21:20:15 saving an archive record to database) and that is likely why there are no uploads happening (most uploaders are archive record based). You are using WU rapid fire which is based on loop packets, so it seems WeeWX has connectivity with your station and is receiving loop packets.

If you have been changing hardware it is quite possible you have corrupt station memory, this sometimes happens with Davis stations when changing hardware or power outages occur. One of the symptoms of corrupt station memory is loop packets continue to be received but no archive records can be obtained from the console. I suggest you work through the Corrupt station memory section of the Troubleshooting the Davis station wiki article.

Gary

[kon...@gmail.com]

Thank you.  I'll give this a go and report back in a day or so.

Regards,

Tom K

[kon...@gmail.com]

Well, the restart of the base unit was pretty quick and fixed the upload issue.  Thank you Gary. 

I was also seeing some PNG and other files not being updated, and some other inconsistencies, but I think they've also cleared.  I'll give it all overnight and check it in the morning.

I have a question about the the NOAA txt files - are they not ALL updated at the same time anymore?...or are only those that have changed updated now.  I seem to remember weewx writing ALL the txt files each time, but now it appears that only the current month and current year txt files are being updated.  Is this as designed now?  I guess I'll see after midnight.  :^)

Many thanks and kind regards,

Tom K.

[gjr80]

Good news.

Often the first thing to do when troubleshooting plots is to delete them all, this forces WeeWX to regenerate the lot. Otherwise you are waiting one, three or 24 hours for some to regenerate (Plots that use an aggregate regenerate every aggregate period, so yearly plots which plot a 24 hour aggregate generate every 24 hours. If a plot has no aggregate then they regenerate every report cycle). That way you don't have a mix of (possibly) old and new.

As far back as I can remember NOAA files have always only generated from the most recent NOAA file to current. So on most occasions that is just the current month and current year. However, if you delete all of this years monthly NOAA files on the next report cycle it will generate from January this year through until now (the most recent NOAA monthly file being December last year). Conversely, if you delete last years yearly file or a monthly file from last year they will not be regenerated, you need to delete all files from that year/month to current to force regeneration. Again a useful rule of thumb when you change data in your archive is to delete all NOAA files (year and month) and force WeeWX to regenerate the lot.

Of course the one off price you pay for deleting plots and NOAA files is that the next report cycle will be a bit longer than usual as WeeWX (may) have a lot of plots and/or NOAA files to generate.

Gary