One month later another serious Weewx upload failure

[Peter Dougherty]

Last month (Mar. 22) I was experiencing upload problems to CWOP. Today a similar (worse) problem. Nothing was done to the Pi since the end of last month's troubles. It just stopped uploading to both CWOP and WU about an hour ago.

I've tried unplugging the console, restarting the process, restarting the pi and nothing is working. Again. This ran for years without corruption and now twice in a month. What can I do to get it working again, and how on Earth can I get this back to be the reliable device it was for almost four years in a row? Linux is massively out of my comfort zone.

The relevant part of my config file and the last few lines of my log follow:

# WEEWX CONFIGURATION FILE

#

# Copyright (c) 2009-2015 Tom Keffer <tke...@gmail.com>

# See the file LICENSE.txt for your rights.

##############################################################################

# This section is for general configuration information.

# Set to 1 for extra debug info, otherwise comment it out or set to zero

debug = 1

# Root directory of the weewx data file hierarchy for this station

WEEWX_ROOT = /

# How long to wait before timing out a socket (FTP, HTTP) connection

socket_timeout = 20

# Do not modify this. It is used when installing and updating weewx.

version = 3.6.2

##############################################################################

#   This section is for information about the station.

[Station]

    

    # Description of the station location

    location = "West Caldwell, NJ"

    

    # Latitude and longitude in decimal degrees

    latitude = 40.8615

    longitude = -74.2775

    

    # Altitude of the station, with unit it is in. This is downloaded from

    # from the station if the hardware supports it.

    altitude = 261, foot

    

    # Set to type of station hardware. There must be a corresponding stanza

    # in this file with a 'driver' parameter indicating the driver to be used.

    station_type = Vantage

    

    # If you have a website, you may specify an URL

    #station_url = http://www.example.com

    

    # The start of the rain year (1=January; 10=October, etc.). This is

    # downloaded from the station if the hardware supports it.

    rain_year_start = 1

    

    # Start of week (0=Monday, 6=Sunday)

    week_start = 6

##############################################################################

[Vantage]

    type = serial

    port = /dev/ttyUSB0

    driver = weewx.drivers.vantage

    

    

    # The time (in seconds) between LOOP packets.

    loop_interval = 2.5

##############################################################################

#   This section is for uploading data to Internet sites

[StdRESTful]

    

    [[StationRegistry]]

        # To register this weather station with weewx, set this to true

        register_this_station = true

    

    [[AWEKAS]]

        # This section is for configuring posts to AWEKAS.

        

        # If you wish to do this, set the option 'enable' to true,

        # and specify a username and password.

        enable = false

        username = replace_me

        password = replace_me

    

    

    [[CWOP]]

        # This section is for configuring posts to CWOP.

        

        # If you wish to do this, set the option 'enable' to true,

        # and specify the station ID (e.g., CW1234).

        enable = true

        station = W2IRT

        post_interval = 300

        log_success = True

        log_failure = True

        server_list = rotate.aprs.net:14580, rotate.aprs2.net:14580, cwop.aprs.net:14580, swop.aprs.net:23

        

        # If this is an APRS (radio amateur) station, uncomment

        # the following and replace with a passcode (e.g., 12345).

        passcode = [removed by me]

    

    

    [[PWSweather]]

        # This section is for configuring posts to PWSweather.com.

        

        # If you wish to do this, set the option 'enable' to true,

        # and specify a station and password.

        enable = true

        station = w2irt

        password = [removed for privacy]

    

    [[WOW]]

        # This section is for configuring posts to WOW.

        

        # If you wish to do this, set the option 'enable' to true,

        # and specify a station and password.

        enable = false

        station = replace_me

        password = replace_me

    

    [[Wunderground]]

        # This section is for configuring posts to the Weather Underground.

        

        # If you wish to do this, set the option 'enable' to true,

        # and specify a station (e.g., 'KORHOODR3') and password.

        enable = true

        station = KNJWESTC2

        password = [removed for privacy]

        

        # Set the following to True to have weewx use the WU "Rapidfire"

        # protocol. Not all hardware can support it. See the User's Guide.

        rapidfire = True

#    [[Twitter]]

#        oauth_token_secret = OAUTH_TOKEN_SECRET

#        oauth_token = OAUTH_TOKEN

#        app_key_secret = APP_KEY_SECRET

#        app_key = APP_KEY

LOG EXCERPT:

r 23 23:11:30 wx weewx[2173]: restx: CWOP: Exception <class 'socket.timeout'> (timed out) when looking for response to login packet

Apr 23 23:11:50 wx weewx[2173]: restx: CWOP: Exception <class 'socket.timeout'> (timed out) when looking for response to packet packet

Apr 23 23:11:50 wx weewx[2173]: restx: CWOP: Published record 2021-04-23 23:10:00 EDT (1619233800)

Apr 23 23:15:16 wx weewx[2173]: vantage: Getting archive packets since 2021-04-23 23:10:00 EDT (1619233800)

Apr 23 23:15:16 wx weewx[2173]: vantage: gentle wake up of console successful

Apr 23 23:15:16 wx weewx[2173]: vantage: Retrieving 1 page(s); starting index= 1

Apr 23 23:15:16 wx weewx[2173]: manager: added record 2021-04-23 23:15:00 EDT (1619234100) to database 'weewx.sdb'

Apr 23 23:15:16 wx weewx[2173]: manager: added record 2021-04-23 23:15:00 EDT (1619234100) to daily summary in 'weewx.sdb'

Apr 23 23:15:16 wx weewx[2173]: vantage: DMPAFT complete: page timestamp 2021-04-15 01:55:00 EDT (1618466100) less than final timestamp 2021-04-23 23:15:00 EDT (1619234100)

Apr 23 23:15:16 wx weewx[2173]: vantage: Catch up complete.

Apr 23 23:15:16 wx weewx[2173]: reportengine: Running reports for latest time in the database.

Apr 23 23:15:16 wx weewx[2173]: vantage: Requesting 200 LOOP packets.

Apr 23 23:15:16 wx weewx[2173]: reportengine: Running report StandardReport

Apr 23 23:15:16 wx weewx[2173]: vantage: gentle wake up of console successful

Apr 23 23:15:16 wx weewx[2173]: reportengine: Found configuration file /etc/weewx/skins/Standard/skin.conf for report StandardReport

Apr 23 23:15:17 wx weewx[2173]: restx: CWOP: Connected to server rotate.aprs.net:14580

Apr 23 23:15:17 wx weewx[2173]: restx: PWSWeather: Published record 2021-04-23 23:15:00 EDT (1619234100)

Apr 23 23:15:17 wx weewx[2173]: cheetahgenerator: using search list ['weewx.cheetahgenerator.Almanac', 'weewx.cheetahgenerator.Station', 'weewx.cheetahgenerator.Stats', 'weewx.cheetahgenerator.UnitInfo', 'weewx.cheetahgenerator.Extras']

Apr 23 23:15:25 wx weewx[2173]: cheetahgenerator: Generated 14 files for report StandardReport in 8.34 seconds

Apr 23 23:15:27 wx weewx[2173]: genimages: Generated 12 images for StandardReport in 1.59 seconds

Apr 23 23:15:27 wx weewx[2173]: reportengine: copied 9 files to /var/www/html/weewx

Apr 23 23:15:27 wx weewx[2173]: reportengine: Running report FTP

Apr 23 23:15:27 wx weewx[2173]: reportengine: Found configuration file /etc/weewx/skins/Ftp/skin.conf for report FTP

Apr 23 23:15:27 wx weewx[2173]: reportengine: FTP upload not requested. Skipped.

Apr 23 23:15:27 wx weewx[2173]: reportengine: Running report RSYNC

Apr 23 23:15:27 wx weewx[2173]: reportengine: Found configuration file /etc/weewx/skins/Rsync/skin.conf for report RSYNC

Apr 23 23:15:27 wx weewx[2173]: reportengine: rsync upload not requested. Skipped.

Apr 23 23:15:37 wx weewx[2173]: restx: CWOP: Exception <class 'socket.timeout'> (timed out) when looking for response to login packet

Apr 23 23:15:57 wx weewx[2173]: restx: CWOP: Exception <class 'socket.timeout'> (timed out) when looking for response to packet packet

Apr 23 23:15:57 wx weewx[2173]: restx: CWOP: Published record 2021-04-23 23:15:00 EDT (1619234100)

[Peter Dougherty]

Sorry, I hit send before completing the post....

After stopping the service again, and invoking the wee_device --dump and  wee_device --clear-memory commands, and then restarting weewx, it started working again. Both CWOP And WU are getting data. And while that's great, it's hinting at a reliability problem that had never existed until last month. Is there anything I can do to solve this permanently and get it back to the way it always was?

Conversely, is there any sort of black-box device or <something> that I can use to just send this info out without needing to play with Linux? I don't want to replace the weather station; the hardware outside is fine, but the the convoluted way it reports to WU and CWOP are a headache I don't want, especially if it's turning into a monthly circus.

[Tom Keffer]

Looking through your raw feed, you certainly have a lot of missing packets. I'm not sure why your site has problems connecting with the APRS servers. Most likely, they are having temporary network or server problems, but I can't say for sure. The CWOP servers seem more reliable.

One suggestion: try running with debug=1 for a while. This will show much more debugging information about the connection attempts.

But, the problems have nothing to do with weewx, and certainly not with your logger --- there was no reason to clear it.

--
You received this message because you are subscribed to the Google Groups "weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/ac756c99-b123-4295-9869-5cac75af885en%40googlegroups.com.