Crash reading from Vantage Pro 2 since v5

[Julian Edwards]

v4 was flawless for me, but since upgrading to v5 (Debian package) the daemon runs for maybe 30 minutes before crashing with this in the log:

Jan 28 09:08:18 jeeves weewxd[3350596]: INFO weewx.engine: Loading station type Vantage (weewx.drivers.vantage)
Jan 28 09:08:25 jeeves weewxd[3350596]: ERROR weewx.drivers.vantage: ip-read error: timed out
Jan 28 09:08:26 jeeves weewxd[3350596]: ERROR weewx.drivers.vantage: ip-write error: [Errno 32] Broken pipe
Jan 28 09:08:29 jeeves weewxd[3350596]: message repeated 3 times: [ ERROR weewx.drivers.vantage: ip-write error: [Errno 32] Broken pipe]
Jan 28 09:08:30 jeeves weewxd[3350596]: ERROR weewx.drivers.vantage: Unable to wake up Vantage console
Jan 28 09:08:30 jeeves weewxd[3350596]: ERROR weewx.drivers.vantage: ip-write error: [Errno 32] Broken pipe
Jan 28 09:08:34 jeeves weewxd[3350596]: message repeated 3 times: [ ERROR weewx.drivers.vantage: ip-write error: [Errno 32] Broken pipe]
Jan 28 09:08:35 jeeves weewxd[3350596]: ERROR weewx.drivers.vantage: Unable to wake up Vantage console
Jan 28 09:08:35 jeeves weewxd[3350596]: ERROR weewx.drivers.vantage: ip-write error: [Errno 32] Broken pipe
Jan 28 09:08:39 jeeves weewxd[3350596]: message repeated 3 times: [ ERROR weewx.drivers.vantage: ip-write error: [Errno 32] Broken pipe]
Jan 28 09:08:40 jeeves weewxd[3350596]: ERROR weewx.drivers.vantage: Unable to wake up Vantage console
Jan 28 09:08:40 jeeves weewxd[3350596]: ERROR weewx.drivers.vantage: While getting EEPROM data value at address 0x29
Jan 28 09:08:40 jeeves weewxd[3350596]: ERROR weewx.engine: Import of driver failed: While getting EEPROM data value at address 0x29 (<class 'weewx.RetriesExceeded'>)
Jan 28 09:08:40 jeeves weewxd[3350596]: CRITICAL weewx.engine:     ****  Traceback (most recent call last):
Jan 28 09:08:40 jeeves weewxd[3350596]: CRITICAL weewx.engine:     ****    File "/usr/share/weewx/weewx/engine.py", line 115, in setupStation
Jan 28 09:08:40 jeeves weewxd[3350596]: CRITICAL weewx.engine:     ****      self.console = loader_function(config_dict, self)
Jan 28 09:08:40 jeeves weewxd[3350596]: CRITICAL weewx.engine:     ****    File "/usr/share/weewx/weewx/drivers/vantage.py", line 32, in loader
Jan 28 09:08:40 jeeves weewxd[3350596]: CRITICAL weewx.engine:     ****      return VantageService(engine, config_dict)
Jan 28 09:08:40 jeeves weewxd[3350596]: CRITICAL weewx.engine:     ****    File "/usr/share/weewx/weewx/drivers/vantage.py", line 2046, in __init__
Jan 28 09:08:40 jeeves weewxd[3350596]: CRITICAL weewx.engine:     ****      Vantage.__init__(self, **config_dict[DRIVER_NAME])
Jan 28 09:08:40 jeeves weewxd[3350596]: CRITICAL weewx.engine:     ****    File "/usr/share/weewx/weewx/drivers/vantage.py", line 539, in __init__
Jan 28 09:08:40 jeeves weewxd[3350596]: CRITICAL weewx.engine:     ****      self._setup()
Jan 28 09:08:40 jeeves weewxd[3350596]: CRITICAL weewx.engine:     ****    File "/usr/share/weewx/weewx/drivers/vantage.py", line 1449, in _setup
Jan 28 09:08:40 jeeves weewxd[3350596]: CRITICAL weewx.engine:     ****      unit_bits              = self._getEEPROM_value(0x29)[0]
Jan 28 09:08:40 jeeves weewxd[3350596]: CRITICAL weewx.engine:     ****    File "/usr/share/weewx/weewx/drivers/vantage.py", line 1523, in _getEEPROM_value
Jan 28 09:08:40 jeeves weewxd[3350596]: CRITICAL weewx.engine:     ****      raise weewx.RetriesExceeded(msg)
Jan 28 09:08:40 jeeves weewxd[3350596]: CRITICAL weewx.engine:     ****  weewx.RetriesExceeded: While getting EEPROM data value at address 0x29
Jan 28 09:08:40 jeeves weewxd[3350596]: CRITICAL __main__: Unable to load driver: While getting EEPROM data value at address 0x29
Jan 28 09:08:40 jeeves weewxd[3350596]: CRITICAL __main__:     ****  Exiting...

[Tom Keffer]

Julian, a couple of questions:

1. These are ip-read and -write errors. What kind of logger are you using? A WeatherLink IP?

2. The log snippet shows code from when the driver is initially loaded, so it is unlikely to run 30 minutes in, unless this is actually a restart. Look farther back in the log and see what triggered the restart.

Most likely this is a network connectivity issue. The only substantive changes in the Vantage driver have been in reading and setting its configuration, particularly retransmitters. 

-tk

--
You received this message because you are subscribed to the Google Groups "weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/c12c28ce-be30-4c3d-a40e-82619a94f357n%40googlegroups.com.

[Julian Edwards]

Hi Tom

1. Yes, it's the Weatherlink IP.

2. The log entries immediately before the ones I pasted are below. I've always seen IP connectivity issues, which I put down to the Weatherlink IP module's idiosyncrasies. When I see these happening I sometimes check to see if I can ping the IP address of the Weatherlink and it always responds, so I don't think there's any underlying network problem (it's all wired as well, there's no Wifi in the way).

Jan 28 09:07:07 jeeves weewxd[3350596]: ERROR weewx.drivers.vantage: ip-read error: timed out
Jan 28 09:07:07 jeeves weewxd[3350596]: ERROR weewx.drivers.vantage: LOOP batch try #1; error: timed out
Jan 28 09:07:08 jeeves weewxd[3350596]: ERROR weewx.drivers.vantage: ip-write error: [Errno 32] Broken pipe
Jan 28 09:07:12 jeeves weewxd[3350596]: message repeated 3 times: [ ERROR weewx.drivers.vantage: ip-write error: [Errno 32] Broken pipe]
Jan 28 09:07:13 jeeves weewxd[3350596]: ERROR weewx.drivers.vantage: Unable to wake up Vantage console
Jan 28 09:07:13 jeeves weewxd[3350596]: ERROR weewx.drivers.vantage: LOOP batch try #2; error: Unable to wake up Vantage console
Jan 28 09:07:13 jeeves weewxd[3350596]: ERROR weewx.drivers.vantage: ip-write error: [Errno 32] Broken pipe
Jan 28 09:07:16 jeeves weewxd[3350596]: message repeated 3 times: [ ERROR weewx.drivers.vantage: ip-write error: [Errno 32] Broken pipe]
Jan 28 09:07:18 jeeves weewxd[3350596]: ERROR weewx.drivers.vantage: Unable to wake up Vantage console
Jan 28 09:07:18 jeeves weewxd[3350596]: ERROR weewx.drivers.vantage: LOOP batch try #3; error: Unable to wake up Vantage console
Jan 28 09:07:18 jeeves weewxd[3350596]: ERROR weewx.drivers.vantage: LOOP max batch errors (3) exceeded.
Jan 28 09:07:18 jeeves weewxd[3350596]: INFO weewx.engine: Main loop exiting. Shutting engine down.
Jan 28 09:07:18 jeeves weewxd[3350596]: INFO weewx.engine: Shutting down StdReport thread
Jan 28 09:07:18 jeeves weewxd[3350596]: ERROR weewx.drivers.vantage: ip-write error: [Errno 32] Broken pipe
Jan 28 09:07:18 jeeves weewxd[3350596]: CRITICAL __main__: Caught WeeWxIOError: LOOP max batch errors (3) exceeded.
Jan 28 09:07:18 jeeves weewxd[3350596]: CRITICAL __main__:     ****  Waiting 60.0 seconds then retrying...
Jan 28 09:08:18 jeeves weewxd[3350596]: INFO __main__: retrying...

The config I am using looks like this:

[Vantage]
   driver = weewx.drivers.vantage
   type = ethernet
   host = <weatherlink IP address redacted>
   tcp_port = 22222
   loop_request = 2

I've added in a systemd config to restart the weexwd if it crashes, but it would be nice to find out what's wrong and perhaps it should just keep retrying forever anyway?

Weirdly it has not crashed out today at all, however.

Thanks

Julian