Shortly after upgrading to 4.9.1 I have a weird issue - sending empry data but...?

196 views
Skip to first unread message

Kruse Ludington

unread,
Nov 13, 2022, 3:12:02 AM11/13/22
to weewx-user
I upgrade to 4.9.1 with no issue and am sneding to many places.

A week or so ago i started getting the dreaded error - but for only one location - 

Nov 12 21:56:11 kruse-pi weewx[193904] ERROR weewx.restx: WindGuru: Failed to publish record 2022-11-12 21:55:00 EST (1668308100): Failed upload after 3 tries

I spoke with the WindGuru folks, asked them to check their logs because I am sending data to many other places with Weewx with no issue - and they replied with this:

Hi,
there is no problem with password or connection
but the station still only sends "nothing":

96.240.13.169 [www.windguru.cz](http://www.windguru.cz/) - [08/Nov/2022:16:35:22 +0100] "GET /upload/api.php?stationtype=weewx&uid=9-WeewxID-9&date=08.11.2022&time=10%3A35&interval=5&precip_interval=5 HTTP/1.1" 200 15 "-" "weewx/4.9.1"
96.240.13.169 [www.windguru.cz](http://www.windguru.cz/) - [08/Nov/2022:16:35:27 +0100] "GET /upload/api.php?stationtype=weewx&uid=9-WeewxID-9&date=08.11.2022&time=10%3A35&interval=5&precip_interval=5 HTTP/1.1" 200 15 "-" "weewx/4.9.1"
96.240.13.169 [www.windguru.cz](http://www.windguru.cz/) - [08/Nov/2022:16:35:32 +0100] "GET /upload/api.php?stationtype=weewx&uid=9-WeewxID-9&date=08.11.2022&time=10%3A35&interval=5&precip_interval=5 HTTP/1.1" 200 15 "-" "weewx/4.9.1"
96.240.13.169 [www.windguru.cz](http://www.windguru.cz/) - [08/Nov/2022:16:40:26 +0100] "GET /upload/api.php?stationtype=weewx&uid=9-WeewxID-9&date=08.11.2022&time=10%3A40&interval=5&precip_interval=5 HTTP/1.1" 200 15 "-" "weewx/4.9.1"
96.240.13.169 [www.windguru.cz](http://www.windguru.cz/) - [08/Nov/2022:16:40:31 +0100] "GET /upload/api.php?stationtype=weewx&uid=9-WeewxID-9&date=08.11.2022&time=10%3A40&interval=5&precip_interval=5 HTTP/1.1" 200 15 "-" "weewx/4.9.1"
96.240.13.169 [www.windguru.cz](http://www.windguru.cz/) - [08/Nov/2022:16:40:36 +0100] "GET /upload/api.php?stationtype=weewx&uid=9-WeewxID-9&date=08.11.2022&time=10%3A40&interval=5&precip_interval=5 HTTP/1.1" 200 15 "-" "weewx/4.9.1"

when windguru server receives such request it always replies "error" (because there is no data in it) so weewx retries 3 times

I thanked them and said I would check from my end, so turning on verbose logging and sure enough, all I see is this (response from windguru):

Nov 12 22:00:33 kruse-pi weewx[196599] DEBUG weewx.restx: WindGuru: Failed upload attempt 1: Server response: b'ERROR (no data)'

How do I debug this since I am sending to these places with no issue using the same weewx instance and software?

Nov 12 21:50:25 kruse-pi weewx[193904] INFO weewx.restx: Wunderground-PWS: Published record 2022-11-12 21:50:00 EST (1668307800)
Nov 12 21:50:25 kruse-pi weewx[193904] INFO weewx.restx: Windy: Published record 2022-11-12 21:50:00 EST (1668307800)
Nov 12 21:50:25 kruse-pi weewx[193904] INFO weewx.restx: PWSWeather: Published record 2022-11-12 21:50:00 EST (1668307800)
Nov 12 21:50:25 kruse-pi weewx[193904] INFO weewx.restx: CWOP: Published record 2022-11-12 21:50:00 EST (1668307800)
Nov 12 21:50:25 kruse-pi weewx[193904] INFO weewx.restx: OWM: Published record 2022-11-12 21:50:00 EST (1668307800)
Nov 12 21:50:25 kruse-pi weewx[193904] INFO weewx.restx: AWEKAS: Published record 2022-11-12 21:50:00 EST (1668307800)
Nov 12 21:50:25 kruse-pi weewx[193904] INFO weewx.restx: Meteoservices: Published record 2022-11-12 21:50:00 EST (1668307800)
Nov 12 21:50:25 kruse-pi weewx[193904] INFO weewx.restx: Weather365: Published record 2022-11-12 21:50:00 EST (1668307800)
Nov 12 21:50:25 kruse-pi weewx[193904] INFO weewx.restx: WeatherCloud: Published record 2022-11-12 21:50:00 EST (1668307800)

Tom Keffer

unread,
Nov 13, 2022, 1:19:18 PM11/13/22
to weewx...@googlegroups.com
I would suggest contacting the author of the extension. 

It's worth noting that if you set debug=2, then the actual HTTP GET that WeeWX is sending out will be logged.

--
You received this message because you are subscribed to the Google Groups "weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/3bc613f3-0961-4713-b323-34a9f63a46d2n%40googlegroups.com.

Kruse Ludington

unread,
Nov 14, 2022, 4:49:49 PM11/14/22
to weewx-user
Here's an example of data received every 16 seconds form the AmbientWeather WS-2902C using the Interceptor driver:

Nov 14 11:30:14 kruse-pi homeassistant[821]: #033[32m2022-11-14 11:30:14.951 INFO (MainThread) [aioambient] Received packet MESSAGE data 2["data",{"dateutc":1668443400000,"tempinf":76.3,"humidityin":33,"baromrelin":30.154,"baromabsin":30.281,"tempf":42.3,"battout":1,"humidity":50,"winddir":313,"windspeedmph":6.3,"windgustmph":8.1,"maxdailygust":17.2,"hourlyrainin":0,"eventrainin":0,"dailyrainin":0,"weeklyrainin":0.091,"monthlyrainin":1.701,"totalrainin":15.63,"solarradiation":390.55,"uv":3,"temp1f":69.6,"humidity1":49,"batt1":1,"batt_co2":1,"feelsLike":38.31,"dewPoint":25,"feelsLike1":68.6,"dewPoint1":49.6,"feelsLikein":75.2,"dewPointin":45.1,"lastRain":"2022-11-13T13:35:00.000Z","tz":"America/New_York","date":"2022-11-14T16:30:00.000Z","macAddress":"E8:DB:84:E6:D0:B0"}]#033[0m

And it is going through out to several other services, information  from WindGuru in the logs shows as:

Nov 14 11:27:41 kruse-pi weewx[12402] DEBUG weewx.engine: Loading service user.windguru.WindGuru
Nov 14 11:27:41 kruse-pi weewx[12402] INFO user.windguru: service version is 0.2
Nov 14 11:27:41 kruse-pi weewx[12402] INFO user.windguru: Data will be uploaded for 9-WeewxID-9
Nov 14 11:27:41 kruse-pi weewx[12402] DEBUG weewx.engine: Finished loading service user.windguru.WindGuru
Nov 14 11:30:22 kruse-pi weewx[12402] DEBUG user.windguru: url: http://www.windguru.cz/upload/api.php?stationtype=weewx&uid=9-WeewxID-9&date=14.11.2022&time=11%3A30&interval=5&precip_interval=5
Nov 14 11:30:22 kruse-pi weewx[12402] DEBUG weewx.restx: WindGuru url: 'http://www.windguru.cz/upload/api.php?stationtype=weewx&uid=9-WeewxID-9&date=14.11.2022&time=11%3A30&interval=5&precip_interval=5'
Nov 14 11:30:22 kruse-pi weewx[12402] DEBUG weewx.restx: WindGuru: Failed upload attempt 1: Server response: b'ERROR (no data)'
Nov 14 11:30:27 kruse-pi weewx[12402] DEBUG weewx.restx: WindGuru url: 'http://www.windguru.cz/upload/api.php?stationtype=weewx&uid=9-WeewxID-9&date=14.11.2022&time=11%3A30&interval=5&precip_interval=5'
Nov 14 11:30:28 kruse-pi weewx[12402] DEBUG weewx.restx: WindGuru: Failed upload attempt 2: Server response: b'ERROR (no data)'
Nov 14 11:30:33 kruse-pi weewx[12402] DEBUG weewx.restx: WindGuru url: 'http://www.windguru.cz/upload/api.php?stationtype=weewx&uid=9-WeewxID-9&date=14.11.2022&time=11%3A30&interval=5&precip_interval=5'
Nov 14 11:30:33 kruse-pi weewx[12402] DEBUG weewx.restx: WindGuru: Failed upload attempt 3: Server response: b'ERROR (no data)'
Nov 14 11:30:33 kruse-pi weewx[12402] ERROR weewx.restx: WindGuru: Failed to publish record 2022-11-14 11:30:00 EST (1668443400): Failed upload after 3 tries

Got this from debug set to as you suggested.... I am sending nothing... 

Tom Keffer

unread,
Nov 14, 2022, 5:06:50 PM11/14/22
to weewx...@googlegroups.com
On Mon, Nov 14, 2022 at 8:49 AM Kruse Ludington <rklud...@gmail.com> wrote:
Here's an example of data received every 16 seconds form the AmbientWeather WS-2902C using the Interceptor driver:

Nov 14 11:30:14 kruse-pi homeassistant[821]: #033[32m2022-11-14 11:30:14.951 INFO (MainThread) [aioambient] Received packet MESSAGE data 2["data",{"dateutc":1668443400000,"tempinf":76.3,"humidityin":33,"baromrelin":30.154,"baromabsin":30.281,"tempf":42.3,"battout":1,"humidity":50,"winddir":313,"windspeedmph":6.3,"windgustmph":8.1,"maxdailygust":17.2,"hourlyrainin":0,"eventrainin":0,"dailyrainin":0,"weeklyrainin":0.091,"monthlyrainin":1.701,"totalrainin":15.63,"solarradiation":390.55,"uv":3,"temp1f":69.6,"humidity1":49,"batt1":1,"batt_co2":1,"feelsLike":38.31,"dewPoint":25,"feelsLike1":68.6,"dewPoint1":49.6,"feelsLikein":75.2,"dewPointin":45.1,"lastRain":"2022-11-13T13:35:00.000Z","tz":"America/New_York","date":"2022-11-14T16:30:00.000Z","macAddress":"E8:DB:84:E6:D0:B0"}]#033[0m

None of these observation types are in the normal WeeWX schema. Perhaps the interceptor station map is wrong or inoperative?

I don't have an explanation for why they would work for other upload sites. Perhaps they just don't report an error?

-tk

gjr80

unread,
Nov 14, 2022, 8:30:48 PM11/14/22
to weewx-user
I agree with Tom, the WindGuru uploader is not part of WeeWX so the problem should be taken up with the WindGuru uploader author. But....

It would be worthwhile seeing the full story rather than just a few small extracts. Interceptor based installs can be complex and you can sometimes see some (seemingly) unusual behaviour. Does the WindGuru issue occur every archive record or just occasionally? It would be worthwhile seeing the WeeWX startup and an extended log extract. I would suggest editing weewx.conf and setting debug = 2. Restart WeeWX. Let WeeWX run until at least a couple of WindGuru errors occur. Take a log extract showing the full WeeWX startup sequence, do not alter/filter anything in the log. This will give us a clear picture of your WeeWX config. Also include a log extract showing the WindGuru errors, make sure you include at least two full archive periods before the WindGuru error. Again don't alter/filter anything in the log. With debug = 2, the interceptor driver and multiple uploads the log extract will likely be lengthy, but it will give the full picture as to what is going on.

Gary

Kruse Ludington

unread,
Nov 17, 2022, 2:58:08 AM11/17/22
to weewx-user
I have the fix. I realized that I was actually sending EMPTY messages to ALL of these from WEEWX - WindGuru is THE ONLY SITE that rejects the empty messages of all of the below! LOL

Met WOW
Windy
PWSWeather
Wunderground
WindGuru
Awekas
OWM
Meteoservices
WeatherCloud
Weather365
CWOP

When I originally set up weewx a couple years ago and I had this issue and this was the original fix - I was bummed that my complaints about it had never been addressed. The source code I include in the .zip file below is an older version from Matt I think it was .54b or the like...

Having remembered the issue is an old problem with the interceptor driver - I haven't had the chance to debug it yet but will at some point - in any event, note the attached zip file which has a readme included I wrote which states:

"This is a workaround/fix for an issue with intercepting AmbientWeather
console messages using the Interceptor driver for the WS-2902C model
weather (and possibly similar models):

The latest interceptor integration has a file which I have renamed
interceptor.py.new.bad, a copy is in this .zip file. This ends up
causing all of the data sent to various weather web sites to actually
be an empty message! The older interceptor.py file which is included
here (renamed to interceptor.py.old.good), still works.

Just rename the interceptor.py.old.good file as interceptor.py and
place it in:

"/usr/share/weewx/user"  (that last directory is NOT misspelled)

(You might want to rename the old (newer) interceptor.py that
is already there on your machine first for your comfort level).

Note, there will be several messages in the log about "unrecognized
parameters" when using this driver, but those are the more esoteric
weather station details that are typically not used - and those
messages can be ignored, unless you want to update weewx and the
DB schema to also handle those."

old_interceptor.py_that_works.zip
Reply all
Reply to author
Forward
0 new messages