Changed weather station and cant get observer to work

[Dan Wheaton]

Hi all.

My WS died, so i have replaced it with a similar model, but for the life of me just cannot get the observer to pick up data.

I am  using DNS spoofing to rtupdate.wunderground.com. Weewx sees the HTTP GET request for data, but isnt doing anytihng with it. I *think* i have to configure a sensor map, but im not 100% certain on that.

Here is the HTTP GET request i am seeing.

ID=XXXX&PASSWORD=XXXX&indoortempf=74.1&indoorhumidity=68&tempf=66.1&humidity=76&dewptf=58.3&windchillf=66.1&absbaromin=29.38&baromin=29.91&windspeedmph=2.0&windgustmph=3.8&winddir=356&windspdmph_avg2m=2.0&winddir_avg2m=74&windgustmph_10m=2.5&windgustdir_10m=83&rainin=0.21&dailyrainin=0.63&weeklyrainin=0.63&monthlyrainin=0.63&solarradiation=77.47&UV=1&dateutc=2022-4-12%205:51:57&action=updateraw&realtime=1&rtfreq=5

TIA!

[Dan Wheaton]

More log info:
syslog:

Apr 12 18:32:39 raspberrypi weewx[1773] DEBUG weewx.engine: Finished loading service weewx.engine.StdCalibrate
Apr 12 18:32:39 raspberrypi weewx[1773] DEBUG weewx.engine: Loading service weewx.engine.StdQC
Apr 12 18:32:39 raspberrypi weewx[1773] DEBUG weewx.engine: Finished loading service weewx.engine.StdQC
Apr 12 18:32:39 raspberrypi weewx[1773] DEBUG weewx.engine: Loading service weewx.wxservices.StdWXCalculate
Apr 12 18:32:39 raspberrypi weewx[1773] INFO weewx.wxservices: StdWXCalculate will use data binding wx_binding
Apr 12 18:32:39 raspberrypi weewx[1773] DEBUG weewx.manager: Daily summary version is 2.0
Apr 12 18:32:39 raspberrypi weewx[1773] INFO weewx.manager: Daily summaries at V2.0. Patching to V4.0
Apr 12 18:32:39 raspberrypi weewx[1773] INFO weewx.manager: recalculate_weights: Using database 'weewx.sdb'
Apr 12 18:32:39 raspberrypi weewx[1773] DEBUG weewx.manager: recalculate_weights: Tranche size 100
Apr 12 18:33:44 raspberrypi weewx[1773] DEBUG user.interceptor: GET: ID=XXXX&PASSWORD=XXXX&indoortempf=73.6&indoorhumidity=64&tempf=63.1&humidity=82&dewptf=57.5&windchillf=63.1&absbaromin=29.39&baromin=29.93&windspeedmph=0.0&windgustmph=0.7&winddir=171&windspdmph_avg2m=0.2&winddir_avg2m=83&windgustmph_10m=0.4&windgustdir_10m=123&rainin=0.0&dailyrainin=0.63&weeklyrainin=0.63&monthlyrainin=0.63&solarradiation=0.0&UV=0&dateutc=2022-4-12%208:10:51&action=updateraw&realtime=1&rtfreq=5&

messages:
Apr 12 18:32:39 raspberrypi weewx[1773] INFO weewx.engine: Loading station type Interceptor (user.interceptor)
Apr 12 18:32:39 raspberrypi weewx[1773] INFO user.interceptor: driver version is 0.53
Apr 12 18:32:39 raspberrypi weewx[1773] INFO user.interceptor: device type: observer
Apr 12 18:32:39 raspberrypi weewx[1773] INFO user.interceptor: mode is listen
Apr 12 18:32:39 raspberrypi weewx[1773] INFO user.interceptor: listen on :80
Apr 12 18:32:39 raspberrypi weewx[1773] INFO user.interceptor: sensor map: {'extraTemp2': 'temperature_2', 'pm2_5': 'pm2_5', 'soilTemp1': 'soil_temperature_1', 'soilTemp2': 'soil_temperature_2', 'soilTemp3': 'soil_temperature_3', 'soilTemp4': 'soil_temperature_4', 'txBatteryStatus': 'battery', 'outTemp': 'temperature_out', 'windSpeed': 'wind_speed', 'windGust': 'wind_gust', 'outHumidity': 'humidity_out', 'windDir': 'wind_dir', 'radiation': 'solar_radiation', 'inTemp': 'temperature_in', 'windGustDir': 'wind_gust_dir', 'barometer': 'barometer', 'windchill': 'windchill', 'dewpoint': 'dewpoint', 'rain': 'rain', 'extraHumid6': 'humidity_6', 'pressure': 'pressure', 'extraHumid4': 'humidity_4', 'extraHumid5': 'humidity_5', 'extraHumid2': 'humidity_2', 'extraHumid3': 'humidity_3', 'extraTemp8': 'temperature_8', 'extraHumid1': 'humidity_1', 'extraTemp6': 'temperature_6', 'extraTemp7': 'temperature_7', 'extraTemp4': 'temperature_4', 'extraTemp5': 'temperature_5', 'rainRate': 'rain_rate', 'extraTemp3': 'temperature_3', 'extraHumid8': 'humidity_8', 'extraTemp1': 'temperature_1', 'leafWet1': 'leafwetness_1', 'leafWet2': 'leafwetness_2', 'extraHumid7': 'humidity_7', 'UV': 'uv', 'soilMoist3': 'soil_moisture_3', 'soilMoist2': 'soil_moisture_2', 'soilMoist1': 'soil_moisture_1', 'inHumidity': 'humidity_in', 'soilMoist4': 'soil_moisture_4'}
Apr 12 18:32:39 raspberrypi weewx[1773] INFO weewx.engine: StdConvert target unit is 0x1
Apr 12 18:32:39 raspberrypi weewx[1773] INFO weewx.wxservices: StdWXCalculate will use data binding wx_binding
Apr 12 18:32:39 raspberrypi weewx[1773] INFO weewx.manager: Daily summaries at V2.0. Patching to V4.0
Apr 12 18:32:39 raspberrypi weewx[1773] INFO weewx.manager: recalculate_weights: Using database 'weewx.sdb'

[Dan Wheaton]

Interceptor config:

[Interceptor]
    # This section is for the network traffic interceptor driver.

    # The driver to use:
    driver = user.interceptor

    # Specify the hardware device to capture.  Options include:
    #   acurite-bridge - acurite internet bridge
    #   observer - fine offset WH2600/HP1000/HP1003, aka 'observer'
    #   lw30x - oregon scientific LW301/LW302
    #   lacrosse-bridge - lacrosse GW1000U/C84612 internet bridge
    device_type = observer

[Dan Wheaton]

Runing interceptor on its own, i get this.

Doesnt seem to matter what device option i use

PYTHONPATH=/usr/share/weewx python /usr/share/weewx/user/interceptor.py --device=observer --mode=listen --port=80 --debug
raw data: ID=ISYDNEY467&PASSWORD=XXXX&indoortempf=73.6&indoorhumidity=64&tempf=63.1&humidity=82&dewptf=57.5&windchillf=63.1&absbaromin=29.39&baromin=29.93&windspeedmph=0.0&windgustmph=0.7&winddir=171&windspdmph_avg2m=0.2&winddir_avg2m=83&windgustmph_10m=0.4&windgustdir_10m=123&rainin=0.0&dailyrainin=0.63&weeklyrainin=0.63&monthlyrainin=0.63&solarradiation=0.0&UV=0&dateutc=2022-4-12%208:10:51&action=updateraw&realtime=1&rtfreq=5&
No handlers could be found for logger "__main__"
raw packet: {}
mapped packet: {}

[Rainer Lang]

Please answer the before asked questions ...

What's your weather station (console) model ?

what's your Raspi model ?

an adaptation of your weewx.conf may be needed.

At first glance I suspect a port issue.

then we can take it from there ....

it is always helpful when you copy the FULL syslog from start up covering at least one better two archive cycle(s), with debug option = 1 set in weewx conf !!!

--
You received this message because you are subscribed to the Google Groups "weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/eada5e4c-321b-46fb-bfa6-75061ac5e0b6n%40googlegroups.com.

[Rainer Lang]

What's your weather station (console) model ?

what's your Raspi model ?

an adaptation of your weewx.conf may be needed.

At first glance I suspect a port issue.

--
You received this message because you are subscribed to the Google Groups "weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/2bd7e563-bd1d-45d9-b531-606101ae5b94n%40googlegroups.com.

[Dan Wheaton]

I got this working on my new instance of weewx.

I was heading in the right direction -- for some reason the request has an addtional & on the end. I used nginx to modify it, and away it went.

[Rainer Lang]

1. The FT-0832 is not a Fine Offset / Ecowitt clone.
2. my understanding is that you use the WU post of the console for reading via the Interceptor driver

If you send your WU posts to WU, station ID Ixxxxxxx, you could catch the traffic in parallel via sniffing mode

your [Interceptor] section should then look like

[Interceptor]
    driver = user.interceptor
    device_type = observer
    mode = sniff
    iface = eth1  #or wlan0 if you use the WLAN port ("WiFi")
    pcap_filter = src weather-station-IP-address and dst port 80

if you use DNS hijack (spoofing), it should look like below, provided your DNS entry is properly set

[Interceptor]
    driver = user.interceptor
    device_type = observer
    port = 80

And, when your Interceptor driver listens at port 888 (syslog !!), it won't catch the traffic sent to port 80
If you redirected your traffic to port 888 (I'd rather choose 8000 and higher, 888 is reserved for other purposes afaik), it should be found by the Interceptor driver

Am 12.04.2022 um 14:45 schrieb Dan Wheaton:

My weather station is "FT-0832" -- I havent been able to work out what its a clone of.

My Pi actually died as part of troubleshooting this, so i have setup a new weewx instance on my NUC, but running inot the same problem.

I *think* the URL is getting truncated, as it ends with an &.

If i bypass weewx, then it all works as expected in wunderground.

Apr 12 22:29:32 homeassistant weewx[2679260]:  * Starting weewx weather system weewx
Apr 12 22:29:33 homeassistant weewx[2679294] INFO __main__: Initializing weewx version 4.7.0
Apr 12 22:29:33 homeassistant weewx[2679294] INFO __main__: Using Python 3.8.10 (default, Mar 15 2022, 12:22:08) #012[GCC 9.4.0]
Apr 12 22:29:33 homeassistant weewx[2679294] INFO __main__: Platform Linux-5.4.0-105-generic-x86_64-with-glibc2.29
Apr 12 22:29:33 homeassistant weewx[2679294] INFO __main__: Locale is 'en_US.UTF-8'
Apr 12 22:29:33 homeassistant weewx[2679294] INFO __main__: Using configuration file /etc/weewx/weewx.conf
Apr 12 22:29:33 homeassistant weewx[2679294] INFO __main__: Debug is 0
Apr 12 22:29:33 homeassistant weewx[2679294] INFO __main__: PID file is /var/run/weewx.pid
Apr 12 22:29:33 homeassistant weewx[2679302] INFO weewx.engine: Loading station type Interceptor (user.interceptor)
Apr 12 22:29:33 homeassistant weewx[2679260]:    ...done.
Apr 12 22:29:33 homeassistant systemd[1]: Started LSB: weewx weather system.
Apr 12 22:29:33 homeassistant weewx[2679302] INFO user.interceptor: driver version is 0.53
Apr 12 22:29:33 homeassistant weewx[2679302] INFO user.interceptor: device type: observer
Apr 12 22:29:33 homeassistant weewx[2679302] INFO user.interceptor: mode is listen
Apr 12 22:29:33 homeassistant weewx[2679302] INFO user.interceptor: listen on :888
Apr 12 22:29:33 homeassistant weewx[2679302] INFO user.interceptor: sensor map: {'pressure': 'pressure', 'barometer': 'barometer', 'outHumidity': 'humidity_out', 'inHumidity': 'humidity_in', 'outTemp': 'temperature_out', 'inTemp': 'temperature_in', 'windSpeed': 'wind_speed', 'windGust': 'wind_gust', 'windDir': 'wind_dir', 'windGustDir': 'wind_gust_dir', 'radiation': 'solar_radiation', 'dewpoint': 'dewpoint', 'windchill': 'windchill', 'rain': 'rain', 'rainRate': 'rain_rate', 'UV': 'uv', 'txBatteryStatus': 'battery', 'extraTemp1': 'temperature_1', 'extraTemp2': 'temperature_2', 'extraTemp3': 'temperature_3', 'extraHumid1': 'humidity_1', 'extraHumid2': 'humidity_2', 'soilTemp1': 'soil_temperature_1', 'soilTemp2': 'soil_temperature_2', 'soilMoist1': 'soil_moisture_1', 'soilMoist2': 'soil_moisture_2', 'soilMoist3': 'soil_moisture_3', 'soilMoist4': 'soil_moisture_4', 'leafWet1': 'leafwetness_1', 'leafWet2': 'leafwetness_2', 'pm2_5': 'pm2_5', 'extraTemp4': 'temperature_4', 'extraTemp5': 'temperature_5', 'extraTemp6': 'temperature_6', 'extraTemp7': 'temperature_7', 'extraTemp8': 'temperature_8', 'extraHumid3': 'humidity_3', 'extraHumid4': 'humidity_4', 'extraHumid5': 'humidity_5', 'extraHumid6': 'humidity_6', 'extraHumid7': 'humidity_7', 'extraHumid8': 'humidity_8', 'soilTemp3': 'soil_temperature_3', 'soilTemp4': 'soil_temperature_4'}
Apr 12 22:29:33 homeassistant weewx[2679302] INFO weewx.engine: StdConvert target unit is 0x1
Apr 12 22:29:33 homeassistant weewx[2679302] INFO weewx.wxservices: StdWXCalculate will use data binding wx_binding
Apr 12 22:29:33 homeassistant weewx[2679302] INFO weewx.engine: Archive will use data binding wx_binding
Apr 12 22:29:33 homeassistant weewx[2679302] INFO weewx.engine: Record generation will be attempted in 'software'
Apr 12 22:29:33 homeassistant weewx[2679302] INFO weewx.engine: Using archive interval of 60 seconds (software record generation)
Apr 12 22:29:33 homeassistant weewx[2679302] INFO weewx.restx: StationRegistry: Registration not requested.
Apr 12 22:29:33 homeassistant weewx[2679302] INFO weewx.restx: Wunderground: Posting not enabled.
Apr 12 22:29:33 homeassistant weewx[2679302] INFO weewx.restx: PWSweather: Posting not enabled.
Apr 12 22:29:33 homeassistant weewx[2679302] INFO weewx.restx: CWOP: Posting not enabled.
Apr 12 22:29:33 homeassistant weewx[2679302] INFO weewx.restx: WOW: Posting not enabled.
Apr 12 22:29:33 homeassistant weewx[2679302] INFO weewx.restx: AWEKAS: Posting not enabled.
Apr 12 22:29:33 homeassistant weewx[2679302] INFO weewx.engine: 'pyephem' not detected, extended almanac data is not available
Apr 12 22:29:33 homeassistant weewx[2679302] INFO __main__: Starting up weewx version 4.7.0
Apr 12 22:29:33 homeassistant weewx[2679302] INFO weewx.engine: Using binding 'wx_binding' to database 'weewx.sdb'
Apr 12 22:29:33 homeassistant weewx[2679302] INFO weewx.manager: Starting backfill of daily summaries
Apr 12 22:29:33 homeassistant weewx[2679302] INFO weewx.manager: Daily summaries up to date
Apr 12 22:29:33 homeassistant weewx[2679302] INFO weewx.engine: Starting main packet loop.
Apr 12 22:29:35 homeassistant weewx[2679302] ERROR user.interceptor: parse failed for ID=xxxx&PASSWORD=xxxx&indoortempf=72.9&indoorhumidity=65&tempf=60.7&humidity=87&dewptf=56.8&windchillf=60.7&absbaromin=29.43&baromin=29.96&windspeedmph=0.2&windgustmph=0.7&winddir=294&windspdmph_avg2m=0.0&winddir_avg2m=237&windgustmph_10m=0.0&windgustdir_10m=216&rainin=0.0&dailyrainin=0.63&weeklyrainin=0.63&monthlyrainin=0.63&solarradiation=0.0&UV=0&dateutc=2022-4-12%2012:29:35&action=updateraw&realtime=1&rtfreq=5&: dictionary update sequence element #27 has length 1; 2 is required

On Tuesday, April 12, 2022 at 10:07:14 PM UTC+10 lang....@googlemail.com wrote:

To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/a35b3724-9880-4dda-9822-6e792d547fe9n%40googlegroups.com.