aqi_backfill gives error

[Rahul Bedi]

Hi,

I tried running the "aqi_backfill" script which is part of the aqi extension on a weewx 4.1.1 install and get the following error.

Looks like way to pull the config seems to have changes since the time this script was written.

Any ideas?

- Rahul

pi@PrideWeatherStation:/usr/share/weewx $ sudo ./aqi_backfill weewx.conf

Traceback (most recent call last):

  File "./aqi_backfill", line 34, in <module>

    config = weewx.engine.getConfiguration(args.config_file)

AttributeError: 'module' object has no attribute 'getConfiguration'

pi@PrideWeatherStation:/usr/share/weewx $ sudo ./aqi_backfill /etc/weewx/weewx.conf

Traceback (most recent call last):

  File "./aqi_backfill", line 34, in <module>

    config = weewx.engine.getConfiguration(args.config_file)

AttributeError: 'module' object has no attribute 'getConfiguration'

[jonathan koren]

There's a new weewx-aqi release (1.3) https://github.com/jonathankoren/weewx-aqi/releases/tag/v1.3 so make sure you get that. It has some changes that effect aqi_backfill, including the fix for this.

Be aware, aqi_backfill  pretty temperamental.

[Rahul Bedi]

Tried and gives the following message and it hangs:

pi@PrideWeatherStation:/var/lib/weewx $ sudo /usr/share/weewx/aqi_backfill --start_time 1592634016 --end_time 1593670517 /etc/weewx/weewx.conf
Starting backfill from 1592634016 2020-06-20 11:50:16
No handlers could be found for logger "weewx.drivers.wmr200"
Exception in thread Thread-2:

Traceback (most recent call last):

  File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
    self.run()
  File "/usr/share/weewx/weewx/drivers/wmr200.py", line 1229, in run
    _ = self.usb_device.read_device()
  File "/usr/share/weewx/weewx/drivers/wmr200.py", line 259, in read_device
    raise weewx.WeeWxIOError(msg)
WeeWxIOError: read_device() USB Error Reason:[Errno 110] Operation timed out

--
You received this message because you are subscribed to a topic in the Google Groups "weewx-user" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/weewx-user/K6drNzzE5vs/unsubscribe.
To unsubscribe from this group and all its topics, send an email to weewx-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/cc941830-184c-4006-9aff-65071baa3d29o%40googlegroups.com.

[jonathan koren]

It appears that weewx can't talk to whatever device is on your USB. Are you sure you have the WMR 200 configured correctly? Is it plugged in?

These errors aren't even happening in the AQI code.

To unsubscribe from this group and all its topics, send an email to weewx...@googlegroups.com.

[Rahul Bedi]

Yes. Works with no issues outside of the script.

It's not clear to me as to why this script is even trying to talk to the weather station. Shouldn't it be just be moving data from one database to the other ?

To unsubscribe from this group and all its topics, send an email to weewx-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/de4581a0-cfe4-4e4c-b13c-eeba41e209a1o%40googlegroups.com.

[jonathan koren]

It creates a weewx engine.StdEngine to get handles to the databases to query. So no, it does not talk to any devices, but the device is getting opened as part of the engine startup,

I have not seen anything like this with the Vantage driver. Have you tried shutting down weewx before running aqi_backfill?

To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/de4581a0-cfe4-4e4c-b13c-eeba41e209a1o%40googlegroups.com.

[Rahul Bedi]

Sorry for the late reply. I tried running the latest rev with weewx shut and here is where I wound up before it hung.

pi@PrideWeatherStation:/usr/share/weewx $ sudo ./aqi_backfill --start_time 1478193919 --end_time 1592548226 /etc/weewx/weewx.conf
Starting backfill from 1478193919 2016-11-03 22:55:19
No handlers could be found for logger "weewx.manager"
processed 30 days... 1480785900 2016-12-03 22:55:00

Exception in thread Thread-2:
Traceback (most recent call last):
  File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
    self.run()
  File "/usr/share/weewx/weewx/drivers/wmr200.py", line 1229, in run
    _ = self.usb_device.read_device()
  File "/usr/share/weewx/weewx/drivers/wmr200.py", line 259, in read_device
    raise weewx.WeeWxIOError(msg)
WeeWxIOError: read_device() USB Error Reason:[Errno 110] Operation timed out

processed 60 days... 1483377900 2017-01-02 22:55:00
processed 90 days... 1485970200 2017-02-01 23:00:00
processed 120 days... 1488562200 2017-03-03 23:00:00
processed 150 days... 1491154200 2017-04-02 23:00:00
processed 180 days... 1493746200 2017-05-02 23:00:00
processed 210 days... 1496338800 2017-06-01 23:10:00
processed 240 days... 1498930800 2017-07-01 23:10:00
processed 270 days... 1501557600 2017-08-01 08:50:00
processed 300 days... 1504149600 2017-08-31 08:50:00
processed 330 days... 1506741600 2017-09-30 08:50:00
processed 360 days... 1509333600 2017-10-30 08:50:00
processed 390 days... 1511930700 2017-11-29 10:15:00
processed 420 days... 1514522700 2017-12-29 10:15:00
processed 450 days... 1517115900 2018-01-28 10:35:00
processed 480 days... 1519707900 2018-02-27 10:35:00
processed 510 days... 1522300200 2018-03-29 10:40:00
processed 540 days... 1525530600 2018-05-05 20:00:00
processed 570 days... 1528123800 2018-06-04 20:20:00
processed 600 days... 1530717900 2018-07-04 20:55:00
processed 630 days... 1533359100 2018-08-04 10:35:00
processed 660 days... 1535996400 2018-09-03 23:10:00
processed 690 days... 1538488800 2018-10-02 19:30:00
processed 810 days... 1548349800 2019-01-24 22:40:00
processed 900 days... 1555643400 2019-04-19 08:40:00
processed 1050 days... 1568389800 2019-09-13 21:20:00

To unsubscribe from this group and all its topics, send an email to weewx-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/98d1270f-98f5-47f9-924e-b9fc566558eco%40googlegroups.com.

[spam-...@robotmonkeys.net]

i don’t know. WMR 200 is starting the polling thread in the constructor, and it appears to work different from the Vantage device that I have.

Try backfilling in smaller parts, like a year at a time, and try ti keep the jobs under 5 minutes, or whatever your update interval is.