wee_import PWS station not found.

[Clint Parrish]

I’m having a problem importing records from WU. I have over 11 years of records that I want to combine into my weewx.sdb.

I have entered my nine digit PWS ID into my config file and get the following when I run wee_import:

wee_import --config=/etc/weewx/weewx.conf --import-config=/var/tmp/wu.conf --from=2019-08-29 --to=2019-08-30 --dry-run
Starting wee_import...
Observation history for Weather Underground station 'KILSULLI1' will be imported.
Using database binding 'wx_binding', which is bound to database 'weewx.sdb'
Destination table 'archive' unit system is '0x01' (US).
Missing derived observations will be calculated.
Observations timestamped after 2019-08-29 00:00:00 CDT (1567054800) and up to and
including 2019-08-31 00:00:00 CDT (1567227600) will be imported.
This is a dry run, imported data will not be saved to archive.
Unable to open Weather Underground station KILSULLI1
**** <urlopen error [Errno -2] Name or service not known>
**** Unable to load config file.
**** <urlopen error [Errno -2] Name or service not known>
**** Nothing done, exiting.

Could somebody please help? Thanks!

Clint

[Clint Parrish]

I got a different error. Here is the output. Not sure what changed.

wee_import --import-config=/var/tmp/wu.conf --from=2019-08-29 --to=2019-08-30 --dry-run

Starting wee_import...
Observation history for Weather Underground station 'KILSULLI1' will be imported.
Using database binding 'wx_binding', which is bound to database 'weewx.sdb'
Destination table 'archive' unit system is '0x01' (US).
Missing derived observations will be calculated.
Observations timestamped after 2019-08-29 00:00:00 CDT (1567054800) and up to and
including 2019-08-31 00:00:00 CDT (1567227600) will be imported.
This is a dry run, imported data will not be saved to archive.
Unable to open Weather Underground station KILSULLI1

**** HTTP Error 403: Forbidden

**** Unable to load config file.

**** HTTP Error 403: Forbidden
**** Nothing done, exiting.

[gjr80]

Hi,

The wee_import WU module has not yet been updated to use the new WU API. Give me a few days and I should have the new API incorporated and it should work then.

Gary

[Clint Parrish]

Thanks Gary for looking at this.

[Phil Youngholm]

This is my first time in the forum. Sincere apologies if I've overlooked anything written up in the docs or already posted!

I get the same 403 error message when I try to import.

I have an API key from WU, and I assume WU wants it before it will serve the data, but I can't see anywhere to provide it. The import config file seems to be the logical place (along with station_id) but it's not mentioned in http://www.weewx.com/docs/utilities.htm.

[gjr80]

Hi,

Sorry for the tardy reply. You are doing nothing wrong, the released versions of WeeWX do not support importing from WU since WUs changes earlier this year. I have updated wee_import to import from WU using an API key; however, that change will not be rolled out until WeeWX v4.0 is released. Let me look and see if I can make available a version of wee_import that will work out of the box with WeeWX v3.9.x.

Gary

[Phil Youngholm]

Thanks! I’m not in a hurry, and I’d hate to feel responsible for distracting you from — and delaying — 4.0.

I only have 5 years of data, and I’ve screen-scraped it. This was my primary concern: to have my own copy in case WU decides to disappear it. I can easily wait for 4.0.

[George Anestopoulos]

Hi all, 

I'm new to weewx, I have moved from weatherlink to weewx, but I cannot import my historical data because of the same error. 

Is any Estimate when 4.0 version will come out? 

Is any other way to import my data from weatherlink?

Thanks.

[gjr80]

I have made the necessary changes to the 4.0 release wee_import to fix this issue; however, I still have a few more checks to do before it can be used. Unfortunately other things have limited the time I have had available for wee_import development lately. I will let Tom speak for when 4.0 might be released, though I do have a means by which the 4.0 wee_import utility can be used under an existing 3.x install without interfering with the existing 3.x install. So the release of 4.0 is not the limiting factor here, rather it is me finishing up with wee_import. Should be this week but I can't promise that.

I am not a Weatherlink user so I can't comment on any other means of importing Weatherlink data,

Gary 

[George Anestopoulos]

Hi Gary, 

Thank you for your update. 

I will try to use the 4.0 import utility under the existing 3.0 installation.

Thank you very much .

[gjr80]

George,

Perhaps I have misunderstood you, but if you intend using 4.0 wee_import now I would advise against it as wee_import needs to be verified against some recent changes elsewhere in the 4.0 code base. I will post here the instructions for use of the 4.0 wee_import once I have completed the verification.

Gary

[George Anestopoulos]

Hi Gary, 

No worries. 

I will wait until the release of 4.0 . 

My task is to import all historical Data from WU to my new weewx installation. 

Regards

[Jay Jaeger]

FYI, I am in the same boat with a 403 error during wee_import for WU.  Glad to hear someone is working on it.  As I am currently testing, and have "throw away" data (just running the Simulator at present - my real station continues to run) I'd be happy to give it a whirl.  I don't plan on a real migration until I test my actual weather station (probably next week) - and in any event, not until the new year.

(As an aside, I am really impressed so far with the help I had with a question earlier today and with the general activity level on this forum.  I have been out in the boondocks running the *ancient* meteo software for more than a decade.)

JRJ

[transmorph]

Hey Gary,

Did you end up getting this one finished? I'd be vey happy to give it a whirl on my 3.9.2 installation.

Thanks.

[gjr80]

Sorry but have not yet completed the v4 wee_import code, well actually the code is complete but it’s the verification that is not complete. There has been substantial changes to how wee_import calculates derived obs and I need to make sure this is working properly. On top of that my ‘WeeWX time’ has been somewhat limited of late.

Gary

[transmorph]

No problem Gary. I can wait.

[gjr80]

Given that WeeWX v4 will be released RSN I have held off posting the instructions for using WeeWXv4 wee_import with a WeeWX v3.x install. I realise now that some folks may not be upgrading to WeeWX v4 for various reasons so I have published the instructions here. One thing I forgot to mention in that post is that once WeeWX v4 is released the -b development option can be omitted from the git clone command.

Gary