https://www.wunderground.com/weatherstation/WXDailyHistory.asp?ID=KORHOODR3
but now it's
https://www.wunderground.com/dashboard/pws/KORHOODR3
You used to be able to download a day's worth of data, but now I'm not sure how to do that without screen scraping. Wunderfixer may no longer be possible to do, at least not accurately
-tk
--
You received this message because you are subscribed to the Google Groups "weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/54718d99-b68d-4f34-8213-4786a2578265%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Validation failed: weather_underground is invalid.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/CAPq0zEDFjY2C%3DUt8Tnnx00gZE189-w-mJ%2BcwAaU%2BiCjOEZ5vsQ%40mail.gmail.com.
Reference #30.6f451160.1558531514.16ced4f6
--
You received this message because you are subscribed to the Google Groups "weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/07ac6f86-ae4d-4854-8398-ce4ab8d846c1%40googlegroups.com.
--
You received this message because you are subscribed to the Google Groups "weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/22591326-058f-4717-bdb4-2f91cd099e68%40googlegroups.com.
Hey, Doug,Creating a front end to search your own local data would certainly be doable.For sure, directing end-users to our own sites and letting them search our historical data would be useful.But that wouldn't fix the problem at hand. :-/The wunderfixer utility is there to query what data WU has on record from your station and to re-upload any missing data.Basically if we can't fix this then it means WU will often be missing data from time to time for various reasons.Really only WU should care and end-users who go to their site to look at historical data. So yeah, they should be invented to help, since they're the ones missing the data, and the less reliable their data, the more likely even end-users will begin to abandon using them.
Regards,\Leon--Leon Shaner :: Dearborn, Michigan (iPad Pro)
--Sort of a noob question or maybe a feature request: how about adding a web interface to search the database for historic weather data? I grab the wunderground data that I have uploaded to add to various farm records a few months or even a year after the fact. If WU is getting worse perhaps I need another solution?Thanks,Doug B.
On Tuesday, May 21, 2019 at 11:09:14 AM UTC-7, tds wrote:For the last three days, my daily cron job of wunderfixer have returned "503 Unavaialbe" (May 18), "404 Not Found" (May 19) and "403 Forbidden" (May 20).
You received this message because you are subscribed to the Google Groups "weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to weewx...@googlegroups.com.
--
You received this message because you are subscribed to the Google Groups "weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/DA01E425-B99A-4959-8FB2-B564A61B3E77%40isylum.org.
<wu.txt>
Working from here:Really just doing the "import ssl" and using https in the URL, and adding context=ssl_context to the urllib.request.A snippet of that looks as follows, but still getting 403 forbidden. :-(# For new WU interface which uses SSL and TLSv1.2import ssl..."&month=%d&day=%d&year=%d&format=1" % (self.station, dayRequested_tt[1],dayRequested_tt[2], dayRequested_tt[0])# specify TLSv1.2 and SSLv2, but not SSLv3ssl_context = ssl.SSLContext(ssl.PROTOCOL_TLSv1_2)ssl_context.options |= ssl.PROTOCOL_SSLv23ssl_context.options |= ssl.OP_NO_SSLv3try :# Hit the weather underground site:_wudata = urllib.request.urlopen(_url, context=ssl_context)
Regards,\Leon--Leon Shaner :: Dearborn, Michigan (iPad Pro)
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/DA01E425-B99A-4959-8FB2-B564A61B3E77%40isylum.org.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/FA3780B4-F4CB-4897-9CA5-87557D62DAF7%40isylum.org.
Hey WeeWX'ers!!! =D
To unsubscribe from this group and stop receiving emails from it, send an email to weewx...@googlegroups.com.
<wu.txt>
To unsubscribe from this group and stop receiving emails from it, send an email to weewx...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/07ac6f86-ae4d-4854-8398-ce4ab8d846c1%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to weewx...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/DA01E425-B99A-4959-8FB2-B564A61B3E77%40isylum.org.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to weewx...@googlegroups.com.
To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/49f5ecce-f082-4d64-848c-98e07e3d6349%40googlegroups.com.
To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/db878ac7-8255-4704-9e69-051647ae8f98%40googlegroups.com.
Jarom,
The API Key is generated in the "Member Settings" section of wunderground.com ("My Profile" > "Member Settings" > "API Keys").
I am in contact with IBM. This whole interface is entirely for THEIR benefit.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/36EA4E1E-EEAE-4210-A18E-5024653E6F09%40isylum.org.
Gary
Gary
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/CAA23789-2FE9-4DCA-A2EC-386451439DC4%40isylum.org.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/4F4B3374-A489-4DF2-8E7B-3E2ABD71B676%40isylum.org.
There is no point re-uploading 00:00:00, then 00:01:00, then 00:02:00, because WU is only going to keep 00:00:00, and then later it will keep whatever is closest to 00:05:00. That's been the behavior of wunderfixer vs. WU for as long as I've been working with it, however. :-/
--
You received this message because you are subscribed to the Google Groups "weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/c3476bc2-674f-4928-bf58-55f2150159b2%40googlegroups.com.
Gary,In practice, WU seems to discard data that is not close to their APPARENTly preferred 5-minute "normalization buckets."I upload via rapidfire *and* regular loop on 1-minute intervals, and irregardless of same, the queries only ever show the records most closely aligned to their "preferred" 5-minute "buckets."I would love to see them preserve the same interval that I upload, but either by design or omission or bug, they simply don't. :-(Could be the layers in-between are dropping data by code-exception.Could be it's deliberate.I'm not here to debug their code unless they want to start paying me a worthy salary. ;-)Well... MOST of the time the behavior I have described seems to be true. :-/While WU normally SEEMS to only keeps records on 5-minute boundaries, I have seen where if wunderfixer is used persistently enough (say more than 10 times spread out every 20 minutes across a total span of 200 minutes) then it will keep records that are more frequent than every 5-minutes.Right now / especially lately, things are so sporadic with WU that I don't even want to spend cycles chasing what's really going on there. I would rather just only have wunderfixer ignore most records except those nearest the 5-minute boundaries that WU seems to most care about.
On Monday, 27 May 2019 13:16:53 UTC+10, Leon Shaner wrote:
On Monday, 27 May 2019 13:16:53 UTC+10, Leon Shaner wrote:
[snip]
If you can see any shorter paths to a more reliable outcome than I have achieved so far, then you know know know I will be very grateful. =DI am not sure what local/UTC issue you refer to. When I do a api.weather.com/v2/pws/history query on a station to the east of Greenwich I am returned all records for the date specified (eg 20190525 gives me all records for 25 May 2019), each record contains an epoch timestamp which is correct and consistent with 25 May 2019. Everything is as I would expect. However, when I perform the same query on a station to the west of Greenwich I am returned records for the day before the date specified (ie 20190525 gives me all records for 24 May 2019 not 25 May 2019), again each record contains an epoch timestamp but the timestamp is for the previous day Ie 24 May 2019. I have checked a number of data records in the stations history table and WU is definitely returning the midnight to midnight data for the day before. I have confirmed this behaviour with a number of stations both east and west of Greenwich.I don't think there is a local/UTC time issue, I think WU is having some implementation issues and for stations west of Greenwich they are returning the wrong day of data.
Gary
./wunderfixer --verbose --date=2019-05-29 --epsilon=125
I get
Using configuration file /home/weewx/weewx.conf.
Using database binding 'wx_binding', which is bound to database 'archive_mysql'
Weather Underground Station: xxxxxxx
Date to check: 2019-05-29
Number of archive records: 288
Number of WU records: 97
Number of missing records: 288
Now WU actually has 288 records for 2019-05-29.
But it only has 97 records for 2019-05-30.
So it is clear that wunderfixer is downloading the record data for 2019-05-30 from WeatherUnderground and trying to match them with the local records for 2019-30-29.
Of course, they all mismatch, and so wunderfixer concludes that it must upload all the data for 2019-05-29.
Hope this narrows down the search for a solution.
Rod
--
You received this message because you are subscribed to the Google Groups "weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/683a28af-35e4-474e-95a0-f684b9926af0%40googlegroups.com.
./wunderfixer --verbose --date=2019-05-29 --epsilon=125
Using configuration file /home/weewx/weewx.conf.
Using database binding 'wx_binding', which is bound to database 'archive_mysql'
Weather Underground Station: xxxxx
Date to check: 2019-05-29
Number of archive records: 288
Number of WU records: 288
Number of missing records: 0
[root@moses bin]# ./wunderfixer --verbose --date=2019-05-30 --epsilon=125
Using configuration file /home/weewx/weewx.conf.
Using database binding 'wx_binding', which is bound to database 'archive_mysql'
Weather Underground Station: xxxxxx
Date to check: 2019-05-30
Number of archive records: 128
Number of WU records: 127
Number of missing records: 1
To unsubscribe from this group and stop receiving emails from it, send an email to weewx...@googlegroups.com.
To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/3570f548-caf3-43e8-858d-1b4d8c87d84a%40googlegroups.com.
epoch: 1559210400 date_epoch_local: 2019-05-30 20:00:00 utcepoch: 1559209400 date_epoch_utc: 2019-05-30 10:00:00 tz: Australia/Sydney obsTimeUtc: 2019-05-30T10:00:00Z obsTimeLocal: 2019-05-30 20:00:00
epoch: 1559210700 date_epoch_local: 2019-05-30 20:05:00 utcepoch: 1559209700 date_epoch_utc: 2019-05-30 10:05:00 tz: Australia/Sydney obsTimeUtc: 2019-05-30T10:05:00Z obsTimeLocal: 2019-05-30 20:05:00
Number of WU records: 242
--
You received this message because you are subscribed to the Google Groups "weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/5a44cbcd-8ddd-4a11-a2d0-4fc8cd4d0663%40googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/388426A6-12D0-45FC-AFF2-E6EB532B61DC%40isylum.org.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/184A035F-2BFD-4C43-9584-B84EB083F11F%40isylum.org.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/D30A437D-57EF-46B0-A40F-98A7C1D2D793%40yager.net.au.
If you request information for my station (I’ve sent you the details in a PM), the correct information will be in
- the same day request: if the request is made between 00:00 and 19:59 (at those times, the UTC date is the same as the date where you are )
- the request for the next day: if the request is made between 20:00 and 23:59 (at those times, the UTC date is one day ahead the date where you are)
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/CB045A39-A0D2-415D-B8C2-B741AF0D263B%40isylum.org.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/BD67E5D8-2F65-477A-B7DB-AD0C5B984148%40yager.net.au.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/AB1F8DAE-A13C-4E1A-BA85-EFE4C6E19FF4%40isylum.org.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/8DC2EED8-5147-4D0F-9FDB-A9964E59DCDC%40isylum.org.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/F2BA4631-596B-413C-A1FF-59918A37A339%40yager.net.au.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/9825A07F-F1AD-44EF-9C90-0987BD82751F%40isylum.org.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/D6C1F955-E49C-4AE3-9D91-EFC319B23E56%40yager.net.au.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/466426A5-B6CE-436C-8AA9-1D2DB85B154F%40isylum.org.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/946F4409-E5AB-4310-847C-BE06BD973A03%40yager.net.au.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/C3DEB686-8192-42BC-ACE7-D5FF4F9075DD%40isylum.org.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/3C441E3C-B1C9-4FC4-88BB-6285A9157F46%40isylum.org.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/F16953D6-6EEB-486C-9560-0A5A9F9357E8%40yager.net.au.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/0325F9D5-5216-40B9-B787-3534C7134C3A%40isylum.org.
I've ported wunderfixer to the new WU API. Commit 32c35ce on the development branch.
Unfortunately, it looks like the WU no longer allows re-posting old records, so the utility may no longer be useful. I'd be interested in other people's experience.
Also, as I understand it, there are issues for people living east of Greenwich. I live west, so I wasn't able to check that. Other people's experiences would be welcome.
NB: this is on the development branch. You will have to clone the weewx GitHub repository, then check out the development branch.
-tk
On Jul 18, 2019, at 11:11 AM, Thomas Keffer <tke...@gmail.com> wrote:
--
You received this message because you are subscribed to the Google Groups "weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/641183af-69e7-4c99-bc7d-f8092554194d%40googlegroups.com.
Thanks, Rod! =D
<div style=