Responsive Skin and Weewx v4.1.1 generating debug messages

[Susan Mackay]

As part of testing my HP1000 driver under Weewx V4.1.1 and Python 3 (which I know a few people are waiting for) I note that I am getting a number of messages in the system log fro the 'ausearch.py' file which is part of the responsive skin.

Looking at the code, the messages come from 'syslog.syslog(syslog.LOG_DEBUG...' lines. 

I don't remember these lines being generated in the system log before (Weewx V3, Python 2, also upgraded my RPi Zero from Jessie to Buster).

Is there some setting somewhere that is telling the OS that these messages need to be logged?

Susan

PS - for those who care about the HP1000 driver, it all seems to be working at the moment - soak testing continues...

[Greg from Oz]

I am using responsive skin and it works fine.

This is what I am using:

https://github.com/dcapslock/weewx-responsive-skin/blob/master/Aus/aussearch.py

This is my website:

https://weather.ubeaut.work/

I am running:

wewx 4.1.1

Ubuntu 20.04

Python 3

[Susan Mackay]

Greg - the code is working well and that was not what I was saying (apparently not very clearly).

Are you getting a lot of messages in the system log such as:

Sep 17 13:50:18 weather /weewxd[586]: aussearch: feelslikeLocal['DaySummer'] = {-40: 'Cold', 16: 'Cool', 22: 'Mild', 27: 'Warm', 32: 'Hot', 37: 'Very Hot'}

Sep 17 13:50:18 weather /weewxd[586]: aussearch: feelslikeLocal['NightSummer'] = {-40: 'Cold', 10: 'Cool', 15: 'Mild', 18: 'Warm', 22: 'Hot'}

Sep 17 13:50:18 weather /weewxd[586]: aussearch: feelslikeLocal['DayWinter'] = {-40: 'Very Cold', 10: 'Cold', 13: 'Cool', 16: 'Mild', 20: 'Warm'}

Sep 17 13:50:18 weather /weewxd[586]: aussearch: feelslikeLocal['NightWinter'] = {-40: 'Very Cold', 1: 'Cold', 5: 'Cool', 10: 'Mild'}

Sep 17 13:50:19 weather /weewxd[586]: aussearch: check xml file: /var/lib/weewx/aussearch/IDN11060.xml expires 2020-09-17 05:55:00+00:00

Sep 17 13:50:19 weather /weewxd[586]: aussearch: xml: checking cache sent-time va remote amoc sent-time: IDN11060.xml

Sep 17 13:50:19 weather /weewxd[586]: aussearch: xml: /var/lib/weewx/aussearch/IDN11060.xml: sent-time: 2020-09-16T23:12:46Z

Sep 17 13:50:19 weather /weewxd[586]: aussearch: xml: ftp://ftp.bom.gov.au/anon/gen/fwo/IDN11060.amoc.xml: sent-time: 2020-09-16T23:12:46Z

Sep 17 13:50:20 weather /weewxd[586]: aussearch: check xml file: /var/lib/weewx/aussearch/IDV10753.xml expires 2020-09-17 06:10:00+00:00

Sep 17 13:50:20 weather /weewxd[586]: aussearch: xml: checking cache sent-time va remote amoc sent-time: IDV10753.xml

Sep 17 13:50:20 weather /weewxd[586]: aussearch: xml: /var/lib/weewx/aussearch/IDV10753.xml: sent-time: 2020-09-16T19:00:19Z

Sep 17 13:50:20 weather /weewxd[586]: aussearch: xml: ftp://ftp.bom.gov.au/anon/gen/fwo/IDV10753.amoc.xml: sent-time: 2020-09-16T19:00:19Z

Sep 17 13:50:20 weather /weewxd[586]: aussearch: check xml file: /var/lib/weewx/aussearch/IDQ11295.xml expires 2020-09-17 06:15:00+00:00

Sep 17 13:50:21 weather /weewxd[586]: aussearch: xml: checking cache sent-time va remote amoc sent-time: IDQ11295.xml

Sep 17 13:50:22 weather /weewxd[586]: aussearch: xml: /var/lib/weewx/aussearch/IDQ11295.xml: sent-time: 2020-09-16T18:40:09Z

Sep 17 13:50:22 weather /weewxd[586]: aussearch: xml: ftp://ftp.bom.gov.au/anon/gen/fwo/IDQ11295.amoc.xml: sent-time: 2020-09-16T18:40:09Z

Susan

[Ian Prescott]

Hi Susan

I have a RPi 3b, Responsive skin, weewx 4.1.1, python 3 ......here http://therocksweather.ddnsfree.com/

and a grep of syslog gave me a lot of this below, u r not alone ........I have no idea how or why, I am a learner that has received a lot of help to get where I am.

Sep 17 14:35:57 weatherpi /weewxd: aussearch: json file downloaded: http://bom.gov.au/fwo/IDQ60901/IDQ60901.94575.json
Sep 17 14:40:57 weatherpi /weewxd: aussearch: feelslikeLocal['DaySummer'] = {-40: 'Cold', 16: 'Cool', 22: 'Mild', 27: 'Warm', 32: 'Hot', 37: 'Very Hot'}
Sep 17 14:40:57 weatherpi /weewxd: aussearch: feelslikeLocal['NightSummer'] = {-40: 'Cold', 10: 'Cool', 15: 'Mild', 18: 'Warm', 22: 'Hot'}
Sep 17 14:40:57 weatherpi /weewxd: aussearch: feelslikeLocal['DayWinter'] = {-40: 'Very Cold', 10: 'Cold', 13: 'Cool', 16: 'Mild', 20: 'Warm'}
Sep 17 14:40:57 weatherpi /weewxd: aussearch: feelslikeLocal['NightWinter'] = {-40: 'Very Cold', 1: 'Cold', 5: 'Cool', 10: 'Mild'}
Sep 17 14:40:57 weatherpi /weewxd: aussearch: check xml file: /var/lib/weewx/aussearch/IDQ11295.xml expires 2020-09-17 06:15:00+00:00
Sep 17 14:40:57 weatherpi /weewxd: aussearch: xml: checking cache sent-time va remote amoc sent-time: IDQ11295.xml
Sep 17 14:40:58 weatherpi /weewxd: aussearch: xml: /var/lib/weewx/aussearch/IDQ11295.xml: sent-time: 2020-09-16T18:40:09Z
Sep 17 14:40:58 weatherpi /weewxd: aussearch: xml: ftp://ftp.bom.gov.au/anon/gen/fwo/IDQ11295.amoc.xml: sent-time: 2020-09-16T18:40:09Z
Sep 17 14:40:58 weatherpi /weewxd: aussearch: check xml file: /var/lib/weewx/aussearch/IDQ10090.xml expires 2020-09-17 06:20:00+00:00
Sep 17 14:40:58 weatherpi /weewxd: aussearch: xml: checking cache sent-time va remote amoc sent-time: IDQ10090.xml
Sep 17 14:40:59 weatherpi /weewxd: aussearch: xml: /var/lib/weewx/aussearch/IDQ10090.xml: sent-time: 2020-09-16T19:00:03Z
Sep 17 14:40:59 weatherpi /weewxd: aussearch: xml: ftp://ftp.bom.gov.au/anon/gen/fwo/IDQ10090.amoc.xml: sent-time: 2020-09-16T19:00:03Z
Sep 17 14:41:00 weatherpi /weewxd: aussearch: xml file downloaded: http://www.bom.gov.au/fwo/IDZ00056.warnings_qld.xml
Sep 17 14:41:00 weatherpi /weewxd: aussearch: check json file: /var/lib/weewx/aussearch/IDQ60901.94575.json expires 2020-09-17 05:05:00+00:00

--
You received this message because you are subscribed to the Google Groups "weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/97ba92f6-8243-46e6-8e56-4b56354d0a4do%40googlegroups.com.

[Greg from Oz]

I looked at the code and it looks like it is all hard coded in there:

            syslog.syslog(syslog.LOG_DEBUG, "aussearch: feelslikeLocal['DaySummer'] = %s" % (pprint.pformat(self.feelslikeLocal['DaySummer'])))

So my guess would be you could comment the log entries out.

[gjr80]

Looks like standard debug output code to me, albeit using the old syslog module rather than the logging module. debug = 0 in weewx.conf should turn it off.

Gary

[Greg from Oz]

I have debug = 0 and the output is still going to syslog.

[Greg from Oz]

The logging has /weewxd and not weewx like the rest of the logs:

Sep 17 19:21:12 jed164 /weewxd: aussearch: check json file: /var/lib/weewx/aussearch/IDN60801.94746.json expires 2020-09-17 09:35:00+00:00

Sep 17 19:21:13 jed164 /weewxd: historygenerator.py: Generated 6 tables in 0.52 seconds

Sep 17 19:21:13 jed164 weewx[292601] INFO weewx.cheetahgenerator: Generated 13 files for report StandardReport in 2.05 seconds

Sep 17 19:21:14 jed164 weewx[292601] INFO weewx.imagegenerator: Generated 14 images for report StandardReport in 0.36 seconds

Don't know if that is a clue or not.

[Glenn McKechnie]

If memory serves correctly, you get this behaviour when the code
exclusively uses syslog for logging, and you are running the SLE under
4.x

The linked version of ausearch.py isn't coded with the newer
weeutil.logger alternative (see wiki link below)

ie:- if it has the 'new-style weewx logging' it aligns itself in the
same style / format as the rest of the weewx4.x logs. If it's only
the syslog module only then it shows as /weewxd.
It also fixes the errant DEBUG output. (when debug=0)

https://github.com/weewx/weewx/wiki/WeeWX-v4-and-logging

That link has a section at the end under "Maintaining backwards
compatibility" which shows the code style that will incorporate both
syslog and weeutil.logger style.
However, the way ausearch.py has been coded requires a little more
work that just dropping that code into it. There are 18 odd syslog
statements that would need tweaking.

On 17/09/2020, Greg from Oz <ubea...@gmail.com> wrote:
> The logging has /weewxd and not weewx like the rest of the logs:

> Sep 17 19:21:12 jed164* /weewxd:* aussearch: check json file:

> /var/lib/weewx/aussearch/IDN60801.94746.json expires 2020-09-17
> 09:35:00+00:00
> Sep 17 19:21:13 jed164 /weewxd: historygenerator.py: Generated 6 tables in
> 0.52 seconds

> Sep 17 19:21:13 jed164* weewx[*292601] INFO weewx.cheetahgenerator:

> --
> You received this message because you are subscribed to the Google Groups
> "weewx-user" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to weewx-user+...@googlegroups.com.
> To view this discussion on the web visit

> https://groups.google.com/d/msgid/weewx-user/0df80d45-a3bf-43a0-be80-507dc971c48an%40googlegroups.com.
>


--


Cheers
Glenn

rorpi - read only raspberry pi & various weewx addons
https://github.com/glennmckechnie

[Greg from Oz]

Thanks for that.

I am not a python programmer so I will just keep it how it is as it works.

> email to weewx...@googlegroups.com.

[Glenn McKechnie]

I'm with you Greg, that's definitely a good philosophy. :-)

However if you (or others) want to travel to the edge...

On 17/09/2020, Glenn McKechnie <glenn.m...@gmail.com> wrote:
> https://github.com/weewx/weewx/wiki/WeeWX-v4-and-logging
>
> That link has a section at the end under "Maintaining backwards
> compatibility" which shows the code style that will incorporate both
> syslog and weeutil.logger style.
> However, the way ausearch.py has been coded requires a little more
> work that just dropping that code into it. There are 18 odd syslog
> statements that would need tweaking.

I've attached a twaked version where it uses the code as per the above style.

I can't check this here as I stopped running ausearch.py

If anyone wants to try it, the usual caveats apply.
Make a back up of the original. Rename the attached file to
ausearch.py and then replace the original. Restart weewx.

Hopefully I caught all occurences, and that it works as intended.

[Greg from Oz]

Ok I have downloaded and installed it and have no errors or output.

So either it is working or it is not working and not outputting anything...... :)

I will let it run and see what happens.

[Glenn McKechnie]

:-)

At least it didn't fall at the first hurdle.

As I recall it runs it runs infrequently. Checks the timestamp on the
downloaded files and refetches them when the allowed age is passed.

I probably should reinstall it myself. It was a useful extension.

On 17/09/2020, Greg from Oz <ubea...@gmail.com> wrote:

> Ok I have downloaded and installed it and have no errors or output.
> So either it is working or it is not working and not outputting
> anything...... :)
> I will let it run and see what happens.
>
>
> On Thursday, 17 September 2020 20:15:59 UTC+10, Glenn McKechnie wrote:
>>
>> I'm with you Greg, that's definitely a good philosophy. :-)
>>
>> However if you (or others) want to travel to the edge...
>>

>> On 17/09/2020, Glenn McKechnie <glenn.m...@gmail.com <javascript:>>

>> wrote:
>> > https://github.com/weewx/weewx/wiki/WeeWX-v4-and-logging
>> >
>> > That link has a section at the end under "Maintaining backwards
>> > compatibility" which shows the code style that will incorporate both
>> > syslog and weeutil.logger style.
>> > However, the way ausearch.py has been coded requires a little more
>> > work that just dropping that code into it. There are 18 odd syslog
>> > statements that would need tweaking.
>>
>> I've attached a twaked version where it uses the code as per the above
>> style.
>>
>> I can't check this here as I stopped running ausearch.py
>>
>> If anyone wants to try it, the usual caveats apply.
>> Make a back up of the original. Rename the attached file to
>> ausearch.py and then replace the original. Restart weewx.
>>
>> Hopefully I caught all occurences, and that it works as intended.
>>
>> --
>>
>>
>> Cheers
>> Glenn
>>
>> rorpi - read only raspberry pi & various weewx addons
>> https://github.com/glennmckechnie
>>
>

> --
> You received this message because you are subscribed to the Google Groups
> "weewx-user" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to weewx-user+...@googlegroups.com.
> To view this discussion on the web visit

> https://groups.google.com/d/msgid/weewx-user/410d2d5e-e023-447d-849f-1c90e949aa4fo%40googlegroups.com.

[Greg from Oz]

I use it every day and also use the Android weewx app.

https://github.com/evilbunny2008/weeWXWeatherApp which is a really good app.

I will see if my forecasts etc change tomorrow.

[Greg from Oz]

The forecasts have changed and all looks good with your changes you made to aussearch.py

I think it is OK to use.

[Glenn McKechnie]

Excellent.
Good to know.

The Android weewx app looks interesting, I'll put it on the list (of
things ToDo).

> --
> You received this message because you are subscribed to the Google Groups
> "weewx-user" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to weewx-user+...@googlegroups.com.
> To view this discussion on the web visit

> https://groups.google.com/d/msgid/weewx-user/76b27197-72e2-4ecb-a765-0b9be1ef452an%40googlegroups.com.

[Greg from Oz]

The app is great.

I have the forecast and current conditions of my weather station on the first screen

2nd screen has the statistics of the weather station

3rd screen I put the extended radar loop I made that is on my weather site  http://weather.ubeaut.work/WEBCAM/radar.webm (sorry iphone users this link won't work for you)

4th screen I put my webcam image

5th screen I put my whole weather site on it https://weather.ubeaut.work

Thanks for the fix.