V4.6.0 beta 7

[Tom Keffer]

Pretty much the same as beta-6, except it fixes a few annoying bugs:

• Search list no longer grows without bounds.
• All images are no longer regenerated with every reporting cycle.
• Data types that are null at the beginning of the year, but later non-null, are now properly displayed.

http://weewx.com/downloads/development_versions/

[wee...@gmx.de]

Hi Tom,

I had freshly installed 4.6.0b6, then also installed 4.6.0b7 over it again using the "setup.py" method. I copied the skin Seasons from b7 into the corresponding directory after the installation, so that Seasons is used with version b7.

Now my question: What do I have to do so that the UV value is displayed in the diagrams?
If I understand the system correctly, nothing, because standard. But why is there no diagram for the UV value? The UV value is available in the database.

If I want to display additional values as a chart, what is the right way? Is it enough to add the field of the database in "skin.conf" at the position "plot_names"?
Or/and do I have to add this field under
[[day_images]]
manually?

Michael

[Tom Keffer]

The problem seems to be that the image file name is "dayuv.png", but the inclusion algorithm is looking for "dayUV.png".

We'll have to come up with a patch for that.

Thanks for catching this!

-tk

--
You received this message because you are subscribed to the Google Groups "weewx-development" group.
To unsubscribe from this group and stop receiving emails from it, send an email to weewx-developm...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-development/aa774e44-cbb9-4782-8b07-e6b3898e5859n%40googlegroups.com.

[Tom Keffer]

Fixed in commit 5a219d4.

Thanks again.

[wee...@gmx.de]

Thanks again, too

UV is back again :)

Michael

[mbat...@gmail.com]

My instance of 4.6.0b7 has now been up and running for thirty hours, with no errors.

[Graham Eddy]

i am getting cheetah errors on a clean install, preventing Seasons skin from generating

RPi reinstalled linux, new weewx beta7 installed using setup.py, chose simulator driver

only changes from fresh install:

 * config file renamed simulator.conf, and it uses sqlite3 file simulator.sdb and modified simulator driver, skins moved to HTML_ROOT=public_html/simulator/

 * replaced Simulator driver with enhanced one that emits more observations

 * logs to simulator.log

in particular, apart from moving directory of Season skin, no skin changes have been made, and it is the only report trying to be generated

(this is outside scope of the problem but note that weewx runs as user 'weewx' and has its own /run/weewx/ and /var/log/weewx/ directories owned by it)

running weewx for the first time (after clearing a couple of blips) from the command line, it shows the expected packets from driver:

weewx@ironbark:~ $ weewxd --config=simulator.conf --log-label=weewx-simulator
LOOP:   2021-11-13 22:02:26 AEDT (1636801346) altimeter: 32.04769585519381, altInHumidity: 79.99659700397082, altInTemp: 67.00272239682334, altOutHumidity: 99.99149250992706, altOutTemp: 52.94624685417847, altPressure: 31.099914921480096, altRain: 0, altWindDir: 359.9607966852468, altWindGust: 13.999092505796376, altWindGustDir: 359.9607966852468, altWindSpeed: 9.999243754830314, appTemp: 28.46010918752483, barometer: 31.099999998967093, cloudbase: 2080.9394290518258, consBatteryVoltage: 11.351358972380378, cpu_idle: 78.84813691228312, cpu_load: 0.4999999471150336, cpu_temp: 159.99999206725505, dateTime: 1636801346, dewpoint: 27.203560993945757, disk_avail: 48902593300.402245, ET: None, extraTemp1: 69.99659700397082, heatindex: 32.67858297022247, heatingVoltage: 12.368271588001956, humidex: 32.67858297022247, inDewpoint: 31.079533828013187, inHumidity: 29.999999958683617, inTemp: 63.00000002065819, inTempBatteryStatus: 0, luminosity: 0, maxSolarRad: 0.0, mem_avail: 6999995143.22109, outHumidity: 79.99999996901272, outTemp: 32.67858297022247, outTempBatteryStatus: 0, pm2_5: 39.75433529720432, pm2_51_24hav: 41.85260117832259, pm2_52: 23.414025782062343, pm2_52_24hav: 34.02337630343724, pressure: 31.099999998967093, radiation: 0, rain: 0, rainBatteryStatus: 0, rainRate: 0.0, referenceVoltage: 12.164606222537792, riverLevel: 18.997580198467166, rxCheckPercent: 96.69075726807661, soilMoist1: 54.99848750966063, soilMoist2: 45.999092505796376, solarEnergy: 0, supplyVoltage: 10.90014485699457, txBatteryStatus: 0, usUnits: 1, UV: 0, wh40_batt: 0, wh41_ch1_batt: 2.5, wh41_ch2_batt: 0.5050786013157256, wh51_ch1_batt: 0, wh51_ch2_batt: 0, wh57_batt: 3.445610343723811, windBatteryStatus: 0, windchill: 32.67858297022247, windDir: 359.9999998140763, windGust: 6.197456769996279e-09, windGustDir: 359.9999998140763, windrun: None, windSpeed: 5.164547900449179e-09, ws80_batt: 4.246171064042035
LOOP:   2021-11-13 22:02:28 AEDT (1636801348) altimeter: 32.047695846726846, altInHumidity: 79.99664426458719, altInTemp: 67.00268458833024, altOutHumidity: 99.99161066146797, altOutTemp: 52.944347559466586, altPressure: 31.099916103095335, altRain: 0, altWindDir: 359.96134114962837, altWindGust: 13.999105109416199, altWindGustDir: 359.96134114962837, altWindSpeed: 9.999254257846832, appTemp: 28.45807365032865, barometer: 31.099999990703814, cloudbase: 2080.928958935294, consBatteryVoltage: 12.54399105925338, cpu_idle: 84.27962834136689, cpu_load: 0.4999995240354704, cpu_temp: 159.99992860532055, dateTime: 1636801348, dewpoint: 27.20178958368346, disk_avail: 48933021072.21025, ET: None, extraTemp1: 69.99664426458719, heatindex: 32.67676549144743, heatingVoltage: 12.0, humidex: 32.67676549144743, inDewpoint: 31.07953369929752, inHumidity: 29.999999628152565, inTemp: 63.00000018592372, inTempBatteryStatus: 0, luminosity: 0, maxSolarRad: 0.0, mem_avail: 6999956289.272873, outHumidity: 79.99999972111442, outTemp: 32.67676549144743, outTempBatteryStatus: 0, pm2_5: 39.7554703089623, pm2_51_24hav: 41.85328218537738, pm2_52: 23.41671642769745, pm2_52_24hav: 34.02786071282909, pressure: 31.099999990703814, radiation: 0, rain: 0, rainBatteryStatus: 0, rainRate: 0.0, referenceVoltage: 11.418259445311794, riverLevel: 18.9976138030719, rxCheckPercent: 95.78828318361579, soilMoist1: 54.998508515693665, soilMoist2: 45.9991051094162, solarEnergy: 0, supplyVoltage: 12.0, txBatteryStatus: 0, usUnits: 1, UV: 0, wh40_batt: 0, wh41_ch1_batt: 0.9875900026020719, wh41_ch2_batt: 1.881934958769023, wh51_ch1_batt: 0, wh51_ch2_batt: 0, wh57_batt: 4.863442833044135, windBatteryStatus: 0, windchill: 32.67676549144743, windDir: 359.9999983266865, windGust: 5.577711537085861e-08, windGustDir: 359.9999983266865, windrun: None, windSpeed: 4.648092932768577e-08, ws80_batt: 3.1070625518712283

etc

after running about 30 mins, it has created some files (including ~weewx/archive/simulator.sdb) but some have not been generated:

weewx@ironbark:~ $ ls public_html/simulator
celestial.html    daymoistsoil.png  daytempin.png  rss.xml       telemetry.html
daybarometer.png  daytempdew.png    favicon.ico    seasons.css
dayhumin.png      daytempext.png    font           seasons.js
dayhum.png        daytempfeel.png   NOAA           tabular.html

i have attached the config file and logfile from start, noting skin file has not been changed. it seems to be barfing on absent plural label

[matthew wall]

graham,

please try this fix.  in bin/weewx/units.py, change line 652 from this:

    return label[1] if plural else label[0]

to this:

    return label[1] if plural and len(label) > 1 else label[0]

[Graham Eddy]

that fixed the IndexError crashing cheetah while generating Seasons, and files are generated without errors

now what i see in the generated files is US units, whereas i selected metric units during clean install.

same config files as i submitted last time; i can resubmit for convenience

(i know how to fix these things; i am trying the beta from scratch and looking for glitches)

cheers

--
You received this message because you are subscribed to a topic in the Google Groups "weewx-development" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/weewx-development/h_NNrIk830s/unsubscribe.
To unsubscribe from this group and all its topics, send an email to weewx-developm...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-development/90ac1568-6f4b-444e-aecb-2358e923ce9en%40googlegroups.com.

[Graham Eddy]

(third attempt at post - not getting error msg posting online except ‘failed to post’)

i might have explanation why beta7 installation left out vast chunk of weewx.conf, including everything about units.

see following lines in ~weewx/bin/weewx/defaults.py, which shows embedded quotes that surely caused run-time error during installation:

        knot              = " knots"

        knot2             = " knots"

        kPa"              = " kPa",

        kPa_per_hour"     = " kPa/h",

        liter"            = " l",

        litre"            = " l",

        lux"              = " lx",

        mbar              = " mbar"

        mbar_per_hour     = " mbar/h"

_____________
Graham Eddy

[Tom Keffer]

Thanks for spotting this, Graham. A very subtle typo!

Fixed in commit a4d482b

-tk

You received this message because you are subscribed to the Google Groups "weewx-development" group.

To unsubscribe from this group and stop receiving emails from it, send an email to weewx-developm...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-development/30F96001-4BFA-46A2-BC52-183103B0C959%40gmail.com.

[Cameron D]

I see for beta6 you were asking for experience on customising Seasons skin.  I have a renamed and customised Seasons skin so I thought I try it out. Customisations are fairly trivial - graph size, colours, content of each graph, one extra dataset from mem.py

Debian 10, mysql DB system.

Upgraded system from .deb file - no problems with my customised systemd unit files.

I did a normal package upgrade from 4.5.1 using  the .deb file and retained all existing settings. Then did a few diffs to merge in new parameters.

I noticed weewx.conf had a the huge chunk of stuff missing from [[defaults]] - units, labels and such.  I think that has been picked up already so I carried on with my old content.

This then ran using my old Seasons-x skin folder and looked OK.

I switched to default new Seaqsons and it was OK as well.

Duplicated the Seasons folder and merged my config changes into the new skins file.  The changes were nearly all in places that were similar to the old format, so it was all quite straightforward.

The only thing I found initially a bit confusing was the "DisplayOptions" section where it says I can override the values in the config file.   My impression is that I need to edit the rest of the skin config file anyway in order to manipulate the graphs so it made more sense to me to simply edit the DisplayOption parameters in place. Is that the intention?

Cheers,

Cameron.

[Tom Keffer]

Yes, that is the intention.

Another option is to override [DisplayOptions] and, for that matter, [ImageGenerator], in weewx.conf. That way, if a new version of a skin comes out, you don't have to do anything. Just slip the new version in place. Unfortunately, that's not always possible because some things cannot be overridden. In particular, the templates themselves.

Thanks for giving it a thorough try!

--

You received this message because you are subscribed to the Google Groups "weewx-development" group.
To unsubscribe from this group and stop receiving emails from it, send an email to weewx-developm...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-development/10232fa9-3c7e-48b3-83e4-8651a574a7d4n%40googlegroups.com.

[Cameron D]

Thanks Tom,

Now for the next issue, although I can't recall  precisely what I did when.

Only after yesterdays post did I notice that the wind vector plots were missing, so I thought I'd try to apply your patched code. I may have done completely the wrong thing, but it was all I could think of instead of waiting for the next beta release.

I downloaded the development code from github as at 2021-11-22 05:15:00Z

I updated all the newer bin/weewx python files and merged the skin changes.

Python files updated were: 

• defaults.py,
• cheetahgenerator.py, 
• units.py, 
• manager.py, 
• restx.py, 
• reportengine.py

After the normal upgrade via .deb file to beta 7, I am sure the graphs were displaying in my required units.

However, after the most recent changes the graphs are now in US units.

I see a setting has appeared in my weewx.conf, saying   "unit_system = us".  I know I'm getting old, but I don't recall putting it in there - did it happen automatically as part of the 4.6.0 upgrade?

Did I miss reading some documentation about changing the way units are specified?

I had up to 4.5.1 used a section in my weewx.conf overriding the Unit-Groups section.  This is partly because the Australian standard system reports wind in km/h and rain in mm (half metric, half metricwx)  I put the groups under:

[StdReport]

        [[Defaults]]

                  [[[Units]]]

                           [[[[Groups]]]]

with my Defaults being the last section of StdReports.   Is the order important?  My group definitions seem to get ignored, although commenting out the unit_system = xx  line seems to revert to the old pattern and it falls back to using my Group definitions.

[Tom Keffer]

The option unit_system is included in new, fresh, installs, but it is not injected into old config files. You must have started, somewhere, with a fresh install.

Think of unit_system as a shorthand for a bunch of unit group settings. 

NB: this is still in flux. The option may be moved to sit under [[Defaults]], instead of directly under [StdReport].

To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-development/778f9cbb-221b-45cb-948a-0c98e79b9d2dn%40googlegroups.com.

[Cameron D]

It look like at some stage between 4.5.1 and here you have fixed the memory usage creep  - I was seeing ~35MB/month very reliably, but so far (1 week) I've not seen any change.

Regarding the new unit_system parameter - my system was definitely a dpkg upgrade only to beta7, no fresh install.  If dpkg scripts did not  insert it then I can only assume that I did myself and did not notice.  I have a habit of running diffs against new config files and manually merging things like changed comments as well as looking for real changes.  I must have thought it was just part of the commented block and ignored it.  Or I got distracted by something.

[Tom Keffer]

No changes in weewx that would affect memory. Indeed, weewx itself is pure Python, so, ultimately, the Python garbage collector will reclaim any lost memory. The problem is almost surely in an underlying library.

To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-development/c540ccf0-a579-4fa3-90a2-b7838e0547ecn%40googlegroups.com.

[salinois]

Hello, sorry to insert me in the subject.

To bounce back on the displays, I have a problem with the display in "statistics", I was able to add a data in "current": temperature du grenier, but how to do in "statistics"; my attached screen copy.

thanks for your help

Patrick

To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-development/CAPq0zECgtn0ibt6-JmBpgVNq%3DSFAFWMvBYAUU37neoT1ZqMW6Q%40mail.gmail.com.

[Tom Keffer]

Patrick, you are giving us very little information. 

1. Where is "temperature du grenier" coming from? Is it one of the "extra temperatures", such as "extraTemp1"? Or, something else?

2. Is this the V4.6 version of the Seasons skin? Or, is it an older version?

Any other information would be helpful.

To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-development/52098905-66c6-7f29-4278-61f5d71216c6%40gmail.com.

[salinois]

sorry,

1 . "Temperature du grenier" is "soilTemp1". ( I modified the name for display as the joined capture)

2. I am testing version 4.6.0 b7 with the Seasons skin.

Patrick

[Tom Keffer]

It should work.

Let us wait until a new beta comes out. There have been several changes since beta-7, and I don't want to go chasing the same bugs.

I should have something in the next day or two. Sorry for the delay!

-tk

[salinois]

ok

thanks for your job

Patrick

[salinois]

hello,

I installed the skin belchertown on weewx 4.6.0b7 but it doesn't work

see the errors...

Dec  6 19:15:17 raspberrypi-p4 weewx[2773] INFO weewx.cheetahgenerator: Generated 8 files for report SeasonsReport in 0.94 seconds
Dec  6 19:15:17 raspberrypi-p4 weewx[2773] INFO weewx.imagegenerator: Generated 8 images for report SeasonsReport in 0.54 seconds
Dec  6 19:15:17 raspberrypi-p4 weewx[2773] INFO weewx.reportengine: Copied 0 files to /var/www/html/weewx
Dec  6 19:15:18 raspberrypi-p4 weewx[2773] ERROR weewx.reportengine: Caught unrecoverable exception in generator 'weewx.cheetahgenerator.CheetahGenerator'
Dec  6 19:15:18 raspberrypi-p4 weewx[2773] ERROR weewx.reportengine:         ****  list index out of range
Dec  6 19:15:18 raspberrypi-p4 weewx[2773] ERROR weewx.reportengine:         ****  Traceback (most recent call last):
Dec  6 19:15:18 raspberrypi-p4 weewx[2773] ERROR weewx.reportengine:         ****    File "/usr/share/weewx/weewx/reportengine.py", line 197, in run
Dec  6 19:15:18 raspberrypi-p4 weewx[2773] ERROR weewx.reportengine:         ****      obj.start()
Dec  6 19:15:18 raspberrypi-p4 weewx[2773] ERROR weewx.reportengine:         ****    File "/usr/share/weewx/weewx/reportengine.py", line 368, in start
Dec  6 19:15:18 raspberrypi-p4 weewx[2773] ERROR weewx.reportengine:         ****      self.run()
Dec  6 19:15:18 raspberrypi-p4 weewx[2773] ERROR weewx.reportengine:         ****    File "/usr/share/weewx/weewx/cheetahgenerator.py", line 159, in run
Dec  6 19:15:18 raspberrypi-p4 weewx[2773] ERROR weewx.reportengine:         ****      ngen = self.generate(gen_dict[section_name], section_name, self.gen_ts)
Dec  6 19:15:18 raspberrypi-p4 weewx[2773] ERROR weewx.reportengine:         ****    File "/usr/share/weewx/weewx/cheetahgenerator.py", line 228, in generate
Dec  6 19:15:18 raspberrypi-p4 weewx[2773] ERROR weewx.reportengine:         ****      ngen += self.generate(section[subsection], subsection, gen_ts)
Dec  6 19:15:18 raspberrypi-p4 weewx[2773] ERROR weewx.reportengine:         ****    File "/usr/share/weewx/weewx/cheetahgenerator.py", line 228, in generate
Dec  6 19:15:18 raspberrypi-p4 weewx[2773] ERROR weewx.reportengine:         ****      ngen += self.generate(section[subsection], subsection, gen_ts)
Dec  6 19:15:18 raspberrypi-p4 weewx[2773] ERROR weewx.reportengine:         ****    File "/usr/share/weewx/weewx/cheetahgenerator.py", line 316, in generate
Dec  6 19:15:18 raspberrypi-p4 weewx[2773] ERROR weewx.reportengine:         ****      searchList = self._getSearchList(encoding, timespan,
Dec  6 19:15:18 raspberrypi-p4 weewx[2773] ERROR weewx.reportengine:         ****    File "/usr/share/weewx/weewx/cheetahgenerator.py", line 410, in _getSearchList
Dec  6 19:15:18 raspberrypi-p4 weewx[2773] ERROR weewx.reportengine:         ****      search_list += obj.get_extension_list(timespan, db_lookup)
Dec  6 19:15:18 raspberrypi-p4 weewx[2773] ERROR weewx.reportengine:         ****    File "/usr/share/weewx/user/belchertown.py", line 1448, in get_extension_list
Dec  6 19:15:18 raspberrypi-p4 weewx[2773] ERROR weewx.reportengine:         ****      obs_unit_label = weewx.units.get_label_string(self.generator.formatter, self.generator.converter, obs)
Dec  6 19:15:18 raspberrypi-p4 weewx[2773] ERROR weewx.reportengine:         ****    File "/usr/share/weewx/weewx/units.py", line 1464, in get_label_string
Dec  6 19:15:18 raspberrypi-p4 weewx[2773] ERROR weewx.reportengine:         ****      return formatter.get_label_string(u, plural)
Dec  6 19:15:18 raspberrypi-p4 weewx[2773] ERROR weewx.reportengine:         ****    File "/usr/share/weewx/weewx/units.py", line 652, in get_label_string
Dec  6 19:15:18 raspberrypi-p4 weewx[2773] ERROR weewx.reportengine:         ****      return label[1] if plural else label[0]
Dec  6 19:15:18 raspberrypi-p4 weewx[2773] ERROR weewx.reportengine:         ****  IndexError: list index out of range
Dec  6 19:15:18 raspberrypi-p4 weewx[2773] ERROR weewx.reportengine:         ****  Generator terminated
Dec  6 19:15:18 raspberrypi-p4 weewx[2773] INFO weewx.reportengine: Copied 2 files to /var/www/html/weewx/belchertown

thanks

patrick

Le 05/12/2021 à 22:43, Tom Keffer a écrit :

[Tom Keffer]

It looks like the Belchertown skin is requesting the plural version of a label while only supplying the singular version.

Commit c6858e7 was added a few weeks ago to guard against this.

[salinois]

hi Tom,

thanks , I was able to do the correction in commit c6858e7

and it works

Patrick