Weewx not running reports

192 views

Skip to first unread message

Ron Walker

unread,

Jul 3, 2019, 5:48:20 PM7/3/19

to weewx-user

Weewx is trying to kill me! Due to a multitude of issues on my original installation, I did a complete new installation of OS and WeeWX on Raspberry Pi. The installation initially worked, but after a reboot this afternoon, WeeWX is no longer running reports. I'm using the Seasons skin with FileParse driver.

I have an archive interval of 5 mins. set. When I start WeeWX manually, I can see the loop packets coming through, but the seem to have an incorrect time stamp. The data being uploaded includes a date and time field populated with Unix time. When I convert those Unix times, I can see that they are the correct time. The time on the Pi is correct. i've attached the output of the startup and a sample of the LOOP data.

My weewx.conf:

# WEEWX CONFIGURATION FILE

# See the file LICENSE.txt for your rights.

##############################################################################

# This section is for general configuration information.

# Set to 1 for extra debug info, otherwise comment it out or set to zero

debug = 2

# Root directory of the weewx data file hierarchy for this station

WEEWX_ROOT = /

# Whether to log successful operations

log_success = True

# Whether to log unsuccessful operations

log_failure = True

# How long to wait before timing out a socket (FTP, HTTP) connection

socket_timeout = 20

# Do not modify this. It is used when installing and updating weewx.

version = 3.9.1

##############################################################################

# This section is for information about the station.

[Station]

# Description of the station location

location = "Sky Pirates Field, Plumsteadville, PA"

# Latitude and longitude in decimal degrees

latitude = 40.1625

longitude = 75.143

# Altitude of the station, with unit it is in. This is downloaded from

# from the station if the hardware supports it.

altitude = 460, foot

# Set to type of station hardware. There must be a corresponding stanza

# in this file with a 'driver' parameter indicating the driver to be used.

station_type = FileParse

# If you have a website, you may specify an URL

#station_url = http://www.example.com

station_url = localhost/weewx

# The start of the rain year (1=January; 10=October, etc.). This is

# downloaded from the station if the hardware supports it.

rain_year_start = 1

# Start of week (0=Monday, 6=Sunday)

week_start = 6

##############################################################################

[Simulator]

# This section is for the weewx weather station simulator

# The time (in seconds) between LOOP packets.

loop_interval = 2.5

# The simulator mode can be either 'simulator' or 'generator'.

# Real-time simulator. Sleep between each LOOP packet.

#mode = simulator

# Generator. Emit LOOP packets as fast as possible (useful for testing).

mode = generator

# The start time. Format is YYYY-mm-ddTHH:MM. If not specified, the default

# is to use the present time.

#start = 2011-01-01T00:00

# The driver to use:

#driver = /weewx-3.9.1/bin/user.fileparse

#############################################################################

[FileParse]

poll_interval = 10

path = /var/tmp/data.csv

driver = user.fileparse

loop_interval = 10

[[label_map]]

Time = dateTime

pressure = pressure

outTemp = outTemp

outHumidity = outHumidity

windSpeed = windSpeed

windDir = windDir

windGust = windGust

windGustDir = windGustDir

supplyVoltage = supplyVoltage

lightLevel = radiation

rainRate = rainRate

rain = rain

##############################################################################

# This section is for uploading data to Internet sites

[StdRESTful]

[[StationRegistry]]

# To register this weather station with weewx, set this to true

register_this_station = false

[[AWEKAS]]

# This section is for configuring posts to AWEKAS.

# If you wish to do this, set the option 'enable' to true,

# and specify a username and password.

# To guard against parsing errors, put the password in quotes.

enable = false

username = replace_me

password = replace_me

[[CWOP]]

# This section is for configuring posts to CWOP.

# If you wish to do this, set the option 'enable' to true,

# and specify the station ID (e.g., CW1234).

enable = false

station = replace_me

# If this is an APRS (radio amateur) station, uncomment

# the following and replace with a passcode (e.g., 12345).

#passcode = replace_me (APRS stations only)

[[PWSweather]]

# This section is for configuring posts to PWSweather.com.

# If you wish to do this, set the option 'enable' to true,

# and specify a station and password.

# To guard against parsing errors, put the password in quotes.

enable = false

station = replace_me

password = replace_me

[[WOW]]

# This section is for configuring posts to WOW.

# If you wish to do this, set the option 'enable' to true,

# and specify a station and password.

# To guard against parsing errors, put the password in quotes.

enable = false

station = replace_me

password = replace_me

[[Wunderground]]

# This section is for configuring posts to the Weather Underground.

# If you wish to do this, set the option 'enable' to true,

# and specify a station (e.g., 'KORHOODR3') and password.

# To guard against parsing errors, put the password in quotes.

enable = false

station = replace_me

password = replace_me

# Set the following to True to have weewx use the WU "Rapidfire"

# protocol. Not all hardware can support it. See the User's Guide.

rapidfire = False

##############################################################################

# This section specifies what reports, using which skins, to generate.

[StdReport]

# Where the skins reside, relative to WEEWX_ROOT

SKIN_ROOT = /etc/weewx/skins

# Where the generated reports should go, relative to WEEWX_ROOT

HTML_ROOT = /var/www/html/weewx

# The database binding indicates which data should be used in reports.

data_binding = wx_binding

# Whether to log a successful operation

log_success = True

# Whether to log an unsuccessful operation

log_failure = False

# Each of the following subsections defines a report that will be run.

# See the customizing guide to change the units, plot types and line

# colors, modify the fonts, display additional sensor data, and other

# customizations. Many of those changes can be made here by overriding

# parameters, or by modifying templates within the skin itself.

[[SeasonsReport]]

# The SeasonsReport uses the 'Seasons' skin, which contains the

# images, templates and plots for the report.

skin = Seasons

enable = true

[[SmartphoneReport]]

# The SmartphoneReport uses the 'Smartphone' skin, and the images and

# files are placed in a dedicated subdirectory.

skin = Smartphone

enable = false

HTML_ROOT = /var/www/html/weewx

[[MobileReport]]

# The MobileReport uses the 'Mobile' skin, and the images and files

# are placed in a dedicated subdirectory.

skin = Mobile

enable = false

HTML_ROOT = /var/www/html/weewx

[[StandardReport]]

# This is the old "Standard" skin. By default, it is not enabled.

skin = Standard

enable = false

[[SteelSeries]]

skin = ss

enable = false

HTML_ROOT = /var/www/html/weewx

[[Washboard]]

skin = Washboard

enable = false

[[FTP]]

# FTP'ing the results to a webserver is treated as just another report,

# albeit one with an unusual report generator!

skin = Ftp

# If you wish to use FTP, set "enable" to "true", then

# fill out the next four lines.

# Use quotes around passwords to guard against parsing errors.

enable = false

user = replace_me

password = replace_me

server = replace_me # The ftp server name, e.g, www.myserver.org

path = replace_me # The destination directory, e.g., /weather

# Set to True for an FTP over TLS (FTPS) connection. Not all servers

# support this.

secure_ftp = False

# To upload files from something other than what HTML_ROOT is set

# to above, specify a different HTML_ROOT here.

#HTML_ROOT = /var/www/html/weewx

# Most FTP servers use port 21

port = 21

# Set to 1 to use passive mode, zero for active mode

passive = 1

[[RSYNC]]

# rsync'ing to a webserver is treated as just another report

skin = Rsync

# If you wish to use rsync, you must configure passwordless ssh using

# public/private key authentication from the user account that weewx

# runs to the user account on the remote machine where the files

# will be copied.

# If you wish to use rsync, set "enable" to "true", then

# fill out server, user, and path.

# The server should appear in your .ssh/config file.

# The user is the username used in the identity file.

# The path is the destination directory, such as /var/www/html/weather.

# Be sure that the user has write permissions on the destination!

enable = false

server = replace_me

user = replace_me

path = replace_me

# To upload files from something other than what HTML_ROOT is set

# to above, specify a different HTML_ROOT here.

#HTML_ROOT = /var/www/html/weewx

# Rsync can be configured to remove files from the remote server if

# they don't exist under HTML_ROOT locally. USE WITH CAUTION: if you

# make a mistake in the remote path, you could could unintentionally

# cause unrelated files to be deleted. Set to 1 to enable remote file

# deletion, zero to allow files to accumulate remotely.

delete = 0

####

# Various options for customizing your reports.

[[Defaults]]

[[[Units]]]

# The following section sets what unit to use for each unit group.

# NB: The unit is always in the singular. I.e., 'mile_per_hour',

# NOT 'miles_per_hour'

[[[[Groups]]]]

group_altitude = foot # Options are 'foot' or 'meter'

group_degree_day = degree_F_day # Options are 'degree_F_day' or 'degree_C_day'

group_pressure = inHg # Options are 'inHg', 'mmHg', 'mbar', or 'hPa'

group_rain = inch # Options are 'inch', 'cm', or 'mm'

group_rainrate = inch_per_hour # Options are 'inch_per_hour', 'cm_per_hour', or 'mm_per_hour'

group_speed = mile_per_hour # Options are 'mile_per_hour', 'km_per_hour', 'knot', or 'meter_per_second'

group_speed2 = mile_per_hour2 # Options are 'mile_per_hour2', 'km_per_hour2', 'knot2', or 'meter_per_second2'

group_temperature = degree_F # Options are 'degree_F' or 'degree_C'

# The following section sets the formatting for each type of unit.

[[[[StringFormats]]]]

centibar = %.0f

cm = %.2f

cm_per_hour = %.2f

degree_C = %.1f

degree_F = %.1f

degree_compass = %.0f

foot = %.0f

hPa = %.1f

hour = %.1f

inHg = %.3f

inch = %.2f

inch_per_hour = %.2f

km_per_hour = %.0f

km_per_hour2 = %.1f

knot = %.0f

knot2 = %.1f

mbar = %.1f

meter = %.0f

meter_per_second = %.1f

meter_per_second2 = %.1f

mile_per_hour = %.0f

mile_per_hour2 = %.1f

mm = %.1f

mmHg = %.1f

mm_per_hour = %.1f

percent = %.0f

second = %.0f

uv_index = %.1f

volt = %.1f

watt_per_meter_squared = %.0f

NONE = " N/A"

# The following section sets the label for each type of unit

[[[[Labels]]]]

day = " day", " days"

hour = " hour", " hours"

minute = " minute", " minutes"

second = " second", " seconds"

NONE = ""

# The following section sets the format for each time scale.

# The values below will work in every locale, but they may not look

# particularly attractive.

[[[[TimeFormats]]]]

hour = %H:%M

day = %X

week = %X (%A)

month = %x %X

year = %x %X

rainyear = %x %X

current = %x %X

ephem_day = %X

ephem_year = %x %X

[[[[Ordinates]]]]

# Ordinal directions. The last one is for no wind direction

directions = N, NNE, NE, ENE, E, ESE, SE, SSE, S, SSW, SW, WSW, W, WNW, NW, NNW, N/A

# The following section sets the base temperatures used for the

# calculation of heating and cooling degree-days.

[[[[[DegreeDays]]]]]

# Base temperature for heating days, with unit:

heating_base = 65, degree_F

# Base temperature for cooling days, with unit:

cooling_base = 65, degree_F

# A trend takes a difference across a time period. The following

# section sets the time period, and how big an error is allowed to

# still be counted as the start or end of a period.

[[[[[Trend]]]]]

time_delta = 10800 # 3 hours

time_grace = 300 # 5 minutes

# The labels to be used for each observation type

[[[Labels]]]

# Set to hemisphere abbreviations suitable for your location:

hemispheres = N, S, E, W

# Formats to be used for latitude whole degrees, longitude whole

# degrees, and minutes:

latlon_formats = %02d, %03d, %05.2f

# Generic labels, keyed by an observation type.

[[[[Generic]]]]

barometer = Barometer

dewpoint = Dew Point

ET = ET

heatindex = Heat Index

inHumidity = Inside Humidity

inTemp = Inside Temperature

outHumidity = Humidity

outTemp = Outside Temperature

radiation = Radiation

rain = Rain Today

rainRate = Rain Last Hour

UV = UV Index

windDir = Wind Direction

windGust = Gust Speed

windGustDir = Gust Direction

windSpeed = Wind Speed

windchill = Wind Chill

windgustvec = Gust Vector

windvec = Wind Vector

extraTemp1 = Temperature1

extraTemp2 = Temperature2

extraTemp3 = Temperature3

# Sensor status indicators

rxCheckPercent = Signal Quality

txBatteryStatus = Transmitter Battery

windBatteryStatus = Wind Battery

rainBatteryStatus = Rain Battery

outTempBatteryStatus = Outside Temperature Battery

inTempBatteryStatus = Inside Temperature Battery

consBatteryVoltage = Console Battery

heatingVoltage = Heating Battery

supplyVoltage = Supply Voltage

referenceVoltage = Reference Voltage

[[[Almanac]]]

# The labels to be used for the phases of the moon:

moon_phases = New, Waxing crescent, First quarter, Waxing gibbous, Full, Waning gibbous, Last quarter, Waning crescent

##############################################################################

# This service acts as a filter, converting the unit system coming from

# the hardware to a unit system in the database.

[StdConvert]

# The target_unit affects only the unit system in the database. Once

# chosen it cannot be changed without converting the entire database.

# Modification of target_unit after starting weewx will result in

# corrupt data - the database will contain a mix of US and METRIC data.

# The value of target_unit does not affect the unit system for

# reporting - reports can display US, Metric, or any combination of units.

# In most cases, target_unit should be left as the default: US

# In particular, those migrating from a standard wview installation

# should use US since that is what the wview database contains.

# DO NOT MODIFY THIS VALUE UNLESS YOU KNOW WHAT YOU ARE DOING!

target_unit = US # Options are 'US', 'METRICWX', or 'METRIC'

##############################################################################

# This section can adjust data using calibration expressions.

[StdCalibrate]

[[Corrections]]

# For each type, an arbitrary calibration expression can be given.

# It should be in the units defined in the StdConvert section.

# Example:

foo = foo + 0.2

##############################################################################

# This section is for quality control checks. If units are not specified,

# values must be in the units defined in the StdConvert section.

[StdQC]

[[MinMax]]

barometer = 26, 32.5, inHg

pressure = 24, 34.5, inHg

outTemp = -40, 120, degree_F

inTemp = 10, 120, degree_F

outHumidity = 0, 100

inHumidity = 0, 100

windSpeed = 0, 120, mile_per_hour

rain = 0, 10, inch

##############################################################################

# This section controls the origin of derived values.

[StdWXCalculate]

[[Calculations]]

# How to calculate derived quantities. Possible values are:

# hardware - use the value provided by hardware

# software - use the value calculated by weewx

# prefer_hardware - use value provide by hardware if available,

# otherwise use value calculated by weewx

pressure = hardware

barometer = software

altimeter = software

windchill = software

heatindex = software

dewpoint = software

inDewpoint = software

rainRate = hardware

##############################################################################

# For hardware that supports it, this section controls how often the

# onboard clock gets updated.

[StdTimeSynch]

# How often to check the weather station clock for drift (in seconds)

clock_check = 14400

# How much it can drift before we will correct it (in seconds)

max_drift = 5

##############################################################################

# This section is for configuring the archive service.

[StdArchive]

# If the station hardware supports data logging then the archive interval

# will be downloaded from the station. Otherwise, specify it (in seconds).

archive_interval = 300

# If possible, new archive records are downloaded from the station

# hardware. If the hardware does not support this, then new archive

# records will be generated in software.

# Set the following to "software" to force software record generation.

record_generation = hardware

# Whether to include LOOP data in hi/low statistics

loop_hilo = False

# The data binding used to save archive records

data_binding = wx_binding

##############################################################################

# This section binds a data store to a database.

[DataBindings]

[[wx_binding]]

# The database must match one of the sections in [Databases].

# This is likely to be the only option you would want to change.

database = archive_sqlite

# The name of the table within the database

table_name = archive

# The manager handles aggregation of data for historical summaries

manager = weewx.wxmanager.WXDaySummaryManager

# The schema defines the structure of the database.

# It is *only* used when the database is created.

schema = schemas.wview.schema

##############################################################################

# This section defines various databases.

[Databases]

# A SQLite database is simply a single file

[[archive_sqlite]]

database_name = weewx.sdb

database_type = SQLite

# MySQL

[[archive_mysql]]

database_name = weewx

database_type = MySQL

##############################################################################

# This section defines defaults for the different types of databases.

[DatabaseTypes]

# Defaults for SQLite databases

[[SQLite]]

driver = weedb.sqlite

# Directory in which the database files are located

SQLITE_ROOT = /var/lib/weewx

# Defaults for MySQL databases

[[MySQL]]

driver = weedb.mysql

# The host where the database is located

host = localhost

# The user name for logging in to the host

user =

# The password for the user name (quotes guard against parsing errors)

password =

##############################################################################

# This section configures the internal weewx engine.

[Engine]

[[Services]]

# This section specifies the services that should be run. They are

# grouped by type, and the order of services within each group

# determines the order in which the services will be run.

prep_services = weewx.engine.StdTimeSynch

data_services = ,

process_services = weewx.engine.StdConvert, weewx.engine.StdCalibrate, weewx.engine.StdQC, weewx.wxservices.StdWXCalculate

archive_services = weewx.engine.StdArchive

restful_services = weewx.restx.StdStationRegistry, weewx.restx.StdWunderground, weewx.restx.StdPWSweather, weewx.restx.StdCWOP, weewx.restx.StdWOW, weewx.restx.StdAWEKAS

report_services = weewx.engine.StdPrint, weewx.engine.StdReport

Loop_data.txt

Startup_log.txt

Thomas Keffer

unread,

Jul 3, 2019, 6:29:06 PM7/3/19

to weewx-user

In your [FileParse] section, you supply a mapping from variable Time to the WeeWX variable dateTime, so this is where the timestamps will come from. You say that the LOOP packets have an incorrect timestamp. Are the timestamps in the file correct? If not, it's inevitable the LOOP packet stamps will be wrong.

If this is the case, you have two choices:

Make sure the timestamp in the file is correct; or
Not supply a timestamp at all. If no timestamp is provided in the file, the fileparse driver will supply one, namely the current UTC time.

You may be reading from a file, but like any other device driver, it is essential that the timestamps be accurate.

-tk

--
You received this message because you are subscribed to the Google Groups "weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/eb420b4a-6232-49d0-9969-1c4f236a6a73%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Ron Walker

unread,

Jul 4, 2019, 11:13:26 AM7/4/19

to weewx-user

Hi Tom,

You were correct. The issue was the timestamp included in the data file. I removed the timestamp from the input and all is well. When I converted that timestamp from Unix time to regular, it turned out to be GMT and not EDT. That is what accounted for the time difference that I was seeing. WeeWX was converting that time stamp to EDT, but NOTHING relating to time was changed. Nothing was changed in the input and to my knowledge, there is no option to change how WeeWX interprets time stamps. So, why when this WAS working, did it suddenly change? this was a brand new WeeWX install.

To unsubscribe from this group and stop receiving emails from it, send an email to weewx...@googlegroups.com.

Andrew Milner

unread,

Jul 4, 2019, 12:58:20 PM7/4/19

to weewx-user

Timestamps in weewx are taken as being UTC which is indeed GMT

Thomas Keffer

unread,

Jul 4, 2019, 5:18:38 PM7/4/19

to weewx-user

You were correct. The issue was the timestamp included in the data file. I removed the timestamp from the input and all is well. When I converted that timestamp from Unix time to regular, it turned out to be GMT and not EDT. That is what accounted for the time difference that I was seeing. WeeWX was converting that time stamp to EDT, but NOTHING relating to time was changed. Nothing was changed in the input and to my knowledge, there is no option to change how WeeWX interprets time stamps. So, why when this WAS working, did it suddenly change? this was a brand new WeeWX install.

I didn't follow any of this. The important thing is to either supply a correct time stamp (in unix epoch time, which is UTC), or let WeeWX provide a valid timestamp.

Glad things are working now.

-tk

Reply all

Reply to author

Forward

0 new messages