Import Historical Data from Weather Station

[Keoni Mahelona]

Kia ora from Aotearoa (New Zealand),

I have a quick question. I've tried searching but maybe my google skills are fail.

Does weewx import all historical information already stored on a weather station? (I'm using an Ambient Weather WS2080 [FineOffset])

If so, this wasn't the case for me. I originally had weewx running the simulation. I stopped weewx, plugged in my WS2080, deleted the weewx.sdb and stats.sdb, and restarted weewx. It works, but no previous data on my weather station was imported. The weather station has been running for a few days since I got weewx running, and I'd like those past days to go into the weewx.sdb.

If weewx doesn't import that data from the weather station, does weewx offer any tools/scripts/methods to import all data from a weather station into the weewx databaes?

I thought I ask before I write my own little script to dump the data via wee_config_fousb and put it into the sqlite database.

Cheers!

[Thomas Keffer]

Look for this feature in the very next release, due out maybe this weekend. Unfortunately, that may be too late for you. :-(

-tk

--
You received this message because you are subscribed to the Google Groups "Weewx user's group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

[Joep L. Blom]

I just installed weewx (incidentally running parallel to wview!) but I haven't found the possibility to obtain the historical data from my weatherstation, the TFA NEXUS that is equal to the TE923, I formerly used Weatherdisplay but that only runs reliably on Windows and moreover it's UI was very illogical. However, when it was restarted - or started - it always read first the memory of the weather-station, adding only new data to the database. Now I like wview and weewx much more (won't go back to windows!!) but this feature Um dearly missing.

Now Tom said on 3/20/13 that it will appear in the next update. However, I'm using version 2.6.0a6-a_all.deb (running Ubuntu 12.04 LTS) but where can I find the option to read the memory of the TFA NEXUS (TE923).

Hope you can solve the problem. Thanks in advance,

Joep

[mwall]

 joep,

tom's post referred to the fine offset stations.  the te923 driver does not (yet) do catchup.  we know how to read records from the station history, but we have not yet reverse-engineered the protocols for reading the archive interval and other station parameters required to do catchup.

if you want to help make it happen sooner than later, run a usb sniffer (e.g., wireshark) while running weather display or the software that came with your station.  the critical things we need to know are how to read the archive interval and how to modify the archive interval.

m

[Joep L. Blom]

m,

Thanks for your reply which makes clear the problems. I know that Weatherdisplay is written in Pascal/objectpascal. There is a Linux version but it has never worked for me and the source is not obtainable. The software that comes with it is also only for Windows and I assume written in C and also no source.
I assume that you know the little tool TE923-tool that gives a memory dump of the TE923. I know that the standard measure/archive interval of the TE923 is 300 sec. and I know you can change that (as I could do with the standard software and with WeatherDisplay). However I don't know the memory locattion where it is stored and also not the commands to control it but I know that it can be programmed with machinecode. I don't know it there is any assembler language for this device as I don't know which processor is used.

It would be very handy if somebody could do something to integrate historic data of the TE923 in weewx (or also wview!).

Joep

[Ulrik]

One way in principal to do it I assume to import the the table created from the Win program. Itis there as records,csv and in tab format. How do You do that in sql  I don't know. Maybe edit columns first in excel. I assume you do it only once.
Ulrik

[J.L. Blom]

Hi,
I'm starting to migrate from wview to weewx by installing it on a
raspberry pi 2.
Well installation apparently goes without a problem using
weewx_3.1.0-1_all.deb. However, the directory weewx with all figures
etc. is not installed. Moreover although "sudo service weewx start" says
that weewx is started, "ps -ef|grep weewx" or "ps -ef|grep weewxd"
doesn't show any running process called weewx or weewxd.
I haven't as yet coupled my weather station (Nexus TE923) to the pi (as
it is currently connected to my workstation), I had expected that it
should run.
Has someone ideas about what's happening?
Thanks in advance
Joep

Sent new with correct reply-address

[gjr80]

Hi,

Think we might need a little more info. First thing that comes to mind is when you installed weewx did you install using a Nexus TE923 or simulator? If you installed for the Nexus and it is not connected to the RPi then that will do it. The real story will be in the weewx logs though. Can you post the log extract from when weewx starts/attempts to start until it terminates (or whatever happens)?

Gary

[J.L. Blom]

Gary,
Thanks for your reaction. Yes, I didn't connect the TE923 as it is
running on my workstation and it is not possible (nor advisable) to
connect an external device that is controlled by the system to 2
different systems.
So I assume that's the reason. But I as I haven't changed the
configuration file I thought it would install without it. I don't like a
gap in my observations as there are already many due to periodic loss of
connectivity and the impossibility (of wview) to read the memory of the
TE923. Is that in the current version of weewx possible? That would be
an enormous improvement.
I would like to store the SQL database and the MYSQL database (as I load
it up) on the raspberry on a 64GB msd-card. But I don't know id I have
sufficient space for say 1 year or more data.
Maybe you can also give an answer on the 2 questions.
Thanks in advance
Joep

[gjr80]

Hi Joep,

You need to look in weewx.conf or post the log extract I mentioned to see what weewx is doing. In weewx.conf the station_type setting will tell you whether weewx is looking for your station or using the simulator. What is this parameter set to? In terms of what weewx can do with a TE923, you will probably need one of the TE923 users/developers to chime in, I run a Davis so I don't know. I note in the weewx User Guide the TE923 support is listed as 'experimental' so it is likely not as mature as some drivers and perhaps does not support all TE923 capabilities. If you search the forums or read any comments in the TE923 driver file you might get some useful info.

Database size is really like asking how long is a piece of string... For example, my archive interval is set to 5 minutes with SQLite and my database was 30-40 Mb last time I can remember looking and that was with about 2 years of data. Archive is probably the key driver of database size. I would expect at 64Gb card would have more than enough space for many years if data. I would be more concerned about the reliability of the card when used over a long period. Again searching the forums for SD card failures and the RPi will reveal many interning pieces of info.

Gary

[J.L. Blom]

Gary,
Thanks. That's valuable information. I know what I have to do and start
working on it.
Many thanks for your information and I hope I get it up and running.
I don't have much worries about the micro sd-card as my systems are
daily backed up on a hard disk even if I'm away for a longe period as
the backups are also made by the raspberry pi (using backuppc).
Thanks again
Joep