Corrupted Memory card. Now I lost 6 months of data?

[Joe]

I'm curious if anyone has any suggestions on this.

I had to revert back to a WEEWX backup from June of this year.  

I re imaged the SD card and booted it up. It began doing its thing.

I loaded the HTML and, the graph has 6 months of data not listed on the graphs.

Is there something I should be doing when I revert to a backup?

Thanks again guys.

[Karen K]

Warning: According to my experience memory cards get corrupted after some time of use. You may think of doing backup more often or running a second WeeWX on another computer.

[michael.k...@gmx.at]

If you didn't put the caurrent database, holding the values up until now, on the card, after reverting, that's exactly the expected behaviour.

Joe schrieb am Montag, 21. Dezember 2020 um 03:22:33 UTC+1:

[wes...@gmail.com]

running an RPI on an SSD is a bad idea as kk44 point out.  run your RPI on an SSD and life will be way better.

[Tom Keffer]

I have successfully run WeeWX on an SD card for over 6 years and counting without a problem. Currently, there has been almost 2 years of continuous uptime. http://www.threefools.org/weewx/status/index.html

You always want to do a backup, even for an SSD, but SD cards can provide long life provided:

• You get a good one. Not the one that came with the $59 IP camera you bought 3 years ago; and
• You use a UPS.

-tk

On Mon, Dec 21, 2020 at 8:31 AM wes...@gmail.com <wes...@gmail.com> wrote:

running an RPI on an SSD is a bad idea as kk44 point out.  run your RPI on an SSD and life will be way better.

--
You received this message because you are subscribed to the Google Groups "weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/f1495006-31ce-4f9a-ab74-f6834d167d2cn%40googlegroups.com.

[vince]

On Monday, December 21, 2020 at 11:00:40 AM UTC-8 Tom Keffer wrote:

You always want to do a backup, even for an SSD, but SD cards can provide long life provided:

• You get a good one. Not the one that came with the $59 IP camera you bought 3 years ago; and
• You use a UPS.

...and adding on - ALWAYS use a quality power supply when using a pi, as poor power is the quickest way to get a SD card to fail, 'especially' on a pi that is not a pi3 or pi4 model.   Check your syslogs for evidence of periodic low power as these things might be transient.  For example - I'm driving a pi3 attached to a 10" display that came with its own power supply that can feed the pi.  All it's doing is running a browser with an always on dashboard, but every time weewx runs its archive interval I get a low-power set of messages in syslog saying that even that is pushing the borderline power a little too far.  It's very repeatable.  The pi are 'very' sensitive to borderline power being provided...

[ch...@chrismaness.com]

I want to piggy back on this.  Is it feasible to do the old dump/restore to a NFS mount on a Pi4?  I used to do this on FreeBSD and it worked really nicely -- even from a live system.

Thanks, Chris KQ6UP

--
You received this message because you are subscribed to the Google Groups "weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/c41dd291-6aa7-4029-8ce1-da7df3f0c971n%40googlegroups.com.

[vince]

On Monday, December 21, 2020 at 12:18:02 PM UTC-8 ch...@chrismaness.com wrote:

I want to piggy back on this.  Is it feasible to do the old dump/restore to a NFS mount on a Pi4?  I used to do this on FreeBSD and it worked really nicely -- even from a live system.

Weewx doesn't care either way.

The operating system doesn't care either way.

So of course yes it is feasible.

That said, sqlite3 used to have some wording in its docs saying they don't guarantee data integrity if you have the db network mounted, although most people tend to ignore that caveat.    Lots of people NFS/SMB mount sqlite4 databases. FWIW, I do it at $job with db with over 20M records, although once the db is generated batch by some python magic it's essentially read-only so it's not quite an apples-and-apples comparison to weewx writing every few minutes to the db.

[vince]

(sigh - sqlite3 db in my previous post, of course...)

[Joe]

I appreciate the responses.  I'm having trouble updating to the newest version now so I'm not sure what went wrong overall.

[vince]

On Wednesday, December 23, 2020 at 7:42:49 AM UTC-8 Joe wrote:

 I'm having trouble updating to the newest version now so I'm not sure what went wrong overall.

In the absence of seeing any logs we don't either.

[Joe]

It says the package is not understood. I don't get this one.

root@raspberrypi:~# sudo apt-get install weewx

Reading package lists... Done

Building dependency tree       

Reading state information... Done

Suggested packages:

  sqlite ftp python-dev python-pip

The following packages will be upgraded:

  weewx

1 upgraded, 0 newly installed, 0 to remove and 207 not upgraded.

Need to get 0 B/1,207 kB of archives.

After this operation, 645 kB disk space will be freed.

E: /var/cache/apt/archives/weewx_4.2.0-1_all.deb not a valid DEB package.

E: Prior errors apply to /var/cache/apt/archives/weewx_4.2.0-1_all.deb

debconf: apt-extracttemplates failed: No such file or directory

dpkg-deb: error: archive '/var/cache/apt/archives/weewx_4.2.0-1_all.deb' contains not understood data member control.tar.xz, giving up

dpkg: error processing /var/cache/apt/archives/weewx_4.2.0-1_all.deb (--unpack):

 subprocess dpkg-deb --control returned error exit status 2

Errors were encountered while processing:

 /var/cache/apt/archives/weewx_4.2.0-1_all.deb

E: Sub-process /usr/bin/dpkg returned an error code (1)

root@raspberrypi:~# 

[Joe]

Right it was from July this year.  I don't have the 'current' one because the memory card suddenly died and was not accessable.

I assumed the online portion would be retained .

[Joe]

You mean to say running on the SD-CARD is bad idea?

I do get the inherent nature of SD-CARDS being unpredictible.  But I buy high quality cards.  The one I had been using was not unfortunately, but I switched to a red label super fast sandisk.

using an SSD would definitely be a good idea in my case.

[vince]

On Thursday, December 24, 2020 at 4:33:57 AM UTC-8 Joe wrote:

You mean to say running on the SD-CARD is bad idea?

Not bad, but not great if the card and power aren't quality.  But yes I misstyped my original reply.

Re: your previous message containing " dpkg-deb: error: archive '/var/cache/apt/archives/weewx_4.2.0-1_all.deb' contains not understood data member control.tar.xz, giving up", that's an unusual message.

What version of raspi os are you running ?

Can we see the contents of /etc/os-release and /etc/debian_version please ?

[wes...@gmail.com]

it is true that using a high quality sd card will provide a lot more life, but eventually it will fail.  personally i got tired of having to replace sd cards and reinstall.  would you use an sd card for the main storage of your pc?  my experience is that an ssd provides faster access, more reliability and much increased life span.  i have 7 rpis running and they all use an ssd.

[Joe]

Neither of those directories exist.

Its raspberrypi 3.18.7

[vince]

The current kernel version is 5.4.79 according to the release notes at https://www.raspberrypi.org/software/operating-systems

My suspicion is that you are running an ancient os version that is too old for the current packaged version of weewx.

Again, please run the following commands and provide the results.

• cat /etc/debian_version
• cat /etc/os-release

[Joe]

That worked.  7.8

PRETTY_NAME="Raspbian GNU/Linux 7 (wheezy)"

NAME="Raspbian GNU/Linux"

VERSION_ID="7"

VERSION="7 (wheezy)"

ID=raspbian

ID_LIKE=debian

ANSI_COLOR="1;31"

HOME_URL="http://www.raspbian.org/"

SUPPORT_URL="http://www.raspbian.org/RaspbianForums"

BUG_REPORT_URL="http://www.raspbian.org/RaspbianBugs"

root@raspberrypi:/etc# 

[vince]

Yup - your os is far too ancient for the libraries the weewx dpkg is built against.   That version went end-of-life in May-2018.

I'd suggest you reimage with the current RaspiOS from  https://www.raspberrypi.org/software/operating-systems and then you'll be up to date and supportable.  The weewx package works just fine in the current os.

[Joe]

Really sucks I gotta completely re-image and re-set my whole PI board for this.  I get used to set-forget .  I downloaded the files it needs. Database. conf files etc as the online site says.

I was hoping this program would be more backward compatible with the RPI OS.

[Tom Keffer]

I sympathize, but wheezy has not been supported by the RPi foundation in 2-1/2 years. Everything dies eventually.

You can try upgrading the operating system in situ:

sudo apt dist-upgrade

This hasn't always worked for me, but it's worth a try.

-tk

--
You received this message because you are subscribed to the Google Groups "weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/2dfc7a65-53b1-47e4-88a4-290c54b7d6a3n%40googlegroups.com.

[Tom Keffer]

Oh, and to answer your earlier question on what you need to save, see the section Making backups.

[vince]

You can get old versions of weewx .deb packages at http://weewx.com/downloads/released_versions/ if you know what version you used to use.   Check your weewx.conf file for the version identifier near the top.    You could alternately use the 'setup.py' method to install current weewx on your ancient os, likely using python2 that your old os probably has as its default.

But your preferred path is reflash to a current os and install current weewx and then you're good for a long time.   You're talking 15 minutes of work to do that.

I would suggest not bothering trying a dist-upgrade from debian-7 to debian-10, as it's going to take forever and likely will not work anyway.   Just reimage clean to current RaspiOS which is based on current debian and get caught up once and for all.

[Joe]

Reimaged it finally and got the database conf file and such transferred over.  

Now its catching up with all the data its been storing the past few days in the Davis and publishing the records for last few days.

I guess it has been a few years since I have done this so its not too bad I guess.

Hopefully I dont loose much data.  I'm still miffed why I lost 6mo of data when I restored a backup from 6 months ago but I probably just dont understand how the database is written is all.  

Such is life! I Do appreciate, as I always do the responses from the group.  

[Joe]

Looks like its all working and accessing the davis OK.

Only problem Im having now is the dates and times on the generated HTML are all over the place.  Some of it is from a couple days ago, some of it is last night and the mobile and smartphone HTML is not current.

[Graham Eddy]

sounds like some files might not be generating. are the timestamps on the generated files current? errors in log?

--
You received this message because you are subscribed to the Google Groups "weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/0771af19-832b-40a9-b96a-167d8f03790fn%40googlegroups.com.

[Joe]

I''m watching with TAIL and I dont see any errors. It's making the images and using FTP to send as needed but the dates and times on the published HTML is all over. Some says 2am, some says last night at 830pm.

The FTP files date/time are mostly Dec 26 now, but some are 25th.

[Graham Eddy]

to reduce the problem space, maybe ignore FTP for now - just look at the generated files locally. if timestamps are all over the place, either new ones are not being attempted (skin config error) or they are failing (template content failure)

watching tail, sometimes many screenfulls of log are generated at once and you can miss big chunks. i suggest using an editor to look at the log, line by line, to confirm (a) it has found the report definition; (b) it is enabled and will attempt generating all its files; (c) any errors; (d) completion of report generation

[Joe]

SO far Im not seeing any errrors. Other than the files themselves are still dated dec 25

Some are 12-27

var/www/weewx

total 852

drwxr-xr-x 7 root root  4096 Dec 27 19:51  .

drwxr-xr-x 3 root root  4096 Dec 25 20:40  ..

drwxr-xr-x 2 root root  4096 Dec 25 20:52  backgrounds

-rw-r--r-- 1 root root  5563 Dec 27 19:51  celestial.html

-rw-r--r-- 1 root root  7635 Dec 27 19:51  daybarometer.png

-rw-r--r-- 1 root root  6141 Dec 27 19:50  dayhumidity.png

-rw-r--r-- 1 root root  5387 Dec 27 19:51  dayhum.png

-rw-r--r-- 1 root root  9734 Dec 27 19:50  dayinside.png

-rw-r--r-- 1 root root  5382 Dec 27 19:50  daypond.png

-rw-r--r-- 1 root root  6543 Dec 27 19:51  dayradiation.png

-rw-r--r-- 1 root root  5813 Dec 27 19:51  dayrain.png

-rw-r--r-- 1 root root  6554 Dec 27 19:51  dayrx.png

-rw-r--r-- 1 root root  9199 Dec 27 19:50  daytempchill.png

-rw-r--r-- 1 root root  8421 Dec 27 19:51  daytempdew.png

-rw-r--r-- 1 root root  7835 Dec 27 19:51  daytempfeel.png

-rw-r--r-- 1 root root  7402 Dec 27 19:51  daytempin.png

-rw-r--r-- 1 root root  7825 Dec 27 19:51  daytemp.png

-rw-r--r-- 1 root root  5675 Dec 27 19:51  dayuv.png

-rw-r--r-- 1 root root 11334 Dec 27 19:51  dayvolt.png

-rw-r--r-- 1 root root  5620 Dec 27 19:51  daywinddir.png

-rw-r--r-- 1 root root  7357 Dec 27 19:51  daywind.png

-rw-r--r-- 1 root root  6148 Dec 27 19:51  daywindvec.png

-rw-r--r-- 1 root root  1150 Dec 27 19:46  favicon.ico

drwxr-xr-x 2 root root  4096 Dec 25 20:53  font

-rw-r--r-- 1 root root  7315 Dec 27 19:51 '#FTP.last'

-rw-r--r-- 1 root root 25919 Dec 27 19:50  index.html

-rw-r--r-- 1 root root   564 Dec 27 19:46  mobile.css

-rw-r--r-- 1 root root  2413 Dec 27 19:50  mobile.html

-rw-r--r-- 1 root root  7606 Dec 25 20:48  monthbarometer.png

-rw-r--r-- 1 root root 11985 Dec 27 19:50  month.html

-rw-r--r-- 1 root root  7135 Dec 25 20:48  monthhumidity.png

-rw-r--r-- 1 root root  6519 Dec 25 20:53  monthhum.png

-rw-r--r-- 1 root root  8204 Dec 25 20:51  monthinside.png

-rw-r--r-- 1 root root  5436 Dec 25 20:51  monthpond.png

-rw-r--r-- 1 root root  7674 Dec 25 20:51  monthradiation.png

-rw-r--r-- 1 root root  6976 Dec 25 20:48  monthrain.png

-rw-r--r-- 1 root root  7324 Dec 25 20:51  monthrx.png

-rw-r--r-- 1 root root  9045 Dec 25 20:48  monthtempchill.png

-rw-r--r-- 1 root root  9280 Dec 25 20:48  monthtempdew.png

-rw-r--r-- 1 root root  8541 Dec 25 20:53  monthtempfeel.png

-rw-r--r-- 1 root root  7629 Dec 25 20:53  monthtempin.png

-rw-r--r-- 1 root root  7808 Dec 25 20:53  monthtemp.png

-rw-r--r-- 1 root root  6344 Dec 25 20:51  monthuv.png

-rw-r--r-- 1 root root 12216 Dec 25 20:53  monthvolt.png

-rw-r--r-- 1 root root  6489 Dec 25 20:51  monthwinddir.png

-rw-r--r-- 1 root root  8153 Dec 25 20:51  monthwind.png

-rw-r--r-- 1 root root  6142 Dec 25 20:51  monthwindvec.png

drwxr-xr-x 2 root root  4096 Dec 27 19:50  NOAA

drwxr-xr-x 2 root root  4096 Dec 27 19:50  RSS

-rw-r--r-- 1 root root  6273 Dec 27 19:51  rss.xml

-rw-r--r-- 1 root root  5106 Dec 27 19:46  seasons.css

-rw-r--r-- 1 root root  6232 Dec 27 19:46  seasons.js

drwxr-xr-x 3 root root  4096 Dec 27 19:50  smartphone

-rw-r--r-- 1 root root 18994 Dec 27 19:50  statistics.html

-rw-r--r-- 1 root root  4724 Dec 27 19:51  tabular.html

-rw-r--r-- 1 root root  7191 Dec 27 19:51  telemetry.html

-rw-r--r-- 1 root root  8922 Dec 25 20:47  weekbarometer.png

-rw-r--r-- 1 root root 11995 Dec 27 19:50  week.html

-rw-r--r-- 1 root root  7023 Dec 25 20:52  weekhum.png

-rw-r--r-- 1 root root  8599 Dec 25 20:48  weekinside.png

-rw-r--r-- 1 root root  5919 Dec 25 20:47  weekpond.png

-rw-r--r-- 1 root root  9554 Dec 25 20:48  weekradiation.png

-rw-r--r-- 1 root root  7927 Dec 25 20:47  weekrain.png

-rw-r--r-- 1 root root  8094 Dec 25 20:48  weekrx.png

-rw-r--r-- 1 root root 11098 Dec 25 20:47  weektempchill.png

-rw-r--r-- 1 root root 11207 Dec 25 20:47  weektempdew.png

-rw-r--r-- 1 root root  9494 Dec 25 20:52  weektempfeel.png

-rw-r--r-- 1 root root  7420 Dec 25 20:52  weektempin.png

-rw-r--r-- 1 root root  8094 Dec 25 20:52  weektemp.png

-rw-r--r-- 1 root root  7026 Dec 25 20:48  weekuv.png

-rw-r--r-- 1 root root 11923 Dec 25 20:53  weekvolt.png

-rw-r--r-- 1 root root  7525 Dec 25 20:48  weekwinddir.png

-rw-r--r-- 1 root root  9247 Dec 25 20:48  weekwind.png

-rw-r--r-- 1 root root  7552 Dec 25 20:48  weekwindvec.png

-rw-r--r-- 1 root root  3533 Dec 27 19:46  weewx.css

-rw-r--r-- 1 root root  7767 Dec 25 20:51  yearbarometer.png

-rw-r--r-- 1 root root  9579 Dec 25 20:51  yearhilow.png

-rw-r--r-- 1 root root  7912 Dec 27 19:50  year.html

-rw-r--r-- 1 root root  7607 Dec 25 20:51  yearhumidity.png

-rw-r--r-- 1 root root  7017 Dec 25 20:53  yearhum.png

-rw-r--r-- 1 root root  8469 Dec 25 20:51  yearinside.png

-rw-r--r-- 1 root root  5372 Dec 25 20:51  yearpond.png

-rw-r--r-- 1 root root  7446 Dec 25 20:52  yearradiation.png

-rw-r--r-- 1 root root  6565 Dec 25 20:51  yearrain.png

-rw-r--r-- 1 root root  7311 Dec 25 20:51  yearrx.png

-rw-r--r-- 1 root root  9379 Dec 25 20:51  yeartempchill.png

-rw-r--r-- 1 root root  9988 Dec 25 20:51  yeartempdew.png

-rw-r--r-- 1 root root  8794 Dec 25 20:53  yeartempfeel.png

-rw-r--r-- 1 root root  7840 Dec 25 20:53  yeartempin.png

-rw-r--r-- 1 root root  7638 Dec 25 20:53  yeartemp.png

-rw-r--r-- 1 root root  6920 Dec 25 20:52  yearuv.png

-rw-r--r-- 1 root root 11815 Dec 25 20:53  yearvolt.png

-rw-r--r-- 1 root root  7589 Dec 25 20:51  yearwinddir.png

-rw-r--r-- 1 root root  8958 Dec 25 20:51  yearwind.png

-rw-r--r-- 1 root root  7648 Dec 25 20:51  yearwindvec.png

[Graham Eddy]

the .html timestamps are all current (assuming Dec 27 19:50 is current).

the .png timestamps are current until middle of the month images, then all old → stopping part way through image generation.

some of the .png timestamps are very late in the 5 minute reporting period → maybe not finishing one report before starting the next.

you will need to look at (post here) the detailed log showing from before the start of report generation until past the end of completion of report generation to see if there is overlap.

or maybe the image generator is crashing part-way → ditto for need to see detailed logs

[Joe]

Ok I will get a look at it in about a week after a needed vacation.

[Rob Cranfill]

With all this talk about "good quality" SD cards, can anyone share a recommendation?

I have an SSD that I run my main WeeWX/HomeAssistant server on, but I have several others that I play around with, and need to get some new SD cards for that purpose, so I figure I may as well get some "good" ones.

Thanks for any suggestions.

[vince]

https://www.amazon.com/SanDisk-Ultra-microSDXC-Memory-Adapter/dp/B073JWXGNT

[Lo LL]

I lost my Weewx PI the 25th of december : Pi hang and restart didn't help. I tried to access to SD card with a reader on another PI, and it was unreadable : the SD was without any partition for parted/fdisk !

I used testdisk tool (apt-get install testdisk) and it rebuild the partition table of SD. I recovered my Weewx in 10 mins :-)

Maybe it doesn't cover all SD failures but testdisk is a tool to test in these case.

In fact, i don't understand what could write on MBR w/o admin commands ? Maybe power failure during SD write had finished on bad sector...

[Joe]

Sandisk extreme with the red and brown two tone color.  Unfortuantely, I did not have one of these in the PI at the time.  Though I do now.  I've never had one fail .

[weather list]

The Meteobridge builder requires a high endurance microSD card for their NANO SD unit; I haven’t investigated to see if they come in higher capacities though it seems likely they would.

Choice of microSD Card 

To avoid lots of system fails caused by worn out consumer microSD cards we restrict microSD cards that can be used in the NANO to 1GB and 2GB industrial SLC cards. These are world-wide available from Mouser and other electronic distributors. We decided to enforce use of these high endurance cards to avoid having tons of unnecessary support requests and not to harm the reputation of the NANO SD by failed cards. Please trust in our experience with flash storage issues that there is simply no reasonable way to avoid buying of high-price, high-endurance SLC storage. These are the currently supported microSD cards: 

swissbit SFSD1024N1BM1TO-I-DF-221-STD (microSD Card, 1 GB, SLC Flash, -40°C - 85°C)
swissbit SFSD2048N1BM1MT-I-ME-221-STD (microSD Card, 2 GB, SLC Flash, -40°C - 85°C) 

swissbit SFSD2048N1BM1MT-E-ME-221-STD (microSD Card, 2 GB, SLC Flash, -25°C - 85°C)
ATP AF2GUDI (microSD Card, 2 GB, SLC Flash, -40°C – 80°C)
Cactus KS2GRIT-803M (microSD Card, 2 GB, SLC Flash, -45°C – 90°C)

Panasonic SMSC02DA1 (microSD Card, 2 GB, SLC Flash, -40°C - 85°C)

Apacer MSD02GIDI-T (microSD Card, 2 GB, SLC Flash) 

--
You received this message because you are subscribed to the Google Groups "weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/3efb56ad-5b36-4530-a492-d22f8ae0e1e1n%40googlegroups.com.

[Karen K]

In german people say (translated word by word): "Who buys cheap, buys twice."

[Joe]

Yep.  But I am away from the house on vacation. I'm still confused why im having trouble drawing graphs and posting current wx data via weewx.

[steep...@gmail.com]

There are more SLC cards available from Mouser and other distributors with much lager capacities. Those quoted below would struggle to contain an operating system, WeeWX and data.

 

Sent from Mail for Windows 10

To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/9D53803F-2DA9-4AD9-9AFE-B154AB984065%40gmail.com.

 

[storm...@gmail.com]

Or you can look into Berryboot: https://berryterminal.com/doku.php/berryboot

[Michael Form]

As someone has previously suggested, you can boot and run a Raspberry Pi off of a SSD. These are a lot more reliable than most SD cards and are available with huge capacities. Unless you are buying a 1 TB or 2 TB SSD, they are also relatively inexpensive. I am running several Pis, both models 3 and 4, on some 500 GB and 250 GB SSDs with no problems. You can also use a MSATA or M2 drive as well.

Although there are off the shelf solutions to do this (check out Geekworm), the easiest way is to buy an inexpensive SATA, MSATA or M2 to USB external interface and plug it into the Pi's USB port. If you use a Pi4, then you can run it as a USB3 device, which is faster.

Mike

To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/C5730ACE-3052-4D5D-B93A-DDF569033F1E%40hxcore.ol.

[Rainer Lang]

@ (not only) weatherlist

If you had copied the list completely, .... 😉

See below - bold by me.

(but possibly a SSD comes cheaper than the higher capacity SLC micro SD cards - still may need an enclosure with USB (best 3) interface; not too expensive either)

.....

Meteobridge enforces the use of one of the following industrial SLC cards:

......

• Western Digital/SanDisk SDSDQED-008G-XI, SDSDQED-016G-XI, SDSDQED-032G-XI, SDSDQED-064G-XI (microSD Card, 8-64 GB, SLC Flash)
• Greenliant GLS93MP008G1-I-BZ801 (microSD Card, 8 GB, SLC Flash)

To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/0997bb38-d65f-822a-998f-d8f2f45f4779%40verizon.net.

[Mike Revitt]

This was on of my main concerns when I first moved my WeeWX station to a Raspberry Pi, so I have added a nightly backup to AWS S3 for the database and as S3 now has versioning that will be my next addition so I have more than one backup .

I haven't gotten around to writing this up yet, but it has been working uninterrupted for 213 days.

If you want to know how I did it just reach out, the process is very similar to my solution for publishing to S3 which I have just finished writing up this week

[Joe]

  GNU nano 3.2                                                                                                        syslog                                                                                                                  

Here is the log

Jan  4 00:25:33 raspberrypi weewx[677] INFO weewx.restx: Wunderground-RF: Published record 2021-01-04 00:25:33 CST (1609741533)

Jan  4 00:25:35 raspberrypi weewx[677] INFO weewx.restx: Wunderground-RF: Published record 2021-01-04 00:25:35 CST (1609741535)

Jan  4 00:25:36 raspberrypi weewx[677] INFO weewx.imagegenerator: Generated 13 images for report StandardReport in 8.04 seconds

Jan  4 00:25:36 raspberrypi weewx[677] INFO weewx.reportengine: Copied 0 files to /var/www/weewx

Jan  4 00:25:36 raspberrypi weewx[677] DEBUG weewx.reportengine: Running report 'SeasonsReport'

Jan  4 00:25:36 raspberrypi weewx[677] DEBUG weewx.reportengine: Found configuration file /etc/weewx/skins/Seasons/skin.conf for report 'SeasonsReport'

Jan  4 00:25:37 raspberrypi weewx[677] DEBUG weewx.cheetahgenerator: Using search list ['weewx.cheetahgenerator.Almanac', 'weewx.cheetahgenerator.Station', 'weewx.cheetahgenerator.Current', 'weewx.cheetahgenerator.Stats', 'weewx.cheetahg$

Jan  4 00:25:37 raspberrypi weewx[677] DEBUG weewx.manager: Daily summary version is 2

Jan  4 00:25:49 raspberrypi weewx[677] INFO weewx.restx: Wunderground-RF: Published record 2021-01-04 00:25:49 CST (1609741549)

Jan  4 00:25:49 raspberrypi weewx[677] INFO weewx.cheetahgenerator: Generated 8 files for report SeasonsReport in 12.96 seconds

Jan  4 00:25:49 raspberrypi weewx[677] DEBUG weewx.manager: Daily summary version is 2

Jan  4 00:25:57 raspberrypi weewx[677] INFO weewx.imagegenerator: Generated 14 images for report SeasonsReport in 7.65 seconds

Jan  4 00:25:57 raspberrypi weewx[677] INFO weewx.reportengine: Copied 0 files to /var/www/weewx

Jan  4 00:25:57 raspberrypi weewx[677] DEBUG weewx.reportengine: Running report 'SmartphoneReport'

Jan  4 00:25:57 raspberrypi weewx[677] DEBUG weewx.reportengine: Found configuration file /etc/weewx/skins/Smartphone/skin.conf for report 'SmartphoneReport'

Jan  4 00:25:58 raspberrypi weewx[677] DEBUG weewx.cheetahgenerator: Using search list ['weewx.cheetahgenerator.Almanac', 'weewx.cheetahgenerator.Station', 'weewx.cheetahgenerator.Current', 'weewx.cheetahgenerator.Stats', 'weewx.cheetahg$

Jan  4 00:25:58 raspberrypi weewx[677] DEBUG weewx.manager: Daily summary version is 2

Jan  4 00:25:58 raspberrypi weewx[677] INFO weewx.cheetahgenerator: Generated 6 files for report SmartphoneReport in 0.75 seconds

Jan  4 00:25:58 raspberrypi weewx[677] DEBUG weewx.manager: Daily summary version is 2Jan  4 00:26:01 raspberrypi weewx[677] INFO weewx.restx: Wunderground-RF: Published record 2021-01-04 00:26:01 CST (1609741561)

Jan  4 00:26:01 raspberrypi weewx[677] INFO weewx.imagegenerator: Generated 6 images for report SmartphoneReport in 3.04 seconds

Jan  4 00:26:01 raspberrypi weewx[677] INFO weewx.reportengine: Copied 0 files to /smartphone

Jan  4 00:26:01 raspberrypi weewx[677] DEBUG weewx.reportengine: Running report 'MobileReport'

Jan  4 00:26:01 raspberrypi weewx[677] DEBUG weewx.reportengine: Found configuration file /etc/weewx/skins/Mobile/skin.conf for report 'MobileReport'

Jan  4 00:26:02 raspberrypi weewx[677] DEBUG weewx.cheetahgenerator: Using search list ['weewx.cheetahgenerator.Almanac', 'weewx.cheetahgenerator.Station', 'weewx.cheetahgenerator.Current', 'weewx.cheetahgenerator.Stats', 'weewx.cheetahg$

Jan  4 00:26:02 raspberrypi weewx[677] DEBUG weewx.manager: Daily summary version is 2

Jan  4 00:26:02 raspberrypi weewx[677] INFO weewx.cheetahgenerator: Generated 1 files for report MobileReport in 0.29 seconds

Jan  4 00:26:02 raspberrypi weewx[677] DEBUG weewx.manager: Daily summary version is 2

Jan  4 00:26:03 raspberrypi weewx[677] INFO weewx.restx: Wunderground-RF: Published record 2021-01-04 00:26:03 CST (1609741563)

Jan  4 00:26:04 raspberrypi weewx[677] INFO weewx.imagegenerator: Generated 4 images for report MobileReport in 2.06 seconds

Jan  4 00:26:04 raspberrypi weewx[677] INFO weewx.reportengine: Copied 0 files to /mobile

Jan  4 00:26:04 raspberrypi weewx[677] DEBUG weewx.reportengine: Running report 'FTP'

Jan  4 00:26:04 raspberrypi weewx[677] DEBUG weewx.reportengine: Found configuration file /etc/weewx/skins/Ftp/skin.conf for report 'FTP'

Jan  4 00:26:05 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/daywindvec.png to /daywindvec.png

Jan  4 00:26:06 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/daywind.png to /daywind.png

Jan  4 00:26:06 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/celestial.html to /celestial.html

Jan  4 00:26:06 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/tabular.html to /tabular.html

Jan  4 00:26:07 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/dayuv.png to /dayuv.png

Jan  4 00:26:07 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/dayradiation.png to /dayradiation.png

Jan  4 00:26:07 raspberrypi weewx[677] INFO weewx.restx: Wunderground-RF: Published record 2021-01-04 00:26:07 CST (1609741567)

Jan  4 00:26:07 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/year.html to /year.html

Jan  4 00:26:07 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/telemetry.html to /telemetry.html

Jan  4 00:26:08 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/dayvolt.png to /dayvolt.png

Jan  4 00:26:08 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/rss.xml to /rss.xml

Jan  4 00:26:08 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/week.html to /week.html

Jan  4 00:26:09 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/daytempfeel.png to /daytempfeel.png

Jan  4 00:26:09 raspberrypi weewx[677] INFO weewx.restx: Wunderground-RF: Published record 2021-01-04 00:26:09 CST (1609741569)

Jan  4 00:26:09 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/index.html to /index.html

Jan  4 00:26:09 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/daybarometer.png to /daybarometer.png

Jan  4 00:26:09 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/daytempin.png to /daytempin.png

Jan  4 00:26:10 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/daytemp.png to /daytemp.png

Jan  4 00:26:10 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/dayhum.png to /dayhum.png

Jan  4 00:26:10 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/dayrain.png to /dayrain.png

Jan  4 00:26:11 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/daypond.png to /daypond.png

Jan  4 00:26:11 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/daytempdew.png to /daytempdew.png

Jan  4 00:26:11 raspberrypi weewx[677] INFO weewx.restx: Wunderground-RF: Published record 2021-01-04 00:26:11 CST (1609741571)

Jan  4 00:26:11 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/statistics.html to /statistics.html

Jan  4 00:26:11 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/dayrx.png to /dayrx.png

Jan  4 00:26:12 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/dayhumidity.png to /dayhumidity.png

Jan  4 00:26:12 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/daywinddir.png to /daywinddir.png

Jan  4 00:26:12 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/month.html to /month.html

Jan  4 00:26:13 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/dayinside.png to /dayinside.png

Jan  4 00:26:13 raspberrypi weewx[677] INFO weewx.restx: Wunderground-RF: Published record 2021-01-04 00:26:13 CST (1609741573)

Jan  4 00:26:13 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/daytempchill.png to /daytempchill.png

Jan  4 00:26:13 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/mobile.html to /mobile.html

Jan  4 00:26:14 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/NOAA/NOAA-2021.txt to /NOAA/NOAA-2021.txt

Jan  4 00:26:14 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/NOAA/NOAA-2021-01.txt to /NOAA/NOAA-2021-01.txt

Jan  4 00:26:14 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/smartphone/temp_outside.html to /smartphone/temp_outside.html

Jan  4 00:26:15 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/smartphone/rain.html to /smartphone/rain.html

Jan  4 00:26:15 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/smartphone/barometer.html to /smartphone/barometer.html

Jan  4 00:26:15 raspberrypi weewx[677] INFO weewx.restx: Wunderground-RF: Published record 2021-01-04 00:26:15 CST (1609741575)

Jan  4 00:26:15 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/smartphone/index.html to /smartphone/index.html

Jan  4 00:26:15 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/smartphone/radar.html to /smartphone/radar.html

Jan  4 00:26:16 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/smartphone/wind.html to /smartphone/wind.html

Jan  4 00:26:16 raspberrypi weewx[677] DEBUG weeutil.ftpupload: Uploaded file /var/www/weewx/RSS/weewx_rss.xml to /RSS/weewx_rss.xml

Jan  4 00:26:16 raspberrypi weewx[677] INFO weewx.reportengine: ftpgenerator: Ftp'd 37 files in 11.63 seconds

Jan  4 00:26:16 raspberrypi weewx[677] DEBUG weewx.reportengine: Running report 'RSYNC'

Jan  4 00:26:16 raspberrypi weewx[677] DEBUG weewx.reportengine: Found configuration file /etc/weewx/skins/Rsync/skin.conf for report 'RSYNC'

Jan  4 00:26:16 raspberrypi weewx[677] DEBUG weewx.reportengine: rsyncgenerator: Rsync upload not requested. Skipped.

[Xant]

I recently also had a corrupted SD card. Tried many alternatives to recover data, including trying to mount at a Linux machine (at no prevail).

The only (Windows) solution that actually worked was, where I was able to read and retrieve data, was the freeware "DiskInternals Linux Reader":

https://www.diskinternals.com/linux-reader/

Xant

[salinois]

hi

happy new year at all

I had already this issue, now I used a disk ssd for my RPi3b.

bye

Patrick

To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/774affd0-b8b5-4f43-8de4-e8b415296c68n%40googlegroups.com.

[Joe]

Log give any clues ?

[Joe]

I upgraded to the most recent release, and it is reporting, generating new graphs on schedule.  

Not sure why that had any bearing on it, but it's working 100% now.

[salinois]

hi,

I bought that

bye

Patrick

To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/481eaa6b-952b-4dd0-99bc-1ce6d4336ef7n%40googlegroups.com.

[LeaF]

Mike,

You mentioned up above that you do a nightly backup to AWS S3 for the database.  Can you show us how that was accomplished?   (I followed your instructions on how to upload my weather data to S3, and it has worked perfectly. Thanks)

Lee

[Mike Revitt]

That is the next thing I plan to document, but at the moment I just do a file copy and am converting that to a SQLite backup and I am also planning to take advantage of S3 versioning so I have more than 1 copy