On Wed, 08 Feb 2023 10:27:53 -0800, Andy Valencia <
van...@vsta.org>
wrote:
>Jeff Liebermann <
je...@cruzio.com> writes:
>> Please use an image backup, not a file by file or incremental backup.
>
>With 16TB, this becomes questionable.
None of my customers have huge data storage requirements. The worst
case customer is a collector of ripped videos and music with lossless
compression. I think he has about 200TB of these, all scattered among
multiple NAS servers. For backup, he mirrors the partitions (not the
drives) to other NAS servers, some of which are offsite. Since drive
capacity continues to grow, the expansion rate is about 4 times the
data for every new NAS drive. EXT3 can handle volumes up to 32TB, so
mirroring to NAS drives should be functional for a few more years.
When that hits the wall, EXT4 will go to 1 Exabyte.
However, he's an exception. I'm officially retired and no longer
service companies and corporation. All of my customers are either
home users or small businesses. Typically, their laptop or desktop
machines will run Windoze 10 or 11 and have between 50 and 100GB of
used space. Workstation SSD drive capacity is typically about 500GB.
The backup drives are typically 2TB USB-3 drives. A 100GB backup
typically will compress to about 75GB, which allows for 20 image
backups on each 2TB drive. Android and IOS pretty much take care of
themselves.
The basic idea is to inspire users to actually perform their own
backups. None of my users have an IT staff available. The problem is
they all have excuses not to do backups. What image backups bring to
the table is speed. The image backup doesn't take very long. 100GB
might take about 20 minutes. That's fast enough to do over a lunch
break. If it's not a major ordeal, and I remind them often, they will
usually do backups.
>When they're part of four disks in a
>single filesystem, it's not a good idea at all.
I don't have any customers that use RAID storage on their laptops or
desktops. They might have a NAS that uses RAID. By breaking up
everything into smaller partitions, that can be backed up
individually, image backups are still useful. When someone tries to
do an image backup of everything in one giant gulp that things go
awry. It's like eating a big meal. It works if you eat it in small
bites, but your can choke on it if you try to eat the entire meal in
one swallow.
>I use btrfs for file
>servers, and it has worked very well in production, WRT backups, and it
>nicely supports moving a disk to a new one (same size or larger) while in
>production. If you don't want to roll your own, Synology has some nice
>devices which are powered by it.
Synology is what I used to use for NAS. I had some problems which I
don't want to discuss (because some were my fault). Currently, I'm
using TrueNAS CORE (FreeNAS). However, most of remaining customers
have minimal storage requirements and don't need a NAS box.
>OTOH, if you have a filesystem on a single disk, I have products like these:
>
>
https://www.ebay.com/itm/314238381638
>
>(I haven't used this particular one; my own is not listed any more.)
I have something like that which I used to use for formatting, testing
and mirroring hard disk drives. I haven't had much need for something
like that recently. Reminder... I'm retired, which means I'm lazy.
>They seem to run at full media speed, I haven't found a faster way to move
>bits to a new disk.
The next generation of machines will probably use NVMe drives running
at PCI bus speeds or seven times faster than SATA. The only way to
move data quickly between NVMe drives is a PC motherboard with dual
PCIe-x16. I'm too lazy to calculate which generation of PCIe will be
required. I haven't seen the need or the hardware to do this yet, but
I'm fairly certain they will arrive shortly. My customer that
collects videos has seen Linus Tech Tips on YouTube, where Linus
demonstrates his 10gigabit ethernet (fiber) network. Copying files
across 10g is amazingly fast. It's one of these videos:
<
https://www.youtube.com/@LinusTechTips/search?query=10g+network>
Interesting nostalgia on your web site.
Good luck. In computers, everything you know today, is wrong
tomorrow.