[gentoo-user] Compressed Filesystem
Helmut Jarausch
I'm looking for a working and maintained compressed filesystem.
I'd like to use it for backing up my root and my /usr filesystems,
so that I can use rsync to keep it up-to-date.
I've come across CompFused which seems to be just what I'm looking for,
but it's buggy not maintained anymore.
Similarly, fusecompress
http://bugs.gentoo.org/show_bug.cgi?id=127433
doesn't build on an up-to-date Gentoo system and doesn't
look maintained either.
There would be sys-fs/zfs-fuse but that sounds like overkill to me.
Are there any other packages?
Many thanks for a hint,
Helmut.
--
Helmut Jarausch
Lehrstuhl fuer Numerische Mathematik
RWTH - Aachen University
D 52056 Aachen, Germany
William Kenworthy
> Hi,
>
> I'm looking for a working and maintained compressed filesystem.
> I'd like to use it for backing up my root and my /usr filesystems,
> so that I can use rsync to keep it up-to-date.
>
> I've come across CompFused which seems to be just what I'm looking for,
> but it's buggy not maintained anymore.
>
> Similarly, fusecompress
> http://bugs.gentoo.org/show_bug.cgi?id=127433
> doesn't build on an up-to-date Gentoo system and doesn't
> look maintained either.
>
> There would be sys-fs/zfs-fuse but that sounds like overkill to me.
>
> Are there any other packages?
>
> Many thanks for a hint,
> Helmut.
Tried a few for this and besides the unmaintained part, they dont stand
up to the battering that rsync dishes out - regular corruption.
If you have space, look at dirvish (its in portage) on reiserfs. Tried
it on ext2 and ext3 - more corruption but reiserfs3 with data=journal is
rock solid. The devs reccomend not using a journaled FS for
performance, but I found it essential for my setup.
Dirvish takes the full size for the first backup. Subsequent backups
create hard links to existing files so only differences show up as using
space. After a number of backups, total size stabilises around 2x
original space unless you add some large files, or do an "emerge -ep
world" :)
Can be easily managed by cron and ssh keys including how many backups to
keep etc. Can use on a local system, or more usually to a remote
machine. Restore is as simple as copying the files back (though special
files an permissions need to be maintained so a simple copy isnt viable
for a full system restore.)
BillK
Mike Kazantsev
Helmut Jarausch <jara...@igpm.rwth-aachen.de> wrote:
> Hi,
>
> I'm looking for a working and maintained compressed filesystem.
> I'd like to use it for backing up my root and my /usr filesystems,
> so that I can use rsync to keep it up-to-date.
>
> I've come across CompFused which seems to be just what I'm looking
> for, but it's buggy not maintained anymore.
>
> Similarly, fusecompress
> http://bugs.gentoo.org/show_bug.cgi?id=127433
> doesn't build on an up-to-date Gentoo system and doesn't
> look maintained either.
>
> There would be sys-fs/zfs-fuse but that sounds like overkill to me.
>
> Are there any other packages?
Although it might not be stable enough yet, btrfs has support for
compression.
--
Mike Kazantsev // fraggod.net
Volker Armin Hemmann
> Hi,
>
> I'm looking for a working and maintained compressed filesystem.
> I'd like to use it for backing up my root and my /usr filesystems,
> so that I can use rsync to keep it up-to-date.
>
> I've come across CompFused which seems to be just what I'm looking for,
> but it's buggy not maintained anymore.
>
> Similarly, fusecompress
> http://bugs.gentoo.org/show_bug.cgi?id=127433
> doesn't build on an up-to-date Gentoo system and doesn't
> look maintained either.
>
> There would be sys-fs/zfs-fuse but that sounds like overkill to me.
>
> Are there any other packages?
>
> Many thanks for a hint,
> Helmut.
>
reiser4. Bonus, it only tries to compress stuff that can be compressed (the
test is quick&dirty and sometimes wrong, but most of the time good enough).
Helmut Jarausch
Thanks!
But what's the future of reiser4 FS ? What are the advantages compared
to btrfs ?
Many thanks,
Volker Armin Hemmann
> On 28 Dec, Volker Armin Hemmann wrote:
> > On Montag 28 Dezember 2009, Helmut Jarausch wrote:
> >> Hi,
> >>
> >> I'm looking for a working and maintained compressed filesystem.
> >> I'd like to use it for backing up my root and my /usr filesystems,
> >> so that I can use rsync to keep it up-to-date.
> >>
> >> I've come across CompFused which seems to be just what I'm looking for,
> >> but it's buggy not maintained anymore.
> >>
> >> Similarly, fusecompress
> >> http://bugs.gentoo.org/show_bug.cgi?id=127433
> >> doesn't build on an up-to-date Gentoo system and doesn't
> >> look maintained either.
> >>
> >> There would be sys-fs/zfs-fuse but that sounds like overkill to me.
> >>
> >> Are there any other packages?
> >>
> >> Many thanks for a hint,
> >> Helmut.
> >
> > reiser4. Bonus, it only tries to compress stuff that can be compressed
> > (the test is quick&dirty and sometimes wrong, but most of the time good
> > enough).
>
> Thanks!
> But what's the future of reiser4 FS ? What are the advantages compared
> to btrfs ?
reiser4 was denied for 'layer violation'.
btrfs violates those layers even more.
I do no know btrfs. But there are two nice things about reiser4:
it takes your data seriously. It tries everything to make sure your data hit
the platter. Device does not support barriers? Reiser4 detects that and goes
into sync mode.
Second, reiser4 is really, really really fast (except mounting).
Volker Armin Hemmann
> Am 29.12.2009 14:04, schrieb Volker Armin Hemmann:
> > I do no know btrfs. But there are two nice things about reiser4:
> > it takes your data seriously. It tries everything to make sure your data
> > hit the platter. Device does not support barriers? Reiser4 detects that
> > and goes into sync mode.
> > Second, reiser4 is really, really really fast (except mounting).
>
>
> would you recommend it over ext4 for a productive root-fs, considering
> speed and safety .... ?
just think a moment of the tons of bug fixes constantly going into ext4. That
crap is not stable. Pre-alpha maybe.
Stefan G. Weichinger
> I do no know btrfs. But there are two nice things about reiser4:
> it takes your data seriously. It tries everything to make sure your data hit
> the platter. Device does not support barriers? Reiser4 detects that and goes
> into sync mode.
> Second, reiser4 is really, really really fast (except mounting).
thinking "ricer" here (ricer vs. reiser ;-) ):
would you recommend it over ext4 for a productive root-fs, considering
speed and safety .... ?
Personally I avoided reiserfs for years after having some really bad
crashes back then .... but sure, things developed since then.
S
Volker Armin Hemmann
> On Wed, 2009-12-30 at 00:08 +0100, Volker Armin Hemmann wrote:
> > just think a moment of the tons of bug fixes constantly going into
> > ext4. That
> > crap is not stable. Pre-alpha maybe.
>
> root directory of my laptop since July 2008. The only problem I've had
> since then is one time it would not mount on boot. I merely had to fsck
> it from a live media an then it was ok (nothing lost or currupted). But
> that was a long time ago when it was still ext4dev. And I've had
> numerous crashes and battery depletions on the laptop without incident.
> So the pre-alpha FUD that some people are spreading is either not true
> or I just happen to be the luckiest ext4 user in the world :-).
>
tell that to the people who got their configs zeroed because extX devs value
benchmarks at default settings as more important than your data.
Albert Hopkins
> ext4. That
> crap is not stable. Pre-alpha maybe.
People say this from time to time, yet I have been running ext4 on my
Stefan G. Weichinger
>> would you recommend it over ext4 for a productive root-fs, considering
>> speed and safety .... ?
>
> just think a moment of the tons of bug fixes constantly going into ext4. That
> crap is not stable. Pre-alpha maybe.
hmm, thanks for that thought ...
Stroller
On 30 Dec 2009, at 00:17, Albert Hopkins wrote:
> ... The only problem I've had
> since then is one time it would not mount on boot. I merely had to
> fsck
> currupted).
Fixed this for you.
Stroller.
Marcus Wanner
working. My problem was that the input drivers were not working (because
they had not been recompiled after an update), so once I ran startx, no
keyboard or mouse input was registered. This meant that every time I
tried something which I thought would fix it, I had to hard reset the
system and look at the logs. The only problem was that the logs had the
wrong contents because they had been "written to" but not actually
flushed to the disk, and it took me about 10 hard resets to figure that
out. Even though I was running ext4, I never lost a thing (except the
logs :p).
For the curious, I eventually got good logs by running shutdown -h 1 in
one tty right before running startx in the other, and that shutdown the
system correctly.
Marcus
Volker Armin Hemmann
you could have set up acpid to switch to vt1 when the power button is pressed.
This is a nice safeguard against a misbehaving X.
Neil Bothwick
> I had to hard reset the
> system and look at the logs. The only problem was that the logs had the
> wrong contents because they had been "written to" but not actually
> flushed to the disk, and it took me about 10 hard resets to figure that
> out.
Another reason to you the magic sysrq keys instead of the reset button.
S syncs your filesystems.
--
Neil Bothwick
Get your copy at http://www.geekthing.com/~robf/gensig/
Marcus Wanner
> On Wed, 30 Dec 2009 09:12:29 -0500, Marcus Wanner wrote:
>
>
>> I had to hard reset the
>> system and look at the logs. The only problem was that the logs had the
>> wrong contents because they had been "written to" but not actually
>> flushed to the disk, and it took me about 10 hard resets to figure that
>> out.
>>
> Another reason to you the magic sysrq keys instead of the reset button.
> S syncs your filesystems.
>
Wait, to get sysrq is Shift+printscreen, right?
Marcus
Dale
This is from a post by Neil a good long while back:
Hold down Atl, hold down SysRq, press each of the keys in turn. The usual
full sequence is R-E-I-S-U-B
Reboot
Even
If
System
Utterly
Broken
I usually only get to the second or third key and I am back at a console.
That help?
Dale
:-) :-)
Volker Armin Hemmann
and sometimes K is all you need.
Thank god for /usr/src/linux/Documentation
Marcus Wanner
Marcus
Dale
This was posted by Volker a while back.
e sends TERM to all processes (except init)
i kills all processes (except init)
s syncs partitions
u remounts everything ro
b boots a box
o turns off a box
k saks a box - kills all processes on that vt
That tells what each key does. I'm still not sure which one took me back to a console. It may be the E key that does it.
Dale
:-) :-)
r unraws the keyboars - takes it away from X.
Enrico Weigelt
> Hi,
>
> I'm looking for a working and maintained compressed filesystem.
> I'd like to use it for backing up my root and my /usr filesystems,
> so that I can use rsync to keep it up-to-date.
Perhaps you could try venti+fossil or git.
cu
--
----------------------------------------------------------------------
Enrico Weigelt, metux IT service -- http://www.metux.de/
cellphone: +49 174 7066481 email: in...@metux.de skype: nekrad666
----------------------------------------------------------------------
Embedded-Linux / Portierung / Opensource-QM / Verteilte Systeme
----------------------------------------------------------------------
Helmut Jarausch
> Helmut Jarausch wrote:
>> Hi,
>>
>> I'm looking for a working and maintained compressed filesystem.
>> I'd like to use it for backing up my root and my /usr filesystems,
>> so that I can use rsync to keep it up-to-date.
>
> Perhaps you could try venti+fossil or git.
>
Are there any ebuilds around?
Mike Kazantsev
Helmut Jarausch <jara...@igpm.rwth-aachen.de> wrote:
> On 3 Jan, Enrico Weigelt wrote:
> >
> > Perhaps you could try venti+fossil or git.
> >
> Thanks, but I haven't found venti or fossil in Gentoo's tree.
> Are there any ebuilds around?
You'd need plan9 for these ;)
Enrico Weigelt
> On 3 Jan, Enrico Weigelt wrote:
>> Helmut Jarausch wrote:
>>> Hi,
>>>
>>> I'm looking for a working and maintained compressed filesystem.
>>> I'd like to use it for backing up my root and my /usr filesystems,
>>> so that I can use rsync to keep it up-to-date.
>> Perhaps you could try venti+fossil or git.
>>
> Thanks, but I haven't found venti or fossil in Gentoo's tree.
> Are there any ebuilds around?
plan9port
>
> Helmut.