How does barman manage wal files?

84 views
Skip to first unread message

杨华杰

unread,
Apr 20, 2013, 10:13:05 PM4/20/13
to pgba...@googlegroups.com
Hi 


I make barman working, but soon after I found a problem. The wal files are filling up the free space of the backup server. I searched over google and found the size can consume 50GB a day. I could not afford such a hard disk consume when the real data size may just 23MB.


Maybe this is also the truth, the primary server's free hard disk is consuming when the connection between primary and back up server dis-connected. 


Above all, does barman has a solution.




Regards,
Hua Jie

Veit Guna

unread,
Apr 21, 2013, 5:05:40 AM4/21/13
to pgba...@googlegroups.com

Hi.

I think it depends on how many writes take place on the database. The more you perform updates, insert and deletes, the larger the wal files will be. Our database for example is 1,2 GB in size but takes only about 200-300 MB wals per day. You may consider using wal compression as well.





"杨华杰" <yhj...@gmail.com> schrieb:

--
Von meinem Tablet gesendet.

杨华杰

unread,
Apr 21, 2013, 9:40:18 PM4/21/13
to pgba...@googlegroups.com
Hi Guna

I don't think so. I am testing the barman function. My database size is only  23 MB.


Regards,
Hua Jie


--
--
You received this message because you are subscribed to the "Barman for PostgreSQL" group.
To post to this group, send email to pgba...@googlegroups.com
To unsubscribe from this group, send email to
pgbarman+u...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/pgbarman?hl=en?hl=en-GB
 
---
You received this message because you are subscribed to a topic in the Google Groups "Barman, Backup and Recovery Manager for PostgreSQL" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/pgbarman/LViNn1qzW8Q/unsubscribe?hl=en-GB.
To unsubscribe from this group and all of its topics, send an email to pgbarman+u...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

Gabriele Bartolini

unread,
Apr 22, 2013, 3:47:33 AM4/22/13
to pgba...@googlegroups.com, 杨华杰
Hi Hua Jie,

Il 22/04/13 03:40, 杨华杰 ha scritto:
> I don't think so. I am testing the barman function. My database size
> is only 23 MB.
I am very interesting in hearing your definition for "barman function".
WAL compression indeed is one of the features of Barman as Veit was saying.

Cheers,
Gabriele

--
Gabriele Bartolini - 2ndQuadrant Italia
PostgreSQL Training, Services and Support
gabriele....@2ndQuadrant.it | www.2ndQuadrant.it

杨华杰

unread,
Apr 22, 2013, 12:27:47 PM4/22/13
to Gabriele Bartolini, pgba...@googlegroups.com
From a user view, I only see the wal files are increasing like a rocket......


 gabriele.bartolini@2ndQuadrant.it | www.2ndQuadrant.it


Gabriele Bartolini

unread,
Apr 22, 2013, 12:57:02 PM4/22/13
to pgba...@googlegroups.com, Gabriele Bartolini, pgba...@googlegroups.com
Please, you have not defined "barman function" yet.

Cheers,
Gabriele

Inviato da iPhone
--
--
You received this message because you are subscribed to the "Barman for PostgreSQL" group.
To post to this group, send email to pgba...@googlegroups.com
To unsubscribe from this group, send email to
pgbarman+u...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/pgbarman?hl=en?hl=en-GB
 
---
You received this message because you are subscribed to the Google Groups "Barman, Backup and Recovery Manager for PostgreSQL" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pgbarman+u...@googlegroups.com.

杨华杰

unread,
Apr 22, 2013, 9:05:26 PM4/22/13
to pgba...@googlegroups.com, Gabriele Bartolini
HI Gabirele

Which function should I refer? I have 1 week experience to fight with barman.


Regards,
Hua Jie


You received this message because you are subscribed to a topic in the Google Groups "Barman, Backup and Recovery Manager for PostgreSQL" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/pgbarman/LViNn1qzW8Q/unsubscribe?hl=en-GB.
To unsubscribe from this group and all of its topics, send an email to pgbarman+u...@googlegroups.com.

Gabriele Bartolini

unread,
Apr 23, 2013, 5:01:47 AM4/23/13
to 杨华杰, pgba...@googlegroups.com
Hi Hua Jie,

On Tue, 23 Apr 2013 09:05:26 +0800, 杨华杰 <yhj...@gmail.com> wrote:
> Which function should I refer?

I don't know, you mention you were testing the "barman function". I
asked for more information on this definition.

> I have 1 week experience to fight with barman.

My understanding is that your main issues are not with Barman (please
do not use the term 'fight'), rather with understanding the way
PostgreSQL handles crash and disaster recovery.

As we always say (it is in the documentation as well), working with
Barman requires knowledge on PostgreSQL.

As far as I see it, your issue is tied to the archive_timeout setting.
Could you please describe the kind of environment you are intending to
use Barman? Is it a business continuity environment? What is your SLA?

Cheers,
Gabriele
--
Gabriele Bartolini - 2ndQuadrant Italia
PostgreSQL Training, Services and Support
Gabriele....@2ndQuadrant.it - www.2ndQuadrant.it

杨华杰

unread,
Apr 24, 2013, 9:48:05 PM4/24/13
to Gabriele Bartolini, pgba...@googlegroups.com
Hi Babriele

I think I got my answer in the Retention policies section.


Thanks for your patient.


Regards,
Hua Jie




 Gabriele.Bartolini@2ndQuadrant.it - www.2ndQuadrant.it

Gabriele Bartolini

unread,
Apr 25, 2013, 1:58:59 AM4/25/13
to pgba...@googlegroups.com, 杨华杰
Hi Hua,

Il 25/04/13 03:48, 杨华杰 ha scritto:
> I think I got my answer in the Retention policies section.
That's great!
> Thanks for your patient.
No worries, enjoy the "espresso" backup with Barman! - it is actually
breakfast time for me. :)

Cheers,
Gabriele

--
Gabriele Bartolini - 2ndQuadrant Italia
PostgreSQL Training, Services and Support
gabriele....@2ndQuadrant.it | www.2ndQuadrant.it

Reply all
Reply to author
Forward
0 new messages