Google Groups no longer supports new Usenet posts or subscriptions. Historical content remains viewable.
Dismiss

AW: mbox can't go over 2gb?

539 views
Skip to first unread message

Mark Romen

unread,
Sep 21, 2010, 5:04:11 AM9/21/10
to
Can i convert a mbox Mailbox to mdir?

mark

-----Ursprüngliche Nachricht-----
Von: CommuniGate Pro Discussions [mailto:CGat...@mail.stalker.com] Im Auftrag von Shaun Gamble
Gesendet: Freitag, 17. September 2010 04:30
An: CommuniGate Pro Discussions
Betreff: Re: mbox can't go over 2gb?

Possibly, portability of code enforces this limit on the developers.

When you look at the size of our Sales and Marketing team collective
emails as well as our development team, there is no way I can use mbox
for this lot any more. Architects still love to send full CAD drawings,
published as PDF via email. Thankfully the 15MB limit rule I imposed
forces most users to use something like YouSendIt. But the development
team need to receive large emails. It is not uncommon for architects
(from another company) to try and send 100MB emails. One of my customers
has 30GB of email. I "trained him" to regularly "file" emails into
separate folders.

I also use a monitor account to archive all incoming and outgoing email.
Needless to say, this account was moved to mdir very quickly.

On 17/09/2010 1:56 AM, Communigate Forum wrote:
> so in conclusion and just one more time...
>
> please can we finally rid cgp of this totally artificial mbox limit so
> we can make best use of the work done to make mbox the best format in
> terms of searching which is a very common requirement...
>
> i simply do not understand why getting rid of the now antique limit is
> so hard, its a real pain in the butt!
>
> rup
>
>
> On 16/09/2010 13:20, Jeff Wark wrote:
>> The use could organize into other folders, but that breaks the
>> ability to search your mail efficiently.
>>
>> On 9/15/2010 4:27 PM, Aaron Willems wrote:
>>> I was forced to switch users to mdir in order to get around the 2 GB
>>> mbox limit. I have one user with a 9 GB inbox. Refuses to delete any
>>> email.
>>>
>>> Aaron Willems
>>> Lieberman Productions
>>> Systems Administrator
>>> Sent from my iPad
>>>
>>> On Sep 15, 2010, at 12:35 PM, slamp slamp<slac...@gmail.com> wrote:
>>>
>>>> is anyone running on a 64-bit OS/CGPro and hitting this mbox file
>>>> limit?
>>>>

--

Shaun
http://www.fitzroyisland.com http://www.destinationnt.com
http://www.momdarwin.com http://www.valueinn.com.au
Please do not send any unsolicited email. It is not wanted.


#############################################################
This message is sent to you because you are subscribed to
the mailing list <CGat...@mail.stalker.com>.
To unsubscribe, E-mail to: <CGateP...@mail.stalker.com>
To switch to the DIGEST mode, E-mail to <CGatePr...@mail.stalker.com>
To switch to the INDEX mode, E-mail to <CGatePr...@mail.stalker.com>
Send administrative queries to <CGatePro...@mail.stalker.com>


#############################################################
This message is sent to you because you are subscribed to
the mailing list <CGat...@mail.stalker.com>.
To unsubscribe, E-mail to: <CGateP...@mail.stalker.com>
To switch to the DIGEST mode, E-mail to <CGatePr...@mail.stalker.com>
To switch to the INDEX mode, E-mail to <CGatePr...@mail.stalker.com>
Send administrative queries to <CGatePro...@mail.stalker.com>

Nicolas Hatier

unread,
Sep 21, 2010, 8:51:19 AM9/21/10
to

http://www.niversoft.com/products/cgscripts/#fast_mailbox_conversion
http://www.niversoft.com/products/cgscripts/#convert_mailboxes

I'm in the process of rewriting the imap-based script (the second link). The first script is much faster anyway, but requires CGP to be stopped.

Regards
Nicolas Hatier


On 2010-09-21 05:04, Mark Romen wrote:
Can i convert a mbox Mailbox to mdir?

mark


--

Nicolas Hatier, ing. <nicolas...@niversoft.com>
Niversoft idées logicielles - http://www.niversoft.com

Matthew Black

unread,
Sep 21, 2010, 10:23:21 AM9/21/10
to
On Tue, 21 Sep 2010 11:04:11 +0200
"Mark Romen" <mark....@lvh.it> wrote:
> Can i convert a mbox Mailbox to mdir?
>
> mark


I'm sure Nicolas H has a toolbox to help you. Here's another solution:

1. Make sure the user's New Mailbox Format is set to MDIR.
2. Create a CGP password to login to the account and enable CGP password.
This only works if your users login with their OS Password. Otherwise, you
need to save their current CGP password and restore when finished.
3. Login to their account.
4. Rename existing mbox folder
5. Create new folder with the correct name
6. Move messages to new folder and verify that worked.
7. Delete old (renamed) folder, which should be empty.

Cheers.

matthew black
e-mail postmaster
california state university, long beach

Communigate Forum

unread,
Sep 21, 2010, 11:16:45 AM9/21/10
to
this whole thing should be controlled by the server and changes made
via the web interface..

when making this kind of change you may have a large amount of highly
valuable mail to convert, stalker should as the supplier of the server
take ownership of this task by this operation being run via the normal
account handling area in a safe and fully logged way, rather than leave
us to use various scripts and work rounds...

this is totally unsatisfactory along with the now antiquated 2gb mailbox
limit.

rup

Support@ish

unread,
Sep 21, 2010, 5:48:40 PM9/21/10
to
you sure you guys are not running into file system limitations?

On 22/09/10 1:16 AM, Communigate Forum wrote:
> this is totally unsatisfactory along with the now antiquated 2gb mailbox
> limit.

--
-------------------------->
ish
http://www.ish.com.au
Level 1, 30 Wilson Street Newtown 2042 Australia
phone +61 2 9550 5001 fax +61 2 9550 4001

Shaun Gamble

unread,
Sep 21, 2010, 7:59:28 PM9/21/10
to
On 22/09/2010 7:48 AM, Support@ish wrote:
> you sure you guys are not running into file system limitations?
>
> On 22/09/10 1:16 AM, Communigate Forum wrote:
>> this is totally unsatisfactory along with the now antiquated 2gb mailbox
>> limit.
>

The 2GB limit is a well known and well discussed CGP limitation on this
forum. If you have a folder, in mbox format, it cannot exceed 2GB. This
does not mean an account's total email cannot be larger than 2GB, it
just means a single mbox file cannot exceed 2GB. MBox is a desired
format for it's indexing. Backup problems and size limitation tend to
rule it out. Changing a folder from mbox to mdir will get rid of the
limitation.

Personally, I don't really have a problem with the file size limit. I
have accepted it and moved on. While the limit can cause problems, I'd
prefer portability over a larger mbox file any day.

--

Bleek Thomas

unread,
Sep 22, 2010, 2:35:59 AM9/22/10
to
I can't understand why CG don't split the mbox file into several files if it is approaching the 2GB limit. This could be implemented completely transparent to the clients.

Perhaps this could be done with even smaller pieces, for instance splitting into 100MB chunks. So we would have fast access over NFS and also reducing the backup/snapshot disadvantages because changes in the folder will not everytime result in a big new file to backup.

What I am missing here?
thomas

--
Dr. Thomas Bleek, Netzwerkadministrator
Helmholtz-Zentrum Potsdam
Deutsches GeoForschungsZentrum
Telegrafenberg G261
D-14473 Potsdam
Tel.: +49 331 288- 1818/1681 Fax.: 1730 Mobil: +49 172 1543233
E-Mail: b...@gfz-potsdam.de

Communigate Forum

unread,
Sep 22, 2010, 4:37:14 AM9/22/10
to
sounds like an excellent plan to me!!!

perfect!

rup

Graeme Fowler

unread,
Sep 22, 2010, 5:06:38 AM9/22/10
to
On 22/09/10 07:35, Bleek Thomas wrote:
> I can't understand why CG don't split the mbox file into several files if it is approaching the 2GB limit. This could be implemented completely transparent to the clients.
>
> Perhaps this could be done with even smaller pieces, for instance splitting into 100MB chunks. So we would have fast access over NFS and also reducing the backup/snapshot disadvantages because changes in the folder will not everytime result in a big new file to backup.
>
> What I am missing here?

That it would not be mbox format, but something else. A halfway house
between 1 message per file (maildir/mdir) and 1 folder per file (mbox).

Not that it sounds like a totally crazy idea, but it would require
CommuniGate to have its' own "proprietary" mailbox format; that's not
really something the company or product are well known for, is it?

Graeme

Communigate Forum

unread,
Sep 22, 2010, 5:11:58 AM9/22/10
to
a degree of pragmatism would be required its true... ;-)

sounds pretty cool though...

rup

Bleek Thomas

unread,
Sep 22, 2010, 5:22:29 AM9/22/10
to

Am 22.09.2010 um 11:06 schrieb Graeme Fowler:
>
> That it would not be mbox format, but something else. A halfway house
> between 1 message per file (maildir/mdir) and 1 folder per file (mbox).

So we could perhaps combine the advantages of both formats and avoid/reduce the disadvantages?

>
> Not that it sounds like a totally crazy idea, but it would require
> CommuniGate to have its' own "proprietary" mailbox format; that's not
> really something the company or product are well known for, is it?

No Client should "see" this. Only for admins like us the process of restoring of mailboxes gets a little more complicated. I think, the advantages outweigh this and it should be not a big problem for CG to implement this. But I think, their focus is more on the multimedia-stuff:-(

I'm waiting for years for an indexing-solution for mdir like that for mbox.

I would prefer to have them working more at the foundation of the wonderful, stable core CGP mail-system (mail, calendaring, adressbook, finito!).
But don't let us discuss this here again and again,
tb

>
> Graeme
>
> #############################################################
> This message is sent to you because you are subscribed to
> the mailing list <CGat...@mail.stalker.com>.
> To unsubscribe, E-mail to: <CGateP...@mail.stalker.com>
> To switch to the DIGEST mode, E-mail to <CGatePr...@mail.stalker.com>
> To switch to the INDEX mode, E-mail to <CGatePr...@mail.stalker.com>
> Send administrative queries to <CGatePro...@mail.stalker.com>

--


Dr. Thomas Bleek, Netzwerkadministrator
Helmholtz-Zentrum Potsdam
Deutsches GeoForschungsZentrum
Telegrafenberg G261
D-14473 Potsdam
Tel.: +49 331 288- 1818/1681 Fax.: 1730 Mobil: +49 172 1543233
E-Mail: b...@gfz-potsdam.de

John Kougoulos

unread,
Sep 22, 2010, 9:17:44 AM9/22/10
to

>> Perhaps this could be done with even smaller pieces, for instance
>> splitting into 100MB chunks. So we would have fast access over NFS and
>> also reducing the backup/snapshot disadvantages because changes in the
>> folder will not everytime result in a big new file to backup.
>

> That it would not be mbox format, but something else. A halfway house
> between 1 message per file (maildir/mdir) and 1 folder per file (mbox).
>
> Not that it sounds like a totally crazy idea, but it would require
> CommuniGate to have its' own "proprietary" mailbox format; that's not
> really something the company or product are well known for, is it?
>

This mailbox format is implemented in uw-imapd, it's the "mix" format.

Obviously a new mailbox format would mean that the Communigate developers
would have to maintain one extra format, which means that each time an
extra feature is needed it has to be implemented in 3 mailbox formats
instead of 2 (eg 50% increased development time), not to mention the
initial development and testing.

In uw-imap mdir was not supported, and there was no plan to support it, so
the mix format was created. In CGPro mdir works very well, so I guess
there isn't any significant reason to invest into other mailbox formats.

Another similar suggestion would be to invest into database mailbox
formats, but this would increase a lot the complexity to system
administrators.

Regards,
John

0 new messages