Google Groups no longer supports new Usenet posts or subscriptions. Historical content remains viewable.
Dismiss

Buffer size exceeded

45 views
Skip to first unread message

Merciadri Luca

unread,
Dec 6, 2009, 10:11:14 AM12/6/09
to
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hi,

I just used `G f path_to_my_mbox_files/my_mbox_file' to add a group
with one of my mbox files, but I encounter `Buffer size exceeded.'
Okay, I have a lot of mails, and the mbox file is ~2 Gig, but why is
not Gnus able to cope with it? Is there any alternative? (I do not
want to cut this file into different pieces.)

Thanks.
- --
Merciadri Luca
See http://www.student.montefiore.ulg.ac.be/~merciadri/
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Processed by Mailcrypt 3.5.8 <http://mailcrypt.sourceforge.net/>

iEYEARECAAYFAksbyZIACgkQM0LLzLt8MhycqQCdHM/pyIeG9drwPi1e54l8T/3M
xgIAoJoLugsz5ikMLd0fPCi3vVQhS2HY
=HIqj
-----END PGP SIGNATURE-----

Tassilo Horn

unread,
Dec 7, 2009, 8:31:52 AM12/7/09
to info-gnu...@gnu.org
Merciadri Luca <Luca.Me...@student.ulg.ac.be> writes:

Hi Merciadri,

> I just used `G f path_to_my_mbox_files/my_mbox_file' to add a group
> with one of my mbox files, but I encounter `Buffer size exceeded.'
> Okay, I have a lot of mails, and the mbox file is ~2 Gig, but why is
> not Gnus able to cope with it? Is there any alternative? (I do not
> want to cut this file into different pieces.)

That's an restriction on the maximal buffer size in emacs, and has
nothing to do with gnus. With older emacsen, the limit was 256MB on a
32 bit architecture. With a newer emacs or a 64 bit system, this should
be more.

Evaluate this code to get the maximal MB a buffer may have:

--8<---------------cut here---------------start------------->8---
(/ most-positive-fixnum 1024 1024) ;; <== C-x C-e here!
--8<---------------cut here---------------end--------------->8---

For me it says that the limit is at 2199023255551 MB. That's more than
an ext4 file system can handle. ;-)

I don't know if the variable `most-positive-fixnum' exists in older
emacs versions, but evaluating this should result in the same:

--8<---------------cut here---------------start------------->8---
(let ((i 1024))
(while (> i 0)
(setq i (* i 2)))
(message "Emacs can handle files of %s MB size"
(/ (1- i) 1024 1024))) ;; <== C-x C-e here!
--8<---------------cut here---------------end--------------->8---

Bye,
Tassilo

Merciadri Luca

unread,
Dec 8, 2009, 8:36:59 AM12/8/09
to
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Tassilo Horn <tas...@member.fsf.org> writes:

Tassilo,

Thanks for this answer. My value (/i.e./ the result of the evaluation
of the expression you asked me to type) equals 255. I am not on a 64-bit
architecture, but with a highmem kernel.

Your second expression gives
"Emacs can handle files of 255 MB size"
actually saying the same as the last result.

Any idea on how to change this?

Thanks!

- --
Merciadri Luca
See http://www.student.montefiore.ulg.ac.be/~merciadri/
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Processed by Mailcrypt 3.5.8 <http://mailcrypt.sourceforge.net/>

iEYEARECAAYFAkseVnsACgkQM0LLzLt8MhysJQCfenVqRteCiKFvfiu1sjVrAC57
Uj8AoJAdda1KAOZKCUV2zgHR4GEKWZIo
=6uNE
-----END PGP SIGNATURE-----

Adam Sjøgren

unread,
Dec 9, 2009, 3:36:34 AM12/9/09
to
On Tue, 08 Dec 2009 14:36:59 +0100, Merciadri wrote:

> I am not on a 64-bit architecture, but with a highmem kernel.

> Your second expression gives
> "Emacs can handle files of 255 MB size"
> actually saying the same as the last result.

> Any idea on how to change this?

Change to a 64-bit architecture or reimplement an Emacs?


:-),

Adam

--
"I always liked songs with parentheses in the title." Adam Sj�gren
as...@koldfront.dk

Merciadri Luca

unread,
Dec 9, 2009, 10:28:55 AM12/9/09
to
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

as...@koldfront.dk (Adam Sjøgren) writes:

> Change to a 64-bit architecture or reimplement an Emacs?

I do not understand why it is limited by the local architecture. Can
you explain this?

Reimplementing an Emacs could be fun, but I do not want to. :-)


- --
Merciadri Luca
See http://www.student.montefiore.ulg.ac.be/~merciadri/
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Processed by Mailcrypt 3.5.8 <http://mailcrypt.sourceforge.net/>

iEYEARECAAYFAksfwjcACgkQM0LLzLt8Mhwq+QCeJJXVNghelOliHuFq+00pfWti
OgYAniSb2y1DHRKgoA/TZp3avYL0fwXx
=kVry
-----END PGP SIGNATURE-----

Adam Sjøgren

unread,
Dec 9, 2009, 10:45:33 AM12/9/09
to
On Wed, 09 Dec 2009 16:28:55 +0100, Merciadri wrote:

> as...@koldfront.dk (Adam Sj�gren) writes:

>> Change to a 64-bit architecture or reimplement an Emacs?

> I do not understand why it is limited by the local architecture. Can
> you explain this?

No, but emacswiki has some information:

* http://www.emacswiki.org/emacs/EmacsFileSizeLimit


Best regards,

Merciadri Luca

unread,
Dec 9, 2009, 4:20:12 PM12/9/09
to
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

as...@koldfront.dk (Adam Sjøgren) writes:

> On Wed, 09 Dec 2009 16:28:55 +0100, Merciadri wrote:
>

>> as...@koldfront.dk (Adam Sjøgren) writes:
>
>>> Change to a 64-bit architecture or reimplement an Emacs?
>
>> I do not understand why it is limited by the local architecture. Can
>> you explain this?
>
> No, but emacswiki has some information:
>
> * http://www.emacswiki.org/emacs/EmacsFileSizeLimit

Thanks! Useful link.


- --
Merciadri Luca
See http://www.student.montefiore.ulg.ac.be/~merciadri/
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Processed by Mailcrypt 3.5.8 <http://mailcrypt.sourceforge.net/>

iEYEARECAAYFAksgFIwACgkQM0LLzLt8MhxOoQCeLZDZ0ZUIQwoDHkKy48Vjfo0s
Eq0AnjAOMjh0ewX/TbBUK5KDxCqzSPuV
=exOK
-----END PGP SIGNATURE-----

0 new messages