Can RabbitMQ handle big messages? - rabbitmq-discuss

The old Google Groups will be going away soon, but your browser is incompatible with the new version.
Message from discussion Can RabbitMQ handle big messages?
Received-SPF: pass (google.com: best guess record for domain of rabbitmq-discuss-boun...@lists.rabbitmq.com designates 208.91.1.33 as permitted sender) client-ip=208.91.1.33;
Mime-Version: 1.0 (Apple Message framework v1257)
From: Zabrane Mickael <zabra...@gmail.com>
In-Reply-To: <D0F7A57E-006B-4D9E-9860-0C27CAC05...@vmware.com>
Date: Sat, 10 Mar 2012 20:46:31 +0100
Message-Id: <70117899-BD8D-4A70-B6F7-9EB2B7CEF...@gmail.com>
References: <mailman.0.1331402953.5162.rabbitmq-disc...@lists.rabbitmq.com>
	<A939D4D2-C60B-4C2B-9FA2-581F6A67C...@gmail.com>
	<D0F7A57E-006B-4D9E-9860-0C27CAC05...@vmware.com>
To: Jerry Kuch <jer...@vmware.com>
Cc: "rabbitmq-disc...@lists.rabbitmq.com" <rabbitmq-disc...@lists.rabbitmq.com>
Subject: Re: [rabbitmq-discuss] Can RabbitMQ handle big messages?
Precedence: list
Content-Type: multipart/mixed; boundary="===============6238967836880100955=="
Sender: rabbitmq-discuss-boun...@lists.rabbitmq.com
Errors-To: rabbitmq-discuss-boun...@lists.rabbitmq.com


--===============6238967836880100955==
Content-Type: multipart/alternative; boundary="Apple-Mail=_19595AFB-C56F-405B-8086-C49C977AAD89"


--Apple-Mail=_19595AFB-C56F-405B-8086-C49C977AAD89
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=us-ascii

Thanks Jerry.

I'll experiment with that advice and come back soon.

Regards,
Zabrane

On Mar 10, 2012, at 7:34 PM, Jerry Kuch wrote:

> Hi, Zabrane:  In theory the AMQP protocol IIRC allows crazy large =
message payloads (2^64 bytes I believe).  In practice though, that's =
madness since you end up with potential copying and buffering along the =
way that could make a broker very unhealthy.
>=20
> For moving bulk binary data as in your app, you'd be wise to fragment =
at the producer and reassemble at the destination/consumer. Keeping your =
chunks in the 100KB range might be a decent place to start =
experimenting. =20
>=20
> Sent from my iPhone (Brevity and typos are hopefully the result of =
1-fingered typing rather than rudeness or illiteracy).
>=20
>=20
> On Mar 10, 2012, at 10:28 AM, Zabrane Mickael <zabra...@gmail.com> =
wrote:
>=20
>> Hi there,
>>=20
>> I've a set (~1 million) of high resolution PNG files  each one =
between 100MB and 1GB size.
>> I'd like to know if RabbitMQ is capable of handling such files as =
messages?
>>=20
>> What's the max allowed message size?
>>=20
>> Thx ...
>>=20
>> Regards,
>> Zabrane
>>=20
>> _______________________________________________
>> rabbitmq-discuss mailing list
>> rabbitmq-disc...@lists.rabbitmq.com
>> https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss




--Apple-Mail=_19595AFB-C56F-405B-8086-C49C977AAD89
Content-Transfer-Encoding: quoted-printable
Content-Type: text/html;
	charset=us-ascii

<html><head></head><body style=3D"word-wrap: break-word; =
-webkit-nbsp-mode: space; -webkit-line-break: after-white-space; =
">Thanks Jerry.<div><br><div>I'll experiment with that advice and come =
back =
soon.</div><div><br></div><div><div>Regards,</div><div>Zabrane</div><div><=
br></div><div><div>On Mar 10, 2012, at 7:34 PM, Jerry Kuch =
wrote:</div><br class=3D"Apple-interchange-newline"><blockquote =
type=3D"cite"><div bgcolor=3D"#FFFFFF"><div>Hi, Zabrane: &nbsp;In theory =
the AMQP protocol IIRC allows crazy large message payloads (2^64 bytes I =
believe). &nbsp;In practice though, that's madness since you end up with =
potential copying and buffering along the way that could make a broker =
very unhealthy.</div><div><br></div><div>For moving bulk binary data as =
in your app, you'd be wise to fragment at the producer and reassemble at =
the destination/consumer. Keeping your chunks in the 100KB range might =
be a decent place to start experimenting. &nbsp;<br><br>Sent from my =
iPhone (Brevity and typos are hopefully the result of 1-fingered typing =
rather than rudeness or illiteracy).<div><br =
class=3D"webkit-block-placeholder"></div></div><div><br>On Mar 10, 2012, =
at 10:28 AM, Zabrane Mickael &lt;<a =
href=3D"mailto:zabra...@gmail.com">zabra...@gmail.com</a>&gt; =
wrote:<br><br></div><div></div><blockquote type=3D"cite"><div>Hi =
there,<div><br></div><div>I've a set&nbsp;(<b>~1 million</b>)&nbsp;of =
high resolution <b>PNG</b> files &nbsp;each one between <b>100MB</b> and =
<b>1GB</b>&nbsp;size.</div><div>I'd like to know if <b>RabbitMQ</b> is =
capable of handling such files as =
messages?</div><div><br></div><div>What's the max allowed message =
size?</div><div><br></div><div>Thx ...</div><div><br></div><div><div>
<span class=3D"Apple-style-span" style=3D"border-collapse: separate; =
font-family: Helvetica; font-style: normal; font-variant: normal; =
font-weight: normal; letter-spacing: normal; line-height: normal; =
orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; =
widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; =
-webkit-border-vertical-spacing: 0px; =
-webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: =
auto; -webkit-text-stroke-width: 0px; font-size: medium; =
"><div>Regards,</div><div>Zabrane</div></span>
</div>
<br></div></div></blockquote><blockquote =
type=3D"cite"><div><span>_______________________________________________</=
span><br><span>rabbitmq-discuss mailing list</span><br><span><a =
href=3D"mailto:rabbitmq-disc...@lists.rabbitmq.com">rabbitmq-discuss@lists=
.rabbitmq.com</a></span><br><span><a =
href=3D"https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discu=
ss">https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss</=
a></span><br></div></blockquote></div></blockquote></div><div =
apple-content-edited=3D"true"><br>
</div>
<br></div></div></body></html>=

--Apple-Mail=_19595AFB-C56F-405B-8086-C49C977AAD89--

--===============6238967836880100955==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
rabbitmq-discuss mailing list
rabbitmq-disc...@lists.rabbitmq.com
https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss

--===============6238967836880100955==--
Create a group - Google Groups - Google Home - Terms of Service - Privacy Policy
Account Options
