[rabbitmq-discuss] RabbitMQ Streaming

[Richard Holt]

Hi All,

I was wondering if there is a java implementation of the Stream. functions
i.e. Stream.Publish e.t.c.

We are using very large files in some cases and the Basic.Publish balks at
very large messages as does the client JVM.

Regards,

Richard
--
View this message in context: http://old.nabble.com/RabbitMQ-Streaming-tp27273093p27273093.html
Sent from the RabbitMQ mailing list archive at Nabble.com.

_______________________________________________
rabbitmq-discuss mailing list
rabbitmq...@lists.rabbitmq.com
http://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss

[Paul Jones]

Hi Richard,

At this point, neither Rabbit nor the clients support the stream functions. However, it shouldn't be too difficult to do this yourself. It has been discussed a number of times on the list before - one of the simplest solutions is to break your stream up into pieces yourself, and then include a custom header indicating when the stream is finished.

Cheers,
Paul.

[Richard Holt]

Hi thanks for that it was what i expected as i saw the posts you mention.

I just wanted to clarify that there wasn't implicit support from the
AMQ.Stream code out of the box that just hadnt been linked into the java
libraries.

What has been discussed seems to indicate the use of the Basic.Publish
mechanism with tailored header support around it.

I was hoping there would be something already written which would allow
this.

Regards,

Richard Holt wrote:
>
> Hi All,
>
> I was wondering if there is a java implementation of the Stream. functions
> i.e. Stream.Publish e.t.c.
>
> We are using very large files in some cases and the Basic.Publish balks at
> very large messages as does the client JVM.
>
> Regards,
>
> Richard
>

--
View this message in context: http://old.nabble.com/RabbitMQ-Streaming-tp27273093p27303852.html

[Paul Jones]

Not that I know I'm afraid. If you do end up writing code to do it though (and manage to separate it from the rest of your codebase), I'm sure many in the community would be interested in using it.

[Richard Holt]

Thanks and yes I am sure they would :) we will have to see if we have the
time do this work first though as we anticipated a smaller time to develop
this than appears to be necessary now.

--
View this message in context: http://old.nabble.com/RabbitMQ-Streaming-tp27273093p27304228.html

[Richard Holt]

I have just been reading the specification and it may be that the file
contents class is more relevant has anyone put this client in place or do i
need to write this?

thanks

Richard Holt wrote:
>
> Hi All,
>
> I was wondering if there is a java implementation of the Stream. functions
> i.e. Stream.Publish e.t.c.
>
> We are using very large files in some cases and the Basic.Publish balks at
> very large messages as does the client JVM.
>
> Regards,
>
> Richard
>

--
View this message in context: http://old.nabble.com/RabbitMQ-Streaming-tp27273093p27304798.html

[Alexis Richardson]

Richard

What language are you working in?

If it's Ruby, then Nanite supports streaming by chunking, over RabbitMQ, iirc.

alexis

On Mon, Jan 25, 2010 at 9:50 AM, Richard Holt

[Richard Holt]

We are primarily a java house as such we would prefer to work with that if
possible. If however this cuts out the work then ruby may become a
possibility.

--
View this message in context: http://old.nabble.com/RabbitMQ-Streaming-tp27273093p27304999.html

[Alexis Richardson]

OK.

There are some file transfer java classes out there in the wild. I
cannot recall where, but google may help a bit here.

On Mon, Jan 25, 2010 at 11:00 AM, Richard Holt

[Richard Holt]

i have just found 2 posts which discuss the removal of both these facilities
from the specification anyway so is it a good idea for us to even consider
this route?

Richard Holt wrote:
>
> Hi All,
>
> I was wondering if there is a java implementation of the Stream. functions
> i.e. Stream.Publish e.t.c.
>
> We are using very large files in some cases and the Basic.Publish balks at
> very large messages as does the client JVM.
>
> Regards,
>
> Richard
>

--
View this message in context: http://old.nabble.com/RabbitMQ-Streaming-tp27273093p27305221.html

[Alexis Richardson]

Richard

Yes it is fine for you to do this. The use case is common and valid.
However that does not mean it needs to be spelt out in the spec
itself. One thing we realised about AMQP is that it says a bit too
much in the spec. It needs to talk about *messaging* - everything
else is an application of messaging.

alexis

[asaf david]

Did you end up implementing this? If possible, I'd really love seeing the code as i have to do the same thing exactly

thanks