Run Map Reduce on non-default versions?

[Ranjit Chacko]

I have a couple of questions about the App Engine Map Reduce API. First of all there's a mapreduce package in the SDK, and there's a separate mapreduce bundle here:

https://developers.google.com/appengine/downloads

Which one should I be using? Should I be using the bundle, or is the documentation out of date and I should actually use the SDK version?

Second I'd like to be able to run mapreduce's on a non-default version to make sure that the requests from the mapreduce don't interfere with user requests.

What's the best way to do this? Can I start the pipeline with a task queue, and set the target version of that queue to be my non-default version?

[Jim Morrison]

As long as you start the mapreduce on a non-default version it will
continue to run in the non-default version. I also run my mapreduces
through a separate taskqueue. One advantage of using the separate
mapreduce bundle is that you can put in your own changes. E.g. I
pickle the mapper key value pairs so that I can send full objects
between the mapper and reducer.

> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengi...@googlegroups.com.
> To post to this group, send email to google-a...@googlegroups.com.
> Visit this group at http://groups.google.com/group/google-appengine?hl=en.
> For more options, visit https://groups.google.com/groups/opt_out.
>
>



--
Jim

[Ranjit Chacko]

Other than being able to customize the bundle, are there any other differences between it and the SDK version? What's the "official" way of using map reduces according to Google?

 So when you run your mapreduces in a separate queue do you pass in the queue_name to the pipeline.start() command, just like with the normal Pipeline API? 

[Jim Morrison]

On Fri, Mar 1, 2013 at 10:06 AM, Ranjit Chacko <rjch...@gmail.com> wrote:
> Other than being able to customize the bundle, are there any other
> differences between it and the SDK version? What's the "official" way of
> using map reduces according to Google?
>
> So when you run your mapreduces in a separate queue do you pass in the
> queue_name to the pipeline.start() command, just like with the normal
> Pipeline API?

Yes.