Does makeExtractable have some way to use a rhipe control object?

[jeremiah rounds]

https://github.com/tesseradata/datadr/blob/5334ea10c86136de2fea7ff19a69841388345fc6/R/ddo_ddf_kvHDFS.R#L75

makeExtractable has no way to use a control object like the other MapReduce functions in datadr and the MapReduce uses defaults?  I dunno I am asking.

Thanks,

Jeremiah

[Jakub Paulina]

I am looking forward for this funkcionality too. I think every function should have control function to handle Hadoop mapred settings in R. Is still Tessera/ datadr / Rhipe / Trelliscope under develompent or its dead project ? For example trelliscope tutoriall is under construction for some months.

[Jakub Paulina]

But if i am not wrong u can use global option with Rhoptions() funkcion to setup hadoop. For example i curently used rhoptions(mapreduce.map.memory.mb = 3072) to increase memory. And it works

[jeremiah rounds]

Thanks for the tip.  I have noticed Saptarshi uses the rhoptions heavily too, but for some reason I developed the habit of resetting them for every job.

On Mon, May 16, 2016 at 12:15 PM, Jakub Paulina <jakub.pa...@gmail.com> wrote:

But if i am not wrong u can use global option with Rhoptions() funkcion to setup hadoop. For example i curently used rhoptions(mapreduce.map.memory.mb = 3072) to increase memory. And it works

--
You received this message because you are subscribed to the Google Groups "Tessera-Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to tessera-user...@googlegroups.com.
To post to this group, send email to tesser...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/tessera-users/f480ff1e-6308-4f95-9826-8b5e08f24373%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

[Ryan Hafen]

That’s correct that you can set parameters globally with rhoptions, but often you want to set job-specific parameters, in which case we really do need to make sure the control option is available to every method that kicks off an M/R job. I’ve updated makeExtractable accordingly.  You can install from github (this change is not yet on CRAN).

As for the status of Tessera, the project is alive and in use daily.  Last month datadr and trelliscope were added to CRAN.  We are a bit low on developer resources at the moment, with a lot of resources dedicated to theory and application, while I have been tied up with a lot of travel / consulting work.  Also, we are rewriting a lot of the internals of Trelliscope and writing a new Trelliscope viewer from scratch that will have a lot of nice features - a lot to juggle while keeping documentation / etc. up to date.  We welcome any contributions from the community :).

Ryan

To view this discussion on the web visit https://groups.google.com/d/msgid/tessera-users/CAOjnRsYb0d9GvEoiXrdCFyiteLbAjodxoo7hTxM1nT3Hfp%2BxpA%40mail.gmail.com.