Use Lemur as a library?

[kyle....@gmail.com]

Lemur brings a good bit of value in wrapping the aws sdk's for working with EMR and making interaction easier.

The command line interface looks convenient for integrating with shell based tooling.

What I'd like to be able to do is use Lemur as a library from my existing Clojure based systems - are there any plans to make Lemur (a jar) available via Clojars?

I realize that I can install the jar locally in my ~/.m2/repo or to another private repo (we do have an s3 backed repo set up), but I'd prefer to use official project releases.

Regards,

Kyle

[Marc Limotte]

Kyle,

See this Lemur issue: https://github.com/TheClimateCorporation/lemur/issues/23

marc

--
You received this message because you are subscribed to the Google Groups "Lemur User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to lemur-user+...@googlegroups.com.
To post to this group, send email to lemur...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/lemur-user/df3f587c-e262-46b0-a2b6-f61e74879953%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

[Kyle R. Burton]

Thanks for your reply.

With respect to managing global state, what are the options?  Creating adding an additional arity to each funciton that needs the context - an optional first argument which is the context; or using a dynamic var, where users can set the binding they wish to use.  

I haven't read through the tests, do you feel the tests cover enough of the core or would significant additional testing be necessary?

If I know what approach you're planning on, perhaps I can do some of the work.

Best Regards,

Kyle

--
You received this message because you are subscribed to a topic in the Google Groups "Lemur User" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/lemur-user/TXi_ZMvolGM/unsubscribe.
To unsubscribe from this group and all its topics, send an email to lemur-user+...@googlegroups.com.

To post to this group, send email to lemur...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/lemur-user/CAAQjde6__bToGz-0qJTdeNBE0A-%3DmtNKa_snwc_FeMmsJ%2BHaMw%40mail.gmail.com.

For more options, visit https://groups.google.com/groups/opt_out.

--
Twitter: @kyleburton
Github: https://github.com/kyleburton
Blog: http://asymmetrical-view.com/
Fun: http://snapclean.me/

[Marc Limotte]

Hi Kyle,

Test coverage is reasonable.

Adding an additional arg to each function signature would be the better answer.  It's more explicit than a dynamic-var.  If you want to give this a shot, that would be great.

marc

To view this discussion on the web visit https://groups.google.com/d/msgid/lemur-user/CANP%2B8r%3D%2BXxQGMEEU%2Bsbqi%2BpODm9mWdim1C49jzj%3DdtAqROVY%2BQ%40mail.gmail.com.

[Kyle R. Burton]

Marc,

With respect to the tests, do the tests assert internal lemur functionality or do they actually allocate AWS resources and execute EMR jobs?  

When trying to run 'lein test', it looks like the tests require AWS credentials - I'd prefer to be able to execute tests without actually interacting with AWS.  Is that possible?

Kyle

To view this discussion on the web visit https://groups.google.com/d/msgid/lemur-user/CAAQjde7QqCWAFa-cRMonQ7OMUdrzNBB%2BMxQuwMXdQj%2BR1puyrQ%40mail.gmail.com.

For more options, visit https://groups.google.com/groups/opt_out.

[Marc Limotte]

If you run `lein test` that will run just the unit tests, which do not rely on Amazon Web Services.  Most (all?) of lemur.core-test has only these unit tests.

Then you can run `lein test :integration` -- the integration tests do interact with Amazon.

And finally, `lein test :manual` will actually launch an elastic mapreduce instance.  This one doesn't run with the integration tests, because in the case of failure, it might leave your instance running.  So it should get special attention as far as running.

marc

To view this discussion on the web visit https://groups.google.com/d/msgid/lemur-user/CANP%2B8rmkUHxqO0M4v%3D%3DYGNesO5Mn%3D1nHEHwAK%2Bbv1Wigoh3rsw%40mail.gmail.com.