Lemur User

Lemur is a tool to launch hadoop jobs locally or on EMR, based on a configuration file, referred to as a jobdef. The jobdef file describes your EMR cluster, local environment, pre- and post-actions (aka hooks) and zero or more "steps". A step is Amazon's name for a task or job submitted to the cluster. Lemur reads your jobdef, at the end of your jobdef, you execute (fire! ...) to make things happen. Also keep in mind that the jobdef is an interpreted clj file, so you can insert arbitrary Clojure code to be executed anywhere in the file (but see HOOKS below for a better way).

Lemur is described here.  And help is on the wiki.




Showing 1-19 of 21 topics
Hadoop Training in Hyderabad jogi...@gmail.com 11/20/14
Hadoop Training in Hyderabad pmptra...@gmail.com 11/6/14
ANN: Lemur 1.4.3 lbar...@climate.com 10/14/14
wait-on-step does not wait when step name is defined using a $ variable Gareth Rogers 10/13/14
:step-jar, :run-time-jar, :jar-src-path and profiles Gareth Rogers 5/12/14
New Job updates from Referenceglobe ReferenceGlobe 4/11/14
unable to load parameter file Saeedeh Noroozi 4/4/14
Running from check out from Github Gareth Rogers 4/2/14
New Job updates from Referenceglobe ReferenceGlobe 3/28/14
Use Lemur as a library? kyle....@gmail.com 2/15/14
ANN: Lemur 1.4.0 - upgrade clojure dependency to 1.5 Steve Kim 1/23/14
Creating a cluster in the eu-west-1 region. Gareth Rogers 12/10/13
issue with mutli input elba...@gmail.com 7/18/13
Running lemur on eu-west instances c...@campanja.com 5/20/13
Run different types of jobs Aleks.E 5/8/13
ANN: Lemur 1.3.1 - submit steps to an existing job flow (cluster) Marc Limotte 2/20/13
Retry Vikram Kadi 1/28/13
how to use a keep-alive cluster ? fbrub...@gmail.com 11/7/12
doing a "big" project in Lemur fbrub...@gmail.com 10/16/12
More topics »