Lemur User

Lemur is a tool to launch hadoop jobs locally or on EMR, based on a configuration file, referred to as a jobdef. The jobdef file describes your EMR cluster, local environment, pre- and post-actions (aka hooks) and zero or more "steps". A step is Amazon's name for a task or job submitted to the cluster. Lemur reads your jobdef, at the end of your jobdef, you execute (fire! ...) to make things happen. Also keep in mind that the jobdef is an interpreted clj file, so you can insert arbitrary Clojure code to be executed anywhere in the file (but see HOOKS below for a better way).

Lemur is described here.  And help is on the wiki.




Showing 1-20 of 25 topics
Hadoop Training In Bay Area Info Cim 7/12/16
Creating a cluster in the eu-west-1 region. Gareth Rogers 12/15/15
ANN: Lemur 1.4.6 Leon Barrett 12/2/15
Resize cluster - number of instances Pavan Reddy 7/13/15
EMR service role and EC2 instance profile support Gareth Rogers 7/4/15
Hadoop Training in Hyderabad Simpson whitecabs 11/20/14
Hadoop Training in Hyderabad kumar pmpTraining 11/6/14
ANN: Lemur 1.4.3 lbar...@climate.com 10/14/14
wait-on-step does not wait when step name is defined using a $ variable Gareth Rogers 10/13/14
:step-jar, :run-time-jar, :jar-src-path and profiles Gareth Rogers 5/12/14
New Job updates from Referenceglobe ReferenceGlobe 4/11/14
unable to load parameter file Saeedeh Noroozi 4/4/14
Running from check out from Github Gareth Rogers 4/2/14
New Job updates from Referenceglobe ReferenceGlobe 3/28/14
Use Lemur as a library? Kyle Burton 2/15/14
ANN: Lemur 1.4.0 - upgrade clojure dependency to 1.5 Steve Kim 1/23/14
issue with mutli input Aleksandr Elbakyan 7/18/13
Running lemur on eu-west instances c...@campanja.com 5/20/13
Run different types of jobs Aleks.E 5/8/13
ANN: Lemur 1.3.1 - submit steps to an existing job flow (cluster) Marc Limotte 2/20/13
More topics »