Hi,
Let me know if you’re interested in the below job position. Please reply me back with your updated resume to ravi.e...@acsicorp.com or you can reach me on my number 678-207-5286
Position: Hadoop Engineer,
Location: NYC, NY
Duration: 6 Months
Rate: $50/hr - $55/hr on C2C
The Hadoop Infrastructure team is responsible for developing, provisioning and managing Hadoop Ecosystem Infrastructure for the organization.
With our diverse use cases, we do not use off-the-shelf management tools. Our custom developed Hadoop management infrastructure is built to fully automate deployment and operations
We are looking for an experienced infrastructure engineer who enjoys building large scale data systems and has previous knowledge of working with one of more Hadoop distribution systems.
Responsibilities:
· Evaluate Hadoop infrastructure requirements and design/deploy solutions (high availability, big data clusters, elastic load tolerance, etc.)
· Develop automation, installation and monitoring of Hadoop ecosystem components; specifically: Spark, HBase, HDFS, Map/Reduce,
· Dig deep into performance, scalability, capacity and reliability problems to resolve issues
· Create productive models for integrating internal application teams and vendors with our infrastructure
· Troubleshoot and debug Hadoop ecosystem run-time issues
· Provide developer and operations documentation
· Run Proof of concept projects with our customers
Required Skills:
· Proficiency in one or more of Java, Python, SQL, Scala
· Experience with Hadoop eco-system
· Knowledge of working with Cloudera, MapR or HDP distribution of Hadoop
· Proven experience building and scaling out Hadoop based or Unix hosted database infrastructure for an enterprise (software, network, storage and related)
· 2+ years’ experience of Hadoop administration or a strong and diverse background of distributed cluster management and operations experience
· 2+ years of Chef, Puppet, Ansible, etc. system configuration experience
· 2+ years of Devops or System Administration experience
· Experience writing software in a continuous build and automated deployment environment.
· Open source experience is a plus (a well curated blog, upstream accepted contribution or community presence)
Preferred Skills
· Experience with ETL and BI tools
· Kerberos experience a plus
· CM_API experience using python/java api