Title: Hadoop Admin
Location: Pleasanton, CA (Locals)
Duration: 12 Months
Mode of Interview: In Person
Need Visa & D/L copy for all H1, H4 & GC holders
Scope:
The Hadoop Engineer shall support the Client's enterprise architecture team.
The consultant will provide professional services to support the long term IT strategy and planning to include high level analysis, professional reports and presentations, and mentoring, support and training.
Tasks:
The tasks for the Hadoop Engineer include, but are not limited to, the following:
Translate client user requirements into technical architecture vision and implementation plan
Design and implement an integrated Big Data platform and analytics solution
Design and implement data collectors to collect and transport data to the Big Data Platform.
Implement monitoring solution(s) for the Big Data platform to monitor health on the infrastructure.
Technical Knowledge and Skills:
Consultant resources shall possess most of the following technical knowledge and experience:
2+ years of hands-on development, Deployment and production Support experience in Hadoop environment.
4-5 years of programming experience in Java, Scala, Spark, Python.
Proficient in SQL and relational database design and methods for data retrieval.
Knowledge of NoSQL systems like HBase or Cassandra
Hands-on experience in Cloudera Ddistribution 5.x ,Java and Solr.
Hands-on experience in creating, indexing Solr collections in Solr Cloud environment.
Hands-on experience building data pipelines using Hadoop components Sqoop, Hive, Pig, Solr, MR, Spark, Spark SQL.
Must have experience with developing Hive QL, UDF’s for analyzing semi structured/structured datasets.
Must have experience with Spring framework.
Hands-on experience ingesting and processing various file formats like Avro/Parquet/Sequence Files/Text Files etc.
Must have working experience in the data warehousing and Business Intelligence systems.
Expertise in Unix/Linux environment in writing scripts and schedule/execute jobs.
Successful track record of building automation scripts/code using Java, Bash, Python etc. and experience in production support issue resolution process.
Nice-To-Have Skills
Hands-on experience working in Real-Time analytics like Spark/Kafka/Storm
Working knowledge of Aspire Content Processing Platform and Query Processing Language(QPL)
Experience working with users on requirements gathering
Agile development methodologies.
Demonstrable Skills:
The Consultant resource(s) shall possess most of the following skills:
Strong analytical skills with the ability to analyze information and identify and formulate solutions to problems.
Provide more in-depth analysis with a high-level view of goals and end deliverables.
Complete work within a reasonable time frame under the supervision of a manager or team lead.
Plan and manage all aspects of the support function.
Extensive knowledge of and proven experience with data processing systems, and methods of developing, testing and moving solutions to implementation.
Strong knowledge in project management practices and ability to document processes and procedures as needed.
Work collaboratively with other support team members and independently on assigned tasks and deliverables with minimum supervision
Communicate effectively with users at all levels, from data entry technicians up to senior management, verbally and in writing.
Self-motivated, working closely and actively communicating with team members to accomplish time critical tasks and deliverables
Ask questions and share information gained with other support team members, recording and documenting this knowledge
Elicit and gather user requirements and/or problem description information, and record this information accurately
Listen carefully and act upon user requirements
Convey and explain complex problems and solutions in an understandable language to both technical and non-technical persons
Present technical solutions to management and decision makers
Follow the lead of others on assigned projects as well as take the lead when deemed appropriate
Think creatively and critically, analyzing complex problems, weighing multiple solutions, and carefully selecting solutions appropriate to the business needs, project scope, and available resources
Take responsibility for the integrity of the solution
Core Competencies:
The Consultant resource(s) shall possess the following prerequisite core competencies:
Act with integrity;
Use sound judgment;
Commit to quality;
Demonstrate adaptability;
Innovate;
Think strategically;
Communicate effectively and influence others; and
Work well both independently and as part of a team..