Looking for Senior Big Data Engineer
Srilakshmi
Hi,
Hope you are doing great!!
We have an urgent requirement for below position. Please go through the requirement and Let me know if you would be interested and get back to me with your updated resume and following information ASAP.
Position Title: Senior Big Data Engineer
Location: Irvine, CA
Duration: 6+Months with possibility of extension
Interview Mode: Telephonic and then F2F
Candidates must have experience with both Informatica as well as Hadoop technologies.
Position Summary:
The Senior Big Data Engineer will work within the Enterprise Data Services team in Agile environment to install, update, maintain, monitor and support the Hadoop and Enterprise Data Warehouse/Enterprise Business Intelligence tools, applications and databases to support all Kelley Blue Book Business units. The individual will work closely in a team consisting of other big data and data warehouse engineers, business analysts, business intelligence engineers, system analysts, quality assurance engineers and database administrators in developing data warehouse solutions to meet stated requirements, develop detailed specifications and unit test plans for implementation. Since EDW works with multiple business units to create cross functional solutions, the Senior Big Data Engineer must be able to interface with various business units to understand the requirements and prepare documentation to support development.
The individual must be capable of understanding Hadoop ecosystem and the complex object design and the underlying data model of the system. The individual must be comfortable with developing data-centric applications using Hadoop tools, Netezza, Informatica, Informatica BDE (Big Data Edition), HIVE MapReduce, Spark and able to develop ETL packages, and is expected to develop queries and stored procedures involving complex database structures and Hadoop Distributed File System(HDFS). The individual must have excellent communication skills, work well in a team environment, enjoy solving complex problems and be able to work in a fast paced environment.
The Responsibilities:
· Define technical scope and objectives through research and participation in requirements-gathering and definition of processes
· Gather and process raw, structured, semi-structured, and unstructured data at scale, including writing scripts, developing programmatic interfaces against web APIs, Web logs, processing real time feeds, etc.
· Design, review, implement and optimize data transformation processes in the Hadoop (primary) and Informatica ecosystems
· Test and prototype new data integration tools, techniques and methodologies
· Adhere to all applicable development policies, procedures and standards
· Participate in functional test planning and testing for the assigned application integrations, functional areas and projects.
· Work with the team in an Agile/SCRUM environment to ensure a quality product is delivered
· Rapid response and cross-functional work to deliver appropriate resolution of technical, procedural, and operational issues.
Qualifications
Required Skills and Experience:
· A BS degree in Computer Science, related technical field, or equivalent work experience; Masters preferred.
Minimum of three years’ experience with the following:
· Experience architecting and integrating the Hadoop platform with traditional RDBMS data warehouses.
· Experience with major Hadoop distributions like Cloudera (preferred), HortonWorks, MapR, BigInsights, or Amazon EMR is essential.
· Experience developing within the Hadoop platform including Java MapReduce, Hive, Pig, Pig Latin, and Pig UDF development.
· Excellent oral and written communication skills
· Excellent customer service skills
· Excellent analytical and problem solving skills
· Working knowledge of Linux O/S environments
Preferred Skills & Experience:
· Experience with logical, 3NF or Dimensional data models.
· Experience with data quality tools such as First Logic.
· Experience with NoSQL databases like HBase, Cassandra, Redis and MongoDB.
· Experience with Hadoop ecosystem technologies like Flume, Kafka and Spark.
· Experience with Netezza and Oracle.
· Certifications from Cloudera, HortonWorks and/or MapR.
· Knowledge of Java SE, Java EE, JMS, XML, XSL, Web Services and other application integration related technologies
· Familiarity with Business Intelligence tools and platforms like Datameer, Platfora, Tableau and Microstrategy a plus.
· Experience in working in an Agile/SCRUM model.
For Quick Process Fill the details:
Candidate Name:
Education:
Phone:
Email ID :
Visa Status & Validity:
DOB(MM/DD/YY):
Current Location:
Willing to relocate:
Willing to attend F2F:
Availability:
Reason for Change (if currently working):
Best time to attend interview call:
Vendor:
Thanks,
Srilakshmi U
O2 Technologies Inc.
949-232-1810 (O) Ext : 104
949-861-6107 (F)