[Big Data for Better Decisions] #12: Big Data Engineer- A Typical

[Ravindra Dastikop]

BIG DATA ENGINEER

This position will focus primarily on engineering, design and implementation of our Big Data architecture called Analytics Discovery Platform (ADP),  work with the Big Data architect and Aster/Hadoop administrators, and coordinates needs between COE and Business and applications teams.

 

In addition, this engineering position with be more project focused,  leveraging the technical architecture and making adjustments, as per our standards, based on the project non functional requirements, identifying existing or new infrastructure and creating engineering (physical) diagrams.  The position will be responsible for deploying first (new) technical architecture through production warranty period and support performance testing if required.

 

The candidate must have excellent hands on knowledge of Hadoop,Unix/Linux operating systems as well as storage configurations.  Skills include proven experience with data architecture methodologies and principles such as data modeling and exposure to a large complex organization.

PRIMARY DUTIES AND RESPONSIBILITIES:

 

• Big Data (i.e. Hadoop) engineering & design to support the business needs
• Work within projects to leverage and implement the technical architecture
• Support the Retail and PBM side of the business
• Comply to CVS standards

 

Required Skills: 

• 10+ years in a data architecture role
• 2-4 years of deep skills in implementation of the Big Data landscape
• 2-4 years of deep working knowledge in use of open source tools such as; Hadoop technology (Hadoop, Sqoop, Hive,etc.), Python and bash.
• 2+ years of hands on developing Sqoop scripts and batch processing
• 4 + years of hands on experiences and  thorough understanding of  UNIX/Linux operating systems
• 2-4 years experience in designing large data warehouses, working knowledge of design techniques such as star schema, flow-flake
• 2-4 years of experience with various information modeling techniques (such as data flow diagrams, third normal form, entity-relationship diagrams or create/read/update/delete matrices).
• Familiarity with business intelligence and data warehousing development processes and techniques.
• Has strong presentation and collaboration skills and can communicate all aspects of the job requirements, including the creation of formal documentation
• Strong communication and interpersonal skills
• Strong problem solving, time management and organizational skills
• Be able to document where appropriate
• Participation in a team atmosphere and working well with others.
• Being able to remain neutral toward any specific technology choice or vendor; being more interested in results than personal preferences.
• Demonstrates a sense of urgency in completing tasks and resolving issues in order to deliver quality projects on time and within budget
• Exhibits a high energy, strategic thinking, results oriented, and global collaborative approach.

 

Preferred Skills: 

• Hands on working with Hortonworks Hadoop
• Teradata's Aster appliance and having actual implementation involvement
• Database administration experience is a plus
• Thorough understanding of relational database management systems
• Experience working with and architecture of other major RDBMS systems, especially Teradata, DB2, UDB,  SqlServer, and MySql is required 
• Knowledge of industry standards such as Informatica and MicroStrategy
• Ability to guide, lead, mentor and facilitate collaboration among team members
• Experience in retail and pharmacy benefit management (PBM) businesses is a plus

 

EDUCATION: 

• Bachelor’s Degree or equivalent in Computer Science, Engineering, Computer Information Systems, or related field, Master’s Degree is a plus
• Minimum of 2-4 years of focused concentration in Big Data architecture

--
Posted By Blogger to Big Data for Better Decisions at 11/20/2014 07:40:00 AM