Big Data Engineer with DataLake, PySpark, Hadoop and Cloud Needed

[neeraj kumar]

Please send candidates- candidates must be received by COB Friday 8/9 to be considered- thank you!

 

job title :  Sr Data Engineer  

 Location : REMOTE- prefer those local to Minneapolis, MN and Columbus, OH

Needed ASAP

visa USC,GC ONLY   

Contract to Hire- 

 

*Production support weekly on-call weekend/after hours on a rotation basis with other 8 team members.

 

Team is managing Datalake in HNB, Analystics and Data Scientists, this teams job is to find data in HNB and get into Datalakes, build the pipeline so consumers can use the data. Ongoing project to build datalake within HNB.

 

 

UPDATE FROM VSC:

NOT a Data Architect,    Sr Data Engineer  

 

MUST HAVES:

5+ exp in big data tech, PySpark & AWS cloud, any cloud is okay, AWS preferred

Exp programming lang, Python & Spark, other nth is C++ Java etc

Responsible for data engineering process on Data Lake, building pipeline

Building data lake in Hadoop, moving Hadoop to AWS, have skills on Hadoop & AWS (S3, Glue, Athena, etc) - need to have exp working in both Hadoop & Cloud technologies

Overlap between Hadoop & AWS, so needs to have Spark and Python knowledge in both environments

SQL skills a must, writing and troubleshooting database

DevOps technology, Jenkins, deploy tech

Operating system - Linux & basic Shell scripting experience (must have)

Some design level skills (not quite architect) - find need and come up with a technical solution.

Will be some Production Support

Soft skills: communication skills, working with buiness partners, needs to understand business need translate to tech need. Mentoring skills - due to Sr Level. Trouble shooting, critical thinking, enthusiasm for learning and adapting new technology quickly!

REGARDS 

NEERAJ KUMAR