Hiring for Sr. Big Data Engineer with PySpark exp. in Woonsocket RI

[kailash singh]

Role                       :               Sr. Big Data Engineer with PySpark exp.

Location               :               Woonsocket RI

Duration              :               6-12 months
Interview            :               Webex

Green Card, H4 EAD, or US Citizen

Strong PySpark needed

 

Job Requirement

• Agile methodology
• Debugging issues related to Spark performance in a big data environment.
• Coding and architecting of end-to-end applications on modern data processing technology stack (e.g. Hadoop, Cloud, Spark ecosystem technologies)
• Build continuous integration/continuous delivery, test-driven development, and production deployment frameworks
• Lead conversations with infrastructure teams (on-prem & cloud) on analytics application requirements (e.g., configuration, access, tools, services, compute capacity, etc.)

• Platforms: Hadoop, Spark, Kafka, Kinesis, Oracle, TD
• Languages: Python, PySpark, Hive, Shell Scripting, SQL, Pig, Java / Scala
• Proficient in Map-Reduce, Conda, H2O, Spark, Airflow / Oozie / Jenkins, Hbase, Pig, No-SQL, Chef / Puppet, Git
• Familiarity with building data pipelines, data modeling, architecture & governance concepts
• Experience implementing ML models and building highly scalable and high availability systems
• Experience operating in distributed environments including cloud (Azure, GCP, AWS etc.)
• Experience building, launching and maintaining complex analytics pipelines in production

 

 

 

 

Regards ,

Kailash Negi |  KPG99,INC

3240 E State, St Ext |  Hamilton, NJ 08619 
609-681-2603  ||   k...@kpgtech.com

Certified Minority Business Enterprise (MBE)

Working together is a Success!!!

NOTE: Email is the best way to reach me if i am not available at my number.