Please send me the profiles at dee...@godigitive.com
Position : Data Engineer (3 Months to start with)
Location: South San Francisco, CA
JD
Deepak Gulia | Digitive LLC – cloud. made simple
Fax: 408-935-8696 | Email: dee...@godigitive.com
GTALK :- deepakguli...@gmail.com
Role: Data Engineer
Location: Remote (preferred west coast as the candidate shall be working in PST)
Description:
Primary Skills:
· 4+ years working experience in data integration and pipeline development.
· BS degree in CS, CE or EE.
· 2+ years of Experience with AWS Cloud on data integration with Apache Spark, EMR, Glue, Kafka, Kinesis, and Lambda in S3, Redshift, RDS, MongoDB/DynamoDB ecosystems
· Strong real-life experience in python development especially in pySpark in AWS Cloud environment.
· Design, develop test, deploy, maintain and improve data integration pipeline.
· Experience in Python and common python libraries.
· Strong analytical experience with database in writing complex queries, query optimization, debugging, user defined functions, views, indexes etc.
· Strong experience with source control systems such as Git, Bitbucket, and Jenkins build and continuous integration tools.
· Databricks, Redshift Experience is a plus.
Note: Please look for 4-5 years of work experience only as the budget here is limited.