Please send me the
profiles at dee...@digitive.co
Role: Data Engineer (Python/Pyspark)
Location: Carlsbad, CA
Note: We
need resumes of the candidates who have worked on data integration/building
pipelines using Python and/or PySpark as programming language ideally on
Databircks platform.
Description:
- Design,
develop, test, deploy, support, enhance data integration solutions seamlessly
to connect and integrate enterprise systems in our Enterprise Data
Platform.
- Innovate
for data integration in Apache Spark-based Platform to ensure the
technology solutions leverage cutting edge integration capabilities.
- Experience
with ETL, data pipeline creation to load data from multiple data sources.
Primary Skills:
- 4+
years working experience in data integration and pipeline development with
BS degree in CS, CE or EE.
- 2+
years of Experience with AWS Cloud on data integration with Apache Spark,
EMR, Glue, Kafka, Kinesis, and Lambda in S3, Redshift, RDS,
MongoDB/DynamoDB ecosystems
- Strong
real-life experience in python development especially in PySpark in AWS
Cloud environment.
- Design,
develop test, deploy, maintain and improve data integration pipeline.
- Experience
in Python and common python libraries.
- Strong
analytical experience with database in writing complex queries, query
optimization, debugging, user defined functions, views, indexes etc.
- Strong
experience with source control systems such as Git, Bitbucket, and Jenkins
build and continuous integration tools.
- Databricks,
Redshift Experience is a plus.
Deepak Gulia | Digitive LLC – cloud. made simple
Fax: 408-935-8696 | Email: dee...@digitive.co
GTALK :- deepakguli...@gmail.com