12+ years experience || AWS Data Engineer || McLean, VA || PP number mandatory

[Savi Technologies LLC]

Please go through below JD and share suitable profiles.

Role: AWS Data Engineer 
Location: McLean, VA

Job Description: 

  Python and PySpark

Develop and optimize ETL pipelines using Python, PySpark, PySpark Notebooks with AWS EMR.
Should have good understanding of Spark Resilient Distributed Datasets (RDD), Data Frame, and Datasets.
Work with large-scale datasets and build distributed computing solutions.
Design and implement data ingestion, transformation, and processing workflows using IICS jobs.
Write efficient and scalable Python code for data processing.
Collaborate with data engineers, data scientists, and business teams to deliver insights.
Optimize performance and cost efficiency for big data solutions.
Implement best practices for CI/CD, testing, and automation in a cloud environment.
Monitor job performance, troubleshooting failures, and tuning queries.

--

Thanks