Description:
Role name: Python Developer- Data Warehousing
Work site: Charlotte, NC - onsite
Start date: Immediate availability.
Job Description:
We are seeking a highly experienced and skilled Solutions Architect to lead the design, architecture, and optimization of our enterprise-level data processing and application platforms on AWS. The ideal candidate will possess deep expertise in a range of AWS services and big data technologies, ensuring our solutions are scalable, cost-effective, secure, and align with strategic business objectives.
Key Responsibilities
Design and document comprehensive, secure, and scalable technical solutions on AWS leveraging services like Pyspark, flink, Fargate, EMR, EC2, DynamoDB, DocumentDB, Airflow(MWAA).
API Development: Oversee the design and development of performant and secure Python APIs to expose data and application functionalities to internal and external systems.
6-10 years of experience in AWS services.
6-10 years Strong hand on experience working and expected to work on the development
Data Pipeline Development: Lead the architecture of complex batch and real-time data pipelines using big data processing frameworks, including PySpark ensuring efficient data flow and transformation.
Orchestration and Automation: Implement robust workflow orchestration using Apache Airflow (MWAA) for building, scheduling, and monitoring complex data and application workflows.
Database Management: Design and optimize data storage solutions using relational and NoSQL databases, including Amazon DynamoDB and Amazon DocumentDB, to meet performance and scalability requirements.
Infrastructure as Code (IaC): Drive the automation of infrastructure deployment using IaC tools (e.g., Terraform or CloudFormation) and implement CI/CD pipelines following DevOps best practices.
Technical Leadership & Collaboration: Provide technical guidance and mentorship to data engineering and development teams, ensuring alignment with architectural vision and best practices. Collaborate with stakeholders to translate business requirements into technical specifications.
Performance Optimization & Cost Management: Monitor and optimize the performance, cost-efficiency, and resource utilization of all deployed solutions on AWS.
|
