Tech lead- Data Engineer at Malvern, PA || Onsite
Varshendra Chaturvedi
I hope this email finds you well.
If you're interested in pursuing this opportunity, kindly share your updated resume with us at your earliest convenience.
Please feel free to reach out if you have any questions or need further details about the role
If anyone of your friends or Colleagues interested in the below position, please let me know references are highly appreciated...!
If this information was not relevant to you, I extend my apology for sending this email.
Role: Tech lead- Data Engineer
Location: Alpharetta, GA || Hybrid
Position Type: Long Term Contract
Experience (Years): 15+ years
Need H1B
Job Description:
Key Responsibilities
Architect, build, and maintain event-driven data pipelines using AWS services such as Kinesis, MSK/Kafka, Lambda, Step Functions, SQS/SNS, and Glue/EMR.
Develop ETL/ELT workflows using Python and PySpark, ensuring performance, scalability, and cost efficiency.
Implement and optimize Spark-based data transformations, partitioning strategies, and data processing frameworks.
Design and manage data lake and warehouse structures using S3, Glue Catalog, Athena, and/or Redshift.
Build streaming solutions with checkpointing, stateful transformations, idempotency, and schema evolution.
Ensure high standards of data quality, observability, monitoring, and alerting (CloudWatch, Datadog, etc.).
Implement data security best practices including IAM, encryption (KMS), networking, and governance.
Create reusable frameworks, internal libraries, and CI/CD pipelines for automated deployments.
Collaborate with data scientists, analysts, and business teams to deliver well-modeled, reliable datasets.
Lead design reviews, mentor junior engineers, and contribute to engineering best practices.
Required Qualifications
15+ years of professional experience in Data Engineering.
Strong expertise in Python and PySpark for large-scale data processing.
Advanced hands-on experience with AWS (S3, Glue, EMR, Lambda, Step Functions, Kinesis/MSK, DynamoDB, Athena, Redshift).
Deep experience building event-driven and streaming data pipelines.
Strong SQL experience for analytical and ETL workloads.
Hands-on experience with workflow orchestration tools such as Airflow or Step Functions.
Experience with CI/CD, Git, and Infrastructure-as-Code (Terraform or CloudFormation).
Strong understanding of distributed systems, Spark performance tuning, data modeling, and cloud cost optimization.
Knowledge of data security, encryption, networking, and compliance best practices in cloud environments.
Soft Skills
Strong design and architectural understanding
Excellent communication and stakeholder interaction skills
Ability to work in a globally distributed team
Thanks and Regards,
Varshendra Chaturvedi
---------------------------------------------------
Next Level Business Services INC.
Talent Solutions | Digital Transformation | Data Analytics
E-mail: varshendra...@recruiter.nlbtech.com | Web: www.nlbservices.com
An ISO 27001 and 20000-1 Certified & Minority Business Enterprise (CMBE)