Lead Data Engineer / Data Engineer || McLean, VA or Cary,NC

[Rahul R]

Lead Data Engineer

Type: 12‑month Contract

Overview:
Seeking highly skilled Data Engineers to design, develop, and optimize modern data pipelines and architectures supporting advanced analytics and business insights.

Responsibilities:

• Design, build, and maintain scalable data pipelines & ETL processes
• Develop and optimize complex SQL queries for large datasets
• Implement transformations/workflows using Databricks & PySpark
• Build/manage ingestion frameworkACs for structured & unstructured data
• Work within AWS (S3 required; other services a plus)
• Orchestrate workflows/pipelines using Apache Airflow
• Ensure data quality, integrity, and performance across systems
• Collaborate with analytics, product, and engineering teams
• Leverage AI‑assisted development tools to improve productivity & code quality

Required Skills:

• SQL (Expert): Complex queries, performance optimization
• Python: Scripting, automation, pipeline development
• Databricks: ETL pipelines, transformations, scalable processing
• PySpark: Large‑scale dataset processing
• AWS (S3): Cloud storage & processing
• Data Lakes/Warehousing: Snowflake, scalable ingestion patterns
• Apache Airflow: Workflow scheduling & monitoring

Preferred Qualifications:

• Experience with AI‑assisted coding tools (GitHub Copilot, Claude)
• Familiarity with CI/CD, version control, testing best practices
• GitHub/portfolio showcasing data or AI‑related work

What Sets You Apart:

• Ability to thrive in fast‑paced, evolving environments
• Strong problem‑solving & analytical skills
• Passion for efficient, scalable data solutions
• Experience with large, complex enterprise datasets

--

Thanks & Regards,

Rahul 

Talent Acquisition Specialist

Lightning Minds Inc.

Office   :      

Email   :      ra...@lightningminds.com

Email is the best way to reach me…