Lead Data Engineer
wade wilson
Role: Lead Data Engineer
Location: Los Angeles, CA (Locals Onsite)
Need only locals
c2c
Requirements:-
• 12+ years of hands-on experience in Data analytics and Data Engineering.
• 5+ years of experience in Design, Development of Azure data lake, Azure Data Factory with Python/PySpark.
• Experience in handling large volume of data in CosmosDB, SQL server.
• Hands on experience in working on large data conversion/migration projects.
• Strong ETL expertise to handle incremental load, SCDs, archival, encryption of the files/data.
• Experience in Azure services - Function App, Key Vault, Event Hub is advantage
• Strong experience working with SQL/SparkSQL queries, PySpark scripting and delta lake approach.
• Excellent in impact-analysis and root cause analysis.
• Helping teams build CI/CD pipeline