Role; Azure Data Engineer
Exp; 15+
visa; Any visa
JD: Role Summary:
The Azure Data Engineer is responsible for designing, building, securing and monitoring analytics solutions on the Azure data platform. This role requires experience with big data tools, SQL databases, data pipelines, and Azure data services.
Responsibilities:
• Design and implement Azure data solutions for ingesting, transforming, analyzing, and visualizing data from a variety of sources
• Build and maintain Azure data lakes, data warehouses, SQL and NoSQL databases
• Create data pipelines using Azure Data Factory, Databricks, Synapse Analytics, and other big data technologies
• Develop SQL and NoSQL queries to analyze and interpret data
• Migrate relational and non-relational data from on-premises to the cloud
• Automate data integration and processing using triggers and scheduling tools like Azure Data Factory
• Implement RBAC, policies, and other access controls for security
• Monitor and optimize performance of Azure data solutions
• Troubleshoot issues across Azure data platforms and services
• Stay up-to-date on Azure data services and make recommendations on adopting new features
Requirements:
• Bachelor's degree in Computer Science, Analytics, Engineering or related field
• 8+ years experience as a data engineer working with cloud data platforms
• Experience with Azure services: Azure Data Lake, Synapse Analytics, Data Factory, Databricks, SQL Database, Cosmos DB, Event Hubs, Key Vault
• Proficiency writing SQL, Python, Scala or R for data manipulation and analysis
• Understanding of data warehousing, ETL, event stream processing
• Knowledge of big data architectures and tools like Hadoop
• Experience defining scopes of access with RBAC and policies
• Strong analytic skills related to working with business data
• Excellent communication skills and ability to translate requirements