Hiring for Azure Databricks Consultant

[Joshua Daniel]

Azure Databricks Consultant
Location Richardson, TX (Hybrid)/ Chicago, IL
VISA: Any VISA (Except CPT)
Duration: 12+ Months (Contract)
Position Overview
Seeking an experienced Azure Databricks Consultant to architect, build, and optimize cloud-based data pipelines for enterprise-scale analytics projects. This role demands hands-on ETL and data processing expertise, including streaming ingestion from Kafka, processing raw data, and writing to Azure Cosmos DB using PySpark and Databricks.
Responsibilities
• Design, develop, and optimize scalable ETL/data pipelines in Azure Databricks using PySpark.
• Ingest and process high-volume streaming data from Kafka, transforming raw data for downstream analytics.
• Implement data writing and integrations with Azure Cosmos DB for real-time and batch data needs.
• Collaborate with engineering and analytics teams to define requirements, troubleshoot, and continuously improve data processing workflows.
• Monitor, tune, and manage Databricks clusters for performance, cost, and reliability.
• Document solutions, educate stakeholders, and support deployment to production environments.
Required Skills
• Extensive experience with Azure Databricks and PySpark for large-scale ETL and data engineering.
• Hands-on proficiency with Kafka for streaming data sources, processing, and pipeline reliability.
• Strong background in Azure Cosmos DB: data modeling, integration, and performance optimization.
• Familiar with Azure cloud ecosystem and hybrid deployments.

Drop your profiles with jos...@innoverglobalinc.com  or  jos...@innoverglobal.com