Looking for Azure Databricks Engineer in Summit NJ, Hybrid

[Parthu K]

Need your help to identify strong Databricks engineering who can lead the Snowflake to Databricks migration for FP&A team.

 

Location: Summit NJ, Hybrid

Duration: 6 Months+

 

Key Responsibilities:

• Lead and contribute to end-to-end data migration cycles, ensuring accuracy, performance, and scalability.
• Apply best practices and standards for data migration, transformation, and validation.
• Develop and optimize complex SQL stored procedures; strong debugging and performance tuning skills required.
• Design and implement solutions using Delta Lake and Lakehouse architecture.
• Build scalable pipelines using PySpark and Spark SQL, with a focus on performance and cost efficiency.
• Manage Databricks clusters effectively—select appropriate compute types based on workload, and apply tuning strategies for optimal performance.
• Explore and leverage Databricks product features (e.g., Delta share, Lakebridge, ABAC, RBAC) to enhance solution capabilities.
• Collaborate with cross-functional teams to validate migrated datasets and ensure business alignment.
• Support CI/CD processes for code deployment and version control.

 

Required Skills:

• Strong SQL and data modeling expertise.
• Proficiency in Azure Services, Databricks, PySpark, and Spark SQL.
• Experience with cluster management, performance optimization, and cost-effective compute strategies.
• Excellent problem-solving and communication skills.