C2C :: Lead Azure Databricks with Python :: Iselin, NJ (Hybrid)

2 views
Skip to first unread message

Yogesh Singh

unread,
11:54 AM (8 hours ago) 11:54 AM
to Yogesh Singh

Hi All,

Hope you are doing well.

Please share the resume of only H1/H4 candidates for the role below.

Not looking for Sr profiles.

C2C Role:

Lead Azure Databricks with Python

Location: Iselin, NJ (Hybrid)

$67/hr. C2C, sorry, no flexibility

 

 Position Overview

We are seeking a highly skilled Tech Lead with strong hands-on expertise in Python, Databricks, and Angular(Good to have), Azure to lead the design, development, and implementation of scalable data and application solutions. The ideal candidate will guide engineering teams, architect end-to-end systems, and collaborate across functions to deliver high-quality, enterprise-grade products.

Key Responsibilities

Technical Leadership

  • Lead a cross-functional engineering team across backend, frontend, and data engineering streams.
  • Own the full SDLC: architecture, design, development, code reviews, DevOps pipeline oversight, and production deployment.
  • Provide technical direction, mentor developers, enforce coding best practices, and promote engineering excellence.
  • Work closely with product owners, architects, and stakeholders to define technical strategy and roadmap.

Backend Engineering (Python)

  • Design and build robust microservices, APIs, and data processing frameworks using Python.
  • Develop scalable ETL/ELT workflows and backend logic aligned with enterprise data standards.
  • Implement best practices in error handling, logging, performance tuning, and automated testing.

Data Engineering (Databricks)

  • Build large-scale data pipelines and transformations using Databricks (PySpark/Spark SQL).
  • Optimize data workflows for cost, performance, and reliability.
  • Collaborate with data architects to define data models, governance, and quality frameworks.
  • Integrate Databricks with cloud services (Azure/AWS) for end-to-end data solutions.

Cloud & DevOps

  • Work with CI/CD pipelines (Azure DevOps, GitHub Actions, Jenkins, etc.) for automated builds and deployments.
  • Ensure seamless deployment and monitoring of applications in cloud environments.
  • Drive improvements in observability, reliability, and system health using monitoring tools.

Collaboration & Stakeholder Management

  • Partner with business teams to translate requirements into scalable technology solutions.
  • Estimate, plan, and track project deliverables.
  • Guide teams in Agile development practices (Scrum/Kanban).

Required Skills & Qualifications

Technical Skills

  • Strong hands-on experience with Python (Flask/FastAPI/Django desirable).
  • Advanced knowledge of Databricks, PySpark, Spark SQL.
  • Experience building large-scale distributed systems.
  • Strong understanding of cloud platforms (Azure preferred, AWS/GCP acceptable).
  • Familiarity with SQL/NoSQL databases (PostgreSQL, MySQL, Cosmos, MongoDB, etc.).
  • Experience with Git, CI/CD pipelines, Docker, and containerized deployments.

 Thanks

Yogesh Pratap Singh


The information transmitted is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of, or taking of any action in reliance upon this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please contact the sender and delete the material from any computer.
Reply all
Reply to author
Forward
0 new messages