please go through below JD and share suitable profiles.
Role: Sr. ADF & Azure Data Bricks Engineer
Location: Tampa, FL
Duration: 6 months
Description:
- Design and implement scalable data platforms and pipelines using Databricks (including Spark, Delta Lake, MLflow, etc.).
- Work with stakeholders to develop modern data architectures that meet business requirements.
- Lead the migration from legacy platforms to the Databricks Lakehouse architecture.
- Establish data governance, quality, and security standards in collaboration with InfoSec and Compliance teams.
- Optimize data ingestion, transformation, and consumption processes.
- Mentor data engineers and developers on best practices for using Databricks.
- Integrate Databricks with enterprise tools such as Power BI, Tableau, Kafka, Snowflake, and others.
- Develop and implement machine learning/AI workflows within a Databricks environment.
- Collaborate with cloud architects to ensure a robust infrastructure setup on AWS, Azure, or GCP.
- Produce technical documentation, architectural diagrams, and data models.
--