We are seeking a skilled and motivated Data Engineer with experience in Databricks Unity Catalog to support enterprise data governance, access control, and cataloging across our modern data platform. The ideal candidate will play a key role in the implementation, configuration, and optimization of Unity Catalog, ensuring secure and well-organized access to data assets across multiple environments.
Key Responsibilities:
· Design and implement Databricks Unity Catalog to manage metadata, data access policies, lineage, and audit requirements.
· Work with data platform teams to integrate Unity Catalog with existing data lakes, Delta tables, and other cloud storage solutions (e.g., AWS S3, Azure Data Lake).
· Define and enforce fine-grained access control policies using Unity Catalog’s role-based and attribute-based access models.
· Collaborate with Data Governance, Security, and Engineering teams to align Unity Catalog usage with enterprise compliance and data privacy requirements.
· Support data discovery and cataloging through creation and maintenance of well-structured, documented metadata assets.
· Develop automation scripts (e.g., using Python, PySpark, or Terraform) for catalog provisioning, permissioning, and metadata management.
· Monitor data access and lineage using Unity Catalog’s audit and tracking capabilities.
· Provide guidance and best practices for teams onboarding to Unity Catalog and Databricks.
Required Qualifications:
· 8+ years of experience in Data Engineering or Platform Engineering roles.
· Hands-on experience with Databricks, including workspace setup, Delta Lake, and cluster management.
· Strong knowledge of Unity Catalog, including governance, catalog/schema/table management, and access control.
· Proficiency in SQL, Python, or PySpark.
· Familiarity with cloud platforms such as AWS, Azure, or GCP.
· Experience working with IAM, RBAC, and data security frameworks.
· Understanding of data lineage, metadata management, and catalog integration.
· Familiarity with tools such as Terraform, dbutils, or CI/CD pipelines is a plus.
Preferred Qualifications:
· Prior experience in data governance, data security, or privacy compliance (e.g., HIPAA, GDPR).
· Exposure to enterprise MDM, data catalogs like Collibra, Alation, or Informatica.
· Databricks certification(s) such as Databricks Certified Data Engineer Associate/Professional or Unity Catalog
Administrator.Soft Skills:
· Strong communication and collaboration skills.
· Proactive approach to problem-solving and documentation.
· Ability to work in a fast-paced, agile environment.
Thanks, and Regards
Kiran
Talent Acquisition Executive
Email: ki...@ittunescorp.com
IT Tunes
Software Corporation
http://www.ittunescorp.com/