Databricks Data Architect : Mahwah, New Jersey (Hybrid)
deepika dua
Please carefully read the Job Description below, and if you would like to pursue this opportunity, please email me an updated MS Word version of your resume to Deep...@VBeyond.com at your earliest convenience. If you're not interested feel free to send me your resume and let me know what type of positions, I can help you with. I appreciate your time and look forward to hearing from you.
Please share 16+ Years experience candidates
Include contact details and the LinkedIn profile link of the candidate in the email.
Mention Candidate current location & work Authorization/Visa status of the candidate
Position: Databricks Data Architect
Location: Mahwah, New Jersey (Hybrid)
Type: Long term contract
Small Modification to the JD from Customer instead of bringing in AI – It is more of Databricks Data Architect.
Data Engineering Execution
- Build and maintain ingestion frameworks (ADF / Databricks / Spark)
- Implement Bronze -> Silver transformations aligned to architecture
- Architect data quality checks, schema validation, and contract rules
- Optimize pipelines for performance and cost
DevOps & Automation
- Own CI/CD pipelines (Azure DevOps)
- Automate onboarding (repos, pipelines, policies, templates)
- Maintain IaC and scripting (Terraform, PowerShell / Python)
- Troubleshoot pipeline failures and permission issues
Data Modeling - Design and implement curated data models in Gold layer aligned to business use cases
Build:
- Dimensional models (star/snowflake schemas)
- Fact tables, dimensions, surrogate keys, SCD handling
- Translate Silver datasets into:
- Analytics-ready models
- Consistent KPI definitions and business logic
Ensure:
- Consistency across domains (common dimensions, conformed models)
- Reusability and scalability of models
- Alignment with enterprise semantic layer (Power BI / Fabric / downstream tools)
Handle changes such as:
- Column derivation logic changes (not just schema changes)
- Backward compatibility and impact analysis
- Partner with business / data stewards to:
- Define business rules
- Validate metrics and edge cases
- Support regression scenarios
Governance & Data Quality Implementation
- Implement governance patterns defined by architecture
- Enforce:
- Unity Catalog standards
- naming conventions, metadata policies
- access controls (RBAC/ABAC)
Architecture Translation
Automation first thinking and design approach.
Convert high-level architecture into:
low-level designs
reusable templates
engineering playbooks
Ensure consistency across projects and teams
Team Enablement
Support delivery teams with:
onboarding
debugging
design reviews
Provide hands-on guidance
Create reusable assets to reduce repeat questions
Required Skills
Core Platform
Azure Data Platform (ADF, ADLS, Azure SQL)
Databricks (DLT, Delta Lake, Spark, Workflows, Unity Catalog)
Microsoft Fabric (preferred)
Engineering
PySpark / Python (advanced)
SQL (strong)
Pipeline design (batch + streaming)
DevOps / Automation
Azure DevOps (pipelines, repos, policies)
PowerShell automation (must-have for your setup)
CI/CD + Infrastructure-as-Code concepts
Governance / Data Quality
Schema enforcement, data contracts, DQ frameworks
Metadata-driven design understanding
Regards,
Deepika Dua
VBeyond Corporation
https://www.linkedin.com/in/deepika-dua-018459166/
E: Deep...@vbeyond.com | www.vbeyond.com
390 Amwell Road, Suite # 107, Hillsborough, NJ 08844
Note – VBeyond is fully committed to Diversity and Equal Employment Opportunity.
Disclaimer: We respect your Online Privacy. This is not an unsolicited mail. Under Bill S 1618 Title III passed by the 105th US Congress this mail cannot be considered Spam as long as we include Contact information and a method to be removed from our mailing list. If you are not interested in receiving our e-mails then please reply to Deep...@vbeyond.com subject=Remove. Also mention all the e-mail addresses to be removed which might be diverting the e-mails to you. We are sorry for the inconvenience.