Hope you are doing great,
Role : Data Engineer
Location : San Francisco, CA
Duration : 6+ months
Job Description :
Must Have Skills (Top 3 technical skills only) *
1. Azure (ADF),
2. Databricks
3. Spark
Detailed Job Description:
Responsible for the build, deployment, onboarding and operations of multi-tenant data platform components/tools.
• Experience building cloud native production grade enterprise data lake(s) leveraging streaming/micro-batch and batch processing engines
• Best practices, design and operational practices experience of data platform components and capabilities, preferably in an Azure ecosystem
o Experience with the design, deployment and operations of elastic spark clusters (preferably Azure Databricks)
o Experience with and working knowledge in the design of/development with Databricks delta lake on cloud data lake (preferably ADLS gen 2)
o Experience with the design, deployment, integration and operational practices of Data Catalog and Governance tooling (such as Azure Data Catalog, Collibra, Alation)
o Experience building and deploying production grade data pipelines with Azure Data Factory.
Automation of deployment, configuration and operations of Cloud PaaS data services (preferably Azure)
Minimum years of experience*: 10+
Top 3 responsibilities you would expect the Subcon to shoulder and execute*:
1. Participate in building architecture and design
2. Develop, test and deploy data integration solutions
3. Provide data management knowledge to deliver the most architecturally efficient
--
M Manisha
US IT Recruiter,Humac, Inc.
2730 W Agua Fria Freeway, Suite# 204
Phoenix, AZ 85027.