Azure Databricks Architect with PySpark and Snowflake exp || Iselin NJ / New York 10020 (Day 1 Onsite)
Harjot Singh
This is a 100% onsite role and need someone to work from NY from Day 1.
Need someone with strong Databricks Architect experience. Need to be strong in Azure, Spark, Snowflake, etc.
Role: Azure Databricks Architect with PySpark and Snowflake exp
Location: Iselin NJ / New York 10020 (Day 1 Onsite)
Duration: 6+ months
Minimum Exp level : 15+ years
Skills:
- 10+ years - Enterprise Data Management
- 10+ years - SQL Server based development of large datasets
- 5+ years with Data Warehouse Architecture, hands-on experience with Databricks platform. Extensive experience in PySpark coding and Snowflake
- 3+ years Python (NumPy, Pandas) coding experience
- Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling
- Good knowledge on Azure Coud and services like ADF, Active Directory, App Services, ADLS etc
- Hands on experience on CI/CD pipeline implementations
- Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills
- Experience with Snowflake utilities such as SnowSQL and SnowPipe - good to have
- Capable of discussing enterprise level services independent of technology stack
- Experience with Cloud based data architectures, messaging, and analytics
- Superior communication skills
- Cloud certification(s)
- Any experience with Reporting is a Plus
- Excellent written and verbal communication, intellectual curiosity, a passion to understand and solve problems, consulting & customer service
- Structured and conceptual mindset coupled with strong quantitative and analytical problem-solving aptitude
- Exceptional interpersonal and collaboration skills within a team environment
Responsibilities:
- Design, develop, and deploy Databricks jobs to process and analyze large volumes of data.
- Collaborate with data engineers and data scientists to understand data requirements and implement appropriate data processing pipelines.
- Optimize Databricks jobs for performance and scalability to handle big data workloads.
- Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
- Demonstrated proficiency with Data Analytics, Data Insights
- Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process
- Leverage SQL, programming language (Python or similar) and/or ETL Tools (Azure Data Factory, Data Bricks, Talend and SnowSQL) to develop data pipeline solutions to ingest and exploit new and existing data sources.
- Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.
- Collaborate with data engineers and data scientists to understand data requirements and implement appropriate data processing pipelines.
- Optimize Databricks jobs for performance and scalability to handle big data workloads.
Education
- Minimally a Bachelor degree within an Engineering and/or Computer Science discipline
- Master’s degree preferred
Thanks and Regards,
|
Harjot Singh (Sr. Executive - Recruiter) Corporate Office: 650 Wilson Lane, Suite 201, Mechanicsburg, PA 17055 E: harjot...@testingxperts.com W: www.testingxperts.com |
TestingXperts – Next Gen Specialist QA & Software Testing Company
Please consider the planet before printing | Switch off as you go |Recycle always | Your child deserves a better world
CONFIDENTIALITY NOTICE: This e-mail message, including any attachments, is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message.