Data Integration Architect in Dublin, CA (Hybrid)
aa...@arreglocs.net
Hi,
Hope you are doing great.
This is Aaron from Arreglo Consulting. I have a position below, please check and let me know if you are comfortable.
Title: Streamsets Integration Architect
Location: Dublin, CA (Hybrid)
Visa: Any Visa (apart from USC/GC)
Industry Experience: Retail Industry
Experience Required: 15-20 years
Job Description:
· Establish an architecture pattern and build data pipelines using Streamset to source structured, unstructured data from legacy sources and integrate with Snowflake Cloud platform. Hadoop to Snowflake migration streamlining.
· Build data pipelines using Streamset Integration platform to integrate Transportation Management System with Snowflake.
· Resolve issues with existing pipelines, refactor, rationalize and ensure pipelines are optimized for incremental load
· Establish Data observability using Dynatrace, Snowflake metadata
· Register data entities with Alation Data Catalog.
· Metadata capture: data classification, data lineage, role-based access control (RBAC).
· Review and align on Deliverables with Ross team.
· Prepare demo on Alation Data Catalog features.
Must-have skills:
· Individual contributor role, with Streamsets, Hadoop, Snowflake as Primary skills
· Must have 15yrs of Retail industry experience. Someone who understands Supply chain, Transportation management system models, establish an Integration pattern.
Important Skillsets: Streamsets, Hadoop, Snowflake, DBT, Azure Infrastructure, AKS, 10+yrs of Retail Industry experience
Thanks & Regards
| |
