NEED : Senior Data Engineer with ETL & Ab Initio Migration - USPS
himanshu yadav
I hope this message finds you well.
We have a new requirement and would appreciate your support in sharing suitable candidate profiles at the earliest. Please find the high-level details below:
JOB DESCRIPTION
Job Title: Senior Data Engineer with ETL & Ab
Initio Migration
Client: USPS
Location: Boca Raton, FL, USA; West Palm Beach, FL, USA; Dallas, TX, USA; Phoenix, AZ, USA (Highly Prefer)
Ab Initio Migration Specialist
Ab Initio to Azure Databricks Migration Role Overview:
We are seeking an experienced Ab Initio expert to lead and support the migration of legacy Ab Initio workloads to Azure Databricks. The candidate will serve as the onshore technical subject matter expert, bridging business stakeholders and offshore delivery teams while ensuring data accuracy and delivery quality throughout the migration.
Scope of Engagement
- Act as the key Ab Initio SME for the migration of Ab Initio graphs and plans to Azure Databricks ETL jobs, covering assessment, conversion, validation, and cutover.
- Translate Ab Initio logic into Databricks (Spark/PySpark/SQL) equivalents.
- Act as the onshore SME, partnering with business teams and translating requirements into clear specs for offshore delivery.
- Provide guidance, knowledge transfer, and data debugging support to offshore engineers.
- Support data validation during migration and help resolve source-side Ab Initio ETL execution issues.
- Flexible working hours to ensure effective overlap with offshore teams across time zones.
Key Responsibilities
- Analyze and interpret existing Ab Initio graphs, plans, and components to document business and transformation logic.
- Translate complex Ab Initio functions (transform, rollup, join, partition/departition, lookup, normalize/denormalize, etc.) into target Databricks ETL designs.
- Partner with business teams to capture requirements and translate them into actionable specifications for offshore development teams.
- Provide technical guidance and knowledge transfer to offshore engineers executing the conversion.
- Lead data debugging, reconciliation, and root-cause analysis to resolve discrepancies between source (Ab Initio) and target (Databricks) outputs.
- Support data validation and reconciliation throughout the migration to ensure source-to target parity.
- Troubleshoot and resolve source-side Ab Initio ETL execution issues to keep migration and validation on track.
- Define reusable conversion patterns, templates, and best practices to accelerate delivery.
- Support SIT/UAT cycles, validate data parity, and assist with performance tuning on Databricks. Required Skills & Experience
- Strong hands-on expertise with Ab Initio (GDE, Co>Operating System, EME, Conduct>It plans, Continuous Flows).
- Deep understanding of Ab Initio graph design, components, and DML/transform functions.
- Working knowledge of Azure Databricks, Apache Spark, PySpark, and SQL.
- Proven experience in legacy ETL modernization or migration programs.
- Strong data analysis, validation, and debugging skills with the ability to trace logic across complex pipelines.
- Excellent communication skills to work across business stakeholders and distributed offshore teams.
Preferred Qualifications
- 10 years of experience.
- Experience migrating Ab Initio (or comparable legacy ETL such as Informatica/Teradata) to Databricks or other cloud lakehouse platforms.
- Familiarity with Azure data services (ADLS, ADF, Azure SQL) and CI/CD for data pipelines.
- Domain exposure to healthcare, banking, or other regulated, data-intensive industries.
- Experience leading or mentoring offshore delivery teams. Engagement Details
- Onshore role with regular interaction across onshore and offshore teams.
- Flexible working hours to maintain effective overlap with offshore time zones.
- located in Phoenix
Looking forward to hearing from you !
Himanshu Yadav (He/him)
Valzo Soft Solutions, LLC.
Web: www.valzosoft.com Email: hima...@valzosoft.com
Linkedin: https://www.linkedin.com/in/himanshu-yadav-558a9823a/
12600 Deerfield Parkway, Suite# 2123, Alpharetta, GA-30004
CONFIDENTIALITY NOTICE: This email and any attachments are intended only for the recipient(s) and may contain confidential information. If you are not the intended recipient, please delete this message and notify the sender immediately. Unauthorized use, disclosure, or distribution is prohibited. Valzo Soft Solutions LLC accepts no liability for any damage caused by this email or attachments.