Urgently required::Senior DataStage Developer _ :Remote- contract
Vasu Naidu
Hello ,
Greetings for the day.
I am trying to reach you for the below position .Please let me know your interest in taking the new positions or else please refer your colleagues or friends who are looking for a job change.
Drive the end-to-end rationalization, reverse-engineering, and automated validation of legacy DataStage environments migrating to modern Databricks architectures. This role is critical to eliminating legacy code redundancies, mapping complex data lineage, and implementing automated testing frameworks to guarantee zero data loss and business disruption during system cutovers.
- Legacy Rationalization: Analyze DataStage .dsx/.isx exports and metadata to map end-to-end data lineage.
- Code Elimination: Identify and isolate "dead jobs", redundant code, and duplicate logic to streamline migration waves.
- Technical Translation: Provide functional logic explanations of complex parallel/server jobs to the PySpark development team.
- Test Automation: Deploy automated test frameworks to execute large-scale data reconciliation between DataStage and Databricks.
- Data Validation: Build automated scripts to validate data schemas, row counts, and complex transformations across dual-run environments.
- Regression Testing: Execute regression testing on newly refactored PySpark code against historical legacy data.
- Migration Sign-off: Document validation execution KPIs and formally sign off on data accuracy before live migration cutovers.
- Legacy ETL: IBM InfoSphere DataStage (Parallel/Server jobs, Sequences) and operational metadata analysis.
- Data Quality & Testing: Automated ETL Testing tools, PyTest, and Great Expectations.
- Languages & Querying: Advanced SQL, Python, and XML/JSON parsing.
- Target Platforms: Familiarity with Databricks, PySpark, and modern cloud data warehouses.
Vasu.K
US IT Recruiter
Email: va...@atvsllc.com
DISCLAIMER: This email and any files transmitted with this email are confidential and intended solely for the use of the recipient to whom they are addressed. If you are not the intended recipient you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this mail and attached file/s is strictly prohibited. You are also advised to notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system.
This e-mail message including attachment(s), if any, is believed to be free of any virus. However, it is the responsibility of the recipient to ensure that is virus free and American Tech Vision Solutions is not responsible for any loss or damage arising in any way from its use.