SDET/QA Automation Engineer - DLTJP00057273------------USC/GC Only----------------Hybrid (2 Days onsite at nearby Deloitte office)
kannan G
Hello Connections,
How are you?
Email me if you have matching resources for the below requirement on C2C with an expected pay rate - kan...@multivision-inc.com
LinkedIn is Mandatory for the role. Contact me only through email
Please do not call/chat on WhatsApp – Kind Request
SDET/QA Automation Engineer - DLTJP00057273
Location – Hybrid (2 Days onsite at nearby Deloitte office) ----------- Georgia - Atlanta, Texas – Austin, Dallas, Houston; Arizona – Gilbert, Phoenix; Florida – Lake Mary, Orlando, Tampa; North Carolina – Charlotte; Massachusetts – Boston.
Client: ED Jones Through Deloitte
VISA: USC/GC Only
12+ Years Only.------------------------ Profiles below 12 Years will not be considered
Max Rate: $60/hr on C2C
We need a copy of the candidate’s Bachelor's certificate for submission (Degree OR Provisional Certificate).
Candidates who are not interested in submitting a bachelor's certificate before submission, please do not apply
Must-haves:
- Experience in quality engineering, software testing, QA automation, or related technical roles-------------------- Years
- Experience testing enterprise applications, APIs, data pipelines, or workflow-based systems-------------------- Years
- Experience evaluating AI or ML-based systems, including prompt behavior, output quality, or model-driven workflows-------------------- Years
- Strong understanding of test strategy, defect management, root cause analysis, and quality metrics-------------------- Years
- Familiarity with automation frameworks, test management tools, and CI/CD-aligned quality processes-------------------- Years
- Experience with LLM evaluation, prompt testing, RAG validation, or AI observability tools-------------------- Years
- Familiarity with Python, SQL, APIs, or scripting for test automation and data validation-------------------- Years
- Analytical rigor, attention to detail, and ability to identify model failure modes-------------------- Years
Additional Details for Role
We are seeking an AI Quality Engineer to join an innovative and high-impact team building AI capabilities within enterprise systems for a leading wealth management client. In this role, you will define, execute, and continuously improve quality engineering practices for AI-powered applications, including LLM-based assistants, retrieval solutions, and intelligent workflows. You will help ensure these solutions are reliable, accurate, secure, and fit for enterprise use by building robust testing strategies across model behavior, system integrations, user experience, and operational performance. This is an opportunity to shape the next generation of enterprise AI in a highly visible environment, where innovation, rigor, and business value all matter. The ideal candidate brings a quality-first mindset, strong testing discipline, and practical experience validating complex systems in regulated environments.
Key Responsibilities
· Design and execute test strategies for AI applications, including functional, integration, regression, usability, and non-functional testing
· Validate LLM-based solutions for accuracy, relevance, consistency, safety, latency, and task completion across realistic business scenarios
· Create test cases, evaluation datasets, and quality benchmarks for prompts, retrieval pipelines, orchestration flows, and end-user interactions
· Partner with AI engineers, product owners, and business stakeholders to define acceptance criteria and measurable quality standards
· Identify model failure modes, edge cases, hallucination risks, and workflow breakdowns, and recommend corrective actions
· Support automation of AI testing, monitoring, and quality reporting across development and production environments
· Test data flows, APIs, integrations, and system dependencies that support AI-enabled business processes
· Contribute to governance and release readiness by documenting defects, risks, test results, and quality decisions
· Monitor production feedback, user behavior, and operational metrics to help drive continuous improvement
· Help establish repeatable AI quality engineering practices, tooling, and controls for enterprise delivery
Required Qualifications
1. Bachelor’s degree in Computer Science, Engineering, Information Systems, Data Science, or related field
2. 6+ years of experience in quality engineering, software testing, QA automation, or related technical roles
3. Experience testing enterprise applications, APIs, data pipelines, or workflow-based systems
4. Experience evaluating AI or ML-based systems, including prompt behavior, output quality, or model-driven workflows
5. Strong understanding of test strategy, defect management, root cause analysis, and quality metrics
6. Familiarity with automation frameworks, test management tools, and CI/CD-aligned quality processes
7. Ability to work across technical and business teams to define and validate expected outcomes
8. Experience with LLM evaluation, prompt testing, RAG validation, or AI observability tools
9. Familiarity with Python, SQL, APIs, or scripting for test automation and data validation
10. Experience building synthetic datasets, golden test sets, or evaluation frameworks for AI use cases
11. Exposure to responsible AI, model risk, privacy, or governance controls in enterprise settings
12. Experience in financial services, wealth management, consulting, or other regulated environments
Core Competencies
1. Analytical rigor and attention to detail
2. Structured testing and defect analysis
3. Curiosity about model behavior and failure modes
4. Cross-functional collaboration
5. Clear communication of quality risks and trade-offs
6. Focus on reliability, user trust, and measurable outcomes
Regards
Kannan Ganesan
Senior Technical Recruiter
linkedin.com/in/kannan-ganesan-938002133
Please join the groups that are specially created for Bench Sales professionals to share my daily C2C requirements:
Google Group - usc-c2c-...@googlegroups.com
WhatsApp group https://chat.whatsapp.com/I6H3rWPwS2xHMPbpd8uq2X