QA Lead (Gen Ai & Chatbot LLM) || Los Angeles, CA(Hybrid).

[Basha Pathan]

Hello All,

Please find the JD below.

Title: QA Lead (Gen Ai & Chatbot LLM)

Client: AAA

Duration: Long Term

Location: Los Angeles, CA(Hybrid).

Relocation is fine.

Looking for Independent visa holders and total IT exp 14 or 14+.

(H4-EAD,GC-EAD,GC(13+),USC)

Technical Skills

• Strong experience testing LLM/Chatbots, NLP models, or GenAI products.

• Understanding of:

  • LLMs (OpenAI, Azure OpenAI, Anthropic, Llama, Gemini)

  • Prompt engineering concepts

  • RAG workflows, embeddings, vector DBs (Pinecone, FAISS, Chroma)

• Proficiency in:

  • Python scripting

  • Test automation frameworks (Selenium, PyTest, Robot Framework)

  • API testing tools

• Experience with cloud platforms (AWS/Azure/GCP) and DevOps pipelines.

Quality Skills

• Expertise in test planning, strategy, defect lifecycle management.

• Experience with Agile/Scrum.

• Familiarity with AI fairness, bias testing, and safety guidelines.

Nice to Have

• Experience measuring AI performance using A/B testing, human evaluation, or model scoring platforms.

• Knowledge of LangChain, LlamaIndex, or similar frameworks.

• Exposure to MLOps tools like MLflow, Airflow, or Kubernetes.

• Strong communication skills (Good to have prior direct client facing role)
• Functional/UI/API testing, good to have Automation Testing
• Experience GenAI & Chatbot’s LLM Testing
• Test Lead or Architect Level

Thanks & Regards

Basha

US IT Recruiter

Lincoln Softtech LLC

Mobile: 248 744 3742

Email :ba...@lincolnsofttech.com

linkedin.com/in/basha-patan-a08137242

3698 Bethelview Dr,Suite A200-C,Cumming,GA-30040,USA

www.lincolnsofttech.com

 an E-verify Company.