QA AI Lead

Remote, (Multiple states)
Contracted
Entry Level

QA AI Lead

Responsibilities:- Define and implement enterprise-wide AI testing and quality assurance strategies.- Establish testing standards, governance, and best practices for AI/ML and Generative AI applications.- Lead QA activities across AI product lifecycle from development through production deployment.- Drive AI-powered quality engineering transformation initiatives.- Validate LLMs, Chatbots, Copilots, and GenAI applications.- Develop test scenarios for prompt validation, hallucination detection, bias and fairness testing, security and privacy testing, performance and scalability testing, and explainability validation.- Define AI model quality metrics and monitoring standards.- Design and implement automated testing frameworks.- Integrate automated testing into CI/CD pipelines.- Establish AI-assisted test generation and test optimization strategies.- Drive shift-left and continuous testing practices.- Lead and mentor QA Engineers, Automation Engineers, and AI Test Specialists.- Collaborate with Product Owners, Architects, Developers, Data Scientists, and Business Analysts.- Manage vendor and offshore QA teams.- Conduct test planning, effort estimation, and release readiness reviews.- Monitor quality KPIs and AI performance metrics.- Present quality status and risk assessments to leadership teams.- Ensure compliance with security, regulatory, and Responsible AI requirements.

Required Skills:- Bachelor's degree in Computer Science, Information Technology, Engineering, or related field; Master's degree preferred.- 10+ years of experience in Software Quality Assurance.- 5+ years of Test Automation experience.- 3+ years of experience testing AI/ML or Generative AI solutions.- Experience leading QA teams and enterprise testing programs.

Share

Apply for this position

Required*
We've received your resume. Click here to update it.
Attach resume as .pdf, .doc, .docx, .odt, .txt, or .rtf (limit 5MB) or Paste resume

Paste your resume here or Attach resume file

Human Check*