OmegaHires

QA AI Lead

Remote, (Multiple states) - Contracted

QA AI Lead

Responsibilities:- Define and implement enterprise-wide AI testing and quality assurance strategies.- Establish testing standards, governance, and best practices for AI/ML and Generative AI applications.- Lead QA activities across AI product lifecycle from development through production deployment.- Drive AI-powered quality engineering transformation initiatives.- Validate LLMs, Chatbots, Copilots, and GenAI applications.- Develop test scenarios for prompt validation, hallucination detection, bias and fairness testing, security and privacy testing, performance and scalability testing, and explainability validation.- Define AI model quality metrics and monitoring standards.- Design and implement automated testing frameworks.- Integrate automated testing into CI/CD pipelines.- Establish AI-assisted test generation and test optimization strategies.- Drive shift-left and continuous testing practices.- Lead and mentor QA Engineers, Automation Engineers, and AI Test Specialists.- Collaborate with Product Owners, Architects, Developers, Data Scientists, and Business Analysts.- Manage vendor and offshore QA teams.- Conduct test planning, effort estimation, and release readiness reviews.- Monitor quality KPIs and AI performance metrics.- Present quality status and risk assessments to leadership teams.- Ensure compliance with security, regulatory, and Responsible AI requirements.

Required Skills:- Bachelor's degree in Computer Science, Information Technology, Engineering, or related field; Master's degree preferred.- 10+ years of experience in Software Quality Assurance.- 5+ years of Test Automation experience.- 3+ years of experience testing AI/ML or Generative AI solutions.- Experience leading QA teams and enterprise testing programs.

Apply: QA AI Lead
* Required fields
First name*
Last name*
Email address*
Phone number*
Resume*

Attach resume as .pdf, .doc, .docx, .odt, .txt, or .rtf (limit 5MB) or paste resume

Paste your resume here or attach resume file

Desired Rate per hour ($)*
Current contract end date*
Willing to relocate*
Open to Travel (within United States)*
Work Authorization*
Current Location*
Human Check*