Senior AI Test Engineer (API & AI Validation)

Job Title: Senior AI Test Engineer (API & AI Validation)

Experience: 10–12 Years Employment Type: Subcontractor Job

Summary: We are seeking an experienced Senior AI Test Engineer with 10–12 years of experience in Quality Engineering, including hands-on expertise in API testing and AI application validation. The ideal candidate should have strong experience testing AI/LLM-powered applications, validating REST APIs, designing automation frameworks, and ensuring the quality, reliability, security, and performance of modern AI-enabled systems. This role requires a blend of traditional testing expertise and knowledge of AI-specific validation techniques, including prompt testing, model evaluation, hallucination detection, and retrieval validation.

Key Responsibilities:- Define and implement end-to-end test strategies for AI-enabled applications.- Design and execute comprehensive test plans for Generative AI, LLM, RAG, and AI Agent workflows.- Perform functional, integration, regression, system, and UAT testing.- Validate RESTful APIs using tools such as Postman, Swagger, REST Assured, or similar frameworks.- Develop and maintain API automation frameworks.- Validate AI model responses for:- Accuracy- Relevance- Consistency- Hallucinations- Bias- Toxicity- Test prompt engineering scenarios and optimize prompt quality.- Validate Retrieval-Augmented Generation (RAG) pipelines and vector search accuracy.- Verify AI guardrails, content moderation, and responsible AI compliance.- Perform database validation using SQL.- Conduct performance and load testing for APIs and AI services.- Collaborate with Product Owners, Architects, Data Scientists, ML Engineers, and Developers.