Gen AI Assurance Architect Full-time

Description

GenAI Assurance Architect

Responsibilities
• Identify the most effective architectures and models to solve complex data problems around Quality Engineering using GenAI
• Apply GenAI in automating different aspects of STLC such as Test artefact generation, defect prediction, defect triaging, failure analysis, test optimization and self-healing.
• GenAI systems validation including RAG based LLMs for Q&A, generated content and recommendations
• Validate performance, security, finetuning and feedback function for LLM based applications
• Build solutions to ensure fairness and trustworthiness of GenAI systems by performing automated tests for prompt safety, response accuracy, relevancy, toxicity, biasness and explainability
• Lead, mentor, and advise the team members in deploying LLMs and AI models for specified use cases
• Document, summarize and present findings and recommendations for Continuous improvement of AI/GenAI implementations across Quality Assurance & Quality Engineering

Skills / Qualification
• Bachelor’s degree in Statistics, Computer Science, or Engineering
• At least 4 years experience in analytics, data science, ML Engineering in SDLC
• Experience with building a range of AI /GenAI based models into production for use cases like Test case generation, Defect classification & prediction, Root cause analysis (RCA), auto script generation, Model Based Testing (MBT), Test case optimization, Self-healing etc
• At least 1-2 years of experience in building & deploying LLM based solutions from leading vendors like OpenAI – GPT, Google Gemini Pro or AWS Bedrock
• Extensive Python experience required with libraries like LangChain, Ragas, Truelens etc
• Able to communicate technical issues in AI/GenAI with technical & non-technical stakeholders
• Ability to quickly implement POCs on GenAI assurance use cases based on client data