AI Testing Lead

The Consumer Experience Operations (CXO) team at YouTube is responsible for developing user-centric support solutions that address the evolving needs of YouTube’s user base across NFL Sunday Ticket, YouTube TV, and YouTube Music and Premium, as well as Shopping and Fan Funding with the goal of delivering an experience and driving customer lifetime value

• Develop a comprehensive test strategy and define the scope of testing
• Analyze data from AI model performance and user interactions
• Work with UX and Conversation Designers to ensure design solutions are aligned with business key performance indicators
• Create clear documentation, including test cases, user stories, process flows, and requirements matrices
• Manage a team of testers, overseeing testing requirements and implementing a prioritized feedback loop for tech and design

• Bachelor’s degree or equivalent practical experience
• 5 years of experience as a testing lead, business analyst or similar role in the AI domain
• Experience with testing processes like automated testing, adversarial testing, regression testing
• Experience working with UX designers, product managers, and engineers
• Experience with AI-based product testing
• Understanding of UX design principles or conversational AI concepts
• Ability to interpret data and translate it into insights
• Excellent communication skills, with the ability to effectively communicate information to both technical and non-technical audiences

• Bonus
• Equity
• Health insurance
• 401k matching

Google is committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law