Performance Lead, AI Agent

Our goal is to ensure millions of creators and partners on YouTube have easy access to comprehensive support when and where they need it—a mission we are increasingly scaling through our AI agent—and to allow our creators’ voices to help shape product solutions.

• Analyze performance and conversational data to identify optimization opportunities and provide data-driven recommendations that shape the product roadmap.
• Establish and manage the core KPIs for the AI Agent, including novel LLM-based metrics for quality and satisfaction.
• Build forecasting models to project the impact of new AI capabilities and analyze pre- and post-launch data to measure their actual effect.
• Translate analytical findings into clear, actionable insights for PSM, Engineering, and Leadership to drive the overall AI support strategy.
• Structure and interpret A/B tests on prompts and conversational flows, delivering clear impact analyses to guide AI development and improve performance.

• Bachelor’s degree or equivalent practical experience.
• 5 years of experience in an analytical role in customer operations or for an AI/ML product.
• 5 years of experience in manipulating datasets and conducting analyses using SQL and Python.
• Experience creating executive communications (e.g., memos, slide decks, etc.) and presenting to non-technical/analytics audiences.

• 401k matching
• Health insurance
• Flight privileges
• Stock options
• Flexible work arrangements

At YouTube, we believe that everyone deserves to have a voice, and that the world is a better place when we listen, share, and build community through our stories. We work together to give everyone the power to share their story, explore what they love, and connect with one another in the process.