ML Engineer - Evaluation Automation, Siri AI Quality Engineering

Apple has an extraordinary reputation for product quality. We are looking for a versatile Machine Learning Engineer with a strong background in Large Language Models (LLMs) to build the next generation ML evaluation frameworks and tools

• Design and develop machine learning and LLM-based solutions for ML model and system evaluation use cases
• Build the next generation ML evaluation frameworks and tools
• Use LLMs and other ML techniques to help automate large-scale data generation and evaluation job execution on server or on device
• Build and optimize LLM judges
• Detect anomalies
• Streamline ML evaluation workflows

• 3+ years of proven ability in machine learning, including hands-on work with LLMs
• Strong programming skills in Python and experience with ML/NLP libraries
• Experience building or fine-tuning LLMs for software engineering tasks
• Understanding of prompt engineering, and retrieval-augmented generation (RAG)
• Experience developing LLM-based automated evaluation frameworks
• Excellent knowledge of software testing methodologies & practices

• Comprehensive medical and dental coverage
• Retirement benefits
• Range of discounted products and free services
• Reimbursement for certain educational expenses
• Discretionary bonuses or commission payments
• Relocation assistance

Apple is an equal opportunity employer that is committed to inclusion and diversity