AIML - Machine Learning Engineer, Foundation Model Services

Work along side Foundation Model Research team to optimize inference for cutting edge model architectures. Work closely with product teams to build Production grade solutions to launch models serving millions of customers in real time. Build tools to understand bottlenecks in Inference for different hardwares and use cases. Mentor and guide engineers in the organization.

• Work along side Foundation Model Research team to optimize inference for cutting edge model architectures.
• Work closely with product teams to build Production grade solutions to launch models serving millions of customers in real time.
• Build tools to understand bottlenecks in Inference for different hardwares and use cases.
• Mentor and guide engineers in the organization.

• 5+ years of experience leading and driving complex, ambiguous projects.
• Have experience with high throughput services particularly at supercomputing scale.
• Proficient with running applications on Cloud (AWS / Azure or equivalent) using Kubernetes, Docker etc.
• Familiar with GPU programming concepts using CUDA.
• Familiar with one of the popular ML Frameworks like Pytorch, Tensorflow.

• Comprehensive medical and dental coverage
• Retirement benefits
• Range of discounted products and free services
• Reimbursement for certain educational expenses
• Discretionary bonuses or commission payments
• Relocation assistance

Foundation Model Infrastructure team, within Machine Learning Platform Technologies organization is the back-bone of Apple Intelligence. It builds frameworks, services and tools that power the largest Apple foundation models on servers.