Senior ML Research Engineer – LLM Quantization & Model Optimization

Join the Strategic Planning and Architecture (SPARC) team within Microsoft’s Azure Hardware Systems and Infrastructure (AHSI) organization, the team behind Microsoft’s expanding Cloud Infrastructure and for powering Microsoft’s “Intelligent Cloud” mission.

• Design and develop novel quantization techniques to enable efficient deployment of LLM inference and training in Microsoft’s Azure production environments.
• Drive software development and model optimization tooling proof-of-concept effort to streamline deployment of quantized models.
• Analyze performance bottlenecks in state-of-the-art LLM architectures and drive performance improvements.
• Prototype and evaluate emerging low-precision data formats through proof-of-concept implementations.
• Co-design model architecture optimized for low-precision deployment in close collaboration with companywide AI teams.
• Work cross-functionally with data scientists and ML researchers/engineers to align on model accuracy and performance goals.
• Partner with hardware architecture and AI software framework teams to ensure end-to-end system efficiency.

• Doctorate in relevant field OR equivalent experience.
• 4+ years of combined experience, including 2+ years of industry experience in low-precision model optimization and quantization for LLM workloads.

• Health insurance
• 401k matching
• Flight privileges
• Discounts on products and services
• Savings and investments
• Maternity and paternity leave
• Generous time away
• Giving programs
• Opportunities to network and connect

Microsoft delivers more than 200 online services to more than one billion individuals worldwide and AHSI is the team behind our expanding cloud infrastructure.