Principal Software Engineer

We are the AI Frameworks team at Microsoft, part of the CoreAI organization, and we are at the forefront of driving innovation in large-scale AI

• Design, implement, and optimize core components of the AI software stack targeting Microsoft’s first-party AI accelerators
• Develop performance-critical infrastructure to support inference of large language models (LLMs) at scale
• Collaborate with hardware, compiler, and model teams to co-design solutions that maximize performance, efficiency, and reliability across the full AI stack

• Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python
• Experience in C++ and/or Python, with deep understanding of software design, debugging, and performance optimization
• Hands on experience with modern large language model (LLM) serving technologies, including model partitioning, distributed execution, and inference optimization

• Health insurance
• 401k matching
• Flight privileges
• Discounts on products and services
• Savings and investments
• Maternity and paternity leave
• Generous time away
• Giving programs
• Opportunities to network and connect

Microsoft is committed to diversity, equity, and inclusion in the workplace