Software Engineer II

We are the AI Frameworks team at Microsoft, part of the CoreAI organization, and we are at the forefront of driving innovation in large-scale AI.

• Contribute to the design and development of components in the AI software stack for Microsoft’s 1P accelerators.
• Implement features and optimizations under the guidance of senior engineers.
• Collaborate with hardware, compiler, and framework teams to enable efficient execution of LLM workloads.
• Debug issues, analyze performance gaps, and propose targeted improvements.
• Participate in design discussions, code reviews, and maintain high-quality software practices.
• Learn and stay up to date on emerging AI frameworks and accelerator technologies.

• Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python
• OR equivalent experience
• Experience with modern large language model (LLM) serving technologies or distributed inference concepts.
• Strong problem-solving ability and willingness to work in a collaborative team environment.

• 401k matching
• Health insurance
• Flight privileges
• Discounts on products and services
• Generous time away
• Giving programs
• Opportunities to network and connect

We are the AI Frameworks team at Microsoft, part of the CoreAI organization, and we are at the forefront of driving innovation in large-scale AI.