Software Engineer II

Microsoft develops AI software and technology solutions, including the world's fastest AI supercomputers and software stacks for novel AI accelerators.
$98,300 - $193,200
Machine Learning
Mid-Level Software Engineer
Remote
5,000+ Employees
2+ years of experience
AI · Enterprise SaaS

Description For Software Engineer II

The Artificial Intelligence (AI) Frameworks team at Microsoft is seeking a Software Engineer II to join their innovative team. This role sits at the intersection of AI algorithmic innovation, software systems, and purpose-built AI hardware. The team develops AI software that enables running AI models across various platforms, from supercomputers to mobile devices and IoT.

As a Software Engineer II, you'll work on fundamental abstractions, programming models, compilers, runtimes, libraries, and APIs that enable large-scale training and inferencing of advanced AI models. The position offers the opportunity to collaborate with hardware teams and partners while working closely with ML researchers and developers to optimize and scale model training and inference.

The team operates with a collaborative and inclusive culture, contributing to the open-source community. You'll be part of a cross-disciplinary team that values intellectual curiosity and passion for learning new technologies. The role requires strong technical skills in Python and C/C++, along with experience in AI training and inference software.

Microsoft offers competitive compensation, including a base salary range of $98,300 - $193,200 (higher in SF Bay Area), comprehensive benefits, and opportunities for professional growth. The position allows for up to 100% work from home, providing flexibility while maintaining strong team collaboration.

Last updated 21 hours ago

Responsibilities For Software Engineer II

  • Design and develop AI software in C/C++, Python, and other languages
  • Apply engineering principles for defining robust and maintainable architectures and designs
  • Collaborate broadly across multiple disciplines from hardware designers to ML developers
  • Identify requirements, scope solutions, estimate work, schedule deliverables
  • Help establish and drive the adoption of coding standards and patterns

Requirements For Software Engineer II

Python
Java
JavaScript
  • Bachelor's Degree in Computer Science or related technical field
  • 2+ years technical engineering experience with coding languages
  • 1+ years experience with Python, C/C++
  • Solid technical background in software engineering principles
  • Experience with AI training and inference software (PyTorch, Tensorflow, Triton)
  • Cross-team collaboration skills

Benefits For Software Engineer II

Medical Insurance
Education Budget
Parental Leave
Mental Health Assistance
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?

Jobs Related To Microsoft Software Engineer II

Software Engineer 2: Microsoft AI Development Acceleration Program

Microsoft AI Development Acceleration Program seeking Software Engineer 2 to lead AI solutions development and implementation in a two-year leadership development program.

Software Engineer 2: Microsoft AI Development Acceleration Program

Join Microsoft's AI Development Acceleration Program as a Software Engineer 2, leading AI solutions development and working with cutting-edge technologies in a collaborative environment.

Software Engineer 2- AI Tooling

Microsoft is hiring a Software Engineer 2 to develop AI tooling products, requiring 3+ years of experience and expertise in enterprise software development.

Software Engineer II

Software Engineer II position at Microsoft's Azure GenAI team, focusing on LLM technologies and distributed systems with 4+ years of experience required.

Machine Learning Engineer II

Machine Learning Engineer II position at Microsoft focusing on large language model development and adaptation for Azure GenAI platform.