Software Engineer II

Microsoft develops software and services to empower every person and organization on the planet to achieve more.
$98,300 - $193,200
Machine Learning
Mid-Level Software Engineer
Remote
2+ years of experience
AI · Enterprise SaaS

Description For Software Engineer II

Microsoft's AI Frameworks team is seeking a Software Engineer II to work on cutting-edge AI/ML frameworks that power major Microsoft products. The role focuses on developing ONNX (an open standard format for AI models), ONNX Runtime (high-performance ML inferencing and training accelerator), and PyTorch. You'll be part of a team that bridges the gap between state-of-the-art AI models and hardware ecosystems, enabling AI deployment across various platforms from cloud computers to mobile devices.

The position offers the opportunity to impact hundreds of millions of users while working with advanced AI technology. You'll collaborate with key partners on performance optimization for LLMs and contribute to frameworks used by Microsoft Office, Windows, Bing, and other major products. The team values continuous learning, risk-taking, and maintains an open, collaborative environment.

As a Software Engineer II, you'll work with C/C++, Python, and GPU development technologies, designing and implementing components for AI frameworks. The role combines technical expertise in machine learning with software engineering, requiring skills in performance optimization and system architecture.

Microsoft offers competitive compensation, comprehensive benefits, and a culture focused on inclusion and innovation. The position provides an excellent opportunity for growth in the AI/ML field while working on projects that directly impact major technology products used worldwide.

Last updated a day ago

Responsibilities For Software Engineer II

  • Design, implement, and test a function or component for our AI frameworks and tools
  • Speeding up/reducing complexity of key components/pipelines to improve performance and/or efficiency of our systems
  • Engage with key partners to understand and implement robust performance analysis and optimization for state-of-the-art LLMs and other models
  • Perform software development in C/C++, Python, and GPU development in languages such as CUDA, ROCm, or Triton
  • Interacting with and providing tech support for our customers/users
  • Embody Microsoft's Culture and Values

Requirements For Software Engineer II

Python
  • Bachelor's degree in computer science, Computer Engineering, or related technical discipline
  • 2+ years technical engineering experience with coding in languages including C, C++, C#, Java, or Python
  • 2+ years' experience with C/C++ (preferred)
  • 1+ years' experience of programming of CUDA or CPU assembly, or similar experience in compiler (preferred)
  • 1+ year experience working with Nvidia TensorRT, Qualcomm QNN SDK or Intel OpenVINO (preferred)
  • Experience with deep learning frameworks (PyTorch, Tensorflow, ONNX, etc.) (preferred)
  • Must pass Microsoft Cloud Background Check

Benefits For Software Engineer II

Medical Insurance
Education Budget
Parental Leave
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?

Jobs Related To Microsoft Software Engineer II

Software Engineer II

Software Engineer II position at Microsoft working on AI frameworks and machine learning optimization

Software Engineer II

Software Engineer II position at Microsoft working on Azure Machine Learning and OpenAI services, focusing on scalable AI solutions and cloud technologies.

Applied Machine Learning Research Engineer

Applied Machine Learning Research Engineer role at Microsoft focusing on security and compliance solutions using AI/ML, offering hybrid work and competitive benefits.

Software Engineer 2: Microsoft AI Development Acceleration Program

Microsoft AI Development Acceleration Program seeking Software Engineer 2 to lead AI solutions development and implementation in a two-year leadership development program.

Software Engineer 2: Microsoft AI Development Acceleration Program

Join Microsoft's AI Development Acceleration Program as a Software Engineer 2, leading AI solutions development and working with cutting-edge technologies in a collaborative environment.