Software Engineer II

Microsoft is a leading technology company that develops software, hardware, and services to empower people and organizations worldwide.
$98,300 - $208,800
Machine Learning
Mid-Level Software Engineer
Hybrid
5,000+ Employees
2+ years of experience
AI · Enterprise SaaS

Description For Software Engineer II

Are you looking for opportunities to deliver innovations to hundreds of millions of users that impact their daily life? Do you want to be part of a fast-cycle, and hardcore AI/ML frameworks team to advance the AI technology?

We are looking for a Software Engineer II. The AI Frameworks team at Microsoft develops software that pushes the cutting edge of performance and experience in machine learning in production and research. We bridge the gap between the latest state-of-the-art AI models and hardware eco-systems. We build software to enable running AI models everywhere, from the world's fastest super cloud computers, to servers, desktops, mobile phones, IoT devices, and internet browsers. The framework we develop is powering AI experience for all major Microsoft products, such as Office, Windows, Bing, SQL Server, VSCode, Cognitive Service, Copilot+ PC, and many others.

As a Software Engineer II on our team, you would have the opportunity to work on:

  • ONNX: an open standard format for representing AI models, enabling AI developers to work on AI models with a variety of frameworks, tools, runtimes, and compilers.
  • ONNX Runtime: ONNX based cross-platform, high performance ML inferencing and training accelerator.
  • PyTorch: an open-source ML framework used by leading companies and researchers such as Microsoft, Facebook and OpenAI.

We value our team members' happiness and encourage everyone to constantly learn new things and take risks. We collaborate closely and openly to accomplish big things together while having fun.

Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Last updated 14 minutes ago

Responsibilities For Software Engineer II

  • Design, implement, and test a function or component for our AI frameworks and tools
  • Speed up/reduce complexity of key components/pipelines to improve performance and/or efficiency of our systems
  • Engage with key partners to understand and implement robust performance analysis and optimization for state-of-the-art LLMs and other models
  • Perform software development in C/C++, Python, and GPU development in languages such as CUDA, ROCm, or Triton
  • Interact with and provide tech support for our customers/users
  • Embody Microsoft's Culture and Values

Requirements For Software Engineer II

Python
  • Bachelor's degree in computer science, Computer Engineering, or related technical discipline
  • 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, or Python
  • 2+ years' experience with C/C++ (preferred)
  • 1+ years' experience of programming of Compute Unified Device Architecture (CUDA) or Central Processing Unit(CPU) assembly, or similar experience in compiler (preferred)
  • 1+ year experience working with Nvidia TensorRT, Qualcomm QNN SDK or Intel OpenVINO (preferred)
  • Exposure to Deep Neural Network training and inference and experience in one or more deep learning frameworks (PyTorch, Tensorflow, Open Neural Network Exchange-ONNX, etc.) (preferred)
  • Curiosity and passion about learning new technologies (preferred)
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Pass Microsoft Cloud Background Check upon hire/transfer and every two years thereafter

Benefits For Software Engineer II

Medical Insurance
Education Budget
Parental Leave
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?

Jobs Related To Microsoft Software Engineer II

Machine Learning Engineer II

Machine Learning Engineer II at Amazon, developing core shopping experiences using AI and large language models.

SDE II, GenAI Apps, People eXperience and Technology Central Science (PXTCS)

Amazon is hiring a SDE II for GenAI Apps in their PXT Central Science team to build ML and LLM systems, improving employee experience.

Machine Learning Algorithm Validation Engineer

Join Apple as a Machine Learning Algorithm Validation Engineer to work on cutting-edge AI and computer vision technologies.

Cloud Support Engineer - Sagemaker, Vision & other, Support Engineering

Join AWS as a Cloud Support Engineer, working with cutting-edge cloud technologies to assist global companies in leveraging AWS services for mission-critical applications.

Machine Learning Engineer II

Join Uber as a Machine Learning Engineer II to design and implement ML models for ad optimization, working with cutting-edge tech in a dynamic environment.