Software Engineer 2

Microsoft is a leading technology company that develops and sells software, hardware, and cloud services.
Backend
Mid-Level Software Engineer
Hybrid
4+ years of experience
AI · Enterprise SaaS · Cloud

Description For Software Engineer 2

Azure AI Infrastructure team is looking for passionate engineers to build the largest deep-learning infrastructure service at Microsoft. In this role, you will be tasked with building new components to bring the latest innovations in AI Infrastructure onto the Azure AI Platform. You will partner with top engineering talent within Azure AI Infrastructure and across Azure to work on cluster orchestration, job scheduling, storage, networking, containerization, and operating system integration.

Your work will enable various AI languages and run-times on Azure AI Infrastructure to bring distributed deep learning training and inferencing to life. You will build infrastructure components required to build, deploy, monitor, and service highly available and scalable Microsoft Service Fabric and Kubernetes clusters. You will lead development and customer support from the frontline and establish architecture, service excellence guidelines, and a high-quality bar.

We are engineers on Azure AI Infrastructure. We believe that building a planet-scale AI Supercomputer from the ground-up which addresses the fundamental pain-points of data scientists and AI practitioners and takes AI to unprecedented scale is an opportunity of a lifetime.

Azure AI Infrastructure is a globally distributed, multi-tenant service that provides robust, cost-effective, and competitive AI infrastructure (compute, networking, and storage) for AI training and inferencing. By abstracting workloads from underlying infrastructure, Azure AI Infrastructure creates a shared pool of resources that can be dynamically provisioned for full utilization of expensive GPU compute, enabling data scientists to productively build, scale, experiment, and iterate their models on top of a robust, performant, scalable, and cost-effective distributed infrastructure built for AI.

Responsibilities include:

  1. Deliver a robust container orchestration platform for Azure AI Infrastructure
  2. Design and build the scheduling sub-system for AI training and inferencing workloads
  3. Design and build storage and caching system for efficient DNN training and inferencing
  4. Design and build control plane APIs for creation and management of training jobs and inference model metadata
  5. Deliver node management, fault detection, and node repair as a service
  6. Deliver world-class monitoring systems and telemetry pipelines
  7. Codify security and compliance requirements
  8. Leverage performance and profiling tools to identify hot spots and bottlenecks across hardware and software boundaries

Join us in building the future of AI infrastructure at Microsoft!

Last updated 5 months ago

Responsibilities For Software Engineer 2

  • Deliver a robust container orchestration platform for Azure AI Infrastructure
  • Design and build the scheduling sub-system for AI training and inferencing workloads
  • Design and build storage and caching system for efficient DNN training and inferencing
  • Design and build control plane APIs for creation and management of training jobs and inference model metadata
  • Deliver node management, fault detection and node repair as a service
  • Deliver world-class monitoring systems and telemetry pipelines
  • Codify security and compliance requirements
  • Leverage performance and profiling tools to identify hot spots and bottlenecks

Requirements For Software Engineer 2

Kubernetes
Linux
Rust
Go
  • 4+ years of experience with coding in one of C#, C or C++, Rust, go
  • Experience working with the Linux operating system and Kubernetes cluster orchestration
  • Experience with improving service operations or engineering fundamentals
  • Excellent collaboration skills
  • A master's or bachelor's degree in computer science or a related field
  • At least 3 years of experience building and shipping production software or services
  • Ability to meet Microsoft, customer and/or government security screening requirements

Benefits For Software Engineer 2

Medical Insurance
Education Budget
Parental Leave
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?

Jobs Related To Microsoft Software Engineer 2

Technical Support Engineering

Senior Technical Support Engineer role at Microsoft, focusing on resolving complex customer technical issues with up to 50% remote work flexibility.

Technical Support Engineer

Technical Support Engineer position at Microsoft focusing on customer support for data analytics, AI, and business intelligence platforms with competitive pay and benefits.

Software Engineer II

Microsoft Software Engineer II position focusing on Windows servicing and delivery, offering hybrid work and competitive compensation.

Technical Support Engineer - Power Platform

Technical Support Engineer position at Microsoft focusing on Power Platform support, offering remote work and opportunity to provide technical leadership and mentoring.

Software Engineer II

Mid-level Software Engineer position at Microsoft focusing on build systems and test infrastructure for Microsoft Defender, offering competitive pay and hybrid work environment.