AI Hardware/Software Co-design Engineer II

Microsoft delivers more than 200 online services to more than one billion individuals worldwide, powering cloud infrastructure and foundational technologies for Microsoft Azure, Bing, MSN, Office 365, OneDrive, Skype, Teams and Xbox Live.
$98,300 - $193,200
Machine Learning
Mid-Level Software Engineer
Hybrid
5,000+ Employees
2+ years of experience
AI · Enterprise SaaS · Cloud

Description For AI Hardware/Software Co-design Engineer II

Join Microsoft's Azure Hardware Systems & Infrastructure (AHSI) organization as an AI Hardware/Software Co-design Engineer II within the Strategic Planning and Architecture (SPARC) team. This role is at the forefront of innovating hardware designs to propel Microsoft's cloud growth, combining technical capabilities with business strategy.

The position involves working on Azure's hardware roadmap from architecture concept through production, supporting Microsoft's extensive cloud infrastructure that powers services used by over a billion users worldwide. You'll be responsible for developing performance modeling methodologies, analyzing GPU performance for AI workloads, and optimizing system resources.

Key responsibilities include collaborating with cross-functional teams to improve system performance, developing in-house tools for machine learning systems, and creating performance visualization dashboards. The role requires expertise in AI accelerators, computer architecture, and programming skills in C++ and Python.

This is an excellent opportunity for someone with a background in hardware/software co-design who wants to impact Microsoft's AI infrastructure at scale. You'll work with cutting-edge technology while contributing to the architecture that powers Microsoft's "Intelligent Cloud" mission.

The position offers competitive compensation, comprehensive benefits, and the chance to work with industry-leading professionals in AI and cloud computing. You'll be part of a team that values innovation, collaboration, and technical excellence, with opportunities to influence the future of Microsoft's cloud infrastructure.

Working in a hybrid environment, you'll have the flexibility to balance remote work with in-person collaboration, fostering both productivity and team connection. The role provides excellent growth opportunities within Microsoft's dynamic and evolving cloud computing landscape.

Last updated 5 days ago

Responsibilities For AI Hardware/Software Co-design Engineer II

  • Work with business, architecture, and design teams to understand performance requirements
  • Work with platform, firmware, and software teams to identify opportunities to improve system power and performance
  • Develop in-house performance modelling methodology and tools for Machine Learning systems
  • Benchmark and analyze GPU performance for business critical AI workloads
  • Identify performance bottlenecks, optimize resource utilization
  • Create performance visualization dashboards and improve analysis framework
  • Guide teams in designing, building, testing, and deploying changes to existing software

Requirements For AI Hardware/Software Co-design Engineer II

Python
  • Bachelor's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 2+ years technical engineering experience
  • 2+ years of experience working with AI Accelerators such as GPUs or DSAs
  • Deep understanding of computer architecture, SOC and SW architectures
  • Experience in development of analysis tools written in C++ and Python
  • Knowledge of performance monitors and performance tuning
  • Proficiency in scripting languages such as Python, Bash, or PowerShell
  • Proficient problem-solving skills and attention to detail
  • Proficient communication and collaboration skills

Benefits For AI Hardware/Software Co-design Engineer II

Medical Insurance
Education Budget
Parental Leave
Vision Insurance
Dental Insurance
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?

Jobs Related To Microsoft AI Hardware/Software Co-design Engineer II

Machine Learning Engineer - II

Microsoft seeks a Machine Learning Engineer to build evaluation frameworks for cutting-edge AI models, focusing on LLMs and generative AI applications.

Software Engineer II

Microsoft is hiring a Software Engineer II to join their Azure ML team, focusing on large-scale AI inferencing and LLM services, offering competitive pay and benefits.

Applied AI Engineer II

Applied AI Engineer II position at Microsoft Security focusing on developing AI-powered security solutions with competitive compensation and comprehensive benefits.

Software Engineer II - AI/ML

Microsoft Software Engineer II position focusing on AI/ML development for business applications, offering hybrid work and comprehensive benefits.

Software Engineering

Software Engineering role at Microsoft focusing on Azure Machine Learning infrastructure and large-scale AI model serving.