AI Hardware/Software Co-design Engineer II

Microsoft delivers more than 200 online services to more than one billion individuals worldwide, powering cloud infrastructure and foundational technologies for Microsoft Azure, Bing, MSN, Office 365, OneDrive, Skype, Teams and Xbox Live.
$98,300 - $193,200
Machine Learning
Mid-Level Software Engineer
Hybrid
5,000+ Employees
2+ years of experience
AI · Enterprise SaaS · Cloud

Description For AI Hardware/Software Co-design Engineer II

Join Microsoft's Azure Hardware Systems & Infrastructure (AHSI) organization as an AI Hardware/Software Co-design Engineer II within the Strategic Planning and Architecture (SPARC) team. This role is at the forefront of innovating hardware designs to propel Microsoft's cloud growth, combining technical capabilities with business strategy.

The position involves working on Azure's hardware roadmap from architecture concept through production, supporting Microsoft's extensive cloud infrastructure that powers services used by over a billion users worldwide. You'll be responsible for developing performance modeling methodologies, analyzing GPU performance for AI workloads, and optimizing system resources.

Key responsibilities include collaborating with cross-functional teams to improve system performance, developing in-house tools for machine learning systems, and creating performance visualization dashboards. The role requires expertise in AI accelerators, computer architecture, and programming skills in C++ and Python.

This is an excellent opportunity for someone with a background in hardware/software co-design who wants to impact Microsoft's AI infrastructure at scale. You'll work with cutting-edge technology while contributing to the architecture that powers Microsoft's "Intelligent Cloud" mission.

The position offers competitive compensation, comprehensive benefits, and the chance to work with industry-leading professionals in AI and cloud computing. You'll be part of a team that values innovation, collaboration, and technical excellence, with opportunities to influence the future of Microsoft's cloud infrastructure.

Working in a hybrid environment, you'll have the flexibility to balance remote work with in-person collaboration, fostering both productivity and team connection. The role provides excellent growth opportunities within Microsoft's dynamic and evolving cloud computing landscape.

Last updated 3 months ago

Responsibilities For AI Hardware/Software Co-design Engineer II

  • Work with business, architecture, and design teams to understand performance requirements
  • Work with platform, firmware, and software teams to identify opportunities to improve system power and performance
  • Develop in-house performance modelling methodology and tools for Machine Learning systems
  • Benchmark and analyze GPU performance for business critical AI workloads
  • Identify performance bottlenecks, optimize resource utilization
  • Create performance visualization dashboards and improve analysis framework
  • Guide teams in designing, building, testing, and deploying changes to existing software

Requirements For AI Hardware/Software Co-design Engineer II

Python
  • Bachelor's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 2+ years technical engineering experience
  • 2+ years of experience working with AI Accelerators such as GPUs or DSAs
  • Deep understanding of computer architecture, SOC and SW architectures
  • Experience in development of analysis tools written in C++ and Python
  • Knowledge of performance monitors and performance tuning
  • Proficiency in scripting languages such as Python, Bash, or PowerShell
  • Proficient problem-solving skills and attention to detail
  • Proficient communication and collaboration skills

Benefits For AI Hardware/Software Co-design Engineer II

Medical Insurance
Education Budget
Parental Leave
Vision Insurance
Dental Insurance
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?

Jobs Related To Microsoft AI Hardware/Software Co-design Engineer II

Machine Learning Engineer

Machine Learning Engineer position at Microsoft Security's CFAR team, focusing on AI solutions for cybersecurity and fraud prevention, offering competitive salary and benefits.

Software Engineer II

Software Engineer II position at Microsoft focusing on machine learning and SAP workload optimization for Azure platform, offering competitive salary and remote work options.

Software Engineer II

Mid-level Software Engineer position at Microsoft Security, focusing on developing generative AI services and LLM capabilities for security applications.

Software Engineer

Microsoft is seeking a Software Engineer to develop AI-driven services for scientific discovery within their Strategic Missions and Technologies division.

Software Engineer II- AI/ML

Software Engineer II position at Microsoft focusing on AI/ML development for Business & Industry Copilots group, working on Dynamics 365 and enterprise solutions.