AI Hardware/Software Co-design Engineer II

Microsoft delivers more than 200 online services to more than one billion individuals worldwide, powering cloud infrastructure and foundational technologies for Microsoft Azure, Bing, MSN, Office 365, OneDrive, Skype, Teams and Xbox Live.
$98,300 - $193,200
Machine Learning
Mid-Level Software Engineer
Hybrid
5,000+ Employees
2+ years of experience
AI · Enterprise SaaS · Cloud
This job posting may no longer be active. You may be interested in these related jobs instead:
Language Engineer

Language Engineer role at Microsoft AI, focusing on building next-generation capabilities for Copilot through language engineering and LLM development.

Software Engineer II

Microsoft Azure AI Platform Software Engineer II position focusing on machine learning, AI model training, and distributed systems development in Hyderabad, India.

Software Engineer II

Software Engineer II position at Microsoft Security working on Security Copilot and generative AI services in Hyderabad, India.

Software Engineer II

Software Engineer II position at Microsoft working on Azure Specialized team, focusing on SAP workload optimization and machine learning integration.

Software Engineering

Software Engineering role at Microsoft focusing on Azure Machine Learning platform development and large-scale AI model serving infrastructure.

Description For AI Hardware/Software Co-design Engineer II

Join Microsoft's Azure Hardware Systems & Infrastructure (AHSI) organization as an AI Hardware/Software Co-design Engineer II within the Strategic Planning and Architecture (SPARC) team. This role is at the forefront of innovating hardware designs to propel Microsoft's cloud growth, combining technical capabilities with business strategy.

The position involves working on Azure's hardware roadmap from architecture concept through production, supporting Microsoft's extensive cloud infrastructure that powers services used by over a billion users worldwide. You'll be responsible for developing performance modeling methodologies, analyzing GPU performance for AI workloads, and optimizing system resources.

Key responsibilities include collaborating with cross-functional teams to improve system performance, developing in-house tools for machine learning systems, and creating performance visualization dashboards. The role requires expertise in AI accelerators, computer architecture, and programming skills in C++ and Python.

This is an excellent opportunity for someone with a background in hardware/software co-design who wants to impact Microsoft's AI infrastructure at scale. You'll work with cutting-edge technology while contributing to the architecture that powers Microsoft's "Intelligent Cloud" mission.

The position offers competitive compensation, comprehensive benefits, and the chance to work with industry-leading professionals in AI and cloud computing. You'll be part of a team that values innovation, collaboration, and technical excellence, with opportunities to influence the future of Microsoft's cloud infrastructure.

Working in a hybrid environment, you'll have the flexibility to balance remote work with in-person collaboration, fostering both productivity and team connection. The role provides excellent growth opportunities within Microsoft's dynamic and evolving cloud computing landscape.

Last updated 3 months ago

Responsibilities For AI Hardware/Software Co-design Engineer II

  • Work with business, architecture, and design teams to understand performance requirements
  • Work with platform, firmware, and software teams to identify opportunities to improve system power and performance
  • Develop in-house performance modelling methodology and tools for Machine Learning systems
  • Benchmark and analyze GPU performance for business critical AI workloads
  • Identify performance bottlenecks, optimize resource utilization
  • Create performance visualization dashboards and improve analysis framework
  • Guide teams in designing, building, testing, and deploying changes to existing software

Requirements For AI Hardware/Software Co-design Engineer II

Python
  • Bachelor's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 2+ years technical engineering experience
  • 2+ years of experience working with AI Accelerators such as GPUs or DSAs
  • Deep understanding of computer architecture, SOC and SW architectures
  • Experience in development of analysis tools written in C++ and Python
  • Knowledge of performance monitors and performance tuning
  • Proficiency in scripting languages such as Python, Bash, or PowerShell
  • Proficient problem-solving skills and attention to detail
  • Proficient communication and collaboration skills

Benefits For AI Hardware/Software Co-design Engineer II

Medical Insurance
Education Budget
Parental Leave
Vision Insurance
Dental Insurance
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?