HW/SW Co-Design Engineer
Description For HW/SW Co-Design Engineer
OpenAI is seeking a HW/SW Co-Design Engineer to join their Research Platform team in San Francisco. This role is crucial in optimizing hardware for OpenAI's cutting-edge AI workloads. As part of a new team focusing on hardware optimization and co-design, you'll work closely with partners to optimize their hardware for OpenAI's workloads and bring new hardware platforms to production.
The position offers a competitive salary range of $350K-$530K plus equity, reflecting OpenAI's commitment to attracting top talent. The role requires a hybrid work model with 3 days in the office per week, and relocation assistance is available.
You'll be responsible for co-designing future hardware architectures, working with kernel, compiler, and machine learning engineers to understand and implement their needs related to ML techniques, algorithms, and optimizations. The ideal candidate should have 4+ years of industry experience, strong software/hardware co-design background, and deep understanding of GPU and AI accelerators.
The role combines technical expertise with strategic thinking, as you'll influence hardware partner roadmaps and evaluate potential accelerators and platforms. You'll work in a collaborative environment, interfacing with various teams to optimize hardware solutions for OpenAI's ambitious AI development goals.
Benefits include comprehensive healthcare, mental health support, 401(k) matching, generous paid time off, parental leave, and professional development opportunities. This is an exceptional opportunity to shape the future of AI hardware optimization at one of the world's leading AI research companies.
Responsibilities For HW/SW Co-Design Engineer
- Co-design future hardware for programmability and performance with hardware vendors
- Assist hardware vendors in developing optimal kernels and add support for it in our compiler
- Develop performance estimates for critical kernels for different hardware configurations
- Work with machine learning engineers, kernel engineers and compiler developers
- Manage communication and coordination with internal and external partners
- Influence the roadmap of hardware partners to optimize them for OpenAI's workloads
- Evaluate potential partners' accelerators and platforms
- Build simulations and performance models
- Influence roadmaps for hardware partners for datacenter networks, racks, and buildings
Requirements For HW/SW Co-Design Engineer
- 4+ years of industry experience in harnessing compute at scale or building semiconductors
- Strong experience in software/hardware co-design
- Deep understanding of GPU and/or other AI accelerators
- Experience with CUDA or related accelerator programming language
- Experience driving Machine Learning accuracy with low precision formats
- Experience aligning future hardware with HPC infrastructure
- Familiarity with fundamentals of deep learning computing and chip microarchitecture
- Ability to collaborate with ML engineers, kernel writers and compiler developers
- Strong coding skills in C/C++ and Python (preferred)
- PhD in Computer Science and Engineering preferred
- Strong understanding of LLMs and challenges related to their training and inference (preferred)
Benefits For HW/SW Co-Design Engineer
- Medical, dental, and vision insurance for you and your family
- Mental health and wellness support
- 401(k) plan with 50% matching
- Generous time off and 18+ company holidays per year
- Paid parental leave (24 weeks paid birth-parent leave & 20-week paid parental leave)
- Annual learning & development stipend ($1,500 per year)
- Relocation assistance available
Jobs Related To OpenAI HW/SW Co-Design Engineer
