Software Engineer, Networking

The Platform Networking team at OpenAI is responsible for the collective communication stack used in our largest training jobs. Using C++ and CUDA, we work on novel collective communication techniques that enable efficient training of our flagship models on our largest custom-built supercomputers.

As a Software Engineer, Networking, you will design and implement custom networking collectives that are tightly integrated into our training stack. We're looking for people with a background in low-level performance-critical software. Experience with collective communication is a bonus.

In this role, you will:

• Collaborate closely with ML researchers to design and implement efficient collective operations in C++ and CUDA.
• Ensure that our largest training jobs take full advantage of the different network transports used in our supercomputers.
• Work on simulations to inform our future supercomputer network designs.

You might thrive in this role if you:

• Have written distributed algorithms using RDMA in the past.
• Are comfortable writing low-level performance-sensitive CPU and/or GPU code.
• Are familiar with network simulation techniques.

This role is based in San Francisco, CA, with a hybrid work model of 3 days in the office per week. Relocation assistance is offered to new employees.

OpenAI pushes the boundaries of AI capabilities and seeks to safely deploy them to the world through our products. We value diversity and are committed to creating an inclusive environment for all employees.