High Performance Computing Engineer

Boson AI, an innovative startup in the AI space, is seeking a Senior High Performance Computing Engineer to join their team. Founded by renowned experts Alex Smola and Mu Li, the company is at the forefront of developing cutting-edge generative AI models for language, audio, and entertainment.

The role offers an exceptional opportunity to work with state-of-the-art infrastructure, including NVIDIA H100 and A100 GPUs, managing over 20PB of storage, Terabit networking, and hundreds of computers. You'll be responsible for the critical infrastructure that powers their AI operations in Toronto.

As a High Performance Computing Engineer, you'll be deeply involved in managing and optimizing the company's GPU clusters, implementing and maintaining complex networking solutions, and ensuring the smooth operation of their substantial computing infrastructure. The position requires a blend of hardware expertise and software engineering skills, with a focus on high-performance computing environments.

The ideal candidate will bring strong problem-solving abilities and a passion for learning new technologies. You'll work with cutting-edge tools and technologies, including Slurm, MAAS, Ceph, Infiniband, and NVIDIA deepops. The role offers competitive compensation ranging from $150,000 to $250,000 annually, reflecting the senior nature of the position and its critical importance to the company's infrastructure.

This is an excellent opportunity for a seasoned engineer who wants to be at the forefront of AI infrastructure, working with some of the most advanced computing systems available while contributing to the development of next-generation AI technologies.