Senior Systems Engineer – AI/ML Infrastructure

Leading voice AI platform for developers building speech-to-text, text-to-speech and full speech-to-speech offerings with 400+ enterprise customers.
$150,000 - $220,000
Cloud
Senior Software Engineer
Remote
101 - 500 Employees
5+ years of experience
AI · Enterprise SaaS

Description For Senior Systems Engineer – AI/ML Infrastructure

Deepgram, a pioneering voice AI platform, is seeking a Senior Systems Engineer to lead their AI/ML Infrastructure initiatives. With over $85 million in funding from prestigious investors including Y Combinator, Tiger Global, and NVIDIA, Deepgram has established itself as a leader in voice technology, processing over 50,000 years of audio and transcribing over 1 trillion words.

The role combines sophisticated infrastructure engineering with cutting-edge AI technology. As a Senior Systems Engineer, you'll be responsible for designing and maintaining large-scale distributed systems that power Deepgram's AI/ML workloads. This includes building bare-metal GPU compute clusters, implementing robust monitoring solutions, and managing deployments using modern orchestration platforms like Kubernetes and Slurm.

The ideal candidate brings 5+ years of infrastructure engineering experience, with deep expertise in network engineering, storage systems, and container orchestration. You'll be working at the intersection of infrastructure and AI/ML systems, optimizing complex distributed systems for both performance and cost-effectiveness. The role offers the opportunity to work with cutting-edge GPU infrastructure and solve challenging problems in networking and storage at scale.

Deepgram offers a competitive compensation package including a base salary range of $150K-$220K, equity, and an annual bonus of 10%. The company maintains a strong commitment to equality and diversity, welcoming all voices and perspectives. As a remote position, this role provides the flexibility to work from anywhere while contributing to groundbreaking advancements in voice AI technology.

Join a team that has demonstrated impressive growth with 3.3x annual usage increase over the past 4 years and achieve cash-flow positivity. This is an excellent opportunity for someone passionate about infrastructure systems and eager to make a significant impact in the AI industry.

Last updated 5 days ago

Responsibilities For Senior Systems Engineer – AI/ML Infrastructure

  • Build and maintain bare-metal GPU compute clusters for AI training and inference workloads
  • Implement monitoring, alerting, and automation solutions for infrastructure management
  • Manage large-scale deployments using modern orchestration platforms like Kubernetes and Slurm
  • Design and implement reliable, high-performance network architectures for distributed systems
  • Architect and maintain large-scale storage solutions, including backup systems, distributed caching, and object storage

Requirements For Senior Systems Engineer – AI/ML Infrastructure

Kubernetes
Linux
  • 5+ years of experience in infrastructure engineering or similar roles
  • Strong background in network engineering and design for reliability
  • Experience with large-scale storage systems (distributed file systems, caching solutions)
  • Proven track record of managing bare-metal infrastructure
  • Expertise in container orchestration platforms (Kubernetes, Slurm)
  • Experience with GPU infrastructure management and optimization
  • Strong automation and scripting skills

Benefits For Senior Systems Engineer – AI/ML Infrastructure

Equity
  • Equity
  • 10% Annual Bonus

Interested in this job?

Jobs Related To Deepgram Senior Systems Engineer – AI/ML Infrastructure

Infrastructure Engineer

Senior Infrastructure Engineer role at Deepgram, focusing on designing and maintaining large-scale distributed systems infrastructure for AI/ML workloads.

Data Center Civil Engineer, DCDE AMER Civil East

Lead Civil Engineering role at AWS designing and managing Data Center infrastructure with focus on innovation, efficiency, and sustainability.

Lead Mechanical Design Engineer, Data Center Engineering

Lead Mechanical Design Engineer position at AWS, focusing on data center infrastructure design and implementation across APAC region.

Data Center Chief Engineer, DCC Communities

Senior Data Center Chief Engineer role at AWS managing critical infrastructure systems and leading technical teams in maintaining world-class data center operations.

Snr. Technical Account Manager, EMEA-ISV France

Senior Technical Account Manager position at AWS, helping ISV customers optimize their cloud technology usage while providing strategic technical guidance and operational excellence expertise.