Sr. Staff Software Engineer, AI Infra

LinkedIn is the world's largest professional network, built to help members achieve more in their careers.
$180,000 - $300,000
Machine Learning
Staff Software Engineer
Hybrid
5,000+ Employees
5+ years of experience
AI · Enterprise SaaS

Description For Sr. Staff Software Engineer, AI Infra

LinkedIn is seeking a Sr. Staff Software Engineer to join their AI Infrastructure team. This role focuses on scaling LinkedIn's AI model training, feature engineering, and serving capabilities for handling models with hundreds of billions of parameters. The position involves working with cutting-edge technologies including LLMs, GNNs, and various deep learning frameworks. The team is responsible for optimizing performance across algorithms, AI frameworks, data infrastructure, and hardware to maximize the efficiency of LinkedIn's GPU fleet.

The role combines technical leadership with hands-on engineering, requiring expertise in distributed systems, deep learning infrastructure, and large-scale serving systems. You'll work on challenges involving massive scale (billions of parameters, terabytes of data), while enabling rapid experimentation and model deployment across the organization.

As a technical leader, you'll help shape LinkedIn's AI infrastructure strategy, mentor other engineers, and collaborate with the open-source community on projects like PyTorch, DeepSpeed, and Huggingface. The position offers competitive compensation, comprehensive benefits, and the opportunity to work in a hybrid environment that balances remote work with in-office collaboration.

The ideal candidate combines deep technical expertise in ML systems with proven leadership experience, capable of driving technical direction while maintaining hands-on involvement in complex engineering challenges. This role presents an exceptional opportunity to impact the future of AI infrastructure at scale while working with cutting-edge technologies and talented teams.

Last updated 7 hours ago

Responsibilities For Sr. Staff Software Engineer, AI Infra

  • Own technical strategy for broad or complex requirements
  • Design and implement high-performance distributed serving and training systems
  • Improve system observability and developer productivity
  • Mentor other engineers and define technical culture
  • Work with open-source community and influence projects
  • Function as tech-lead for key AI Infrastructure initiatives

Requirements For Sr. Staff Software Engineer, AI Infra

Python
Java
Go
Rust
Scala
Kubernetes
  • BS/BA in Computer Science or related technical field
  • 5+ years of industry experience in software design and development
  • 5+ years of experience in object-oriented programming
  • 2+ years of experience as an architect or technical leader
  • 5+ years of experience building deep learning systems
  • Hands-on experience with distributed systems
  • Experience with ML infrastructure and deep learning frameworks

Benefits For Sr. Staff Software Engineer, AI Infra

Medical Insurance
Dental Insurance
Vision Insurance
401k
Parental Leave
  • Annual performance bonus
  • Stock options
  • Comprehensive benefits package
  • Flexible work arrangements

Interested in this job?

Jobs Related To LinkedIn Sr. Staff Software Engineer, AI Infra

AI Engineering Manager - Foundational AI Data

Lead a team building foundational AI data platform at LinkedIn, managing data infrastructure and machine learning engineering initiatives.

AI Engineering Manager - Foundational AI Data

AI Engineering Manager position at LinkedIn leading a team building foundational AI data platform for next-generation machine learning capabilities.

AI Engineering Manager, Enterprise AI

AI Engineering Manager position at LinkedIn leading Enterprise AI team, focusing on GenAI, search, and recommendation systems, offering $200K-$268K plus benefits.

AI Engineering Manager - Foundational AI Data

Lead a team of data and ML engineers building LinkedIn's foundational AI data platform for next-generation machine learning capabilities.

Staff AI Scientist

Staff AI Scientist position at LinkedIn focusing on large-scale foundation models and AI innovations.