Sr. Staff Software Engineer, AI Infra

LinkedIn is the world's largest professional network, built to help members achieve more in their careers and create economic opportunity.
$180,000 - $300,000
Machine Learning
Staff Software Engineer
Hybrid
5,000+ Employees
5+ years of experience
AI · Enterprise SaaS

Description For Sr. Staff Software Engineer, AI Infra

LinkedIn, the world's largest professional network, is seeking a Sr. Staff Software Engineer to join their AI Infrastructure team. This role presents an exciting opportunity to work on cutting-edge AI technologies and shape the future of professional networking at scale.

The position focuses on building and optimizing LinkedIn's AI model training, feature engineering, and serving infrastructure. You'll be working with models containing hundreds of billions of parameters, spanning recommendation systems, large language models, and computer vision applications. The team leverages a substantial GPU fleet with thousands of latest-generation cards to power these AI capabilities.

As a Sr. Staff Software Engineer, you'll tackle challenges in both model training and serving infrastructure. On the training side, you'll design high-performance data I/O systems, collaborate with open-source communities (Huggingface, Horovod, PyTorch), enable distributed training for massive models, and build containerized pipeline orchestration infrastructure. For serving, you'll develop low-latency applications handling complex models, implement GPU-based inference, and optimize performance at scale.

The role offers a unique blend of technical challenges, including:

  • Scaling AI systems handling billions of parameters and user queries
  • Optimizing performance across algorithms, frameworks, and hardware
  • Working with cutting-edge technologies like LLMs, GNNs, and incremental learning
  • Building robust infrastructure supporting hundreds of new ML models quarterly
  • Collaborating with research teams to implement state-of-the-art AI techniques

LinkedIn offers a hybrid work environment, competitive compensation ($180,000-$300,000), comprehensive benefits, and the opportunity to impact how professionals worldwide connect and grow. You'll work with talented teams of researchers and engineers while building your career and personal brand in the AI industry.

The ideal candidate brings strong software engineering fundamentals, distributed systems experience, and deep knowledge of machine learning infrastructure. This role provides the opportunity to shape the technical direction of AI at LinkedIn while solving complex challenges at massive scale.

Last updated 13 minutes ago

Responsibilities For Sr. Staff Software Engineer, AI Infra

  • Own technical strategy for broad/complex requirements across teams
  • Design and implement large-scale distributed serving/training for recommendation and language models
  • Improve system observability and developer productivity
  • Mentor other engineers and define technical culture
  • Work with open-source community on projects
  • Lead multiple key AI Infrastructure initiatives

Requirements For Sr. Staff Software Engineer, AI Infra

Python
Java
Go
Rust
Scala
Kubernetes
  • BS/BA in Computer Science or related field or equivalent experience
  • 5+ years of industry experience in software design and development
  • 5+ years programming experience in Python, C++, Java, Go, Rust, or Scala
  • 2+ years of technical leadership experience
  • 5+ years experience building deep learning systems
  • Experience with distributed systems
  • Knowledge of machine learning infrastructure and frameworks
  • Experience with deep learning frameworks like PyTorch, TensorFlow

Benefits For Sr. Staff Software Engineer, AI Infra

Medical Insurance
Vision Insurance
Dental Insurance
401k
Parental Leave
  • Medical insurance
  • Vision insurance
  • Dental insurance
  • 401(k)
  • Paid maternity leave
  • Paid paternity leave
  • Performance bonus
  • Stock options

Interested in this job?

Jobs Related To LinkedIn Sr. Staff Software Engineer, AI Infra

AI Engineering Manager - Enterprise AI

AI Engineering Manager position at LinkedIn leading Enterprise AI initiatives in Sunnyvale, focusing on machine learning and AI development.

Senior Staff AI Engineer - Marketing Solutions Agentic Team

Senior Staff AI Engineer position at LinkedIn's Marketing Solutions team, focusing on AI agent development and technical leadership with competitive compensation of $285K-$315K.

AI Engineering Manager, Enterprise AI

Lead LinkedIn's Enterprise AI team developing GenAI powered recruiting tools and learning systems, managing 6-10 engineers with $7B+ business impact.

Staff AI Scientist

Staff AI Scientist position at LinkedIn focusing on large-scale foundation models and AI innovations, offering competitive compensation and hybrid work environment.

Sr. Staff Software Engineer, AI Infra

Senior Staff Software Engineer position at LinkedIn focusing on AI infrastructure, distributed systems, and large-scale machine learning, offering competitive compensation and hybrid work arrangement.