Senior Software Engineer, TensorRT-LLM

NVIDIA is the world leader in accelerated computing, pioneering AI and digital twins technology.
$184,000 - $356,500
Machine Learning
Senior Software Engineer
Hybrid
5,000+ Employees
2+ years of experience
AI

Description For Senior Software Engineer, TensorRT-LLM

NVIDIA is seeking a Senior Software Engineer for their TensorRT-LLM team, focusing on developing cutting-edge inferencing software for AI and deep learning applications. This role sits at the intersection of AI innovation and high-performance computing, where you'll be working on technology that powers breakthroughs in LLM, ChatGPT, and Generative AI.

The position offers an opportunity to work with NVIDIA, a global leader in accelerated computing and AI technology. You'll be part of a fast-paced, delivery-focused team developing software that's foundational to both NVIDIA's product lines and the broader industry. The role involves crafting scalable inferencing software, conducting performance optimization, and staying current with the latest developments in artificial intelligence.

As a Senior Software Engineer, you'll collaborate with software, research, and product teams across NVIDIA, helping shape the direction of machine learning inferencing. The position requires strong technical expertise in C/C++ programming, deep learning frameworks like TensorFlow and PyTorch, and a solid understanding of AI/ML concepts.

The compensation package is highly competitive, with a base salary range of $184,000 to $356,500 USD, plus equity and benefits. NVIDIA offers a collaborative work environment, exposure to state-of-the-art technology, and the chance to contribute to groundbreaking AI advancements. The company values diversity and maintains an inclusive workplace culture, making it an ideal setting for professionals looking to make a significant impact in the AI field.

Last updated 19 hours ago

Responsibilities For Senior Software Engineer, TensorRT-LLM

  • Craft and develop robust inferencing software that can be scaled to multiple platforms for functionality and performance
  • Performance analysis, optimization and tuning
  • Closely follow academic developments in the field of artificial intelligence and feature update TensorRT
  • Collaborate across the company to guide the direction of machine learning inferencing, working with software, research and product teams

Requirements For Senior Software Engineer, TensorRT-LLM

Python
  • Masters or higher degree in Computer Engineering, Computer Science, Applied Mathematics or related computing focused degree (or equivalent experience)
  • 2+ years of relevant software development experience
  • Excellent C/C++ programming and software design skills, including debugging, performance analysis, and test design
  • Strong curiosity about artificial intelligence, awareness of the latest developments in deep learning like LLMs, generative and recommender models
  • Experience working with deep learning frameworks like TensorFlow and PyTorch
  • Proactive and able to work without supervision
  • Excellent written and oral communication skills in English

Benefits For Senior Software Engineer, TensorRT-LLM

Equity
  • Equity

Interested in this job?

Jobs Related To NVIDIA Senior Software Engineer, TensorRT-LLM

Senior Deep Learning Performance Architect

Senior Deep Learning Performance Architect role at NVIDIA focusing on developing processor and system architectures for machine learning acceleration.

Deep Learning Performance Architect

Senior Deep Learning Performance Architect position at NVIDIA, focusing on optimizing deep learning inference performance and developing GPU-accelerated solutions.

Senior Software Engineer - Conversational AI

Senior Software Engineer position at NVIDIA focusing on building next-generation Multimodal Conversational AI systems and Digital Human solutions using advanced Speech and LLM models.

Senior System Software Engineer - MLOps

Senior System Software Engineer position at NVIDIA focusing on MLOps and Triton Inference Server development, offering competitive compensation and opportunity to work with cutting-edge AI technology.

Senior Applied LLM Engineer, AI – Chip Design

Senior Applied LLM Engineer position at NVIDIA focusing on AI and chip design, developing and optimizing retrieval and generation algorithms for enterprise data.