Senior Software Engineer, TensorRT-LLM

NVIDIA is the world leader in accelerated computing, pioneering solutions in AI and digital twins.
$180,000 - $339,250
Machine Learning
Senior Software Engineer
Hybrid
2+ years of experience
AI

Description For Senior Software Engineer, TensorRT-LLM

NVIDIA, the world leader in accelerated computing, is seeking a Senior Software Engineer for their TensorRT-LLM team. This role is at the forefront of the AI revolution, working on inferencing software that's fundamental to NVIDIA's product lines and the broader industry. The position involves developing scalable inferencing solutions, performance optimization, and staying current with AI advancements.

The ideal candidate will join a fast-paced, delivery-focused team working on GPU-accelerated deep learning platforms used worldwide. You'll be instrumental in pushing the boundaries of state-of-the-art AI and Compute systems, while getting exposure to the entire deep learning software stack. The role offers an opportunity to work with cutting-edge technology in areas like LLM, ChatGPT, and Generative AI.

NVIDIA is renowned as one of technology's most desirable employers, offering competitive compensation including a base salary range of $180,000 - $339,250 USD, plus equity. The company values diversity and maintains an inclusive work environment, making it an excellent choice for professionals looking to make a significant impact in the AI industry. The hybrid work arrangement provides flexibility while maintaining collaborative opportunities with some of the most forward-thinking professionals in the technology sector.

Last updated 4 days ago

Responsibilities For Senior Software Engineer, TensorRT-LLM

  • Craft and develop robust inferencing software that can be scaled to multiple platforms for functionality and performance
  • Performance analysis, optimization and tuning
  • Closely follow academic developments in the field of artificial intelligence and feature update TensorRT
  • Collaborate across the company to guide the direction of machine learning inferencing, working with software, research and product teams

Requirements For Senior Software Engineer, TensorRT-LLM

Python
  • Masters or higher degree in Computer Engineering, Computer Science, Applied Mathematics or related computing focused degree (or equivalent experience)
  • 2+ years of relevant software development experience
  • Excellent C/C++ programming and software design skills, including debugging, performance analysis, and test design
  • Strong curiosity about artificial intelligence, awareness of the latest developments in deep learning like LLMs, generative and recommender models
  • Experience working with deep learning frameworks like TensorFlow and PyTorch
  • Proactive and able to work without supervision
  • Excellent written and oral communication skills in English

Benefits For Senior Software Engineer, TensorRT-LLM

Equity
  • Equity

Interested in this job?

Jobs Related To NVIDIA Senior Software Engineer, TensorRT-LLM

Senior System Software Engineer, Deep Learning Accelerator

Senior System Software Engineer role at NVIDIA focusing on Deep Learning Accelerator development, requiring 7+ years of experience in low-level software development and system architecture.

Deep Learning Engineer, End-to-end - Autonomous Driving

Senior Deep Learning Engineer position at NVIDIA focusing on end-to-end autonomous driving solutions, combining AI expertise with automotive technology.

Senior Software Test Development Engineer - Deep Learning

Senior Software Test Development Engineer position at NVIDIA focusing on Deep Learning software quality assurance and test automation, offering competitive salary and equity.

Senior Software Test Development Engineer - Deep Learning

Senior Software Test Development Engineer position at NVIDIA focusing on Deep Learning software quality assurance and test automation.

Senior Software Engineer, Machine Learning VLSI Designs

Senior Software Engineer position at NVIDIA focusing on applying machine learning techniques to VLSI design methodology, offering competitive salary and benefits.