Senior Software Engineer, Machine Learning Inference

Founded in 2017, Syntiant is a leader in delivering hardware and software solutions for edge AI deployment, backed by Intel Capital, Microsoft's M12, and others.
$180,000 - $230,000
Machine Learning
Senior Software Engineer
In-Person
5+ years of experience
AI · Enterprise SaaS

Description For Senior Software Engineer, Machine Learning Inference

Syntiant Corp., a pioneering company in the AI software and semiconductor solutions space, is seeking a Senior Software Engineer specialized in Machine Learning Inference. This role presents an exciting opportunity as the company has recently entered into an agreement to acquire a large, multi-national sensor business with global revenues exceeding $250 million annually.

The position involves developing core building blocks that power computer vision, speech, and other application-specific APIs. Syntiant's unique approach to machine learning emphasizes computational and numerical efficiency, achieving significant improvements over current state-of-the-art solutions. The role requires expertise in developing and optimizing high-performance software for various hardware platforms including CPUs, DSPs, NPUs, and GPUs.

As a Senior Software Engineer, you'll be responsible for profiling and optimizing inference code for edge devices, focusing on power efficiency, latency, and throughput. You'll develop sophisticated tools for benchmarking AI models on resource-constrained platforms and implement cutting-edge ML models with a strong emphasis on computational efficiency.

Founded in 2017 and headquartered in Irvine, California, Syntiant has established itself as a leader in edge AI deployment solutions. The company's technology is being deployed globally across various consumer and industrial applications, from earbuds to automobiles. Syntiant's innovative approach combines deep learning with semiconductor design to produce ultra-low-power, high-performance neural network processors.

The ideal candidate will bring strong expertise in C/C++ programming, deep understanding of machine learning frameworks, and extensive experience with performance optimization. You'll work with a talented team, collaborating with hardware architects to co-optimize software and hardware solutions. This role offers competitive compensation, with a base salary range of $180,000 to $230,000, and the opportunity to work on cutting-edge technology that's reshaping the future of edge AI computing.

Last updated 8 days ago

Responsibilities For Senior Software Engineer, Machine Learning Inference

  • Develop, optimize, and maintain high-performance C/C++ software for CPUs, DSPs, NPUs, and GPUs
  • Profile and optimize inference code for power, latency, and throughput on edge devices
  • Develop tools to benchmark and profile AI models on resource-constrained platforms
  • Research and implement state-of-the-art ML models with focus on computational efficiency
  • Debug and analyze performance bottlenecks in large-scale deployable software
  • Collaborate with hardware architects to co-optimize software and hardware solutions

Requirements For Senior Software Engineer, Machine Learning Inference

Python
  • BS in Computer Science/Engineering or related field (MS or PhD preferred)
  • 5+ years of industry experience in software development and optimization
  • Strong C/C++ programming skills with a focus on performance optimization
  • Experience programming numerical algorithms in ML or related fields
  • Strong understanding of linear algebra and numerical optimization
  • Hands-on experience optimizing code for edge devices
  • Deep understanding of low-level computing, memory hierarchies, and parallel processing techniques
  • Experience with assembly-level optimizations, vectorization (SIMD), and low-level debugging
  • Familiarity with profiling tools such as perf, gprof, Valgrind, Intel VTune, NVIDIA Nsight
  • Experience with machine learning inference frameworks
  • Knowledge of AI model compression, quantization, and pruning techniques
  • Knowledge of compiler optimizations and JIT compilation techniques
  • Experience working in large, complex codebases with version control tools like Git

Interested in this job?

Jobs Related To Syntiant Senior Software Engineer, Machine Learning Inference

Senior Research Scientist, Machine Learning

Senior Research Scientist position at Syntiant developing state-of-the-art ML models for audio and vision applications, offering $180-230K salary with 5+ years experience required.

Machine Learning Platform Engineer

Senior ML Platform Engineer role at DoorDash focusing on building and scaling Generative AI infrastructure and ML platforms.

Machine Learning Engineer

Senior Machine Learning Engineer role at DoorDash, focusing on developing ML models to enhance delivery service quality and customer experience.

AI Engineer

Senior AI Engineer position at Capco focusing on GenAI solutions development and deployment for financial services industry

Senior Software Engineer, AI Platform

Senior Software Engineer position at LinkedIn focusing on AI Platform development, offering $128K-$210K salary with hybrid work model.