Systems Research Engineer, Machine Learning Systems

Together AI is a research-driven artificial intelligence company focused on open and transparent AI systems, aiming to lower the cost of modern AI systems through co-designing software, hardware, algorithms, and models.
$160,000 - $230,000
Machine Learning
Senior Software Engineer
Hybrid
11 - 50 Employees
5+ years of experience

Description For Systems Research Engineer, Machine Learning Systems

As a Systems Research Engineer specialized in Machine Learning Systems at Together AI, you will play a crucial role in researching and building the next generation AI platform. You'll work closely with modeling, algorithm, and engineering teams to design large-scale distributed training systems and a low-latency/high-throughput inference engine. Your responsibilities include optimizing existing training and inference platforms, collaborating with cross-functional teams, developing innovative ideas, and staying current with the latest advancements in machine learning systems.

Together AI is committed to open and transparent AI systems, aiming to drive innovation and create the best outcomes for society. The company is on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. They have contributed to leading open-source research, models, and datasets, and have been behind technological advancements such as FlashAttention, Hyena, FlexGen, and RedPajama.

This role offers a competitive compensation package, including a base salary range of $160,000 - $230,000, equity, health insurance, and other benefits. Together AI also provides flexibility in terms of remote work, although they require working three days per week in their San Francisco office.

Join a passionate group of researchers in building the next generation AI infrastructure and be part of a company that values equal opportunity and diversity in its workforce.

Last updated 8 months ago

Responsibilities For Systems Research Engineer, Machine Learning Systems

  • Optimize and fine-tune existing training and inference platform to achieve better performance and scalability
  • Collaborate with cross-functional teams to integrate cutting edge research ideas into existing software systems
  • Develop your own ideas of optimizing the training and inference platforms and push the frontier of machine learning systems research
  • Stay up-to-date with the latest advancements in machine learning systems techniques and apply many of them to the Together platform

Requirements For Systems Research Engineer, Machine Learning Systems

Python
  • Strong background in machine learning systems, such as distributed learning and efficient inference for large language models and diffusion models
  • Knowledge of ML/AI applications and models, especially foundation models such as large language models and diffusion models
  • Knowledge of system performance profiling and optimization tools for ML systems
  • Excellent problem-solving and analytical skills
  • Bachelor's, Master's, or Ph.D. degree in Computer Science, Electrical Engineering, or equivalent practical experience

Benefits For Systems Research Engineer, Machine Learning Systems

Medical Insurance
Equity
  • Competitive compensation
  • Startup equity
  • Health insurance
  • Other benefits
  • Flexibility in terms of remote work

Interested in this job?

Jobs Related To Together AI Systems Research Engineer, Machine Learning Systems

Multiple ML and Engineering Roles

Multiple engineering and research positions at Together AI, focusing on machine learning, AI infrastructure, and systems development.

Sr. ASIC Design Engineer, Cloud-Scale Machine Learning Acceleration team

Senior ASIC Design Engineer role at AWS, focusing on machine learning hardware acceleration, offering competitive pay and comprehensive benefits.

Deep Learning Compiler Engineer

Senior Deep Learning Compiler Engineer position at Apple, focusing on Neural Engine Accelerator optimization and AI hardware development.

Sr. Software Engineer, Machine Learning Infrastructure and Quality

Senior Software Engineer role at Apple focusing on machine learning infrastructure and quality, offering competitive salary and benefits in Seattle.

Software QA Engineer, Machine Learning (SD)

Senior ML QA Engineer role at Apple, focusing on iOS and macOS creativity applications, requiring 5+ years of experience in ML quality assurance.