Software Engineer, Pre-Training/AI

Data platform helping data scientists and engineers build data applications across ETL, analytics and ML/AI
Machine Learning
Senior Software Engineer
Hybrid
5+ years of experience
AI · Enterprise SaaS

Description For Software Engineer, Pre-Training/AI

Eventual is revolutionizing the data platform landscape with their innovative solution for data scientists and engineers. Their distributed data engine, Daft, demonstrates impressive scale, running on 800k CPU cores daily - surpassing the world's largest supercomputer. The company is well-funded by notable investors including YCombinator and Caffeinated Capital, with a team comprising experts from Amazon, Databricks, Tesla, and Lyft.

As a Research Engineer focused on AI Pretraining, you'll work at the cutting edge of AI and distributed systems. The role involves implementing advanced dataset and model training techniques, including multimodal learning, synthetic data generation, and reinforcement learning from human feedback (RLHF). You'll collaborate with the Daft data engine team to optimize performance for modern AI workloads.

The position requires expertise in Python and deep learning frameworks, with a strong understanding of transformer architectures and distributed training frameworks. A PhD or equivalent research experience in Machine Learning or Computer Science is preferred. The role offers the opportunity to work with world-class experts in distributed computing and AI research, while building next-generation AI infrastructure.

The company offers a flexible hybrid work environment based in San Francisco, requiring at least 3 days of in-person work. Benefits include competitive compensation, equity, and comprehensive health coverage. The interview process is thorough, including initial calls with co-founders, technical screenings, and team meet-and-greets, ensuring a good mutual fit for this innovative role at the intersection of AI and distributed systems.

Last updated a month ago

Responsibilities For Software Engineer, Pre-Training/AI

  • Build model pretraining pipelines: build training and data pipelines using state-of-the-art data techniques
  • Develop a set of benchmarks: design and define the benchmarks for AI data workloads
  • Data Engineering for AI: Collaborate with data engine team to design and optimize the Daft data engine for AI data workloads on massive 100TB+ datasets
  • AI Research: Stay at the forefront of AI research, incorporating the latest advancements into our data engine and platform capabilities

Requirements For Software Engineer, Pre-Training/AI

Python
  • Strong programming skills in Python, with experience in deep learning frameworks such as PyTorch or TensorFlow
  • Deep understanding of transformer architectures, self-supervised learning, and AI model training techniques
  • Experience with distributed training frameworks (e.g., DeepSpeed, FSDP, Horovod) and efficient model parallelism
  • Expertise in data pipelines and large-scale dataset management
  • PhD or equivalent research experience in Machine Learning, Computer Science, or related fields is preferred

Benefits For Software Engineer, Pre-Training/AI

Medical Insurance
Dental Insurance
Vision Insurance
  • Competitive salary and equity
  • Comprehensive health coverage including medical, dental, vision
  • Meal allowances
  • Flexible hybrid work schedule

Interested in this job?

Jobs Related To Eventual Software Engineer, Pre-Training/AI

Multimodal Generative Modeling Research Engineer - SIML, ISE

Senior ML Engineering role at Apple focusing on multimodal generative AI research and implementation for user-facing features.

Software QA Engineer, Machine Learning (SF)

Senior ML QA Engineer role at Apple, focusing on iOS and macOS creativity applications, requiring 5+ years of QA experience with ML expertise.

Software QA Engineer, Machine Learning (SD)

Senior ML QA Engineer role at Apple, focusing on quality assurance for creativity applications, requiring 5+ years of experience and strong ML expertise.

Senior Engineer-XR/AISW Machine Learning

Senior Machine Learning Engineer role at Qualcomm focusing on developing ML solutions and optimizing neural network inference on Snapdragon platforms.

Research Engineer

Research Engineer position at Google DeepMind working on cutting-edge ML models and AI technologies in Seattle.