Software Engineer, Core Engine

Eventual is building the next generation of distributed data technologies for ML/AI workloads. Our open-source engine Daft runs on 800k CPU cores daily and is used by leading companies like Amazon, TogetherAI, and CloudKitchens.

As a Software Engineer on the Core Engine team, you'll be working on critical components of our distributed data engine including:

• Query Planning/Optimizer: Building intelligent workload optimization using modern database techniques
• Execution Engine: Improving memory stability through streaming computation and efficient data structures
• Distributed Scheduler: Enhancing resource utilization, task scheduling and fault tolerance
• Storage: Developing integrations with modern data lake technologies like Apache Parquet, Iceberg and Delta Lake

We're looking for candidates with:

• Strong systems programming foundation (C++, Rust, C)
• Experience with distributed data systems (Hadoop, Spark, Dask, Ray, etc.)
• Knowledge of query planning, optimizations, scheduling, and fault tolerance
• Familiarity with cloud technologies like AWS S3

Our technology stands out by being:

• Python-native: Built for ML/AI and modern data engineering
• Local Development Focused: Optimized for interactive notebook/script workflows
• Multimodal: Supporting complex data types like text, images, tensors
• GPU-Ready: Designed for ML model inference workloads

We offer:

• Flexible hybrid schedule (3 days in-office in SF)
• Comprehensive benefits including medical, dental, vision
• Meal allowances
• Opportunity to shape core architecture decisions
• Fast-paced, autonomous environment
• Backing from top investors like YC, Caffeinated Capital, Array.vc

Join us in building the future of data infrastructure for ML/AI! We're a small, focused team making a big impact in the data/ML ecosystem.