Senior AI/ML Engineer

The AI co-pilot for sales reps at industrial wholesale distributors.
$150,000 - $200,000
Machine Learning
Senior Software Engineer
Hybrid
11 - 50 Employees
6+ years of experience
AI · Enterprise SaaS

Description For Senior AI/ML Engineer

Distro, a Y Combinator-backed startup, is revolutionizing industrial wholesale distribution with AI-powered solutions. As the AI co-pilot for inside sales and counter reps, we're building workflow software that combines verticalized LLMs, search, and quoting logic to enhance efficiency and profitability.

We're seeking a Senior AI/ML Engineer to take complete ownership of our AI infrastructure. This role involves working directly with the CEO to design, build, and deploy core features powered by foundation models. Our product heavily relies on language models for document retrieval, product spec extraction, quote generation, and semantic search.

The position offers a competitive compensation package of $150K–$200K plus 0.50%–0.75% equity. Based in Palo Alto, this hybrid role requires in-person presence Monday, Tuesday, Thursday, and Friday, with Wednesdays remote. You'll be joining at a crucial post-Seed stage, with established customers, revenue, and significant market opportunity.

What makes Distro unique is our focus on real AI applications solving high-stakes problems, our commitment to shipping and improving based on user feedback, and our in-person collaborative environment. We're targeting a massive $7T global ecosystem that's historically been underserved by modern software.

The ideal candidate brings strong engineering fundamentals, hands-on LLM experience, and a builder's mindset. You'll work with cutting-edge technologies including foundation models, vector databases, and modern AI frameworks, while collaborating with a talented team in a fast-paced, design-forward environment.

Last updated 6 hours ago

Responsibilities For Senior AI/ML Engineer

  • Build and ship AI-powered features using foundation models (OpenAI, Anthropic, etc.)
  • Own the AI stack — from prompt engineering to vector search to model serving
  • Implement RAG pipelines, chat agent workflows, and quoting / document workflows
  • Optimize for performance and latency in customer-facing UX
  • Work closely with the CEO to transition ownership
  • Evaluate, test, and iterate on LLMs, prompts, and product experiences
  • Set technical direction for AI infrastructure scaling

Requirements For Senior AI/ML Engineer

Python
TypeScript
  • Strong engineering fundamentals and hands-on experience building with LLMs
  • Experience with foundation models, prompt design, embeddings, and vector DBs
  • Experience shipping AI features to real users
  • Comfort owning the stack end-to-end, including deployment and monitoring
  • Must be in-person 4 days per week in Palo Alto
  • Experience with Agentic chat + retrieval frameworks
  • Experience with Vector databases
  • Model deployment + fine-tuning experience
  • Expertise in production quality Python and/or TypeScript

Benefits For Senior AI/ML Engineer

Equity
  • Equity

Interested in this job?

Jobs Related To Distro Senior AI/ML Engineer

Software Engineer III - ML, Python

Senior Software Engineer role at JPMorgan Chase focusing on ML fraud prevention platform development, offering competitive salary and comprehensive benefits.

AI/ML Engineer III

Senior AI/ML Engineer role at JPMorgan Chase focusing on AWS Cloud, ML platforms, and Gen AI solutions, offering competitive compensation and comprehensive benefits.

Software Development Engineer, Amazon Robotics (AR) Sortation Planning

Senior Software Engineer role at Amazon Robotics focusing on machine learning for robotic workcell optimization and sortation planning.

Sr Software Engineer

Senior Software Engineer position at Amazon RBKS, focusing on AI and computer vision development for smart home applications in Sunnyvale, CA.

Senior Product Manager, Feed Relevance

Senior Product Manager position at LinkedIn focusing on Feed Relevance and AI/ML implementation to enhance user experience and content delivery.