AI/ML Engineer - Large Language Models

Anyscale, backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised, is seeking exceptional AI/ML Engineers to join their hybrid research and product development team. In this role, you will collaborate with cross-functional teams to expand the usability of open source LLMs within Anyscale's ecosystem for enterprise applications. You'll experiment with models, build features for fine-tuning and inference, and work directly with customers to push the boundaries of their LLM use cases on Anyscale's AI platform.

Key responsibilities include:

• Designing, developing, and deploying cutting-edge AI/ML solutions for enterprise applications
• Contributing to features for fine-tuning and inference of LLMs
• Collaborating with customers to understand their needs and help them grow their use cases
• Conducting experiments to push the practical boundaries of open source LLMs
• Improving the performance, scalability, and usability of the AI platform
• Creating technical documentation and case studies

Qualifications:

• Master's degree with 3+ years of experience, or Ph.D. in a relevant field
• Strong technical skills in LLM architecture, training, and inference
• Hands-on experience with LLM training, fine-tuning, or inference optimization
• Experience with observability, monitoring, and debugging LLM systems
• Excellent technical writing skills
• Proactive, self-driven, and adaptable to a startup environment

Anyscale offers competitive compensation, including a salary range of $170,112 ~ $237,000, stock options, comprehensive healthcare plans, 401k, wellness and education stipends, paid parental leave, flexible time off, and more. The company is based in San Francisco, CA, with employees required to come to the office 3 times a week.

Join Anyscale and be part of a team that's making distributed computing and AI accessible to developers worldwide!