Software Engineer, AI Infrastructure
Description For Software Engineer, AI Infrastructure
Harvey is a secure AI platform revolutionizing the legal, tax, and finance industries by augmenting productivity and automating complex workflows. As a Software Engineer on the AI Infrastructure team, you'll be at the forefront of building and maintaining the infrastructure that drives our research and AI engineering efforts.
This role offers an exciting opportunity to work with cutting-edge AI technologies and tackle unique infrastructure challenges in LLM- and AI-native products. You'll be responsible for developing systems for massively parallelized LLM inference, distributed data processing, and large-scale search and retrieval, all while ensuring robust security measures.
Harvey has achieved exceptional product-market fit, partnering with industry giants like A&O and PwC. With over $100 million raised from strategic investors including Sequoia, Kleiner Perkins, and the OpenAI Startup Fund, we're poised for rapid growth. Our world-class team, drawn from leading tech companies, works directly with OpenAI to shape the future of generative AI.
Join us in San Francisco to be part of a high-impact team that's redefining professional services. We offer competitive compensation, including a salary range of $190,000 to $265,000, along with equity and comprehensive benefits. If you're passionate about AI infrastructure and ready to make a significant impact, Harvey is the place for you.
Responsibilities For Software Engineer, AI Infrastructure
- Build scaffolding for massively parallelized LLM inference, model serving at scale, and load-testing of many-step language model programs
- Find, ingest, index, and maintain large public and private datasets comprising millions of complex documents
- Optimize search and retrieval protocols over large, heterogeneous databases and vectorstores
- Ensure our data pipelines adhere to strict security constraints and are robust to large volumes of traffic
Requirements For Software Engineer, AI Infrastructure
- 5+ years of experience (post-BS/MS) in an infrastructure engineering role
- Excited to tackle the unique infra challenges of LLM- and AI-native products
- Communicate both low-level technical details and high-level strategic plans effectively
- Always thinking about the next order of magnitude
- Maintain a high personal velocity
Benefits For Software Engineer, AI Infrastructure
- Comprehensive health, dental and vision coverage
- Retirement benefits (401k match up to 4%)
- Flexible PTO
