Senior Prompt Engineer

Assured is on a mission to modernize insurance, focusing on claims processing. As a Senior Prompt Engineer at Assured, you will be responsible for designing, testing, and iterating on prompt structures to ensure optimal outputs from large language models (LLMs). You'll work closely with engineers and product managers to tailor AI responses, refine AI behaviors, and contribute to innovative customer solutions.

Key responsibilities include:

• Designing and implementing LLM applications for data quality evaluation and complex synthetic data challenges
• Conducting jailbreaks and finding vulnerabilities in LLMs and other generative AI models
• Designing and refining natural language prompts for AI models
• Analyzing language model behavior and providing insights into model performance
• Collaborating with ML engineers, software engineers, and product managers
• Developing documentation, style guides, and prompt templates
• Creating data creation and vulnerability testing scripts
• Leading experimentation and internal R&D efforts

Requirements:

• B.S. or higher in a quantitative field or one related to language models
• Proficiency in Python or TypeScript
• Experience with frontier-scale LLMs (e.g., GPT, Claude, PaLM)
• Familiarity with model evaluation metrics (BLUE, ROUGE, MAUVE)
• Experience building LLM-based applications
• Strong understanding of NLP and language model behavior
• Exceptional communication skills
• Creative mindset and strong problem-solving skills

Assured offers competitive compensation, comprehensive health care, dental and vision insurance, uncapped vacation days, family leave, 401(k) contribution, and more. They are committed to equal opportunity employment and providing accommodations for individuals with disabilities.