AIML - Annotation Engineer, Red Teaming & Safety Evaluation

Apple is seeking an AIML - Annotation Engineer for Red Teaming & Safety Evaluation to join their Machine Learning and AI team in Pittsburgh, Pennsylvania. This role is crucial in assessing, quantifying, and improving the safety and inclusivity of Apple's generative AI-powered features and products.

Key responsibilities include:

• Developing red teaming and grading project strategies, interfaces, and guidelines
• Coordinating with data scientists and product engineering teams
• Managing and prioritizing projects aligned with organizational goals
• Serving as an interface between red teamers and other teams
• Monitoring and managing performance metrics of red teamers
• Distilling findings into recommendations for product engineering and safety policy development
• Enhancing red teaming and grading methodologies

The ideal candidate should have:

• Experience in linguistic and computer vision annotation tasks
• Scripting skills and spreadsheet proficiency
• Project management expertise
• Ability to work with sensitive and potentially offensive content
• Strong understanding of English language and its applications to Natural Language Processing
• Experience with generative models (LLMs, diffusion models)
• Curiosity about fairness and bias in generative AI systems

This role offers the opportunity to work on cutting-edge generative AI projects that will impact Apple's products and the broader world. The team focuses on large generative models for vision and language, with a particular interest in safety, robustness, and uncertainty in models.

Join Apple in shaping the future of AI technology while ensuring its responsible and inclusive development.