The Applied AI Scientist will be part of the Evaluation organization at Apple, focusing on developing advanced AI/ML models for automatic grading and quality assessment of GenAI products. This role involves designing state-of-the-art autograder systems that evaluate AI product quality at scale. The team leverages AI/ML techniques to enhance the evaluation process across various Apple features. Collaboration with product teams and data scientists is essential to ensure the success of next-generation AI-powered features.

• Extensive experience with prompting techniques.
• Deep understanding of GenAI models and at least 1 year of industry experience in building or evaluating GenAI models.
• Familiarity with LLMOps processes for deploying, monitoring, and improving AI models in production environments.
• Excellent analytical skills and judgment for assessing data quality and diagnosing autograder limitations.
• MS/PhD degree in Computer Science, Machine Learning, AI, or related fields.
• Ownership mindset with flexibility to take on various tasks as necessary.

• Design and advance state-of-the-art autograder systems for evaluating AI product quality.
• Apply deep expertise in prompt engineering and evaluation methodology to build robust autograders.
• Collaborate with product, annotation, and evaluation data scientists to deploy autograders.
• Assess product performance, user experience, and adherence to quality and safety standards.
• Contribute to the development of human-in-the-loop evaluation workflows.

• Employees at Apple are often offered comprehensive benefits that support physical and mental well-being—flexible medical plans, confidential counseling, onsite wellness centers at major campuses, and resources for fitness and daily life. Families typically receive fertility support, paid parental leave with gradual return, caregiving leave, and dependent-care guidance, while financial perks commonly include stock grants (with purchase discounts), 401(k) matching, and income-protection coverage. Employees also see robust time off, Apple University learning and tuition reimbursement, donation matching and paid volunteer hours, and deep product and partner discounts.