The Special Projects team at Apple is seeking a skilled Data Scientist to develop user-facing conversational features using state-of-the-art foundation models. This role involves managing and analyzing human and automated data annotation processes while collaborating closely with ML Engineers. The focus is on developing, testing, and refining Large Language Model judges for generative AI model evaluation. A successful candidate will contribute to innovative projects that leverage multimodal capabilities and enhance the evaluation of AI models.

• BA or Master's degree in Data Science, Statistics, or a quantitative social science field
• 2+ years of hands-on experience working in survey design and human data annotation
• Proficiency in Python
• Excellent communication skills
• PhD in Data Science, Statistics, or a quantitative social science field
• Hands-on industry experience with product-focused statistical analysis
• Experience working with large-scale multimodal data and data-annotation pipelines
• Experience with LLM prompt engineering and prompt optimization
• Experience with LLM auto-judges for generative AI model evaluation
• A track record of publications or technical presentations in Data Science or a related field
• Excellent at cross-functional collaboration

• Manage and analyze human and automated data annotation processes.
• Develop, test, and refine Large Language Model judges for generative AI model evaluation.
• Collaborate closely with ML Engineers to enhance data annotation workflows.
• Generate real-world and simulated data for model evaluation.
• Analyze results to improve the performance of AI models.

• Employees at Apple are often offered comprehensive benefits that support physical and mental well-being—flexible medical plans, confidential counseling, onsite wellness centers at major campuses, and resources for fitness and daily life. Families typically receive fertility support, paid parental leave with gradual return, caregiving leave, and dependent-care guidance, while financial perks commonly include stock grants (with purchase discounts), 401(k) matching, and income-protection coverage. Employees also see robust time off, Apple University learning and tuition reimbursement, donation matching and paid volunteer hours, and deep product and partner discounts.