The role focuses on developing novel measurements for the quality of machine-generated dialog. The team is tasked with tracking dataset composition, accuracy of llm-judges, and human expert review results. The position requires collaboration across functions to integrate reporting systems and pipelines. The ideal candidate will have a strong background in data science and engineering, as well as experience in machine learning concepts.

• M.S. or Ph.D. in Computer Science, Data Science, or Data Engineering
• 3+ years of experience in data science and/or data engineering
• 2+ years of experience in Python coding
• Good understanding of metrics, crowd science, and statistics
• Excellent communication skills

• Track the state of dataset composition and accuracy of llm-judges
• Integrate reporting systems and pipelines across partner teams
• Create sustainable and easy-to-use metric reporting pipelines
• Write and architect production-level code
• Measure progress on quality metrics for machine-generated dialog

• Employees at Apple are often offered comprehensive benefits that support physical and mental well-being—flexible medical plans, confidential counseling, onsite wellness centers at major campuses, and resources for fitness and daily life. Families typically receive fertility support, paid parental leave with gradual return, caregiving leave, and dependent-care guidance, while financial perks commonly include stock grants (with purchase discounts), 401(k) matching, and income-protection coverage. Employees also see robust time off, Apple University learning and tuition reimbursement, donation matching and paid volunteer hours, and deep product and partner discounts.