The Measurement Scientist role at Apple Services Engineering focuses on establishing scientifically valid and trustworthy evaluation methods for AI systems. This position bridges measurement science and AI evaluation, requiring collaboration with ML researchers and engineers. The successful candidate will apply psychometric theory and statistical rigor to develop methods for validating AI evaluators and creating statistical tools. This role offers the opportunity to publish work in top measurement and ML venues while contributing to the evaluation SDK used across Apple.

• PhD in Psychometrics, Educational Measurement, Quantitative Psychology, Statistics, or equivalent research/work experience.
• Deep expertise in modeling test data using IRT or related methods.
• Strong statistical foundation including experimental design, power analysis, sampling theory, and uncertainty quantification.
• Track record of designing and validating measurement instruments as demonstrated through publications or applied work.
• Proficiency in Python or R for statistical analysis, psychometric modeling, and method implementation.
• Strong working knowledge of generative AI technology.
• Excellent communication skills to explain complex measurement concepts to engineers, ML researchers, and non-technical stakeholders.
• Experience applying measurement science to AI/ML evaluation, automated scoring systems, or computational assessment.
• Knowledge of modern ML evaluation challenges including LLM-as-judge, automated metrics, benchmark design, and agentic systems.
• Publications at measurement venues or top ML conferences such as NeurIPS, ICML, or ICLR.
• Expertise in computational social or behavioral science using generative AI.
• Experience collaborating with engineers to turn research methods into production tools and scalable infrastructure.

• Develop methods for validating LLM-as-judge evaluators, automated benchmarks, and human evaluations.
• Create statistical tools that help engineers trust their evaluation results.
• Work on an interdisciplinary team with ML researchers to solve new problems in AI evaluation.
• Translate measurement science into practical tools that scale across the organization.
• Publish work at top measurement and ML venues.
• Productionize evaluation methods into the evaluation SDK used across Apple.

• Employees at Apple are often offered comprehensive benefits that support physical and mental well-being—flexible medical plans, confidential counseling, onsite wellness centers at major campuses, and resources for fitness and daily life. Families typically receive fertility support, paid parental leave with gradual return, caregiving leave, and dependent-care guidance, while financial perks commonly include stock grants (with purchase discounts), 401(k) matching, and income-protection coverage. Employees also see robust time off, Apple University learning and tuition reimbursement, donation matching and paid volunteer hours, and deep product and partner discounts.