The Machine Learning Evaluation Engineer will be part of the Data, Analytics and Quality (DAQ) team, focusing on evaluating and enhancing advanced sensing technologies. This role involves collaborating with various teams to develop high-quality algorithms that improve Apple's products. The engineer will design and deploy evaluation strategies for multi-modal foundation models and CV/ML algorithms, emphasizing rigorous assessment and actionable improvements. The position requires a blend of technical expertise, creativity, and systems thinking to ensure models meet high-quality standards.

• Bachelor's degree and a minimum of 3 years relevant industry experience.
• 3+ years of applied experience in Machine Learning, Computer Vision, or AI System Evaluation.
• Deep understanding of core Machine Learning principles, including probability, statistics, data distributions, and model bias/variance.
• Experience analyzing data quality, diversity, representativeness, and coverage gaps in large datasets.
• Applied experience employing and evaluating generative models, including knowledge of prompt tuning and human-in-the-loop methodologies.
• Proven track record of defining robust metrics/KPIs and designing rigorous evaluation frameworks for foundation models.
• Strong proficiency in Python and building automated pipelines.
• Experience using AI-powered development and analysis tools.
• Theoretical and practical understanding of Computer Vision and Vision-Language Models.
• Excellent written and verbal communication skills.

• Design and build comprehensive evaluation pipelines that scale across large datasets.
• Develop and calibrate subjective evaluations for generative models.
• Identify trends in large datasets and conduct deep failure analysis.
• Design and develop cloud-based workflows and dashboards for failure analysis.
• Refine strategies for curating high-quality datasets and ground truth.
• Assess quality, diversity, representativeness, and coverage gaps in datasets.
• Collaborate closely with core model training teams to provide actionable insights.

• Employees at Apple are often offered comprehensive benefits that support physical and mental well-being—flexible medical plans, confidential counseling, onsite wellness centers at major campuses, and resources for fitness and daily life. Families typically receive fertility support, paid parental leave with gradual return, caregiving leave, and dependent-care guidance, while financial perks commonly include stock grants (with purchase discounts), 401(k) matching, and income-protection coverage. Employees also see robust time off, Apple University learning and tuition reimbursement, donation matching and paid volunteer hours, and deep product and partner discounts.