The Evaluation & Insights Engineer will join Apple's Human-Centered AI team, focusing on evaluating and improving AI systems through data science and qualitative insights. This role involves analyzing AI outputs, developing evaluation frameworks, and translating findings into actionable improvements. The engineer will work closely with Data Scientists, Researchers, and Engineers to ensure AI experiences are reliable and aligned with user expectations. A blend of technical expertise and analytical judgment is essential for assessing and enhancing advanced AI models.

• Bachelor's or Master's degree in Computer Science, Machine Learning, Artificial Intelligence, Cognitive Science, or a related technical field
• 8+ years of relevant industry experience in ML Engineering or Applied Research
• Advanced proficiency in Python and modern deep learning ecosystems such as PyTorch, JAX, and Hugging Face
• Proven experience building scalable ML inference pipelines and model-evaluation workflows
• Strong ability to interpret unstructured model outputs and synthesize qualitative findings
• Hands-on experience developing, fine-tuning, or evaluating LLMs, multimodal models, and NLP systems
• Deep familiarity with AI quality metrics and hallucination detection techniques
• Experience building internal tools or automated pipelines for ML workflows using platforms like MLflow or Weights & Biases
• Strong familiarity with advanced prompt engineering and RAG architectures
• Knowledge of human factors, HCI, or cognitive science methodologies as applied to AI system design

• Analyze AI outputs and develop evaluation frameworks for AI systems
• Collaborate with Engineering and Project Managers to ensure AI experiences are reliable and safe
• Translate findings into actionable improvements for product and engineering teams
• Evaluate and improve AI systems by combining data science and qualitative insights
• Assess and interpret the behavior of advanced AI models

• Employees at Apple are often offered comprehensive benefits that support physical and mental well-being—flexible medical plans, confidential counseling, onsite wellness centers at major campuses, and resources for fitness and daily life. Families typically receive fertility support, paid parental leave with gradual return, caregiving leave, and dependent-care guidance, while financial perks commonly include stock grants (with purchase discounts), 401(k) matching, and income-protection coverage. Employees also see robust time off, Apple University learning and tuition reimbursement, donation matching and paid volunteer hours, and deep product and partner discounts.