Apple's US Decision Intelligence team is seeking an AI Evaluations Engineer to manage the evaluation pipeline for AI products and workflows. This role focuses on implementing evaluation frameworks and instrumentation to assess AI system performance and improvements. The engineer will work on both enhancing existing AI projects and innovating new technologies that facilitate decision-making. The position requires collaboration across teams and the ability to adapt to a fast-paced environment.

• 5+ years of experience in data and AI-related fields such as AI engineering, software development, ML engineering, data science, or QA roles.
• Strong Python skills.
• Hands-on experience with AI evaluation techniques, such as Golden datasets, LLM-as-a-Judge, or rubric-based scoring.
• Proficiency in SQL and experience with at least one major data analytics platform, such as Hadoop, Spark, or Snowflake.
• B.S. degree in Computer Science/Engineering, or equivalent work experience.

• Own the end-to-end evaluation pipeline for AI products and workflows.
• Implement and maintain evaluation frameworks and instrumentation.
• Collaborate with data science teams to generate insights leveraging LLMs.
• Translate fuzzy correctness criteria into measurable rubrics or metrics.
• Work across global teams to ensure alignment of product development.

• Employees at Apple are often offered comprehensive benefits that support physical and mental well-being—flexible medical plans, confidential counseling, onsite wellness centers at major campuses, and resources for fitness and daily life. Families typically receive fertility support, paid parental leave with gradual return, caregiving leave, and dependent-care guidance, while financial perks commonly include stock grants (with purchase discounts), 401(k) matching, and income-protection coverage. Employees also see robust time off, Apple University learning and tuition reimbursement, donation matching and paid volunteer hours, and deep product and partner discounts.