This role is part of the Siri organization, focusing on building systems and tooling for evaluation in the development of Siri. The position combines software engineering with evaluation science, utilizing machine learning techniques to ensure quality signals are trustworthy. The candidate will work across various interconnected streams, emphasizing 'evals first' thinking and developing tools for observability and reproducibility. This is an opportunity to define one's own path in a largely unexplored area of technology.

• Strong programming skills in one or more compiled languages such as Swift, C++, or Objective-C.
• Strong Python skills and solid computer science fundamentals, including data structures and algorithms.
• Ability to quickly learn and adapt to evolving technologies and tools.
• Experience with backend/API development and production debugging.
• Excellent communication and cross-team collaboration skills.
• M.S. or B.S. in Computer Science, Machine Learning, or a related field.
• Experience evaluating ML, LLM, or agent-based systems.
• Understanding of reinforcement learning and modern LLM techniques.
• Familiarity with eval-driven development.
• Experience with data science methods applied to quality measurement.
• Experience with MLOps, deployment, and test/eval environment management.
• Comfort communicating and collaborating across multicultural teams.

• Build systems and tooling that integrate evaluation into the development process.
• Contribute to evaluation quality, reward signals, and data science initiatives.
• Implement 'evals first' thinking in team workflows.
• Design tools for observability and reproducibility in quality measurement.
• Define success criteria and test cases based on real user workflows.
• Adapt to evolving technologies and frameworks in machine learning.
• Collaborate effectively within large, cross-functional organizations.

• Employees at Apple are often offered comprehensive benefits that support physical and mental well-being—flexible medical plans, confidential counseling, onsite wellness centers at major campuses, and resources for fitness and daily life. Families typically receive fertility support, paid parental leave with gradual return, caregiving leave, and dependent-care guidance, while financial perks commonly include stock grants (with purchase discounts), 401(k) matching, and income-protection coverage. Employees also see robust time off, Apple University learning and tuition reimbursement, donation matching and paid volunteer hours, and deep product and partner discounts.