The Staff Software Engineer, Model Quality role at Google focuses on developing advanced evaluation systems for AI models, particularly in the context of generative AI and large language models. The position is part of the Google Pics team, which is working on an AI-powered visual editor integrated into Google Workspace. This role involves executing against a roadmap leading to a General Availability launch in 2026, requiring fast-paced execution and collaboration with cross-functional teams. The engineer will leverage their expertise to enhance model quality and user experience through innovative solutions.

• Bachelor's degree or equivalent practical experience.
• 8 years of experience in software development.
• 5 years of experience with speech/audio technology, reinforcement learning, ML infrastructure, or another ML specialization.
• 5 years of experience with ML design and infrastructure, including model deployment and evaluation.
• 5 years of experience testing and launching software products, and 3 years of experience with software design and architecture.
• Experience integrating generative AI tools or Large Language Model interfaces into workflows.

• Build both human-powered and Large Language Model-powered automated evaluation systems to assess model performance.
• Establish clear metrics to measure aspects like grounding, coherence, safety, and helpfulness.
• Utilize platforms and tools to efficiently run evaluations across different models and datasets.
• Provide actionable insights from evaluations to improve model quality in collaboration with research and cross-functional teams.
• Create tools and systems that make the evaluation process more efficient and effective.

• Employees at Google are often offered benefits like comprehensive health insurance, 401(k) matching, and flexible work arrangements, among other benefits.