The GDM Staff Software Engineer position at DeepMind focuses on enhancing agent data quality through innovative software engineering solutions. The role involves working with advanced AI agents and collaborating with a team of machine learning and neuroscience researchers. Key tasks include developing systems for agent testing and creating visualizations of results. The position requires a strong foundation in software engineering and a passion for tackling complex challenges within a mission-driven environment.

• Bachelor's degree in Computer Science or Engineering, or equivalent practical experience.
• Experience with Large Language Models (LLMs), NLP, or Generative AI.

• Construct rigorous quantitative benchmarks and automated evaluation frameworks to measure agent capabilities.
• Develop end-to-end data flywheel on agent evalset curation and automate the flywheel with agentic data pipelines.
• Create a dedicated platform for 'Self-Service Judges' to allow rapid prototyping and testing of new LLM-based classifiers.
• Establish a formal ecosystem for metric lifecycle management, including a sandbox for validating new metrics.
• Productionize automated insights tools to identify the top movers of metric deltas across complex slices.

• Employees at Google are often offered benefits like comprehensive health insurance, 401(k) matching, and flexible work arrangements, among other benefits.