The Staff Software Engineer for Machine Learning at Google Chat will be part of the Chat Back-end team, focusing on building and shaping AI infrastructure that powers Google Chat. This role involves architecting advanced models and developing next-generation capabilities to enhance enterprise collaboration. The engineer will work closely with model builders and leaders to impact billions of users globally. The position emphasizes the integration of generative AI research into production-grade systems.

• Bachelor’s degree in Computer Science, Artificial Intelligence, or equivalent practical experience.
• 8 years of software engineering experience.
• 5 years of experience leading technical strategy and architecting large-scale ML infrastructure and distributed systems.
• Experience managing the full ML development life-cycle, from hypothesis and data collection to fine-tuning, evaluation, and post-production monitoring.
• Experience building, optimizing, and deploying Generative AI systems in production with a focus on latency and cost.

• Lead the shift from reactive manual triage to an AI-scaled, automated evaluation loop.
• Own the technical roadmap for retrieval augmented generation, driving Recall@100 and eliminating hallucinations.
• Automate manual hill-climbing with data-driven frameworks to reduce Time-to-Resolution for Natural Language Understanding bugs.
• Optimize the performance and efficiency of the AI stack by improving TPU/GPU utilization and minimizing end-to-end latency.
• Act as the primary technical liaison with Google DeepMind, Core Machine Learning, Product Managers, and other Workspace pillars.

• Employees at Google are often offered benefits like comprehensive health insurance, 401(k) matching, and flexible work arrangements, among other benefits.