JobsStaff Software Engineer, On-Device Machine Learning Infrastructure
Google logo

Staff Software Engineer, On-Device Machine Learning Infrastructure

Google

Location

Sunnyvale, CA

Type

Full-time

Posted

5/5/2026

Compensation

$207,000 - $300,000 per year

Undergraduate with 5+ Years of Experience
Approval 99%·Filings 5,616·New hires 2,898·
👑 Elite Sponsor
·FY 2025

Job description

The Staff Software Engineer for On-Device Machine Learning Infrastructure at Google will focus on delivering high-performance ML infrastructure that enables on-device deployment of key models across various platforms. This role is part of the Core team, which builds the technical foundation behind Google's flagship products. The engineer will work on optimizing Generative AI performance and collaborate with multiple groups to enhance system resilience and scalability. The position requires a blend of technical expertise and leadership to drive innovation in machine learning applications.

Requirements

  • Bachelor's degree or equivalent practical experience.
  • 8 years of experience in software development.
  • 5 years of experience testing and launching software products.
  • 3 years of experience with software design and architecture.
  • 5 years of experience with ML design and ML infrastructure.

Responsibilities

  • Create roadmaps for developer-facing APIs, SDKs, and tools.
  • Solve technically complex problems related to optimizing Generative AI performance.
  • Guide the team in designing resilient and robust systems.
  • Coordinate efforts across multiple groups to co-design performance workflows.
  • Provide technical mentorship and implement new practices to increase team velocity.

Benefits

  • Employees at Google are often offered benefits like comprehensive health insurance, 401(k) matching, and flexible work arrangements, among other benefits.

Is this posting expired or inaccurate?