JobsStaff Software Engineer, AI Engines 3P TPU Inference
Google logo

Staff Software Engineer, AI Engines 3P TPU Inference

Google

Location

Mountain View, CA

Type

Full-time

Posted

5/26/2026

Compensation

$207,000 - $300,000 per year

Undergraduate with 5+ Years of Experience
Approval 99%·Filings 5,616·New hires 2,898·
👑 Elite Sponsor
·FY 2025

Job description

The Staff Software Engineer for AI Engines 3P TPU Inference at Google will focus on developing next-generation technologies that enhance machine learning infrastructure. This role requires deep expertise in ML compilers and runtimes, as well as strong leadership skills to manage project priorities and deliverables. The engineer will work closely with cross-organizational teams to drive impactful innovations and optimize existing frameworks. The position is critical to supporting Google's mission of advancing AI across various industries.

Requirements

  • Bachelor’s degree or equivalent practical experience.
  • 8 years of experience in software development.
  • 5 years of experience testing and launching software products.
  • 3 years of experience with software design and architecture.
  • 5 years of experience with ML design and ML infrastructure.

Responsibilities

  • Exercise judgment to guide sustainable engineering choices for ML systems at scale.
  • Innovate next directions for infrastructure over a 12-month time horizon.
  • Deliver impactful capability and optimization impact to Cloud and partner product areas.
  • Gracefully migrate existing frameworks and runtimes onto ML Runtime.
  • Partner with GDM to transfer key innovations into products developed by your team.

Benefits

  • Employees at Google are often offered benefits like comprehensive health insurance, 401(k) matching, and flexible work arrangements, among other benefits.

Is this posting expired or inaccurate?