JobsHardware/Software Co-Design Engineer, Inference
Google logo

Hardware/Software Co-Design Engineer, Inference

Google

Location

Sunnyvale, CA

Type

Full-time

Posted

11/5/2026

Compensation

$192,000 - $278,000 per year

Undergraduate with 5+ Years of Experience
H-1B FY202698.4% approval-14% YoY
👑 Elite sponsor

Job description

The Hardware/Software Co-Design Engineer, Inference role at Google focuses on shaping the future of AI/ML hardware acceleration. The position involves driving the development of custom silicon solutions, particularly Tensor Processing Units (TPUs), that support Google's AI/ML applications. The engineer will collaborate with various teams to bridge the gap between model architecture innovation and hardware design. This role is critical in optimizing the hardware/software stack for large machine learning models.

Requirements

  • Bachelor's degree in Electrical Engineering, Computer Engineering, Computer Science, or a related field, or equivalent practical experience.
  • 10 years of experience in computer architecture, chip architecture, or hardware-software co-design.
  • Experience developing systems for performance modeling, simulation, or system analysis.

Responsibilities

  • Drive the definition and optimization of the hardware/software stack to enable performant training and serving of large ML models.
  • Collaborate with research and modeling teams to innovate on model architectures, focusing on scaling, quality, and their direct impact on hardware performance.
  • Lead the development of configurable architectural simulators and cycle-accurate performance models to quantify microarchitectural optimizations and evaluate architectural decisions.
  • Conduct system-level performance analysis across highly distributed ML systems, innovating new methodologies to balance compute, memory bandwidth, and inter-chip network requirements.
  • Engage with partners across hardware design, compiler development, and ML research to transition architectural innovations from concept to production.

Benefits

  • Employees at Google are often offered benefits like comprehensive health insurance, 401(k) matching, and flexible work arrangements, among other benefits.

H-1B filing history

Public USCIS petition and DOL LCA counts · latest USCIS FY2026, LCA FY2026

Filing entity: Google Llc

As of Aug 23, 2026

Initial approvals

908

FY2026

Approval rate

98.4%

FY2026

LCA certified

4,273

FY2026

Entry-level share

0.6%

FY2026

Initial approvals YoY

-14%

Trend

LCA certified YoY

-51%

Trend

Initial approvals by fiscal year

Approval rate by fiscal year

Continuing vs initial approvals

LCA certified positions by quarter

LCA certified positions by fiscal year

Based on public USCIS and DOL filings; not a sponsorship guarantee.

Is this posting expired or inaccurate?