The Staff Software Engineer for On-Device Machine Learning Infrastructure at Google will focus on developing advanced technologies that enhance on-device machine learning capabilities. This role involves working within the Core team, which is responsible for building the technical foundation behind Google's flagship products. The engineer will manage project priorities and deliverables while ensuring high performance for on-device ML infrastructure. This position requires collaboration across various teams to optimize machine learning models for deployment on diverse hardware platforms.

• Bachelor’s degree or equivalent practical experience.
• 8 years of experience in software development.
• 5 years of experience testing and launching software products, and 3 years of experience with software design and architecture.
• 5 years of experience with speech/audio technology, reinforcement learning, ML infrastructure, or specialization in another ML field.
• 5 years of experience with ML design and ML infrastructure, including model deployment and evaluation.

• Create roadmaps for developer-facing APIs, SDKs, and tools to meet the needs of Large Language Models workflows.
• Solve complex technical problems related to optimizing Generative AI performance across various hardware.
• Guide the team in designing resilient systems while anticipating scaling bottlenecks.
• Coordinate efforts across multiple groups to co-design performance and evaluation workflows.
• Provide technical mentorship and implement practices that enhance team velocity.

• Employees at Google are often offered benefits like comprehensive health insurance, 401(k) matching, and flexible work arrangements, among other benefits.