The Staff Software Engineer for On-Device Machine Learning at Google will lead the technical direction of on-device ML and generative AI initiatives. This role involves solving complex problems related to the deployment of Large Language Models on mobile hardware. The engineer will work across multiple teams to define and build developer tools that meet the evolving needs of LLM workflows. The position requires a blend of technical expertise and leadership to drive innovation in machine learning applications.

• Bachelor's degree or equivalent practical experience.
• 8 years of experience in software development.
• 5 years of experience testing and launching software products.
• 3 years of experience with software design and architecture.
• 5 years of experience with ML design and ML infrastructure.

• Create roadmaps for developer-facing APIs, SDKs, and tools.
• Solve technically challenging problems related to optimizing GenAI performance.
• Guide the team in designing resilient systems to anticipate scaling bottlenecks.
• Coordinate efforts across multiple groups to co-design performance and evaluation workflows.
• Provide technical mentorship and implement new practices to increase team velocity.

• Employees at Google are often offered benefits like comprehensive health insurance, 401(k) matching, and flexible work arrangements, among other benefits.