As a Senior Software Engineer for AI Runtime at Databricks, you will be instrumental in building and scaling systems for large-scale GPU training. This role focuses on enhancing the managed GPU training platform, ensuring it is fast, reliable, and user-friendly. You will collaborate with various teams to shape the technical direction of AI Runtime while mentoring other engineers. Your contributions will directly impact the efficiency and performance of AI training infrastructure.

• 5+ years of experience building and operating large-scale distributed systems, particularly in GPU training infrastructure or ML systems.
• Experience with distributed training frameworks such as PyTorch, FSDP, DeepSpeed, or Megatron.
• Strong understanding of training resilience patterns, including checkpointing and automatic recovery for long-running jobs.
• Solid grasp of GPU performance fundamentals and the bottlenecks that affect training throughput.
• Experience building and operating managed, multi-tenant platform products in the cloud.
• Strong foundation in algorithms, data structures, and system design for performance-sensitive systems.
• Proven ability to deliver technically complex initiatives that create customer value.
• Strong communication skills and the ability to collaborate across teams.
• Customer-focused mindset with a passion for mentoring engineers.
• BS in Computer Science or a related field; MS or PhD preferred.

• Drive the architecture and evolution of AIR's managed GPU training platform.
• Solve complex problems in large-scale training, including multi-node orchestration and GPU scheduling.
• Enhance GPU efficiency and training performance while lowering costs per training run.
• Build resilience and observability foundations for multi-node jobs.
• Partner with product, research, and platform teams to improve the developer experience.
• Lead end-to-end engineering efforts from design to production rollout.
• Make high-impact contributions to core systems and support new accelerators.
• Champion engineering excellence and mentor other engineers.