The role at Databricks involves joining the Backline Engineering Team, which acts as a bridge between Frontline Support and Engineering. The team focuses on resolving complex technical issues within the Data and AI ecosystem, emphasizing customer success and operational excellence. Candidates will engage in deep troubleshooting, root cause analysis, and architectural optimization to enhance product supportability. The position requires expertise in specific technical tracks related to data engineering, product supportability, or AI systems.

• 10+ years of relevant experience in a specialized technical track.
• Deep expertise in large-scale big data solutions and ETL pipelines using Spark, Delta Lake, or Hive for the Data Engineering Track.
• Ability to perform code-level root-cause analysis and profiling in Java, Scala, or Python for the Product Supportability Track.
• Experience with large-scale machine learning and generative AI systems for the AI Track.
• Strong problem-solving skills and experience managing both customers and technical stakeholders.

• Conduct deep-dive forensics into Spark core internals and the broader Databricks Data and AI ecosystem.
• Perform advanced code-level analysis and resource profiling to identify and mitigate systemic root causes.
• Optimise architectural performance across the Data and AI stack by refining execution parameters.
• Analyse global issue trends and patterns to influence the product roadmap.
• Develop reproduction frameworks, automated workflows, and AI-driven diagnostic tools.