The Senior Staff Engineer will serve as a technical architect and engineering leader for Databricks' ETL product line, which includes Declarative Dataflow Graphs and Structured Streaming. This role involves shaping the long-term technical direction of data pipelines that are critical for thousands of production customers. The engineer will work on complex challenges in distributed data systems, focusing on scalability and fault tolerance. The position requires collaboration across multiple areas to innovate and enhance data infrastructure.

• 10+ years of experience building, operating, and evolving large-scale distributed systems in production.
• Deep expertise in one or more of database internals, storage systems, distributed computing, streaming systems, language/API design, or performance engineering.
• A track record of executing against a multi-year technical vision through well-sequenced incremental milestones.
• Strong algorithmic foundations with practical judgment on when to apply complex solutions.
• Experience building alignment across teams and driving initiatives from conception through customer adoption.
• BS, MS, or PhD in Computer Science or a related field or equivalent depth of experience.

• Architect and deliver a highly scalable, fault-tolerant platform for declarative pipelines and materialized views.
• Turn ambiguous, large-scale technical challenges into clear execution plans that can be incrementally shipped.
• Bridge the gap between research and production by implementing ideas from academic literature into practical systems.
• Lead performance diagnosis on large production clusters and optimize for cost and latency.
• Shape product direction alongside engineering and product leadership, owning technical strategy from design through delivery.
• Drive complex, multi-team technical initiatives requiring sustained coordination and clear technical judgment.