As a senior engineer at Databricks, you will be part of a small team in the NYC office focused on building CustomerLake, a Customer Data Platform. This role emphasizes developing ML and AI personalization capabilities for businesses that utilize Databricks. You will work in a dynamic 0-to-1 environment, leveraging your extensive experience to drive innovative solutions. The position requires collaboration with product management, engineering, and design to address customer challenges effectively.

• 10+ years of engineering experience with a strong foundation in shipping and improving ML/AI products.
• Hands-on experience building and evaluating ML models and/or LLM systems for real product use cases.
• Experience with personalization based on customer behavior or transactions.
• Proficiency in Python and modern ML frameworks such as PyTorch.
• Familiarity with LLMs and generative AI techniques.
• A demonstrated product mindset with the ability to translate customer problems into MVPs.
• High ownership and bias for action in 0-to-1 environments.

• Evaluate ML and LLM approaches for CustomerLake's personalization use cases.
• Inspect individual traces to understand model behavior in production.
• Build the platform and evaluation framework for optimizing business value.
• Encourage the team to explore new directions and tackle novel methods.
• Collaborate closely with product management, engineering, and design.
• Set the technical foundation and best practices for ML/AI personalization.