As a Senior Software Engineer (Infrastructure) at Databricks, you will be a key technical contributor on the IT Infrastructure team, focusing on the evolution of core infrastructure and observability platforms. This role requires a strong software engineering mindset and deep technical knowledge across SRE and infrastructure. You will be responsible for building resilient and automated infrastructure that supports development teams while ensuring cost optimization and security in the AWS environment. Additionally, you will mentor junior engineers and collaborate with various stakeholders to deliver impactful projects.

• 5+ years of production-level experience with a strong proficiency in Python.
• Expert-level proficiency in Terraform or Pulumi.
• Hands-on experience with AWS, Kubernetes, Docker, and containerization concepts.
• Experience building and troubleshooting integrations between infrastructure, data pipelines, and observability platforms.
• Advanced knowledge of GitHub Actions and GitHub Runners.
• Understanding of observability pillars and hands-on experience with tools like Datadog, Prometheus, or ELK.
• Proficiency in running systems through concepts like Kafka or messaging queues.
• Ability to operate with minimal guidance and take ownership of ambiguous projects.

• Design and deploy production-grade infrastructure on AWS using Terraform or Pulumi.
• Manage and scale containerized workloads using AKS or EKS, focusing on cluster security and resource efficiency.
• Architect robust deployment pipelines using GitHub Actions.
• Create underlying infrastructure to ensure new internal applications are secure and have logging and metrics enabled by default.
• Build internal CLI tools, AI plugins, and automation scripts to streamline developer workflows.
• Collaborate with stakeholders across Security, Engineering, Infrastructure, and Support.
• Participate in code reviews, document solutions, and mentor junior engineers.