Job Description

NVIDIA is seeking a Distinguished Engineer for the Apache Spark Acceleration group to lead the architecture and implementation of GPU-accelerated Apache Spark and engage with open source communities to enhance big data frameworks.

Requirements

BS, MS, or PhD in Computer Science, Computer Engineering, or closely related field (or equivalent experience)
17+ years of work or research experience in software development
Prior experience in delivering complex software projects as a lead architect
Outstanding technical skills in designing and implementing high-quality distributed systems
Excellent programming skills in C++, Java, and/or Scala
Highly motivated with strong interpersonal skills and communication skills
5+ years working experience with key open source big-data projects as a contributor or committer
Excellent knowledge about distributed system schedulers: Kubernetes, Hadoop YARN, Apache Spark
Able to delve into a new area and quickly come up to speed
Able to work with teams across boundaries and geographies

Responsibilities

Lead the architecture, design and implementation of accelerated Apache Spark and related big-data frameworks
Engage open source communities for technical discussion and contribution
Work with NVIDIA partners to deploy GPU enabled data analytics solutions
Present technical solutions at industry conferences and meetups
Collaborate with distributed systems teams to define solutions to distributed processing problems
Provide recommendations and feedback to teams regarding infrastructure, continuous integration and testing strategy
Build, test and optimize CUDA/C++ libraries across different platforms
Build automation and tools to increase the productivity of teams developing distributed systems
Mentor members of the engineering team