Qualcomm Technologies, Inc. is seeking experienced software engineers to enhance the software ecosystem for large-scale LLM inference on Qualcomm platforms. The role involves working with open-source LLM serving systems, distributed systems, and AI accelerator software. Candidates will contribute to projects like llm-d and develop integrations for efficient operation on Qualcomm AI accelerators. This position offers the chance to collaborate with leading open-source communities and shape the future of scalable LLM inference infrastructure.

• Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field and 4+ years of relevant work experience, or a Master's degree with 3+ years, or a PhD with 2+ years.
• Strong software engineering and debugging skills.
• Experience developing production-quality software in Python, C++, Go, or Rust.
• Strong understanding of machine learning or LLM inference systems, distributed systems, or AI accelerator software.

• Contribute features, improvements, bug fixes, and architectural enhancements to open-source LLM inference projects.
• Develop and improve support for Qualcomm AI accelerators in open-source LLM serving frameworks.
• Collaborate with upstream maintainers and open-source communities to design and review Qualcomm-related functionality.
• Develop and enhance inference engine integrations for Qualcomm platforms, focusing on performance optimization.
• Integrate LLM inference software with Kubernetes and cloud-native infrastructure.
• Profile, benchmark, and optimize end-to-end inference performance.
• Collaborate closely with hardware, firmware, compiler, runtime, and product teams to deliver end-to-end solutions.

• Qualcomm offers competitive compensation, annual bonuses, stock programs, comprehensive healthcare coverage, retirement plans, wellness programs, parental leave, flexible work options, and professional development opportunities.