Member of Technical Staff - Data Engineer

Job Description

Microsoft AI (MS AI) is seeking experienced Data Engineers to help build mission critical data pipelines that ingest, process and publishes data streams from our personal AI, Copilot systems.

Requirements

• Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years experience in big data engineering, data modeling and data pipeline engineering work OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ year(s) experience in software development, or data engineering work OR equivalent experience.
• 5+ years technical engineering experience building data processing applications (batch and streaming) with coding in languages including, but not limited to Scala, Python, Java, Spark, SQL.
• 2+ years' experience building scalable services on top of public cloud infrastructure like Azure, AWS, or GCP.
• Extensive use datastores like RDBMS, key-value stores, etc.
• 2+ years' experience building distributed systems at scale and extensive systems engineering knowledge.
• Extensive experience working with Spark framework, Apache Hadoop ecosystem, Kafka, NoSQL, etc.

Responsibilities

• Build scalable data pipelines for sourcing, transforming and publishing data assets for AI use cases.
• Work collaboratively with other Platform, infrastructure, application engineers as well as AI Researchers to build next generation data platform products and services.
• Ship high-quality, well-tested, secure, and maintainable code.
• Find a path to get things done despite roadblocks to get your work into the hands of users quickly and iteratively.
• Enjoy working in a fast-paced, design-driven, product development cycle.
• Embody our Culture and Values.

Benefits

• Industry leading healthcare
• Educational resources
• Discounts on products and services
• Savings and investments
• Maternity and paternity leave
• Generous time away
• Giving programs
• Opportunities to network and connect