Data Engineer II

The Supportability & Customer-Centric Engagement and Engineering Direct (SUCCEED) team at Microsoft is hiring a Data Engineer II in Redmond, WA (onsite). In this role, you will help shape scalable, trustworthy data products by designing and maintaining pipelines, telemetry datasets, measurement models, and dashboards that support engineering, supportability, escalation, and operational intelligence use cases.

What you’ll do

• Build and maintain data pipelines, transformations, semantic models, and curated datasets across engineering and operational data sources.
• Collaborate with product management, engineering, support teams, and leadership to define metrics, key business measures, and data quality expectations.
• Develop telemetry validation and checks for data freshness, completeness, and reliability.
• Create and maintain dashboards, scorecards, and operational reporting using Microsoft reporting tools or equivalent reporting experiences.
• Integrate data from sources such as Azure DevOps, telemetry platforms, support and escalation systems, release-readiness sources, and business reporting tools.
• Automate manual reporting and intake workflows where possible.
• Improve discoverability, governance, ownership, and documentation for critical datasets.
• Support release readiness, customer health, feature adoption, supportability, and escalation analytics.
• Investigate data issues, report root-cause findings for anomalies, and drive fixes with upstream and downstream partners.

Required qualifications

• Bachelor’s Degree in Computer Science, Math, Software Engineering, Computer Engineering, or a related field AND 2+ years of experience in business analytics, data science, software development, data modeling, or data engineering.
• Master’s Degree in Computer Science, Math, Software Engineering, Computer Engineering, or a related field AND 1+ year(s) of experience in business analytics, data science, software development, data modeling, or data engineering.
• OR equivalent experience.
• Ability to meet Microsoft, customer and/or government security screening requirements for the role.
• Successful completion of the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Technologies

• Python
• PySpark
• Kusto Query Language
• Azure Data Explorer
• Microsoft Fabric
• Azure Synapse Analytics
• Apache Spark

Preferred qualifications

• Experience using Python and PySpark scripting for data transformation, automation, validation, or analytics workflows.
• Experience building ETL or ELT pipelines, scheduled data refreshes, production data workflows, or reporting data models.
• Experience with Kusto Query Language, Azure Data Explorer, Microsoft Fabric, Azure Synapse Analytics, Apache Spark, or similar big-data platforms.
• Experience with telemetry, observability, product usage, supportability, or reliability datasets.
• 4+ years of experience with large-scale data platforms, telemetry, business intelligence reporting, or operational analytics.
• Proven experience developing and deploying autonomous artificial intelligence agents or agentic automation systems that reason over data, operate reliably in production, and help drive continuous automated insight generation.

Compensation

USD 102,100 - 219,200 per year.

There is a different range for specific work locations within the San Francisco Bay area and New York City metropolitan area, where the base pay range is USD 133,800 - 219,200 per year.