Data Developer
Azure Cosmos Db
Azure Data Engineer
Azure Data Explorer
Azure Data Platform
Azure Platform
Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Integration
Data Integration Tools
Data Pipeline
Data Platform
Data Processing
Database
Databases
DevOps
Engineer
ETL
Informatica
Information Technology (IT)
Integration
Kusto Query Language
Microsoft Azure
Microsoft Fabric
Programming
Programming Languages
Software Development
Software Engineer
Software Engineering
SQL
Job Description
Own the data foundation for Trane Technologies’ enterprise telematics SaaS platform on Azure, spanning end-to-end lifecycle from IoT ingestion to analytics, reliability, and cost optimization.
Responsibilities
- Design, build, and evolve end-to-end data architecture across Cosmos DB, Azure Data Explorer (ADX), Azure SQL, and Microsoft Fabric
- Architect and optimize Cosmos DB for high-throughput IoT workloads including partition key strategy, indexing policy, schema design, TTL configuration, RU/s throughput tuning, and change feed utilization
- Build and operate ADX clusters with ingestion pipelines (Event Hub ingestion, ingestion mappings, update policies), KQL query optimization, retention and caching policy tuning, and materialized views for analytics
- Design and maintain Azure SQL schemas, stored procedures, and ETL jobs for relational reporting and operational data needs
- Drive data flow across the hot path (Event Hubs real-time processing), warm path (Cosmos DB operational queries), and cold/analytics path (ADX long-term telemetry retention and aggregation)
- Develop and maintain ingestion pipelines using Azure Functions, Event Hubs, and Service Bus
- Implement high-throughput ingestion pipelines processing millions of IoT events per day, including telemetry, alarms, lifecycle events, and geospatial data
- Build transformation and enrichment logic in C#/.NET, Python, and/or pySpark integrated with Azure Functions and Event Hub triggered pipelines
- Implement ingestion pipeline data quality, validation, deduplication, and anomaly detection
- Apply CI/CD for data pipeline deployment using GitHub Actions or Azure DevOps
- Design and maintain ADX update policies and Cosmos DB change feed processors to support downstream data propagation
- Create scalable, queryable data models for time-series telemetry, alarm events, geospatial lookups (H3 hexagonal indexing), and fleet/asset metadata
- Implement scalable partitioning strategies tailored to Cosmos DB (tenant + device key patterns) and ADX (ingestion time partitioning, row ordering policies)
- Model multi-tenant isolation and access patterns in both Cosmos DB and Azure SQL
- Manage data lifecycle policies across ADX (hot/cold cache tiers, retention) and Cosmos DB (TTL, archival strategy)
- Collaborate with backend engineering on microservice data contracts and Cosmos DB document schemas supporting operational APIs and analytics queries
- Work with platform architects to evolve the next-generation telematics platform data architecture
- Partner with backend (JAVA) engineers to support ingestion patterns and data contract design across microservices
- Support product and business stakeholders with ADX/KQL analytics queries, reporting, and ad hoc data investigations
- Partner with project managers to deliver data milestones predictably and communicate risks early
- Own reliability, observability, and SLA of all data pipelines across the production SaaS platform
- Monitor, diagnose, and optimize costs across Cosmos DB (RU/s utilization), ADX (compute and storage tiers), Azure SQL, Event Hubs, and Azure Functions
- Implement governance, RBAC, and data access controls aligned to multi-tenant SaaS requirements
- Create runbooks, architecture documentation, and knowledge-sharing artifacts for the engineering organization
Requirements
- 5+ years of professional data engineering experience building and owning production data platforms
- Bachelor’s degree in Computer Science, Mathematics, Information Technology, or a related field
- Deep, hands-on Azure data expertise:
- Cosmos DB (required): partition strategy, indexing, change feed, TTL, multi-tenant patterns, RU optimization
- Azure Data Explorer (ADX) (required): cluster management, ingestion pipelines, KQL, update policies, retention, caching tiers
- Azure SQL (required): schema design, stored procedures, query optimization, ETL integration
- Azure Event Hubs and Service Bus: high-throughput ingestion, consumer group management, dead-letter handling
- Strong proficiency in KQL for ADX and SQL for Azure SQL
- Working proficiency in Python, pySpark, and/or C#/.NET
- Solid understanding of multi-tenant SaaS data architecture including isolation patterns, tenant-aware querying, and shared infrastructure cost management
- Experience designing data models for time-series, telemetry, and event-driven workloads at scale
- Strong understanding of distributed data systems: partitioning, consistency tradeoffs, and throughput vs. latency optimization
- Hands-on experience supporting and owning production SaaS platforms end-to-end
- Knowledge of Git for distributed version control, including merge conflict resolution and Git branching strategies
- Knowledge of Azure DevOps deployment pipelines
- Experience utilizing AI in a data platform ecosystem
- Ability to operate independently and cross-functionally across architecture, development, DevOps, and product teams
Technologies
- Azure
- Cosmos DB
- Azure Data Explorer (ADX)
- Azure SQL
- Microsoft Fabric
- Azure Functions
- Event Hubs
- Service Bus
- C#/.NET
- Python
- pySpark
- KQL
- SQL
- Git
- Azure DevOps
- GitHub Actions
- H3 hexagonal indexing
- JAVA
- AI
- Fabric (Real-Time Analytics, Lakehouse, Eventstream)
Preferred / Nice-to-have
- Experience in IoT, telematics, fleet management, or large-scale connected device platforms
- Familiarity with geospatial data including H3 indexing, geofencing, or location-enriched telemetry pipelines
- Familiarity with .NET/C# or JAVA in Azure data pipeline development (Azure Functions, Event Hub processors)
- Experience with Azure Container Apps or other containerized Azure compute environments
- Exposure to MQTT, IoT Hub, or cellular device connectivity (private APN) patterns
Benefits
- Health insurance and holistic wellness programs including generous incentives
- Fertility coverage and adoption/surrogacy assistance
- Paid time off including up to 15 vacation days, paid holidays, sick leave, and additional options to support volunteer and parental leave
- 401K match
- Educational and training opportunities through company programs along with tuition assistance and student debt support
Compensation
- Annual base salary range: USD 127,110 - 177,870
- Compensation type: Salary
- Incentive eligible: Yes
- Sales commission eligible: No
- Safety sensitive role: No
Location
- Minneapolis, MN (onsite)