DeveloperJobs.io
← Back to all jobs

Job Description

Own the data foundation for Trane Technologies’ enterprise telematics SaaS platform on Azure, spanning end-to-end lifecycle from IoT ingestion to analytics, reliability, and cost optimization.

Responsibilities

  • Design, build, and evolve end-to-end data architecture across Cosmos DB, Azure Data Explorer (ADX), Azure SQL, and Microsoft Fabric
  • Architect and optimize Cosmos DB for high-throughput IoT workloads including partition key strategy, indexing policy, schema design, TTL configuration, RU/s throughput tuning, and change feed utilization
  • Build and operate ADX clusters with ingestion pipelines (Event Hub ingestion, ingestion mappings, update policies), KQL query optimization, retention and caching policy tuning, and materialized views for analytics
  • Design and maintain Azure SQL schemas, stored procedures, and ETL jobs for relational reporting and operational data needs
  • Drive data flow across the hot path (Event Hubs real-time processing), warm path (Cosmos DB operational queries), and cold/analytics path (ADX long-term telemetry retention and aggregation)
  • Develop and maintain ingestion pipelines using Azure Functions, Event Hubs, and Service Bus
  • Implement high-throughput ingestion pipelines processing millions of IoT events per day, including telemetry, alarms, lifecycle events, and geospatial data
  • Build transformation and enrichment logic in C#/.NET, Python, and/or pySpark integrated with Azure Functions and Event Hub triggered pipelines
  • Implement ingestion pipeline data quality, validation, deduplication, and anomaly detection
  • Apply CI/CD for data pipeline deployment using GitHub Actions or Azure DevOps
  • Design and maintain ADX update policies and Cosmos DB change feed processors to support downstream data propagation
  • Create scalable, queryable data models for time-series telemetry, alarm events, geospatial lookups (H3 hexagonal indexing), and fleet/asset metadata
  • Implement scalable partitioning strategies tailored to Cosmos DB (tenant + device key patterns) and ADX (ingestion time partitioning, row ordering policies)
  • Model multi-tenant isolation and access patterns in both Cosmos DB and Azure SQL
  • Manage data lifecycle policies across ADX (hot/cold cache tiers, retention) and Cosmos DB (TTL, archival strategy)
  • Collaborate with backend engineering on microservice data contracts and Cosmos DB document schemas supporting operational APIs and analytics queries
  • Work with platform architects to evolve the next-generation telematics platform data architecture
  • Partner with backend (JAVA) engineers to support ingestion patterns and data contract design across microservices
  • Support product and business stakeholders with ADX/KQL analytics queries, reporting, and ad hoc data investigations
  • Partner with project managers to deliver data milestones predictably and communicate risks early
  • Own reliability, observability, and SLA of all data pipelines across the production SaaS platform
  • Monitor, diagnose, and optimize costs across Cosmos DB (RU/s utilization), ADX (compute and storage tiers), Azure SQL, Event Hubs, and Azure Functions
  • Implement governance, RBAC, and data access controls aligned to multi-tenant SaaS requirements
  • Create runbooks, architecture documentation, and knowledge-sharing artifacts for the engineering organization

Requirements

  • 5+ years of professional data engineering experience building and owning production data platforms
  • Bachelor’s degree in Computer Science, Mathematics, Information Technology, or a related field
  • Deep, hands-on Azure data expertise:
    • Cosmos DB (required): partition strategy, indexing, change feed, TTL, multi-tenant patterns, RU optimization
    • Azure Data Explorer (ADX) (required): cluster management, ingestion pipelines, KQL, update policies, retention, caching tiers
    • Azure SQL (required): schema design, stored procedures, query optimization, ETL integration
    • Azure Event Hubs and Service Bus: high-throughput ingestion, consumer group management, dead-letter handling
  • Strong proficiency in KQL for ADX and SQL for Azure SQL
  • Working proficiency in Python, pySpark, and/or C#/.NET
  • Solid understanding of multi-tenant SaaS data architecture including isolation patterns, tenant-aware querying, and shared infrastructure cost management
  • Experience designing data models for time-series, telemetry, and event-driven workloads at scale
  • Strong understanding of distributed data systems: partitioning, consistency tradeoffs, and throughput vs. latency optimization
  • Hands-on experience supporting and owning production SaaS platforms end-to-end
  • Knowledge of Git for distributed version control, including merge conflict resolution and Git branching strategies
  • Knowledge of Azure DevOps deployment pipelines
  • Experience utilizing AI in a data platform ecosystem
  • Ability to operate independently and cross-functionally across architecture, development, DevOps, and product teams

Technologies

  • Azure
  • Cosmos DB
  • Azure Data Explorer (ADX)
  • Azure SQL
  • Microsoft Fabric
  • Azure Functions
  • Event Hubs
  • Service Bus
  • C#/.NET
  • Python
  • pySpark
  • KQL
  • SQL
  • Git
  • Azure DevOps
  • GitHub Actions
  • H3 hexagonal indexing
  • JAVA
  • AI
  • Fabric (Real-Time Analytics, Lakehouse, Eventstream)

Preferred / Nice-to-have

  • Experience in IoT, telematics, fleet management, or large-scale connected device platforms
  • Familiarity with geospatial data including H3 indexing, geofencing, or location-enriched telemetry pipelines
  • Familiarity with .NET/C# or JAVA in Azure data pipeline development (Azure Functions, Event Hub processors)
  • Experience with Azure Container Apps or other containerized Azure compute environments
  • Exposure to MQTT, IoT Hub, or cellular device connectivity (private APN) patterns

Benefits

  • Health insurance and holistic wellness programs including generous incentives
  • Fertility coverage and adoption/surrogacy assistance
  • Paid time off including up to 15 vacation days, paid holidays, sick leave, and additional options to support volunteer and parental leave
  • 401K match
  • Educational and training opportunities through company programs along with tuition assistance and student debt support

Compensation

  • Annual base salary range: USD 127,110 - 177,870
  • Compensation type: Salary
  • Incentive eligible: Yes
  • Sales commission eligible: No
  • Safety sensitive role: No

Location

  • Minneapolis, MN (onsite)

Similar Jobs