DeveloperJobs.io
← Back to all jobs

Job Description

Design and own a governed cloud data architecture that connects key business systems into a Microsoft Fabric/Azure lakehouse for reporting in Power BI and future AI needs.

Responsibilities

  • Define and own the target data architecture within the first 90 days, then operate it end-to-end.
  • Deliver a cloud lakehouse on Microsoft Fabric or Azure using OneLake or ADLS storage and Delta tables.
  • Implement a medallion architecture with bronze, silver, and gold layers.
  • Set up Fabric workspaces and environments for development, test, and production.
  • Establish the security model, naming standards, and cost controls for the platform.
  • Build and run ingestion from ERP and operational systems including IBM i / DB2, operations and project management systems, equipment telematics, HR and payroll, SQL Server applications, and other approved sources.
  • Use change data capture or incremental loads when supported by the source systems.
  • Create pipelines and notebooks to move and transform data across layers, including:
    • Data Factory pipelines and dataflows for orchestration
    • Spark notebooks using PySpark or Spark SQL
  • Include scheduling, monitoring, alerting, and recovery capabilities in the data platform.
  • Define an integration standard for system-to-system work:
    • Patterns, tooling, error handling, retries, logging, and alerting
    • API/webhook/file/database interface integration
    • System integration processes that support reliable outcomes
  • Write and tune production SQL transformations, views, stored procedures, and validation logic.
  • Administer SQL Server application databases across performance, indexing, maintenance jobs, and access/schema changes.
  • Design Power BI semantic models on the gold layer, including star schemas, DAX, Direct Lake or import modes, incremental refresh, and row level security by company and role.
  • Publish certified datasets and support business-wide reporting needs through datasets authored by report authors.
  • Operate the Power BI environment, including workspaces, gateway, deployment pipelines, capacity, and access.
  • Coach finance and operations report authors and review their reports until they can publish independently.
  • Implement automated data quality checks and reconciliations to source systems.
  • Keep the data dictionary, lineage, and business definitions current with the data owners.
  • Define master data rules for records shared across the three companies (jobs, equipment, employees, vendors, cost codes) with the responsible owners.
  • Practice “data work as code” using source control, peer review, automated testing, and deployment.
  • Manage Fabric capacity and platform cost, with monthly reporting.
  • Prepare the data foundation for AI use cases with clean, governed, documented data and access controls.
  • Support future ERP selection with data profiling and migration planning.

Requirements

  • Advanced SQL with complex T-SQL, query tuning, stored procedures, indexing, and execution plans.
  • SQL experience with DB2, ideally IBM i, or the ability to become productive within 90 days.
  • SQL Server database administration including performance, indexing, maintenance, security, and access.
  • Dimensional modeling including star schemas, normalization, and slowly changing dimensions.
  • Ability to design and build a cloud lakehouse on Microsoft Fabric or Azure using OneLake or ADLS, Delta or Parquet, and medallion architecture.
  • Capacity to defend the technical design to both an IT Director and a CFO.
  • Experience building and operating pipelines and notebooks on the platform using:
    • Data Factory pipelines/dataflows
    • Spark notebooks (PySpark or Spark SQL)
    • Orchestration tool such as Fabric, Azure Data Factory, Synapse, SSIS, or dbt
  • Integration design experience with REST APIs, OAuth and API keys, JSON, webhooks, file/database interfaces, idempotent loads, and error handling.
  • Power BI semantic model experience on a lakehouse using DAX, relationships, Direct Lake and import modes, incremental refresh, row level security, and performance tuning.
  • Proficiency in at least one programming language for data work; Python or C# preferred.
  • Experience with Git and automated deployment, plus a habit of testing, reconciling, and documenting data work.
  • Data security fundamentals: least privilege, encryption, secrets management, and careful handling of payroll/personnel data.
  • Ability to explain what data does and does not say to finance and operations leaders in plain language.
  • 5+ years building and operating data pipelines, integrations, and models, with at least 3 in a Microsoft data environment.
  • Bachelor’s degree in computer science, information systems, data engineering, or a related field, or equivalent experience.

Technologies

  • Microsoft Fabric, Azure, OneLake, ADLS
  • Delta tables, Delta, Parquet
  • Data Factory, Spark notebooks, PySpark, Spark SQL
  • Fabric, Azure Data Factory, Synapse, SSIS, dbt
  • REST APIs, OAuth, API keys, JSON, webhooks
  • SQL Server, T-SQL, DB2, IBM i
  • Power BI, DAX, Direct Lake, incremental refresh, row level security
  • Git, Python, C#
  • HCSS, Samsara, BambooHR

Nice to Have

  • Construction ERP data, especially eCMS on IBM i; Viewpoint, Sage, CMiC, or Procore also count.
  • HCSS products (HeavyJob, HeavyBid, Equipment360, Dispatcher), BambooHR, and telematics/equipment data from Samsara or OEM feeds.
  • Fabric capacity planning and cost management, or Azure equivalent.
  • Real-time or event-based ingestion (Fabric Real-Time Intelligence, Event Hubs, or similar) for telematics and equipment data.
  • Integration platforms such as Azure Logic Apps, Power Automate, or a commercial iPaaS.
  • Data catalog and governance tools such as Microsoft Purview.
  • Microsoft certifications: DP-700, DP-600, or PL-300.
  • Experience replacing spreadsheet and desktop database workarounds with governed integrations at a mid-size company.

Similar Jobs