Data Engineer
Backend Developer
Analytics
Azure Data Lake
Azure Data Platform
Azure Platform
Big Data
Business Intelligence
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Fabric
Data Integration
Data Integration Tools
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Data Warehouse Lead
Database
Databases
Digital Marketing
Engineer
ETL
Informatica
Integration
Microsoft Fabric
Reporting and Analytics
SQL
Job Description
Design and own a governed cloud data architecture that connects key business systems into a Microsoft Fabric/Azure lakehouse for reporting in Power BI and future AI needs.
Responsibilities
- Define and own the target data architecture within the first 90 days, then operate it end-to-end.
- Deliver a cloud lakehouse on Microsoft Fabric or Azure using OneLake or ADLS storage and Delta tables.
- Implement a medallion architecture with bronze, silver, and gold layers.
- Set up Fabric workspaces and environments for development, test, and production.
- Establish the security model, naming standards, and cost controls for the platform.
- Build and run ingestion from ERP and operational systems including IBM i / DB2, operations and project management systems, equipment telematics, HR and payroll, SQL Server applications, and other approved sources.
- Use change data capture or incremental loads when supported by the source systems.
- Create pipelines and notebooks to move and transform data across layers, including:
- Data Factory pipelines and dataflows for orchestration
- Spark notebooks using PySpark or Spark SQL
- Include scheduling, monitoring, alerting, and recovery capabilities in the data platform.
- Define an integration standard for system-to-system work:
- Patterns, tooling, error handling, retries, logging, and alerting
- API/webhook/file/database interface integration
- System integration processes that support reliable outcomes
- Write and tune production SQL transformations, views, stored procedures, and validation logic.
- Administer SQL Server application databases across performance, indexing, maintenance jobs, and access/schema changes.
- Design Power BI semantic models on the gold layer, including star schemas, DAX, Direct Lake or import modes, incremental refresh, and row level security by company and role.
- Publish certified datasets and support business-wide reporting needs through datasets authored by report authors.
- Operate the Power BI environment, including workspaces, gateway, deployment pipelines, capacity, and access.
- Coach finance and operations report authors and review their reports until they can publish independently.
- Implement automated data quality checks and reconciliations to source systems.
- Keep the data dictionary, lineage, and business definitions current with the data owners.
- Define master data rules for records shared across the three companies (jobs, equipment, employees, vendors, cost codes) with the responsible owners.
- Practice “data work as code” using source control, peer review, automated testing, and deployment.
- Manage Fabric capacity and platform cost, with monthly reporting.
- Prepare the data foundation for AI use cases with clean, governed, documented data and access controls.
- Support future ERP selection with data profiling and migration planning.
Requirements
- Advanced SQL with complex T-SQL, query tuning, stored procedures, indexing, and execution plans.
- SQL experience with DB2, ideally IBM i, or the ability to become productive within 90 days.
- SQL Server database administration including performance, indexing, maintenance, security, and access.
- Dimensional modeling including star schemas, normalization, and slowly changing dimensions.
- Ability to design and build a cloud lakehouse on Microsoft Fabric or Azure using OneLake or ADLS, Delta or Parquet, and medallion architecture.
- Capacity to defend the technical design to both an IT Director and a CFO.
- Experience building and operating pipelines and notebooks on the platform using:
- Data Factory pipelines/dataflows
- Spark notebooks (PySpark or Spark SQL)
- Orchestration tool such as Fabric, Azure Data Factory, Synapse, SSIS, or dbt
- Integration design experience with REST APIs, OAuth and API keys, JSON, webhooks, file/database interfaces, idempotent loads, and error handling.
- Power BI semantic model experience on a lakehouse using DAX, relationships, Direct Lake and import modes, incremental refresh, row level security, and performance tuning.
- Proficiency in at least one programming language for data work; Python or C# preferred.
- Experience with Git and automated deployment, plus a habit of testing, reconciling, and documenting data work.
- Data security fundamentals: least privilege, encryption, secrets management, and careful handling of payroll/personnel data.
- Ability to explain what data does and does not say to finance and operations leaders in plain language.
- 5+ years building and operating data pipelines, integrations, and models, with at least 3 in a Microsoft data environment.
- Bachelor’s degree in computer science, information systems, data engineering, or a related field, or equivalent experience.
Technologies
- Microsoft Fabric, Azure, OneLake, ADLS
- Delta tables, Delta, Parquet
- Data Factory, Spark notebooks, PySpark, Spark SQL
- Fabric, Azure Data Factory, Synapse, SSIS, dbt
- REST APIs, OAuth, API keys, JSON, webhooks
- SQL Server, T-SQL, DB2, IBM i
- Power BI, DAX, Direct Lake, incremental refresh, row level security
- Git, Python, C#
- HCSS, Samsara, BambooHR
Nice to Have
- Construction ERP data, especially eCMS on IBM i; Viewpoint, Sage, CMiC, or Procore also count.
- HCSS products (HeavyJob, HeavyBid, Equipment360, Dispatcher), BambooHR, and telematics/equipment data from Samsara or OEM feeds.
- Fabric capacity planning and cost management, or Azure equivalent.
- Real-time or event-based ingestion (Fabric Real-Time Intelligence, Event Hubs, or similar) for telematics and equipment data.
- Integration platforms such as Azure Logic Apps, Power Automate, or a commercial iPaaS.
- Data catalog and governance tools such as Microsoft Purview.
- Microsoft certifications: DP-700, DP-600, or PL-300.
- Experience replacing spreadsheet and desktop database workarounds with governed integrations at a mid-size company.