Senior Data Engineer
Job Description
Rex Moore Group, Inc. is building and scaling an enterprise data platform that supports reporting, workflow automation, and AI. In this hybrid role in Sacramento, you will act as the internal owner of the organization’s Microsoft Fabric Data Lakehouse platform on OneLake, leading the design, build, operation, and evolution of pipelines, models, and the semantic layer.
You will ensure the platform is reliable and governed end to end, from onboarding new sources and maintaining medallion architecture to delivering governed data products for analytics and Microsoft Foundry AI use cases.
What you’ll do
- Own the ongoing design and operation of the Microsoft Fabric Data Lakehouse, including OneLake storage, Lakehouse items, and Fabric workspaces across development, test, and production environments.
- Build and maintain the medallion architecture (bronze, silver, gold) to land raw data, refine it, and publish it for enterprise consumption.
- Manage deployment automation and environment promotion using Fabric deployment pipelines and Azure DevOps source control.
- Monitor platform health, pipeline reliability, data freshness, and refresh performance against defined service levels.
- Maintain Fabric capacity performance and evaluate capacity sizing based on actual workload rather than default scale-up.
- Administer the on-premises data gateway and hybrid connectivity to on-premises source systems.
- Design and periodically test backup, recovery, and disaster recovery for platform data and configurations.
- Design, build, and operate ingestion and transformation using Fabric Data Factory, Dataflows, notebooks, and Spark.
- Integrate enterprise source systems through supported APIs, vendor connectors, database replication, or secure file transfer, using repeatable patterns.
- Build and maintain integrations with OAuth-secured vendor APIs, including authentication, rate limits, pagination, and incremental extraction.
- Ingest and model semi-structured and document-derived data (document metadata, OCR-extracted fields, drawing markups, and model coordination issues).
- Develop incremental load, change data capture, and historical retention strategies tailored to each source system.
- Implement data quality validation and reconciliation across finance, job cost, and project data.
- Onboard new source systems as the Rex Moore application portfolio evolves.
- Develop and maintain dimensional models and conformed enterprise dimensions in the gold layer (Company, Project, Period, Cost Code, Vendor, Employee).
- Build and tune Direct Lake semantic models for financial reporting and project/job cost reporting.
- Implement and test row-level and object-level security in semantic models, including project-scoped access for project and field roles.
- Manage release and change control for shared models and conformed dimensions so changes are tested, communicated, and applied consistently.
- Standardize enterprise business logic, KPIs, and measures in the semantic layer so calculations are defined once across Power BI reports.
- Partner with business SMEs to define reporting requirements, identify authoritative data sources, and resolve data conflicts.
- Support month-end close data readiness and reconciliation, monitor report usage and adoption, and work with report champions to deliver measurable value.
- Support self-service analytics and Power BI Copilot natural-language Q&A readiness via model metadata and synonym preparation.
- Prepare governed, certified gold-layer data for Microsoft Foundry AI use cases, including AI Search indexing and retrieval patterns.
- Implement and maintain governance and discovery in Microsoft Purview: data cataloging, lineage, business glossary, ownership, sensitivity labeling, data quality rules, and data loss prevention.
- Design and enforce role-based access aligned with Microsoft Entra identity and least-privilege principles.
- Manage service identities, managed identities, and secure credential and secrets handling for integrations.
- Support data classification and controlled access to sensitive financial, project, and workforce information.
- Partner with business data owners and stewards to certify data products and maintain stewardship over time.
- Maintain platform documentation, architecture diagrams, source-to-target mappings, data dictionary, and operational runbooks.
- Complete knowledge transfer from the implementation partner, validate delivered work against acceptance criteria, and take ownership of documentation, runbooks, and open items.
- Establish engineering standards, naming conventions, and repeatable development practices.
- Serve as the internal technical authority for the Data Lakehouse platform after consultant transition.
- Mentor future data team members and direct contractor and vendor work on the platform.
- Track and forecast recurring platform cost across Fabric capacity, storage, compute, and data movement.
- Identify opportunities to simplify, consolidate, or improve existing pipelines and models.
- Stay current on Microsoft Fabric and Azure data platform capabilities and evaluate applicability to the Rex Moore environment.
- Participate in training and self-development to improve technical and business acumen.
Requirements
- 7+ years of experience in data engineering, business intelligence engineering, or enterprise data platform roles.
- Production experience with Microsoft Fabric, Azure Synapse, Databricks, or a comparable cloud lakehouse platform, including layered or medallion architecture.
- Advanced SQL and hands-on experience with cloud data platforms and distributed processing.
- Dimensional modeling experience (Kimball or similar) with demonstrated ownership of a production data model.
- Power BI development including DAX, semantic model design, and report performance tuning.
- Proficiency with Python and/or PySpark for data transformation.
- Experience integrating ERP data and building API-based ingestion against authenticated REST endpoints.
- Working knowledge of source control, CI/CD practices, and deployment automation for data workloads.
- Understanding of enterprise identity and access management, data classification, and secure handling of sensitive data.
- Bachelor’s degree in Information Technology, Computer Science, Data Engineering, or a related field, or equivalent work experience.
- Strong analytical and problem-solving skills, including tracing a data issue from report back to source.
- Strong documentation discipline, including diagrams, runbooks, and technical specifications.
- Excellent verbal and written communication skills.
- Ability to translate business questions into data requirements and explain technical constraints in business terms.
- Ability to collaborate effectively with IT staff, business SMEs, executives, and external vendors.
- Ability to operate independently and own a production platform end to end.
- Commitment to data accuracy and reconciliation to source.
- Ability to prioritize competing demands in a fast-paced environment.
- Ability to establish standards and repeatable patterns rather than solving each problem uniquely.
- Interest in growing the Rex Moore data engineering capability over time.
- Ability to verbally communicate detailed and accurate instructions and information, and to hear with or without correction in order to receive and interpret detailed information.
- Workstation requirements include long periods of desk work.
- Physical requirements include pushing, pulling, lifting, and carrying at least 10 pounds, with occasional lifting or moving up to 35 pounds; occasional walking and standing; visual acuity with or without correction; ability to use fingers and hands to type and operate a keyboard; and occasional stooping, kneeling, and crouching.
Technologies
- Microsoft Fabric, OneLake
- Azure DevOps
- Fabric Data Factory, Dataflows, notebooks, Spark
- OAuth, REST
- Direct Lake
- Power BI, DAX
- Microsoft Foundry, AI Search
- Microsoft Purview
- Microsoft Entra
- Kimball
- Python, PySpark
- Azure Synapse, Databricks
Benefits
- Health Benefits
- 401(k) with Company Match
- Life and Disability Benefits
- Paid Holidays & Paid time off
- Access to multiple types of training
- Opportunities for Self-development and Career Progression
- Wellness Benefits & Employee Assistance Program
- Family Leave (Maternity, Paternity)
- Tuition Reimbursement Program
Preferred knowledge
- Platform: Direct Microsoft Fabric and OneLake production experience, including Direct Lake semantic models; Microsoft Purview (or comparable governance tooling); experience as the first or primary data engineer establishing the function; relevant Microsoft certifications (DP-600, DP-700, AZ-305, AI-102); exposure to Microsoft Foundry, Azure AI Search, or retrieval-augmented generation (RAG) data patterns.
- Construction / AEC industry: experience supporting data, reporting, or systems within construction, engineering, architecture, specialty trade contracting, or another AEC or project-based industry; familiarity with construction financial and operational concepts including job cost, WBS, cost codes and cost types, committed cost, change orders, percent-complete revenue recognition, WIP reporting, and retention; understanding how estimating, project management, field operations, procurement, and accounting data relate across systems; exposure to AEC platforms such as Autodesk Construction Cloud (Build or Forma), Trimble Accubid, Bluebeam, and Revizto (or comparable tools); integration experience with platforms such as Paycom, Expensify, or Hilti ON!Track (or comparable); familiarity with construction workforce and field data including labor hours, crew and unit productivity, timekeeping, payroll integration, equipment and tool tracking, and prefabrication; awareness of data considerations in document-heavy environments including drawings, submittals, RFIs, and contract documents; understanding reporting needs of project managers, field leadership, finance, and executives.
Work environment
- Hybrid position with a combination of in-office and remote work.
- Fully remote arrangements may be considered for candidates with demonstrated success working remotely and driving initiatives independently.
- May be required to travel to other office locations.
Reporting structure
- Reports to: Information Technology Director
- Department: Information Technology Department
Location: Sacramento, CA (hybrid)
Salary: USD 123,350 - 204,150 per year
Experience: 7+ years
Education: Bachelor’s degree in Information Technology, Computer Science, Data Engineering, or a related field, or equivalent work experience