Data Engineer

Data Engineer Developer Jobs

678 jobs found

1d ago

Data Engineer

ComputerPeople Staffing Buffalo, NY

Buffalo, NY

1d ago

$100k - $135k/yr Full time Backend Developer Analytics Big Data

Apply Now

Job Description

ComputerPeople Staffing is hiring a Senior Data Engineer (Direct Hire) for a hybrid role in Buffalo, NY. This is an opportunity to build a centralized enterprise data platform from scratch during a transformation to Oracle Cloud Fusion, taking ownership of Oracle Fusion Data Intelligence (OFDI) and delivering data foundations that support analytics-ready reporting.

You’ll shape end-to-end data architecture, integration patterns, and ETL/ELT pipelines across multiple enterprise systems, with the platform serving as an analytics hub for teams consuming data through Power BI and Oracle Analytics Cloud.

Responsibilities

Act as the primary technical owner of Oracle Fusion Data Intelligence (OFDI), standing up, configuring, and evolving it as the enterprise analytics hub.
Independently design the enterprise data architecture, including data modeling, repository structure, and segmentation strategy across disparate sources such as SAP, on-prem Oracle, SQL Server, and GIS.
Design and build scalable ETL/ELT pipelines to ingest data from multiple systems into a centralized data warehouse.
Develop and maintain integrations using Oracle Integration Cloud (OIC) as enterprise middleware.
Lead the move away from legacy flat file integrations toward API-based, event-driven data flows.
Implement data quality checks, reconciliation, and monitoring to support auditability and regulatory compliance.
Curate trusted, analytics-ready datasets for downstream BI tools, including Power BI and Oracle Analytics Cloud.
Build and maintain semantic data models and data mappings to enable self-service reporting and enterprise analytics initiatives.
Collaborate with application and business teams to define data requirements across operational, financial, regulatory, and customer domains.
Establish data governance frameworks, data lineage documentation, and data quality standards from the ground up.
Document data flows, technical designs, and integration specifications for long-term maintainability.
Partner with enterprise architecture and application teams to align solutions with enterprise standards.
Evaluate and recommend supplemental data tools (for example, Microsoft Fabric) with meaningful input into tooling decisions.
Operate with high autonomy in a self-directed capacity; minimal technical oversight exists above this role, and there is currently no internal mentor for this specific skill set.
Identify gaps in the team’s future capability needs and contribute to hiring decisions as the function grows.

Requirements

Demonstrated experience independently designing and building ETL/ELT pipelines and data architecture for enterprise environments, including relational and cloud-based work, not only executing an existing design.
7+ years of professional experience in data engineering, data integration, or analytics engineering roles.
Strong SQL skills and hands-on experience with relational database platforms such as Oracle, SQL Server, or similar.
Experience pulling from multiple disparate systems (ERP, CRM, CIS, asset management, or similar) into a unified data model.
Scripting proficiency in Python, PowerShell, or similar to support pipeline automation.
Familiarity with cloud-based enterprise platforms and hybrid on-prem/cloud architectures.
Strong instincts for data quality, auditability, and governance.
Knowledge of enterprise integration and data architecture design patterns.
Bachelor’s degree in Computer Science, Information Systems, Engineering, or related field.

Technology

Oracle Fusion Data Intelligence (OFDI), Oracle Cloud Fusion, Oracle Integration Cloud (OIC), Power BI, Oracle Analytics Cloud, Microsoft Fabric, SAP, SQL Server, Oracle, GIS, ETL, ELT, Python, PowerShell, API-based, event-driven data flows, Informatica, Boomi, SSIS, Talend, MuleSoft

Benefits

Annual Bonus Program
Low cost medical and dental premiums
Very generous Paid Time Off
401K match plus an additional Company Funded Retirement Savings Account, even if you do not contribute to 401K
Leadership training program
Management dedicated to career success, with flexibility when life happens
Positive, collaborative work culture
Health insurance
Health savings account
Life insurance
Vision insurance
Flexible schedule
Retirement plan
Dental insurance
Paid time off
401(k) matching

Salary: USD 100,000 - 135,000 per year.
Experience: 7+ years required.
Location: Buffalo, NY 14221 (Required).
Work model: Hybrid.

View full job page →

1d ago

Senior Data Engineer

Suncoast Credit Union Tampa, FL 📍 Florida Remote

Tampa, FL

1d ago

$86k - $115k/yr Full time Senior Azure Data Factory Azure Data Platform

Apply Now

Job Description

Suncoast Credit Union seeks a Senior Data Engineer to design, evaluate, and test data infrastructure that turns raw inputs into usable information. This role supports ETL pipelines, data modeling and governance, analytics, and natural language processing capabilities, with close collaboration across business teams.

Key Responsibilities

Build systems and infrastructures to collect and process data aligned to company goals.
Build, evolve, and scale infrastructure to ingest, process, and extract meaning from data.
Design, develop, and implement statistical models for classification and information extraction.
Use existing data infrastructure to fulfill data requests, including data housekeeping, cleansing, normalization, hashing, and implementation of required data model changes.
Analyze data to identify anomalies, trends, and correlations across related datasets.
Design, develop, and implement natural language processing software modules.
Troubleshoot data platform and pipeline issues, identify potential solutions, and resolve accordingly.
Partner with business counterparts to define requirements for provisioned data and update defined requirement document templates.
Work with the manager to translate business requirements into schema and data model decisions.
Ensure design efficiency to minimize data refresh lag between systems so reporting stays timely.
Deploy data architectures based on manager-established standards that support Suncoast’s data strategy and information architecture needs.
Follow measurable processes, tools, and engineered data management solutions supporting data platforms such as data warehouse, data lakes, visualization tools, master data management, and advanced analytics tools.
Design and develop ETL processes to extract data from multiple source systems, transform it into a usable format, and load it into data platforms.
Establish data governance and quality best practices and standard operating procedures.
Utilize Azure Data Factory to create pipelines for creating, moving, and transforming data across the data stack.
Architect advanced data solutions for current and future data processes.
Provide mentorship to teammates and offer advisory support.
Maintain knowledge of current trends, laws, and issues affecting the area of expertise.
Attend educational events to support professional development.
Complete annual compliance and information security training to understand employee responsibilities for effective compliance and security programs.

Required Qualifications

Bachelor’s degree in finance, economics, computer science, mathematics, or a related field (a comparable combination of work experience and training may substitute).
7+ years of experience making data usable to end users in a complex data environment.
7+ years of experience with Microsoft SQL Server platforms, including SSRS, SSAS, stored procedure creation, trigger definition and implementation, optimization and indexing, and foundational knowledge of views, tables, database DDL, and SQL Server Integration Services (SSIS).
Experience using Development Transact SQL.
Microsoft Azure experience (5 years): portal and resource navigation.
Azure Data Factory experience (5 years): developing pipelines, pipeline activities, troubleshooting, and related tasks.
Experience with REST API.
Experience with GitHub for creating, updating, and submitting code.
Agile methodology experience (1 year), including Kanban and limiting work in progress.
Experience developing ETL processes.
Experience with Delta Lakes and Lakehouse Architecture.
2+ years of experience designing data structures for a production environment.
Ability to prioritize tasks amid competing and changing priorities to meet deadlines.
Accurate, detail-oriented, and organized with task management.
Ability to analyze and resolve difficult and often complex problems.
Strong written, verbal, and interpersonal communication skills for working with members, staff, vendors, and government regulators.
Strong knowledge and understanding of credit union products, services, policies, and procedures.
Strong knowledge and understanding of regulatory compliance.
Strong knowledge and understanding of credit union computer systems and required software applications.

Technologies

Microsoft SQL Server, SSRS, SSAS
Stored Procedure Creation
Trigger definition and implementation
SQL Server Integration Services (SSIS)
Development Transact SQL
Microsoft Azure
Azure Data Factory
REST API
GitHub
Agile Methodology and Kanban
Delta Lakes
Lakehouse Architecture

Compensation and Employment Details

Salary Range: USD 86,000 - 115,000 per year (based on credentials and experience).

Position Type: Full Time

Location: Remote (candidate must reside in Florida)

Benefits

Bonus Program up to 12%
401K Matching up to 8%
Retirement Planning
Pay Increases based on Competency
Employee Loan Discounts
Flex Spending Accounts
Medical Coverage
Dental and Vision Coverage
Access to 4,000+ Gyms
Mental Health Resources
PTO Wellness Days
Short Term and Long Term Disability Coverage
11 Paid Holidays
3 weeks of Paid Time Off
4 weeks of Paid Parental Leave
Birthday PTO
Paid Volunteer Hours
Degree Assistance up to $5,000 per year

For more information, including additional benefits, visit the benefits website: https://careers.suncoastcreditunion.com/benefits.

Company Overview

Suncoast Credit Union is consistently chosen as a Tampa Bay Times Top Workplace due to an inclusive culture focused on growth and community. For more information, visit the careers site: https://careers.suncoastcreditunion.com/.

View full job page →

1d ago

Data Engineer

UST Austin, TX

Austin, TX

1d ago

$72k - $108k/yr Full time Data Engineer Data Engineering ETL

Apply Now

Job Description

UST is hiring a Data Engineer to support project/program execution with documentation, cross-functional coordination, and stakeholder communication.

Responsibilities

Collaborate with other staff to maximize productivity for the project or program.
Document phases of project/program/process development and ensure required information is reported, disseminated, or transferred to relevant functional areas.
Lead regular program reviews, readiness assessments, and risk management discussions.
Provide stakeholder updates across organizational levels, including program status, risks, mitigation plans, and executive-level reporting.
Engage with driving BOM uploads and CP request workflows.
Launch the schedule CRF (change request form) and update PUSH/DROP when applicable.
Manage and track system ship dates and update the system push payout tracker accordingly.
Close CRFs when project managers are the last approvers.
Issue delivery notes for completed projects.
Complete paperwork refreshes for systems in FGI that are approaching their ship date.
Establish and coordinate cross-functional teams with Manufacturing Engineering, Supply Chain, Test Engineering, Quality, Product Engineering, Operations, and Program Management.

Requirements

Bachelor’s degree (preferred).
Years of experience: 0-4.
Project management (required).
Administrator/project management (desired).
Microsoft Office skills (required).
Data Analytics (desired).
Excellent written and verbal communication (required).

Technologies

PySpark
Streaming
Scala
ETL

Role location

Austin, Texas
Onsite

Compensation range

USD 72,000 - 108,000 per year

Benefits

Full-time, regular employees accrue a minimum of 10 days paid vacation per year.
Full-time, regular employees receive 6 days paid sick leave each year (pro-rated for new hires throughout the year).
10 paid holidays.
Eligible for paid bereavement leave and jury duty.
401(k) Retirement Plan eligibility with employer matching.
Medical, dental, and vision insurance (US dependents eligible if residing in the US).
Company-paid Employee Only benefits: basic life insurance, accidental death and disability insurance, and short- and long-term disability benefits.
Eligible to purchase additional voluntary short-term disability benefits.
Eligible to participate in a Health Savings Account (HSA) and Flexible Spending Account (FSA) for healthcare, dependent child care, and/or commuting expenses (as allowable under IRS guidelines).
Full-time temporary employees: 6 days paid sick leave each year (pro-rated) and eligible for the 401(k) program with employer matching.
Part-time employees: 6 days paid sick leave each year (pro-rated) and eligible for the 401(k) Retirement Plan with employer matching.
Part-time temporary employees: 6 days paid sick leave each year (pro-rated).
US employees working in locations with more generous paid sick leave laws will receive benefits per applicable laws.

What you need

Bachelor’s degree (preferred).
Years of experience: 0-4.
Technical skills: Project management (required); Administrator/project management (desired).
Computer skills: Microsoft Office skills (required); Data Analytics (desired).
Soft skills: Excellent written and verbal communication skills (required).

What we believe

Humility, Humanity, and Integrity.
Culture shaped since day one.

View full job page →

1d ago

Data Engineer

Baker Group Ankeny, IA

Ankeny, IA

1d ago

Full time Azure Data Factory Azure Data Platform Azure Platform

Apply Now

Job Description

Baker Group is looking for a data engineer to design, build, and maintain the data pipelines and infrastructure that power analytics and AI use cases on Microsoft Fabric. In this role, you will help establish Baker Group’s data platform as a single source of truth, covering ingestion, transformation, orchestration, governance, and preparation for reporting and machine learning.

This onsite position is based in Ankeny, IA, and it’s ideal for someone with strong ETL/ELT and SQL experience who can own data quality and reliability across end-to-end workflows.

What you’ll do

Design, build, and maintain ETL/ELT pipelines that ingest data from enterprise systems into Microsoft Fabric.
Architect and maintain the Fabric medallion Lakehouse structure (bronze, silver, gold) as Baker Group’s single source of truth.
Develop best practices for the data infrastructure and environment, including Development/Test/Production setups and Git-based version control.
Own pipeline orchestration, scheduling, and monitoring to support reliable and timely data availability.
Curate and maintain core datasets across employee, finance, project, service, and manufacturing domains.
Establish and enforce data quality, validation, and reconciliation processes across pipelines.
Design and manage data models, schemas, and semantic layers for Data Analyst reporting and Data Scientist modeling.
Define and maintain data ontologies and canonical business definitions (for example, “project,” “employee,” or “cost code”) to ensure consistent meaning.
Prepare data for AI and machine learning use cases, including feature-ready datasets, retrieval-augmented generation (RAG) pipelines, and vector embedding storage.
Manage Fabric capacity planning, workspace organization, and performance optimization.
Implement data governance practices aligned with Baker Group’s data classification standards, including access controls, lineage tracking, and metadata management.
Partner with business system owners (ERP, HRIS, MRP, and others) to understand upstream structures and manage change impacts.
Collaborate with Data Scientists and Data Analysts to ensure pipeline outputs support modeling and paginated reporting, dashboards, and self-service BI.
Collaborate with Software Development and DevOps teams so data products support application development needs.
Coordinate with 3rd party consultants when necessary to deliver data engineering projects and extend capacity for demanding needs.
Develop and maintain documentation for pipelines, schemas, and integration logic.
Troubleshoot and resolve pipeline failures, latency issues, and data quality incidents.
Monitor and maintain data-specific infrastructure, including Fabric capacity, pipeline orchestration tools, and monitoring/alerting systems.
Evaluate and recommend new data engineering tools, patterns, and best practices.
Stay current on emerging trends in data engineering, cloud data platforms, and integration techniques.

Requirements

Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or another relevant quantitative field.
3+ years of experience in data engineering, ETL/ELT development, or a related field (listed range: three to five years).
Proficiency with SQL and database technologies for data extraction, transformation, and loading.
Experience with Microsoft Fabric, Azure Data Factory, or similar cloud ETL and orchestration tools.
Experience with medallion architecture and modern data warehousing patterns.
Experience using a programming language such as Python, PySpark, or T-SQL for transformation.
Familiarity with data modeling techniques including dimensional modeling and star schema.
Understanding of data governance, data quality, and metadata management practices.

Technologies

Microsoft Fabric
ETL, ELT
Azure Data Factory
Git
SQL
Python
PySpark
T-SQL
Medallion architecture
Dimensional modeling
Star schema
Retrieval-augmented generation (RAG)
Vector embedding storage

Additional notes

Experience preparing data for AI/ML consumption (vector embeddings, RAG architectures) is a plus.
Business acumen and understanding of construction or related industries is a plus.
No specific certificates required; relevant certifications such as Microsoft Certified: Fabric Data Engineer Associate, Azure Data Engineer Associate, or similar are a plus.
Must have strong analytical and troubleshooting skills, excellent time and project management skills, and strong communication for translating technical data structures to non-technical stakeholders.
Must be able to focus on complex technical problems independently with minimal supervision.
Environmental requirements include prolonged desk work; ability to lift 10 pounds occasionally; and occasional visits to a job site involving standing, walking, and/or climbing stairs.
Equipment includes a computer used for 8 hours a day.

View full job page →

1d ago

Data Engineer I

DHL Whiteland, IN

Whiteland, IN

1d ago

Full time Backend Developer Analytics Azure Data Factory

Apply Now

Job Description

Design and optimize data pipelines to keep information reliable, accessible, and aligned to business goals in an onsite role in Whiteland, IN.

Responsibilities

Improve data accessibility and usability for developers, architects, analysts, and data scientists
Maintain delivery consistency across initiatives by adhering to established data delivery architecture standards
Propose and implement data pipeline designs that optimize data flow for cross-functional teams
Design, build, and deploy data processes that support multiple systems and products
Develop and operate data workflows for modeling, mining, and production, including identifying new data acquisition and integration opportunities
Use multiple languages and tools to integrate systems and enhance data reliability, efficiency, and quality
Architect, build, and launch data models that strengthen analytics capabilities and support business objectives
Collaborate with cross-functional partners to ensure data work aligns with organizational goals and stakeholder needs

Requirements

Bachelor’s degree in Business, Logistics, Mathematics, Statistics, or a related field, or 4 years of equivalent professional experience, required
1+ years of experience in data engineering or a related technical role, required
Hands-on experience developing and managing data pipelines, required
Strong understanding of SQL and experience with database management systems such as MySQL, PostgreSQL, or SQL Server, required
Proficiency in Python, Java, or Scala, required
Familiarity with data warehousing solutions and working with large datasets, required
Knowledge of data modeling, ETL processes, and data warehousing concepts, particularly within Azure environments, required

Preferred Experience

Experience with Azure Data Factory, Azure Databricks, or Azure Synapse Analytics, preferred
Ability to work with Power BI for data visualization, preferred
Understanding of data governance and data quality principles, preferred

Technologies

SQL, MySQL, PostgreSQL, SQL Server
Python, Java, Scala
Data pipelines, data warehousing solutions, data modeling
ETL processes
Azure environments
Azure Data Factory, Azure Databricks, Azure Synapse Analytics
Power BI

Benefits

Competitive wages
Excellent insurance benefits (health, dental, vision, life)
401K plan
Paid vacation and holidays
Opportunities for career growth

View full job page →

1d ago

Data Engineer

National Alliance on Mental Illness Arlington, VA

Arlington, VA

1d ago

$95k - $105k/yr Full time Backend Developer Analytics Business Analytics

Apply Now

Job Description

National Alliance on Mental Illness (NAMI) is building a data platform that helps teams across the organization track program impact and make decisions based on reliable information. This role will focus on creating and operating the central data warehouse and ELT pipelines, then turning raw inputs into trusted, well-documented data products for national, state, and local stakeholders.

Based in Arlington, VA with hybrid options, the Data Engineer will help expand self-service access, reduce manual reporting, and strengthen the systems that keep data accurate from source to dashboard.

Role Focus

Build and operate NAMI’s central data warehouse and ELT pipelines from organizational sources such as micro-services, Salesforce, and an LMS.
Reduce manual reporting by enabling on-demand access for state organizations, local affiliates, and colleagues through curated datasets and self-service reporting that replace hand-built affiliate reports.
Own data quality by expanding automated testing, monitoring, and CI/CD as the platform grows, including end-to-end incident ownership from source to dashboard.
Establish the standards and review practices for NAMI’s data work as the team’s first dedicated data engineer.
Contribute to platform execution across ingestion, transformation, orchestration, and reporting.
Develop well-modeled transformations using analytics engineering best practices.
Deliver trusted, well-documented data products following established architectural patterns, and help improve them over time.

Requirements

3 to 5 years in data, analytics, or backend engineering.
Proficiency in SQL and Python.
Experience with version-controlled production ELT/ETL pipelines, including testing and monitoring.
Strong understanding of data modeling (including dimensional modeling and layered architecture).
Experience with a modern cloud data warehouse.
Ability to communicate technical concepts clearly to non-technical colleagues.

Tools and Technologies

SQL, Python, ELT, ETL
CI/CD
Salesforce, dbt, Fivetran, Airbyte, Dagster, Airflow
Power BI, Tableau, Metabase
LMS

Compensation and Work Setup

Salary: USD 95,000 to 105,000 per year.
Location: Arlington, VA (hybrid).
Minimum experience: 3 years.
Travel: 10 to 20%, including overnight.
Availability: must be available during standard business hours, with core hours between 10:00 a.m. and 3:00 p.m. ET.

Benefits

Generous and comprehensive Health, Dental, and Vision Plans.
Paid Time Off: Vacation, Personal, and Sick Leave.
Paid Parental Leave.
403(b) retirement plan.
Flexible Spending Accounts for health care, dependent care, and commuter expenses.
Life Insurance and Disability coverage paid by NAMI.
Flexible Work and Telework programs.
Professional Development Reimbursement program.
Wellness offerings to support team members.
Employee Referral Program.
Employee Assistance Program (EAP) for support with personal and family problems.

Physical Requirements

Prolonged periods of sitting at a desk and working on a computer.

Preferred Skills and Experience

Hands-on experience with a SQL transformation framework such as dbt.
Exposure to managed ingestion or orchestration tooling (for example, Fivetran, Airbyte, Dagster, Airflow).
Experience with a BI tool such as Power BI, Tableau, or Metabase.
Experience helping evaluate, adopt, or migrate to new data tooling.

View full job page →

1d ago

Data Engineer

Goodville Mutual Casualty Company New Holland, PA

New Holland, PA

1d ago

Full time Azure Data Engineer Data Integration

Apply Now

Job Description

Goodville Mutual Casualty Company is hiring a Data Engineer to improve data workflows, strengthen database performance, and build reliable ETL pipelines for business-aligned, scalable data infrastructure.

Responsibilities

Lead efforts to optimize data workflows
Enhance database performance
Develop robust ETL pipelines
Ensure data infrastructure is scalable, efficient, and aligned with business needs

Requirements

Three (3) days in office at 625 W Main St, New Holland, PA 17557
Two (2) days remote from home office approved by the HR team according to company remote policies
Ability to perform domestic, monthly travel to organization offices (including Pennsylvania, Ohio, and South Dakota) and vendor work sites
Bachelor’s degree in Computer Science, information Systems, or a related field
60 months of experience working in data engineering for a Property & Casualty insurance company
60 months of experience working as an ETL developer for a Property & Casualty insurance company
Use ETL/data integration tools and distributed data processing with programmatic database interaction, such as SSIS, PySpark/PySQL, or equivalent
Use cloud-based data orchestration, asynchronous messaging, and serverless computing to query and manipulate structured data and to perform ETL/data integration, using tools such as SQL, SSIS, ADF, Azure Service Bus, Azure Functions, or equivalent
Work with relational databases using tools such as SQL Server, DB2, Azure SQL, Fabric Lakehouse, and performance tuning techniques, or equivalent
Use system integration technologies (API technologies) such as REST, SOAP, XML, and JSON, along with scripting languages (for example Python and Shell) for automation and data manipulation required
Implement event-driven data flows, and support ETL pipeline design and development