Data Integration

Data Integration Developer Jobs

657 jobs found

Today

Pega Developer

Agile Defense Arlington, VA

Arlington, VA

Today

Full time Agile Methodologies Data Architecture Data Integration

Apply Now

Job Description

Pega Developer role focused on leading the modernization of the Grants Management application for AFOSR in Arlington, VA (onsite).

Responsibilities

Spearhead the modernization and ongoing development of the Grants Management system using the Pega platform.
Translate mission requirements into robust technical solutions aligned with system architecture.
Ensure seamless integration with modern front end technologies and complex data architectures.
Collaborate effectively within an Agile Scrum team to drive iterative delivery.

Requirements

Certified Scrum Master (CSM) and Pega Certified Senior Systems Architect (CSSA).
Eligibility to obtain and maintain a Public Trust with BGI; US citizenship required.
Hands-on experience with Pega 24.1 (or later).
Experience working in an Agile Scrum environment.
Minimum 2 years of relevant experience as a Pega developer or in related roles.

Technologies

Pega 24.1 (or later)
HTML
CSS
JavaScript
JSON
XML
Jenkins
Tracer
Clipboard
Live UI
Log Viewer
SharePoint
Agility (or equivalent)
Pega Developer Studio
Pega Admin Studio

Working conditions

Sedentary work with a maximum lifting requirement of 10 pounds; occasional lift/carry of small articles.
Occasional walking or standing may be required.

Our core values

Happy — Be Infectious
Helpful — Be Supportive
Honest — Be Trustworthy
Humble — Be Grounded
Hungry — Be Eager
Hustle — Be Driven

Equal Opportunity

We may use artificial intelligence tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

View full job page →

Today

Senior Data Engineer

Brooksource New York, NY 🇺🇸 Remote

New York, NY

Today

$65 - $85/hr Full time Senior Analytics API

Apply Now

Job Description

Brooksource invites applications for a Senior Data Engineer tasked with designing, building, and maintaining scalable data pipelines and architectures that empower advanced analytics and business intelligence through big data technologies, cloud platforms, and robust data modeling.

Responsibilities

Design, develop, and optimize large scale ETL pipelines using Informatica, Talend, Apache Spark, and Apache Hive
Construct and sustain data architectures on cloud platforms such as AWS, Azure Data Lake, and other public cloud environments
Collaborate with cross functional teams to capture requirements and translate them into scalable data solutions
Create data models employing dimensional modeling techniques for data warehousing and analytics
Oversee data integration processes involving linked data, RESTful APIs, and other external sources
Ensure data quality, security, and compliance throughout the data lifecycle
Facilitate the deployment of machine learning models through integrated data pipelines
Utilize SQL, Python, Java, Bash scripting, and Shell scripting to automate and enhance processes
Participate in Agile development cycles through sprint planning, reviews, and continuous improvement efforts
Document data workflows and architecture diagrams to promote transparency and knowledge sharing

Requirements

Proven experience as a Data Engineer or similar role focusing on big data systems and cloud-based architectures
Extensive knowledge of AWS services (S3, Redshift, Glue), Azure Data Lake, the Hadoop ecosystem, and other public cloud offerings
Strong proficiency with SQL databases including Microsoft SQL Server, Oracle, and cloud-based options
Hands-on ETL/ELT development experience using Informatica or Talend
Demonstrated expertise in data modeling, including dimensional modeling for enterprise data warehouses
Skilled in Python, Java, VBA, Bash scripting, and Shell scripting for automation tasks
Familiarity with business intelligence tools such as Looker or equivalent platforms for reporting and analysis
Understanding of RESTful API integration for linked data access
Knowledge of analysis skills related to database design, query management, model training, and analytics methodologies
Experience delivering value in Agile environments with iterative development

Technologies

Informatica
Talend
Apache Spark
Apache Hive
AWS
Azure Data Lake
Hadoop
S3
Redshift
Glue
Microsoft SQL Server
Oracle
SQL
Python
Java
VBA
Bash scripting
Shell Scripting
Looker
RESTful API

Compensation

Hourly rate: USD 65.00 - 85.00 per hour

Work Location

New York, NY, with remote work option

View full job page →

Today

Senior Data Engineer - Technology

Neptune Technology Group Inc. Duluth, GA

Duluth, GA

Today

Full time Senior Amazon Web Services AWS

Apply Now

Job Description

Neptune Technology Group Inc offers a path to own and modernize data pipelines by migrating ETL workloads from Redshift stored procedures and legacy SSIS to scalable, cloud-native architectures using AWS Glue and S3. You will drive toward near real-time analytics with stream processing technologies such as Apache Flink and ClickHouse, shaping data models that enable robust reporting, AI, and customer-facing features. This is a role for hands-on leadership, collaboration with product and analytics teams, and the opportunity to set standards that others follow.

This is an onsite role based in Duluth, GA, with the possibility of being based in Tallassee, AL. Up to 20% travel to manufacturing or customer locations may be required when necessary.

Responsibilities

Create and evolve modern ETL and ELT pipelines using AWS Glue and S3 to replace legacy stored procedures and SSIS workloads
Design transformation workflows that are testable, version-controlled, and observable with appropriate monitoring
Optimize and maintain the Redshift data warehouse, focusing on materialized views, query performance, and cost efficiency
Lead the shift from batch ETL to near real-time streaming, evaluating and implementing platforms such as Apache Flink, ClickHouse, Kafka, or Kinesis
Build pipelines that support both near real-time and batch workloads during the platform transition
Collaborate with product and analytics teams to ensure data models support reporting, AI/ML, and customer-facing features
Establish scalable patterns and best practices for pipeline development across the team
Contribute to production support and incident response for data infrastructure

Requirements

Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field, with at least 5 years of data engineering experience
Extensive hands-on experience with AWS Glue (PySpark/Python), S3, and Redshift
Proven track record migrating ETL workloads from legacy tools such as SSIS and stored procedures to modern cloud-native pipelines
Strong SQL skills with best practices and linting, particularly in Redshift or other columnar/MPP databases
Experience with or strong interest in stream processing frameworks such as Flink, Spark Streaming, or Kafka Streams
Familiarity with data pipeline orchestration, monitoring, and robust error-handling patterns
Experience with infrastructure as code and CI/CD for data pipelines

Technologies

Python, PySpark, SQL
AWS Glue, S3, Redshift
SSIS, Apache Flink, ClickHouse
Kafka, Kinesis, Apache Spark Streaming, Kafka Streams
Aurora MySQL, DynamoDB, Apache Druid, dbt
Airflow, Step Functions, MQTT

View full job page →

Today

SmartComm Thunderhead developer

Laiba Techonology LLC Lansing, MI

Lansing, MI

Today

$60 - $65/hr Full time Senior Crm Integration Data Integration

Apply Now

Job Description

Onsite opportunity in Lansing, MI with Laiba Technology LLC. This role focuses on CCM using SmartComm Thunderhead, requiring 7 to 12 years of experience. You will lead offshore development efforts, drive template and data integration with Guidewire or Salesforce, and help ensure accurate, compliant customer communications. The position offers a competitive hourly rate of $60 to $65 and a collaborative environment dedicated to delivering quality BFSI communications.

What you get

Onsite work in Lansing, Michigan
Competitive pay: $60.00 to $65.00 per hour
Opportunity to lead offshore development teams
Hands-on use of SmartComm Thunderhead for CCM
Ability to integrate templates and data with Guidewire or Salesforce via APIs

Responsibilities

Lead offshore developers, monitor code quality, and assign tasks
Create reusable digital forms and letters using Advanced Template Designer
Connect form fields to data with formats such as XML, JSON, and XPath
Link SmartComm with larger systems like Guidewire or Salesforce via APIs
Test templates to ensure customer letters, policies, and bills are accurate and compliant

Requirements

Customer Communications Management (CCM) experience using SmartComm Thunderhead
7 to 12 years in CCM with SmartComm (Thunderhead)
JavaScript
XML
XSLT
REST and SOAP APIs
Data Modeler
Draft Editor
Review Now
Background in Banking, Financial Services, or Insurance (BFSI) is highly preferred
Location: Lansing, MI onsite
Hands-on knowledge of SmartComm modules such as Data Modeler, Draft Editor, and Review Now
Experience with Guidewire and Salesforce integrations
Familiarity with Advanced Template Designer

View full job page →

Today

Senior Salesforce Developer

ThrasherGroup Omaha, NE

Omaha, NE

Today

$95k - $130k/yr Full time Senior Crm Integration Customer Relationship Management (CRM)

Apply Now

Job Description

The Senior Salesforce Developer at ThrasherGroup focuses on modernizing and sustaining the Salesforce platform, serving as the primary in-house developer and collaborating with an internal Salesforce Administrator and SI partners to deliver scalable solutions and integrations. This onsite role is based in Omaha, Nebraska, with a salary range of USD 95,000 to 130,000 per year.

Responsibilities

Architect and maintain scalable Salesforce implementations across Apex, Lightning Web Components, and Flow, owning Field Service Lightning end-to-end from scheduling policies and dispatch workflows to configuring the mobile app and service appointments.
Simplify and strengthen the platform by removing complexity, consolidating redundant automations, and reducing technical debt without disrupting live operations.
Develop and manage integrations between Salesforce and third-party tools, creating automations that reduce manual tasks, improve data quality, and keep field operations running smoothly.
Define and uphold internal development standards by delivering clean, well-documented code and acting as the technical counterpart to SI partners, reviewing Deliverables and progressively reducing outside dependency.
Translate operational needs into working features by partnering with business stakeholders to convert real problems into well-architected solutions, and clearly communicating trade-offs to non-technical leaders.
Demonstrate high ownership by proactively surfacing risks, guiding prioritization decisions, and leaving the platform in a better state than it was found.

Requirements

5+ years of Salesforce development experience with deep proficiency in Apex, Flow (including complex nested and record-triggered flows), and Lightning Web Components (LWC). Required
Demonstrated Field Service Lightning expertise: scheduling policies, dispatch console, mobile app, work order management and service appointments. Required
Proven ability to simplify over-engineered solutions for efficiency and performance. Required
Experience with Omni-Channel routing, Enhanced Messaging/SMS infrastructure, and Salesforce automation tooling. Required
Ability to execute from an architect's blueprint independently, flagging problems intelligently without constant oversight. Required
Strong written and verbal communication skills, with the ability to explain technical trade-offs to a non-technical audience. Required

Technologies

Apex
Lightning Web Components (LWC)
Flow
Field Service Lightning
Omni-Channel
Salesforce

Benefits

Medical insurance
Dental insurance
Flex spending
HSA
Vision insurance
Life insurance
401(K) Retirement Savings up to a 5% match
Employer paid life insurance in the amount of $50,000
Company-led community volunteer opportunities
Career growth and development

Compensation Package

Base salary starting at $95,000, commensurate with experience. The overall salary range for this role is USD 95,000 to 130,000 per year.

View full job page →

Today

Data Engineer - Telemetry & Analytics Pipeline

Entarian Denver, CO

Denver, CO

Today

$105k - $130k/yr Full time Amazon Web Services Analytics Arm/bicep

Apply Now

Job Description

Entarian is seeking a Data Engineer to design, build, and maintain telemetry and analytics pipelines that collect, process, and deliver data for analytics, monitoring, and security decision-making. The role ensures high-quality, real-time data flow across cloud and on-prem environments to support operational insights within a Zero Trust framework. Located in Denver, CO, this onsite position offers a competitive salary and the chance to contribute to mission-critical data infrastructure.

Overview

Location: Denver, CO (onsite)
Salary: USD 105,000 - 130,000 per year
Minimum experience: 5 years
Education: Bachelor’s degree in information technology, computer science, engineering, or related technical discipline
Contract status: Position is contingent upon contract award and funding

Responsibilities

Architect and deploy scalable telemetry ingestion pipelines that span cloud environments, endpoints, networks, and applications
Develop both real-time streaming and batch processing workflows using modern data engineering tools
Create data models, schemas, and metadata structures to support analytics, dashboards, and machine learning
Improve pipeline performance, reliability, observability, and data quality
Ingest telemetry from identity systems, logging platforms, monitoring tools, and security technologies
Automate ETL or ELT processes, data normalization, and event enrichment
Collaborate with analytics, cloud, security, and platform engineering teams to define data requirements
Maintain governance, retention, compliance, and secure handling of data across pipelines
Troubleshoot ingestion issues, latency, schema drift, and data integrity concerns
Document pipeline architecture, data flow diagrams, and operational procedures

Requirements

Active Secret security clearance
Bachelor’s degree in information technology, computer science, engineering, or related discipline (equivalent experience considered)
Minimum five years of experience with modern data engineering platforms (Azure Data Factory, AWS Glue, Databricks, Kafka, Spark, Flink, etc.)
Strong ability to build data ingestion and streaming pipelines
Proficiency in Python, SQL, or similar languages
Knowledge of data modeling, ETL/ELT patterns, and distributed systems
Familiarity with telemetry sources (logs, metrics, events) and common security/monitoring tools
Experience with cloud storage (S3, ADLS, GCS) and data warehouses or lakehouses
Understanding of data governance, lineage, and quality frameworks
Strong technical communication skills
Proficiency with Microsoft Office Suite (Word, PowerPoint, Excel, Project, Outlook)
Ability to travel approximately 25% to support customer locations, mission partner engagements, and operational activities

Technologies

Azure Data Factory
AWS Glue
Databricks
Kafka
Spark
Flink
Python
SQL
S3
ADLS
GCS
Elastic
Splunk
Azure Monitor
Grafana
OpenTelemetry
Terraform
ARM/Bicep

Join the Mission and Start Your Career Journey

Apply directly via our Careers Portal. For referrals or inquiries, please email the team at careers@entarian.com.

About Us

Entarian is formed through the strategic union of Sev1Tech and ERT, a premier provider of mission-critical engineering and technology solutions. Founded on a legacy dating back to 1993, Entarian is a product of an evolved and fully diversified engineering and federal technology leader. From deep space to defense and civilian missions, Entarian delivers secure, mission-aligned digital solutions that drive national resilience and operational effectiveness.

View full job page →

Today

Lead Data Engineer / Data Architect

Glint Tech Solutions LLC Charlotte, NC

Charlotte, NC

Today

Full time Azure Data Factory Azure Data Lake Storage Azure Synapse Analytics

Apply Now

Job Description

The Lead Data Engineer / Data Architect role guides the enterprise data strategy and scalable platform design for a major US retail eCommerce modernization project. This onsite position is based in Charlotte, North Carolina, and focuses on architecture across re-architecture initiatives, database migrations, and cloud-native microservices migration to unify and modernize data platforms.

Responsibilities

Architect and own the enterprise data architecture to support high-volume retail eCommerce operations.
Develop and maintain ETL and ELT pipelines using Azure Data Factory, Azure Synapse Analytics, and Databricks with pySpark.
Design conceptual, logical, and physical data models to optimize storage efficiency and data retrieval.
Implement data warehousing approaches including dimensional modeling, star schemas, Data Mesh, Delta Lakehouse, and Data Vault.
Lead database migrations and the migration of microservices to unified cloud-native solutions.
Integrate data from databases, APIs, and external providers via API integrations and message queuing.
Embed metadata management and governance processes within cloud-based data platforms.
Guide and mentor cross-functional engineering teams while shaping technical strategy and stakeholder communications.

Requirements

8+ years of overall experience, including 1+ year in an Architect-level role.
3+ years of hands-on experience with Azure Data Factory and Azure Synapse Analytics.
Deep Microsoft Azure expertise across Data Lake Storage, Databricks, pySpark, Cosmos DB, and PostgreSQL.
Strong SQL proficiency for complex queries, transformations, and cloud performance tuning.
Experience with Azure MI, Cosmos DB, Analysis Services, and Informix.
Proficiency in Python and Python-based ETL tooling.
Shell scripting experience — Bash, Unix, or Windows.
Proven ability to lead teams, define technical strategy, and communicate across all organizational levels.

Technologies

Azure Data Factory
Azure Synapse Analytics
Databricks
pySpark
Data Lake Storage
Cosmos DB
PostgreSQL
SQL
Python
Bash
Unix
Windows
Azure MI
Analysis Services
Informix
Elasticsearch
Docker
Kubernetes
Delta Lake
Delta Lakehouse
Data Mesh
Data Vault

Nice-to-have Skills

Elasticsearch experience
Docker and Kubernetes familiarity
Performance tuning and pipeline optimization expertise
Azure, Databricks, or related cloud certifications

Company Overview

Glint Tech Solutions is a women-owned global staffing and IT recruiting firm connecting top technical talent with leading enterprise clients across the United States and Canada.