Data Engineering

Data Engineering Developer Jobs

315 jobs found

4d ago

Principal AI Software Developer

Leidos Egg Harbor Township, NJ

Egg Harbor Township, NJ

4d ago

$131k - $237k/yr Full time Backend Developer Agile Agile Methodologies

Apply Now

Job Description

Leidos is hiring a Principal AI Software Developer to support the Air Traffic Business Area within the Homeland Sector. This role helps build the Leidos Common Baseline by designing and delivering microservices-based, AI-enabled capabilities for highly regulated, safety-critical national air traffic operations. The position works in an Agile/SAFe environment and contributes to reliable software engineering outcomes through modern CI/CD and DevSecOps practices.

Responsibilities

Design, develop, and maintain microservices-based applications using modern software engineering best practices
Partner with product owners, architects, and engineers in an Agile/SAFe delivery model
Participate in sprint planning, daily standups, reviews, and retrospectives
Work with systems engineering and program teams to translate requirements into working software solutions
Build clean, maintainable, and testable code aligned with CI/CD and DevSecOps practices
Contribute to system design discussions and technical decision-making
Integrate services with databases, messaging systems, and external APIs
Support troubleshooting, performance tuning, and continuous improvement
Collaborate with QA, DevOps, and platform teams to support reliable delivery
Implement modern automated testing strategies, including unit, integration, contract, and end-to-end testing
Use AI-assisted development tools to accelerate coding, refactoring, debugging, and test creation

Required Qualifications

Bachelor’s degree in Computer Science, Engineering, or a related technical field (or equivalent experience)
12+ years of relevant experience, or a Master’s Degree and 10+ years of relevant experience
Hands-on experience building and supporting microservices-based systems
Proficiency in at least one modern programming language (for example: Java, Python, C++, or similar) on a Linux-based system
Experience or exposure to AI/ML-enabled systems (Claude-Code), automation, or intelligent platforms
Experience working in Agile environments
Understanding of APIs and distributed system concepts
Ability to obtain and maintain a Public Trust
U.S. citizenship required
Successful completion of background investigations as required by the government customer

Technologies

Java, Python, C++, Linux, Claude-Code, CI/CD, DevSecOps, Agile, SAFe, Scaled Agile Framework (SAFe), Kafka, AWS, Azure, GCP, Docker, Kubernetes

Benefits

Health and Wellness programs
Income Protection
Paid Leave
Retirement

Additional Preferences

Experience with Git-based version control and CI/CD pipelines
Familiarity with Scaled Agile Framework (SAFe)
Experience working with relational and/or NoSQL databases
Hands-on experience with Kafka or other event-streaming technologies
Cloud experience (AWS, Azure, or GCP)
Containerization and orchestration experience (Docker, Kubernetes)
Experience working in DevSecOps environments
Experience with test automation frameworks and integrating automated test suites into CI/CD pipelines
Desired (not required): commutable distance to Gaithersburg, MD or Egg Harbor Township, NJ

Location: Egg Harbor Township, NJ (hybrid)

Pay Range: $131,300.00 - $237,350.00 per year

Posting Date: September 25, 2026

View full job page →

4d ago

Senior Director, Data Engineer

Information Technology Senior Management Forum McLean, VA

McLean, VA

4d ago

$315k - $359k/yr Full time Manager Artificial Intelligence Azure

Apply Now

Job Description

Lead enterprise-grade data and AI engineering in a cloud environment supporting banking-grade identity, access decisioning, and AI/ML security. This Senior Director role focuses on multi-year platform strategy and architecture, with the goal of delivering scalable, real-time data and ML systems. The position is based in McLean, VA (onsite) and offers a salary range of USD 314,800 - 359,300 per year.

What you’ll do

Own the enterprise strategy and multi-year roadmap for identity analytics, access decisioning, and AI/ML security platforms, aligning AI/ML investment with business, audit, and regulatory priorities.
Partner with C-suite and CISO-org stakeholders to fund next-generation capabilities and guide platform evolution.
Lead and scale a 50+ person organization across Data Engineering, ML, Generative AI, and Security Products, including managers and senior individual contributors.
Set engineering standards and a high bar for well-managed delivery through hiring, development, and retention of top technical talent.
Provide hands-on technical direction by reviewing architectures, model designs, and system trade-offs, staying close to code and data to make sound decisions under uncertainty.
Architect low-latency, event-driven systems for real-time identity decisioning and threat detection using streaming telemetry, behavioral signals, and contextual graph data.
Design, build, and maintain ML infrastructure and pipelines for end-to-end workflows: feature extraction, training, testing, guardrails, evaluation, deployment, and real-time and batch inference.
Drive MLOps evolution with automated, metrics-backed deployment workflows, integration validation and testing, and scalable monitoring and observability for models in production.
Build the intelligence layer for agentic and non-human identity by combining behavioral analytics, ML-based intent determination, and context graphs for securing AI agents and workload identities.
Apply LLM and GenAI techniques in production for threat-intelligence summarization, automated incident triage, and adaptive access-policy recommendation, including optimization to improve scalability, cost, latency, and throughput.
Operate an automated governance function using pipelines from enterprise and IGA platforms, operationalizing NIST controls with continuous control validation and audit-ready evidence.
Lead enterprise readiness for emerging cyber risk from frontier AI models and agentic attack patterns.

What you bring

Bachelor’s Degree in Computer Science or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering).
9+ years of experience in data engineering.
7+ years of people management experience.
7+ years of programming experience with at least one of: Python, Java, or Scala.
5+ years driving technical delivery of roadmap features.
6+ years designing and developing data pipelines.
4+ years in data modeling and designing end-to-end data solutions using both relational and non-relational database systems.

Tools and platforms

Python, Java, Scala, NIST, AWS, Microsoft Azure, Google Cloud, EMR, Spark, Glue, Databricks, Airflow, Dagster, Monte Carlo, Splunk, MongoDB, Cassandra, DynamoDB, Snowflake, Redshift, SQL.

Compensation and benefits

Performance-based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI).
Comprehensive, competitive, and inclusive health and financial benefits designed to support total well-being.

Posting details

Posted date: 9/25/2026
Location: McLean, VA (onsite)
Employment authorization: Capital One will consider sponsoring a new qualified applicant for employment authorization for this position.
Application window: Expected to accept applications for a minimum of 5 business days.
Equal opportunity: Capital One is an equal opportunity employer committed to non-discrimination in compliance with applicable federal, state, and local laws (EOE, including disability/vet).
Other: No agencies please. Capital One promotes a drug-free workplace. Capital One will consider qualified applicants with criminal history in a manner consistent with applicable laws.

Preferred qualifications

Master’s Degree in Computer Science or a related field
12+ years of experience in application development with demonstrated proficiency in Python, SQL, Scala, or Java
8+ years of hands-on experience designing, deploying and operating data workloads in at least one public cloud environment (AWS, Microsoft Azure, or Google Cloud)
8+ years of experience building or supporting distributed data or compute workloads using tools such as EMR, Spark, Glue, or Databricks
8+ years of experience designing, implementing, and operating real-time or streaming data pipelines
6+ years of experience working on data observability (e.g., Monte Carlo, Splunk) or data orchestration tools (e.g., Airflow, Dagster)
8+ years of experience working with unstructured or semistructured data using NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB)
8+ years of experience designing and supporting data warehousing solutions (e.g., Snowflake, Redshift)
6+ years of experience working in an Agile development environment
6+ years of experience developing user-centric reusable data products
5+ years of experience in Data Governance, Data Governance Platforms, Data Standardization, and Data Modeling

View full job page →

4d ago

Data Engineer

VISUAL SOFT, INC Huntsville, AL

Huntsville, AL

4d ago

Full time 3d Design Tools Amazon Web Services AWS

Apply Now

Job Description

VISUAL SOFT, INC is seeking a Data Engineer to support secure, mission-critical data environments within a classified cloud infrastructure. This role is fully onsite in Huntsville, Alabama and requires an active Top Secret clearance as well as U.S. citizenship.

In this position (Mid-Level or Senior), you will build and maintain ETL and data integration capabilities across on-premises and AWS environments, including real-time and batch processing, automation, and data governance activities.

What you will do

Design, develop, and maintain ETL workflows to extract, transform, and load large-scale structured and unstructured datasets.
Build data migration solutions between legacy and modern systems using SQL, Java, and cloud-native tools.
Create data integration frameworks using AWS services including Glue, Lambda, S3, RDS, Redshift, and Kinesis.
Develop automation scripts with Python, Shell, or Bash for deployment, data validation, and maintenance.
Maintain and enhance data pipelines for real-time and batch data processing.
Support data quality, metadata management, and data governance efforts.
Participate in Agile/Scrum sprints, contributing to design, code reviews, testing, and documentation.
Troubleshoot and resolve data-related issues across on-premises and AWS environments.

Required education

Bachelor’s Degree (B.S.) in Computer Science, Information Systems, Engineering, or a related field.

Required experience

5+ years (Mid-Level) or 8+ years (Senior-Level) in data engineering or database development.

Skills and qualifications

Strong hands-on experience with ETL tools, such as Informatica, Talend, Pentaho, AWS Glue, or custom Java ETL frameworks.
Proficiency in SQL and at least one major RDBMS, including Oracle or PostgreSQL.
Experience with data migration projects and data quality validation.
Proficiency in Java or Python for data processing and automation.
Cloud experience, preferably AWS (including RDS, S3, Lambda, Redshift, Glue).
Working knowledge of Linux/Unix environments and shell scripting.
Experience working in an Agile/Scrum development environment.
Excellent problem-solving, analytical, and communication skills.

Technologies

ETL, AWS Glue, AWS Lambda, Amazon S3, Amazon RDS, Amazon Redshift, Amazon Kinesis
SQL, Java, Python, Shell, Bash
Informatica, Talend, Pentaho
Oracle, PostgreSQL, MongoDB
Linux/Unix, Agile/Scrum, and AWS cloud services

Location and clearance

Huntsville, Alabama (100% onsite)
Clearance required: Active Top Secret Clearance (U.S. Citizenship Required)

Employment type

Full-Time / Permanent
1099 Consultant

Benefits

3 weeks of Paid time off (PTO) that includes sick leave
2 floating and 8 public holidays
Company covers 50% of health and dental insurance for all full-time employees (dependents at extra cost)
STD, LTD, and one-time salary equivalent of life insurance at no cost to all full-time employees
401k program after 90 days with a company match of 4% and immediate vesting
Profit sharing for w-2 employees with no benefits and no employee contributions required
Floating and holidays expire at the end of every year of service

View full job page →

4d ago

Data Engineer – Legacy Systems & AI Workflows

Groundswell McLean, VA

McLean, VA

4d ago

$90k - $175k/yr Full time Artificial Intelligence Big Data Bigdata

Apply Now

Job Description

Groundswell is seeking an experienced Data Engineer to deliver secure data ingestion, integration, and pipeline operations for a mission-focused platform, including AI-enabled capabilities in controlled environments.

Responsibilities

Design, develop, and operate batch and streaming ETL/ELT pipelines ingesting data from multiple structured and semi-structured sources into secure cloud data platforms.
Onboard legacy data sources by reviewing schemas, mappings, interfaces, validation rules, ownership, and operational support procedures.
Create automated data-quality checks for completeness, accuracy, consistency, timeliness, and referential integrity with monitoring and alerting that drive action.
Automate deployments and pipeline operations using SOAP APIs, workflow orchestration, and environment-specific configuration.
Troubleshoot distributed data system failures using logs, metrics, lineage, and operational signals; clearly communicate root cause and recovery plan.
Partner with software engineers, cloud engineers, data scientists, security teams, architects, and customer stakeholders to translate mission needs into measurable data products.

Requirements

Bachelor’s degree in Computer Science, Computer Engineering, Mathematics, Statistics, or a related technical field.
5+ years of professional data engineering experience, including production pipeline development and operations.
Proficiency in Python, Java, R, or another programming language used for data engineering.
Experience with legacy systems that use SOAP APIs for data interaction.
Experience implementing data-quality frameworks, validation processes, monitoring, and alerting for production pipelines.
Working knowledge of data security and governance in restricted or compliance-oriented environments, including access controls, encryption, and auditability.
Experience working with APIs (SOAP/REST) and structured data formats including JSON, XML, CSV, and Parquet.
Ability to document technical decisions and collaborate with multidisciplinary teams and customer stakeholders.
Must be a U.S. Citizen per contract requirements.
Must be able to obtain and maintain a Public Trust Clearance per contract requirements.

Technologies

Python, Java, R
SOAP APIs, SOAP/REST
JSON, XML, CSV, Parquet
Jupyter Notebook, numpy, pandas
AWS, Databricks
LLM, AI/ML, C3.ai

Preferred Qualifications

Experience building preprocessing, chunking, filtering, metadata enrichment, or evaluation pipelines for LLM and other AI/ML workflows.
Experience operating data platforms with segmented networks, limited connectivity, strict change control, or formal authorization requirements.
Strong SQL skills including query optimization, data modeling, joins, window functions, and analysis of large datasets.
Experience with Jupyter Notebook or equivalent tools for data analysis.
Hands-on experience with Python libraries such as numpy and pandas.
Hands-on experience with at least one major cloud provider; AWS experience strongly preferred.
Extra consideration for C3.ai experience.
Active Public Trust Clearance.
Preference for candidates local to the Washington, DC metro area.

Benefits

Comprehensive medical, dental, and vision plans
Flexible Spending Account
4% 401K Match (immediate vesting)
Paid Time Off
Tuition reimbursement, certification programs, and professional development
Flexible work schedule
On-site gym and childcare option

Additional Notes

Location: McLean, VA (onsite)
Salary: USD 89,886 - 175,444 per year
Groundswell does not accept unsolicited resumes through or from search firms or staffing agencies; unsolicited resumes become the property of Groundswell and no placement fee is owed.
Disability accommodation: contact hr@gswell.com or 703-639-1777 to request reasonable accommodation during the selection process.

Required Clearance

Public Trust Clearance required per contract requirements.

Certifications

AWS Data Engineer Certification, Databricks, cloud data engineering, or other relevant professional certification is preferred.

Employee Rights (Posted Resources)

EO 13496 Notification of Employee Rights under NLRA
Know your rights: Workplace Discrimination is Illegal

View full job page →

4d ago

Software Engineer III - Senior Databricks/Spark/AWS Data Engineer

JPMorganChase Columbus, OH

Columbus, OH

4d ago

Full time Artificial Intelligence AWS Aws Cloudwatch

Apply Now

Job Description

Build secure, scalable data engineering solutions at JPMorganChase in Columbus, OH (onsite). This Software Engineer III role supports modernization to a Databricks-on-AWS lakehouse and focuses on delivering high-quality production pipelines using Apache Spark (PySpark). You will collaborate with stakeholders, apply strong engineering practices, and help enable reliable analytics for BI partners working in Sigma, Tableau, and Alteryx.

What you’ll be doing

Design, build, and maintain new data pipelines on Databricks using PySpark, creating secure, production-ready code and reviewing/debugging processes implemented by others.
Optimize and tune PySpark jobs and Databricks clusters for performance, scalability, and cost efficiency, including partitioning, caching, and resource management.
Design and implement scalable data frameworks using medallion lakehouse patterns (bronze/silver/gold) for workforce data analytics end-to-end pipelines.
Implement data quality checks and validation processes using Delta Lake and Delta Live Tables expectations to support accuracy and reliability.
Deliver robust monitoring and alerting for data ingestion issues by leveraging Databricks and AWS CloudWatch to improve performance and throughput.
Identify recurring operational issues and work to eliminate or automate remediation using Databricks Workflows and AWS-native automation.
Use AI and Agentic AI to accelerate data pipeline development and adopt AI-assisted engineering tools such as Claude and GitHub Copilot to improve developer productivity and code quality.
Provision and deliver curated, reliable data sets to BI partners so they can support reporting and analytics use cases in Sigma, Tableau, and Alteryx.
Partner with business stakeholders to understand requirements, design appropriate solutions, and produce architecture and design artifacts for complex applications.
Contribute to software engineering communities of practice focused on new and emerging technologies, supporting a culture that values diversity, opportunity, inclusion, and respect.

What you’ll need

Formal training or certification in software engineering concepts plus 3+ years of applied experience in data engineering, including design, application development, testing, and operational stability.
Advanced, hands-on expertise in Apache Spark (PySpark) for large-scale distributed processing and strong proficiency building and operating production pipelines on Databricks (including Delta Lake and lakehouse patterns).
Strong knowledge of the AWS data ecosystem: S3, EMR, Glue, Lambda, Athena, along with AWS storage and compute services; experience with Parquet and Iceberg data formats.
Strong programming skills in Python for data processing and application development (Java or Scala is a plus).
Proficiency with automation and continuous delivery, using CI/CD pipelines and tools such as Git/Bitbucket, Jenkins, or Spinnaker for automated deployment and version control.
Hands-on experience across system design, application development, testing, and operational stability, including advanced understanding of agile methodologies, application resiliency, and security.
In-depth knowledge of the financial services industry and their IT systems.
Solid SQL and data modeling skills for efficient data management and retrieval (experience with relational databases such as Oracle is a plus).
Experience with scheduling tools such as Airflow and Autosys to automate and manage job scheduling.

Benefits

Competitive total rewards package including base salary determined based on role, experience, skill set, and location.
In eligible roles, commission-based pay and/or discretionary incentive compensation in cash and/or forfeitable equity.
Comprehensive health care coverage.
On-site health and wellness centers.
Retirement savings plan.
Backup childcare.
Tuition reimbursement.
Mental health support and financial coaching.
Additional details about total compensation and benefits provided during the hiring process.
Equal opportunity employer with high value on diversity and inclusion.

Preferred qualifications

Databricks certifications (for example, Databricks Certified Data Engineer Associate/Professional).
Familiarity with Generative AI and Agentic AI frameworks, including AI coding assistants such as Claude and GitHub Copilot in an engineering workflow.
Deeper expertise in the AWS cloud platform and broader service catalog.

About the team

JPMorganChase corporate functions span areas including finance and risk, human resources, and marketing. These corporate teams are essential to helping set businesses, clients, customers, and employees up for success.

View full job page →

4d ago

Sr Software Engineer

Mclane Company, Inc. Temple, TX

Temple, TX

4d ago

Full time Backend Developer Senior APIs

Apply Now

Job Description

Build and ship full stack software that supports critical business capabilities, with a cloud-native focus on Google Cloud Platform and support for Microsoft Azure. This hybrid role in Temple, TX brings together frontend, backend, APIs, CI/CD, and real-world production troubleshooting so you can see your work through to impact.

What Mclane Company, Inc. offers

Day 1 Benefits: medical, dental, and vision insurance, FSA/HSA, and company-paid life insurance.
Paid time off starts day one.
401(k) Profit Sharing Plan after 90 days.
Additional benefits including pet insurance, maternity/paternity leave, employee assistance programs, discount programs, and a tuition reimbursement program.

Responsibilities

Design, develop, test, and deploy scalable full stack applications for critical business needs.
Build and maintain backend services, APIs, and microservices using Java and/or Python.
Create modern, responsive user interfaces using React or Vue.
Design and implement cloud-native solutions primarily in Google Cloud Platform (GCP), with support for Microsoft Azure environments.
Create and maintain Infrastructure as Code (IaC) using Terraform.
Build and enhance RESTful APIs and event-driven integrations.
Collaborate with architects, product owners, and cross-functional teams to translate business requirements into technical solutions.
Contribute to CI/CD pipelines, automation initiatives, and cloud deployment strategies.
Participate in code reviews and promote engineering best practices around security, scalability, and maintainability.
Troubleshoot and resolve complex production issues while driving continuous improvement.

Requirements

Bachelor’s degree in Computer Science, Software Engineering, Information Systems, or a related technical field (required).
5+ years of professional software engineering experience, including full stack development.
Strong backend experience with Java (Spring Boot/Quarkus) and/or Python (Django/Flask).
Solid front-end development experience with React, Flutter, or Vue.js.
Hands-on experience with Google Cloud Platform (GCP).
Working knowledge of Microsoft Azure.
Experience building and maintaining Infrastructure as Code with Terraform.
Strong understanding of RESTful API design and microservices architecture.
Experience with relational and/or NoSQL databases: PostgreSQL, MySQL, MongoDB, DB2, or Oracle.
Experience with CI/CD pipelines, Git-based workflows, and code review practices.
Familiarity with containerization technologies such as Docker and Kubernetes.
Strong analytical and problem-solving skills.
Ability to collaborate effectively in a hybrid, cross-functional team environment.
Must be able to read, write, and understand English at a level sufficient to perform job-related tasks effectively and safely, including understanding work instructions, safety protocols, and role communications.

Hybrid position / location

This is a hybrid role requiring reporting to the office at least three days a week.
Candidates should be within a 50-minute radius from Temple, TX.

Additional fit traits

Teamwork oriented
Organized
Problem solver
Detailed

Technologies you’ll work with

Java, Python, Spring Boot, Quarkus, Django, Flask, React, Flutter, Vue, Vue.js, GCP, Microsoft Azure, Terraform, RESTful APIs, CI/CD pipelines, Git, Docker, Kubernetes, PostgreSQL, MySQL, MongoDB, DB2, Oracle.

View full job page →

4d ago

Software Engineer

Copper State Bolt & Nut Co. Phoenix, AZ

Phoenix, AZ

4d ago

Full time Backend Developer .NET .NET Core

Apply Now

Job Description

Copper State Bolt & Nut Company is seeking a Software Developer (Full Stack and Microsoft Power Platform) for the internal IT team in Phoenix, AZ.

Responsibilities

Develop, integrate, support, and continuously improve internal business applications
Build full-stack applications using modern technologies
Create and support REST APIs, Azure Functions, and system integrations
Work with SQL, relational databases, and data platforms
Develop solutions using Power Apps and Power Automate
Use technologies such as C#/.NET, JavaScript/TypeScript, Node.js, Python, or similar
Support Git, CI/CD, testing, deployment, monitoring, and release processes
Troubleshoot issues across applications, APIs, databases, integrations, and performance
Work with Microsoft Azure, Dynamics 365, and Microsoft Fabric
Document solutions and follow appropriate security and development practices

Requirements

Degree in Computer Science, Software Engineering, Information Systems, or equivalent experience
Strong software development and problem-solving skills
Experience with JavaScript/TypeScript, C#/.NET, Python, Java, or similar
Experience with SQL, REST APIs, JSON, and relational databases
Familiarity with Git, CI/CD, cloud technologies, and modern software development practices
Understanding of authentication, security, and systems integration
Ability and willingness to learn new technologies quickly