Data Engineering

Data Engineering Developer Jobs

75 jobs found

Today

Senior Machine Learning Engineer

Motion Recruitment Wilmington, MA

Wilmington, MA

Today

Full time Senior Artificial Intelligence Data Analysis

Apply Now

Job Description

Own end-to-end machine learning for edge-ready models, from sensor ingestion through deployment and operational MLOps processes.

Responsibilities

Own the full ML lifecycle, starting from raw sensor data and ending with a model running on constrained hardware
Design and develop sensor data pipelines for continuous collection, cleaning, and organization
Build, train, optimize, and deploy signal processing and anomaly detection models for edge devices
Create and refine ML models for real-time device applications and ongoing performance improvements
Collaborate with embedded engineers to integrate and validate inference within device software
Work closely with firmware teams to embed and test AI features on hardware platforms
Build and maintain MLOps infrastructure to support regulatory and quality processes
Set up and manage tooling for experiment tracking, automated evaluations, and deployment management
Participate in sensor selection and validation
Document model development to support regulatory submissions and internal quality processes
Analyze model behavior, ensure reliability, and troubleshoot issues to maintain high-quality outputs

Requirements

5+ years of experience in machine learning engineering or applied ML
Strong proficiency in Python
Hands-on experience with PyTorch or TensorFlow
Experience deploying models to the edge using TFLite, ONNX, CoreML, TensorRT, or an equivalent workflow
Experience building sensor data pipelines
Proficiency with MLOps
Solid software engineering fundamentals
Proficiency in C or C++
Degree in a relevant field

Desired Skills & Experience

Experience with physiological signal processing for medical or wearable applications
Background in robotics or autonomous systems
Experience in a startup or small team

Technology Stack

Python
PyTorch
TensorFlow
TFLite
ONNX
CoreML
TensorRT
MLOps
C
C++

Location

Wilmington, MA (onsite)

Benefits

Bonus OR Commission eligible
Medical Insurance
Dental Benefits
Vision Benefits
Paid Time Off (PTO)
401(k) (including match - if applicable)

View full job page →

Today

Staff Software Engineer - Logs Management

Datadog New York, NY

New York, NY

Today

$244k - $305k/yr Full time Backend Developer Data Data Analysis

Apply Now

Job Description

Datadog’s Logs organization is hiring a Staff Software Engineer to reshape log ingestion, querying, and intelligent log management.

Responsibilities

Work with Product Managers to clarify ambiguous requirements and identify the most impactful solutions for customers
Own technical strategy and execution for systems focused on log query performance and ingestion at scale
Design and evolve platform systems that support reliable, high-performance log experiences
Prototype new capabilities and collaborate with peers on initiatives across:
- AI-powered log management
- Security and business operations
- Advanced query capabilities
- External data sources query capabilities
Mentor engineers across levels
Contribute to a high-performing, collaborative team culture

Requirements

Deep experience architecting and scaling backend systems, with emphasis on data-intensive or distributed infrastructure
Comfort operating in ambiguous environments with a balance of drive, curiosity, and pragmatic decision-making
Proven experience partnering with Product Managers and customers to define product direction and ship high-impact features
Expertise in debugging complex systems and optimizing performance across real-time data pipelines
Hands-on experience using AI agent tools as part of daily engineering practices
Ability to lead by example through mentorship and collaboration
Demonstrated capability using AI coding tools in day-to-day workflows, including validating, critiquing, and refining AI-generated output
Bonus: Motivated to push the boundaries of how AI can improve software engineering best practices and contribute to building AI-enabled capabilities

Benefits

Generous and competitive benefits package
New hire stock equity (RSUs) and employee stock purchase plan
Continuous career development and pathing opportunities
Employee-focused best in class onboarding
Internal mentor and cross-departmental buddy program
Friendly and inclusive workplace culture

Location: New York, NY (hybrid)
Compensation: USD 244,000 - 305,000 per year

View full job page →

1d ago

Senior Geospatial Data Engineer

Vantor Services Inc. McLean, VA

McLean, VA

1d ago

$137k - $200k/yr Full time Senior Analytics ArcGIS Enterprise

Apply Now

Job Description

Vantor Services Inc. is hiring a Senior Geospatial Data Engineer to help mission teams curate and transform geospatial data into usable ArcGIS Portal content and data-driven analytics. In this onsite role in McLean, VA, you will support geospatial data processing and visualization workflows using Python and Tableau, backed by tools and platforms across the ArcGIS ecosystem. Pay ranges from USD 137,000 to 200,200 per year, based on location and experience.

Responsibilities

Manage, curate, publish, and maintain geospatial datasets, hosted feature layers, web maps, dashboards, and data products in ArcGIS Portal.
Ensure mission users have accurate, well-organized, current, and usable geospatial information.
Use Python, Tableau, ArcGIS, and related tools to process large datasets, automate workflows, prepare data for analysis, and deliver visual analytics that surface patterns, trends, anomalies, and operationally relevant insights.
Partner with mission users to understand geospatial data needs, analytic questions, visualization requirements, and operational workflows.
Identify, acquire, clean, transform, validate, curate, and publish large geospatial and tabular datasets from diverse sources.
Develop Python scripts and tools to automate geospatial processing, quality control, enrichment, transformation, and publication workflows.
Manage and update ArcGIS Portal content, including hosted feature layers, map services, web maps, dashboards, data hubs, and related geospatial products.
Build and maintain Tableau dashboards, reports, and analytic visualizations for the data processing office and mission stakeholders.
Apply cartographic design, symbology, labeling, layer management, metadata practices, and performance tuning to improve usability of geospatial products.
Integrate structured, unstructured, tabular, and spatial datasets into cohesive analytical and visualization environments.
Support geospatial data library functions such as dataset organization, metadata creation, version management, quality control, discoverability, and lifecycle maintenance.
Create documentation, data dictionaries, standard operating procedures, user guidance, and technical recommendations to support repeatable data management and visualization workflows.
Work independently across two office environments while collaborating with multidisciplinary teams and communicating technical concepts clearly to technical and non-technical audiences.

Requirements

Active TS/SCI U.S. Government security clearance with polygraph and U.S. citizenship.
Bachelor’s degree in Geography, GIS, Computer Science, Data Science, Engineering, or a related technical discipline.
12+ years of professional experience in geospatial technology, software development, data engineering, data analysis, or a related technical field.
Strong Python experience for geospatial data processing, automation, transformation, analysis, and workflow improvement.
Demonstrated experience working with large geospatial datasets, including cleaning, formatting, joining, enriching, validating, and preparing data for analysis or publication.
Hands-on experience with ArcGIS Enterprise, ArcGIS Portal, or ArcGIS Online, including publishing and maintaining hosted feature layers, web maps, dashboards, and geospatial content.
Experience curating geospatial data holdings, including organizing datasets, maintaining metadata, improving discoverability, and ensuring data quality.
Experience developing dashboards, reports, or analytic visualizations in Tableau or a comparable business intelligence platform.
Understanding of geospatial data formats, projections, coordinate systems, spatial joins, geoprocessing workflows, cartographic principles, and spatial data management.
Experience with relational databases, preferably PostgreSQL/PostGIS, for storing, querying, and managing spatial or tabular data.
Strong analytical, problem-solving, communication, and customer engagement skills.
Proven ability to work independently with minimal guidance while coordinating effectively across teams, offices, and mission stakeholders.
Eligibility is contingent upon verification of clearance status.
Certain roles may be subject to U.S. export control laws, requiring U.S. person status as defined by 8 U.S.C. 1324b(a)(3).

Benefits

Robust 401(k) with company match
Mental health resources
Student loan repayment assistance
Adoption reimbursement
Pet insurance

Technologies

Python, Tableau, ArcGIS, ArcGIS Enterprise, ArcGIS Portal, ArcGIS Online, ArcPy
GeoPandas, Shapely, Fiona, Rasterio, GDAL, QGIS
PostgreSQL, PostGIS, Elasticsearch, Kibana
Amazon S3, ArcGIS Hub
Jira, Confluence, DevOps

Pay Transparency

The base pay for this position within the Washington, DC metropolitan area is $137,000.00 - $182,000.00 - $200,200.00 annually. For all other states, geographic cost of labor is used to develop market-driven ranges for roles, so ranges may differ by location.

View full job page →

2d ago

Data Engineer

CVS Health Phoenix, AZ

Phoenix, AZ

2d ago

$65k - $173k/yr Full time Big Data Data Data Analysis

Apply Now

Job Description

Join CVS Health in Phoenix, AZ (onsite) as a Data Engineer focused on delivering modern data solutions that help move healthcare data into action. This full-time role supports a data engineering team processing payer files into the Data Warehouse, with opportunities to design, integrate, and implement both on-premise capabilities and cloud migrations. You will work in a fast-paced, agile environment alongside engineering, analytics, data science, and product teams.

Compensation: USD 64,890 - 173,040 per year (typical pay range: $64,890.00 - $173,040.00). Anticipated weekly hours: 40.

What you’ll do

Deliver high-quality modern data solutions through collaboration with engineering, analysts, data scientists, and product teams in an agile, team-based environment.
Design, integrate, and implement data solutions on-premise and support migrations of existing workloads to the cloud.
Process payer files and enable reliable ingestion into the Data Warehouse.
Support cloud and on-prem data warehousing services by writing and modifying code in SQL, Python, and PySpark.

Key skills and experience

4+ years working with SQL and relational database management systems.
2+ years in Cloud Data Engineering Platforms such as AWS, GCP, Azure, Databricks, or Snowflake.
2+ years in on-prem Data Engineering Platforms such as Microsoft SQL Server, Oracle, or Teradata.
Hands-on experience with dimensional data modeling, schema design, and data warehousing.
Hands-on experience troubleshooting data issues.
Hands-on experience applying various performance improvement techniques.
Ability to identify and implement process improvements and best practices, with ownership in a fast-paced, collaborative support environment.
Excellent oral and written communication skills.

Technologies

SQL, Python, PySpark, AWS, GCP, Azure, Databricks, Snowflake
Microsoft SQL Server, Oracle, Teradata

Benefits

Medical, dental, and vision coverage
Paid time off
Retirement savings options
Wellness programs
Other resources, based on eligibility
Eligible for a CVS Health bonus, commission, or short-term incentive program in addition to the base pay range listed above.

Education

Bachelor’s degree in Computer Science / Engineering.

Preferred qualifications

Familiarity with healthcare data and healthcare insurance feeds is a plus

View full job page →

4d ago

Principal Data Engineer, People Data

Okta Bellevue, WA

Bellevue, WA

4d ago

$197k - $271k/yr Full time Apache Airflow Big Data Bigdata

Apply Now

Job Description

The Principal Data Engineer will join Okta’s People Data and Data & Insights team, shaping scalable enterprise data solutions for candidate and employee lifecycle information. This role combines technical architecture, data governance, and cross-functional leadership to improve data availability, integrity, and adoption across the organization.

Role Overview

As a Principal Data Engineer, you will architect, build, and maintain critical systems that support externally reported people-related numbers. You will lead complex technical initiatives spanning multiple data domains, with a focus on data modeling standards, governance rigor, and reliable data contracts that support global product teams.

Core Responsibilities

Design, build, and evolve high scale data solutions that establish reference architecture and simplify access to data across the organization
Create data quality frameworks including monitoring, anomaly detection, and alerting, with governance, lineage tracking, and change management practices appropriate for externally reported metrics
Drive adoption of consistent data modeling patterns, naming conventions, documentation norms, and metric governance standards across the data organization
Lead cross-functional technical initiatives across data verticals to accelerate delivery and improve the resilience of data systems
Make sound technical decisions in ambiguous environments, balancing near-term delivery with long-term infrastructure investment
Champion Data Contracts by implementing data contracts and schema evolution practices to support reliability across global product teams
Mentor and scale engineering execution by mentoring senior engineers, leading cross-functional task forces, and fostering a culture of engineering excellence and data-driven decision making
Stay current with emerging data technologies and practices to guide the team’s long-term technical direction

Requirements

10+ years of experience in data engineering, with proven experience in a senior or lead capacity; experience with Federal government compliance and security requirements is highly desirable
Expert-level experience with SQL, ETL/ELT tools (Airflow, dbt), and MPP databases (Snowflake, Redshift), plus extensive hands-on experience with AWS services (S3, Lambda, EMR, ECR, EKS)
HR data expertise, including candidate lifecycle, employee records, compensation, and organizational data, with experience designing data models for recruiting analytics, engagement signals, and workforce planning metrics
Familiarity with Workday data structures is a bonus
Experience building and maintaining both batch and realtime pipelines using technologies such as Spark and Kafka
Deep experience designing and working with modern lakehouse and warehouse architectures (Databricks, Snowflake) and modern file formats (Iceberg, Delta)
Demonstrated ability to integrate AI tools to optimize or redesign workflows and drive measurable impact such as efficiency and quality improvements
Track record of hands-on collaboration with Data Science, Business, and Product teams

Technologies

SQL, Airflow, dbt, Snowflake, Redshift
AWS: S3, Lambda, EMR, ECR, EKS
Spark, Kafka, Databricks
Iceberg, Delta

Location and Salary

Location: Bellevue, WA (hybrid)
Compensation: USD 197,000 - 270,600 per year
Experience Level: 10+ years

The Okta Experience

Supporting Your Well-Being
Driving Social Impact
Developing Talent and Fostering Connection + Community

View full job page →

4d ago

Principal Data Engineer, Product Data

Okta Chicago, IL

Chicago, IL

4d ago

$197k - $271k/yr Full time Apache Airflow Data Architecture Data Build Tool

Apply Now

Job Description

Okta is hiring a Principal Data Engineer, Product Data to architect, build, and maintain scalable data solutions for product behavioral and telemetry data. This role leads cross-functional efforts to strengthen data availability, integrity, governance, and the adoption of consistent data modeling and metric standards.

What You’ll Do

Design, build, and evolve high-scale data solutions that serve as an organizational reference architecture and simplify data access across teams.
Develop data quality frameworks, monitoring, anomaly detection, and alerting, including governance, lineage tracking, and change management rigor for externally reported numbers.
Drive organization-wide adoption of consistent data modeling patterns, naming conventions, documentation norms, and metric governance standards.
Lead cross-functional technical initiatives across data verticals to accelerate delivery and harden data systems.
Operate effectively in ambiguity and make sound technical decisions that balance short-term delivery with long-term infrastructure investment.
Champion data contracts by implementing data contracts and schema evolution practices to support reliable downstream usage across global product teams.
Mentor and scale by raising the technical bar through mentoring senior engineers, leading cross-functional task forces, and promoting engineering excellence and data-driven decision making.
Stay current on the data landscape by adopting and advocating for emerging technologies and practices to shape long-term technical direction.

What You Bring

Experience: 10+ years in a data engineering role, with proven experience in a senior or lead capacity. Federal government compliance and security requirements experience is highly desirable.
Product knowledge: Deep expertise in product behavioral data engineering, specifically telemetry data, including structured data for product launch analysis, feature usage, retention, and other product lifecycle metrics.
Partnering with Product Engineering: Proven experience working closely with Product Engineering teams to support successful instrumentation for data collection.
Technical expertise: Expert-level SQL; ETL/ELT tools including Airflow and dbt; and MPP databases such as Snowflake and Redshift. Extensive hands-on experience with AWS services including S3, Lambda, EMR, ECR, and EKS.
Modern architectures: Deep experience with lakehouse architectures (Databricks) and modern file formats such as Iceberg and Delta.

Core Technologies

SQL, Airflow, dbt, Snowflake, Redshift, AWS S3, AWS Lambda, AWS EMR, AWS ECR, AWS EKS, Databricks, Iceberg, Delta

Location and Role Details

Location: Chicago, IL (hybrid)
Compensation: USD 197,000 - 270,600 per year
Minimum experience: 10 years

The Okta Experience

Supporting Your Well-Being
Driving Social Impact
Developing Talent and Fostering Connection + Community

View full job page →

4d ago

Data Engineer - Senior Consultant

EY McLean, VA

McLean, VA

4d ago

$107k - $201k/yr Full time Senior Analytics Big Data

Apply Now

Job Description

EY is seeking a Senior Data Engineer to support a DoD client in McLean, Virginia (hybrid). This role designs, builds, and deploys data and analytics solutions that translate business needs into mission-support dashboards, workflow automation, and low-code applications.

Role Responsibilities

Support a DoD client in the design, development, and deployment of data analytics, business intelligence, workflow automation, and low-code application solutions.
Partner with client and civilian government stakeholders to convert business requirements into actionable analytics, dashboards, and mission-support applications that improve operational effectiveness, transparency, and decision-making.
Build scalable, robust solutions that unify, enrich, and analyze data from multiple sources.

Key Requirements

Demonstrated experience designing, developing, and maintaining enterprise data pipelines in modern cloud data environments, including implementation of medallion architecture (Bronze, Silver, Gold) and automated ETL/ELT workflows.
Experience integrating data from multiple authoritative systems and enterprise platforms (for example, Maximo, iNFADs, EDW, Databricks/Jupiter) using APIs, automated ingestion patterns, and data transformation frameworks to deliver trusted, analysis-ready data products.
Experience implementing data quality controls, lineage, monitoring, alerting, and operational support processes that strengthen traceability, governance, and reliability of mission-critical datasets.
Must be eligible to obtain and maintain a Secret Clearance.
Must have a bachelor’s degree.
3-5 years of related experience within AI & Data.
Must be comfortable working in-person as needed.
Data quality control, lineage, monitoring, alerting, and operational support experience.

Technologies

Medallion architecture (Bronze, Silver, Gold)
ETL/ELT
APIs
Maximo
iNFADs
EDW
Databricks/Jupiter
Power Platform and Power Platform-based solutions
Palantir Foundry

Ideally, You’ll Also Have

Experience with Palantir Foundry for data integration, ontology enablement, data materialization, and supporting the movement of curated data products into Foundry operational environments.
Experience with Databricks, including pipeline orchestration, data engineering best practices, and integration of Databricks outputs with downstream analytics and decision-support platforms.

Location, Clearance, and Travel

Location: McLean, VA (hybrid).
Eligibility: must be able to obtain and maintain a Secret Clearance.
Work may be required to be completed at the client, EY, and/or CON.
Travel: candidates should be willing to travel 20–30% or more.

Compensation and Benefits

Salary range: USD 106,900 to 200,600 per year.
Comprehensive compensation and benefits including medical and dental coverage, pension, and 401(k) plans, plus a wide range of paid time off options.
Hybrid model expectation for most external, client-serving roles: work together in person 40–60% of the time over the course of an engagement, project, or year.
Flexible vacation policy to determine vacation time based on personal circumstances, plus time off for EY Paid Holidays, Winter/Summer breaks, Personal/Family Care, and other leaves of absence.