Cloud Data Warehouse

Cloud Data Warehouse Developer Jobs

144 jobs found

2d ago

Data Engineer

CGI Group, Inc. Cary, NC

Cary, NC

2d ago

$92k - $161k/yr Full time Backend Developer Aws Data Engineer Big Data

Apply Now

Job Description

CGI Group, Inc. is seeking an experienced Data Engineer to help design and build external-facing API solutions while delivering reliable data movement in AWS environments. This onsite role is based in Cary, NC and centers on hands-on ETL and batch processing using Spring Batch and Apache Spark on AWS EMR.

The role involves creating and operating batch data pipelines, developing client integrations for REST and SOAP services, and supporting squads that build and maintain applications in the cloud. You will also help guide architecture decisions to keep systems scalable, resilient, and extensible.

What you will do

Design, develop, test, deploy, and maintain ETL batch jobs using Spring Batch and Apache Spark on EMR
Schedule, monitor, and debug ETL batch jobs across Spring Batch and Spark workflows
Build Java clients to consume REST and SOAP APIs, and develop Scala Spark batch applications
Use Apache Spark to process large-scale data and write results to NoSQL databases including Cassandra or Yugabyte
Build and deploy solutions on AWS cloud infrastructure
Provide technical support to squads building, deploying, and maintaining applications in AWS
Work across multiple development workstreams while helping ensure scalable, resilient, extensible architectures
Ensure technology decisions align with Fidelity’s architecture standards and strategies
Evaluate and recommend technologies and frameworks for flexibility, long-term viability, and time to market
Collaborate with peers through code reviews, pair programming, and daily discussions across multiple squads

What you bring

Bachelor’s degree in Computer Science, Information Systems, or a related field, with a proven track record in data engineering
6+ years of software development experience
6+ years developing Spark or Spring Batch services for data movement
Hands-on experience scheduling, monitoring, and debugging ETL Spring Batch and Spark batch jobs
Hands-on experience building Java clients consuming REST and SOAP APIs, plus Scala Spark batch applications
Experience developing, testing, deploying, and maintaining ETL batch jobs using Spring Batch and Apache Spark/EMR
Experience using Apache Spark to process big data and write to NoSQL databases such as Cassandra or Yugabyte
Proven experience building and deploying software solutions on public cloud providers such as AWS
Strong understanding of the software development lifecycle (analysis, design, coding, testing, problem resolution, planning)
Strong collaboration and communication skills across multiple squads, with the ability to adapt to change
Experience with cloud-based data warehousing and data lake solutions such as Snowflake
Experience with data storage and management for large datasets (for example, Parquet and HDF5)

Tools and technologies

Spring Batch
Apache Spark and Spark SQL
EMR, AWS
Java, Scala
REST, SOAP
NoSQL (including Cassandra and Yugabyte)
Snowflake, Parquet, HDF5

Compensation and location

Location: Cary, NC (onsite)
Salary: USD 91,800 - 160,700 per year

Benefits

Competitive compensation
Comprehensive insurance options
Matching contributions through the 401(k) plan and the share purchase plan
Paid time off for vacation, holidays, and sick time
Paid parental leave
Learning opportunities and tuition assistance
Wellness and well-being programs

Additional information

CGI provides a reasonable estimate of the compensation range for this role as required by law in some jurisdictions.
CGI benefits are offered to eligible professionals on their first day of employment.
All CGI offers in the U.S. are contingent upon successfully completing a background investigation.
Qualified applicants receive consideration without regard to protected statuses required by applicable laws.
CGI provides reasonable accommodations to qualified individuals with disabilities. For application accommodations in the U.S., email US_Employment_Compliance@cgi.com.

View full job page →

3d ago

Data Engineer

Mindex Rochester, NY

Rochester, NY

3d ago

$90k - $140k/yr Full time Amazon Web Services Analytics Application Security

Apply Now

Job Description

Mindex is looking for a Data Engineer to help SchoolTool power interactive dashboards and analytics with cloud-native data pipelines, data models, and warehouse structures. In this onsite role in Rochester, NY, you will build analytics solutions, collaborate with delivery teams and customer stakeholders, and apply AI-assisted engineering practices across planning through troubleshooting. The position offers Flexible Time Off, medical, dental, and vision insurance, a 401(k) with company match, company-paid life and disability insurance, and professional development opportunities.

What you will do

Build, test, scale, and maintain cloud-native data pipelines, data models, and warehouse structures supporting SchoolTool’s dashboards and analytics.
Develop analytics solutions using Python, Apache Spark, Snowflake, SQL, and NoSQL technologies, along with BI tools such as Amazon QuickSight, Tableau, or Power BI.
Contribute end-to-end to complex data solutions, from data discovery and cleaning through model selection, validation, and deployment.
Work directly with customer stakeholders, align deliverables to their roadmap and vision, and act as a primary contact when needed.
Deliver well-defined data solutions independently and participate in technical design decisions.
Build strong technical and non-technical connections within your team, across Mindex delivery teams, and with customer stakeholders.
Use AI-assisted engineering and the AI DLC across planning, design, development, testing, documentation, and troubleshooting.
Maintain an AI-first mindset to improve productivity, accelerate problem-solving, enhance quality, automate routine tasks, and support innovation.

What you bring

AS or BS degree in Computer Science, Software Engineering, Physical Science, Mathematics, or a related field (preferred), or an equivalent combination of education and experience.
3–5 years of data engineering experience, including implementing a data pipeline for an enterprise application.
Experience with OLTP and OLAP databases and hands-on experience with serverless platforms such as AWS Lambda and/or AWS Glue.
Experience with infrastructure as code using AWS CloudFormation and Terraform, and familiarity with DevOps tools such as AWS CodePipeline, Azure DevOps, or GitLab.
Strong communication skills to clearly explain complex information to technical teams and customer stakeholders.
Strong analytical and problem-solving skills with a focus on exceptional customer service.
High organization and accuracy, with strong initiative and follow-through.
Comfort working both independently and in a collaborative, self-organizing team, including asking questions and providing or accepting feedback.
Ability to use AI to augment expertise and decision-making while maintaining ownership, accountability, and professional judgment for final outcomes.
Ability to identify opportunities to use AI to streamline workflows, reduce manual work, improve efficiency, and increase business value.
Awareness of emerging AI capabilities, tools, and best practices, with proactive identification of workplace applications.
Sound judgment for ethical, secure, and compliant use of AI technologies while protecting confidential customer and company information.
AWS Certification (Associate or Foundational) or applicable industry certifications are a plus.

Technologies you may use

Python, Apache Spark, Snowflake, SQL, NoSQL
Amazon QuickSight, Tableau, Power BI
AWS Lambda, AWS Glue, AWS CloudFormation, Terraform
AWS CodePipeline, Azure DevOps, GitLab

Location and work expectations

This role is onsite in Rochester, NY. Mindex welcomes candidates from a variety of locations; however, candidates should be open to occasional in-person participation. Candidates located within approximately 35 miles of Rochester, NY may be asked to work from the office more frequently based on business or team needs.

Additional details

Applicants must be authorized to work for any employer in the United States.
Mindex is unable to sponsor employment visas at this time.

Physical requirements/conditions

Prolonged periods sitting at a desk and working on a computer.
No heavy lifting expected; exertion up to 10 lbs.

View full job page →

3d ago

Senior Data Engineer (Snowflake, AWS)

Ecco Select Atlanta, GA

Atlanta, GA

3d ago

Contract Senior Amazon Web Services AWS

Apply Now

Job Description

ECCO Select is hiring a Senior Data Engineer to design, build, and maintain data pipelines and a Snowflake data platform on AWS. This hybrid role supports analytics and business reporting by integrating data from multiple internal and external systems, while partnering closely with analysts, BI developers, application engineers, and stakeholders.

Based in Atlanta, this contract position is focused on production-grade data engineering across pipeline orchestration, Snowflake modeling, performance tuning, and governance. The ideal candidate brings hands-on Snowflake and AWS experience and can collaborate effectively across technical and business teams.

Role Summary

As a Senior Data Engineer, you will integrate data from application systems, SaaS platforms, and third-party sources, then transform and deliver trusted datasets through a clean, well-modeled Snowflake environment. You will help ensure reliability with monitoring, data quality checks, and security controls, while documenting flows and contributing to code reviews.

Responsibilities

Design and build batch and near-real-time data pipelines on AWS using S3, Glue, Lambda, and Step Functions.
Develop and maintain Snowflake data models across raw, staging, and reporting layers for analytics and business reporting.
Load and transform data in Snowflake using Snowpipe, Streams and Tasks, and external stages.
Integrate data from internal applications, SaaS platforms, and third-party sources via APIs and file-based feeds.
Tune Snowflake for performance and cost using warehouse sizing, query optimization, and usage monitoring.
Implement data quality checks, monitoring, and alerting to identify pipeline failures and data issues early.
Apply data security and governance standards, including role-based access control and data masking.
Partner with teams supporting .NET-based application systems to source data and support integrations.
Document data flows, models, and processes, and participate in code reviews.

Required Qualifications

5-7+ years of data engineering experience.
Hands-on Snowflake experience, including data modeling, SQL development, and performance tuning.
Production experience with AWS data services including S3, Glue, Lambda, and Step Functions.
Advanced SQL and a strong understanding of data warehousing concepts such as dimensional modeling and ELT patterns.
Familiarity with C#/.NET sufficient to read, support, or build data integrations with .NET applications.
Experience with Git and CI/CD practices.
Strong communication skills and a collaborative approach with both technical and business teams.
Bachelor’s degree in Computer Science or a related field, or equivalent experience.

Tech Stack

Snowflake, AWS
S3, Glue, Lambda, Step Functions
SQL, dimensional modeling, ELT
C#/.NET, Git, CI/CD
Snowpipe, Streams and Tasks, external stages
APIs, role-based access control, data masking

Contract Details

Duration: 6 month+ contract to hire
Schedule: Hybrid, onsite 2 days weekly
Start date: November
Work location: Hybrid remote in Atlanta, GA 30318

Benefits

401(k)
401(k) matching
Dental insurance
Health insurance
Health savings account
Life insurance
Paid time off
Vision insurance

Nice to Have

Experience with dbt, Python, or Airflow.
Infrastructure as code with Terraform or CloudFormation.
Experience with Power BI, Tableau, or other BI tools that use Snowflake.
Background in events, hospitality, or customer engagement data.
SnowPro Core or AWS Data Engineer (Associate) certification.

Application Questions

Are you based in the Atlanta region and willing to work a hybrid schedule coming onsite 2 days weekly?
Can you work as a W2 employee of the agency without sponsorship or future visa transfer?
Do you have 5 or more years of experience in data engineering?
Do you have in-depth hands-on technical experience with the Snowflake platform?
Do you design, build, and maintain data pipelines regularly?
Are you proficient with AWS data services such as S3, Glue, Lambda, or Step Functions?

View full job page →

3d ago

Power BI Developer

CGI Group, Inc. Des Moines, IA

Des Moines, IA

3d ago

$64k - $141k/yr Full time Analytics Automation Developer Big Data

Apply Now

Job Description

CGI is hiring Power BI Developers for enterprise reporting work focused on report development, modernization, and conversion.

Responsibilities

Develop and modify Power BI reports, semantic models, and DAX measures
Convert predominantly Power BI paginated reports (formerly SSRS) into Power BI reporting solutions
Perform data mapping, query construction, data validation, and troubleshooting
Gather and analyze reporting requirements and translate them into technical solutions
Apply data modeling and Power BI best practices, adapting to platform-specific requirements
Work with SQL, Power BI, and enterprise data sources
Collaborate with internal product, technical, functional, and implementation teams
Coordinate with offshore developers and support delivery of assigned work
Identify and resolve issues efficiently; proactively communicate blockers and ask for assistance when needed
Build relationships and establish trust with project stakeholders
Conduct detailed testing and validation of report results

Requirements

2+ years Power BI development experience
Strong hands-on DAX experience using Power BI Studio and Power BI Desktop
Strong experience in data modeling and reporting best practices
Working knowledge of SQL, including reading, writing, and modifying queries
Experience gathering and analyzing requirements
Strong attention to detail and pattern recognition
Strong troubleshooting and analytical skills
Ability to collaborate effectively across technical and functional teams
Demonstrated willingness to ask for help, communicate blockers, and keep work moving efficiently

Technologies

Power BI
DAX
Power BI Studio
Power BI Desktop
SSRS
SQL
Databricks
Snowflake
ERP knowledge (CGI Advantage, Workday, Peoplesoft, etc.)

Benefits

Competitive compensation
Comprehensive insurance options
Matching contributions through the 401(k) plan and the share purchase plan
Paid time off for vacation, holidays, and sick time
Paid parental leave
Learning opportunities and tuition assistance
Wellness and Well being programs

Desired skills

ERP knowledge (CGI Advantage, Workday, Peoplesoft, etc.)
Experience with Databricks and/or Snowflake
Experience working with in a government environment

Other information

Location: Des Moines, IA (onsite)
Salary: USD 63,700 - 141,100 per year
CGI anticipates accepting resumes through November 30, 2026
Tag: #LI-AH9

View full job page →

4d ago

Senior Data Engineer

Teal Health United States

United States

4d ago

$90 - $125/hr Contract Senior 3d Design Tools Aws Data Engineer

Apply Now

Job Description

Teal Health is hiring a Senior Data Engineer to take ownership of the company’s data warehouse, ingestion pipelines, and modeled Omni data layer. In this hybrid United States contract role, you will build analysis-ready models so teams can confidently query consistent data across forecasting and key operational domains.

You will work end to end, starting from raw sources and moving through semantic modeling and dbt transformations, while partnering with analytics to ensure dashboards reflect an accurate, well-defined data layer. The work includes ongoing integrations, documentation, and careful handling of sensitive health information in line with HIPAA and Teal’s data governance practices.

What you’ll own

Own Teal’s data warehouse, including architecture, performance, reliability, and documentation.
Manage and extend Fivetran ingestion across source systems, troubleshooting connector and schema issues as they arise.
Build and maintain the dbt transformation layer, following a staging reporting pattern from raw sources to business-ready models used for forecasting, marketing, HubSpot, AWS, PostHog, and inventory.
Own the Omni data layer, defining relationships, joins, and modeled fields that enable cross-system answers on demand.
Partner with the analytics lead so dashboards rely on a data layer that is accurate, consistent, and well-defined.
Take on integrations early, including connecting new data sources and supporting partner data flows.
Write dbt tests and documentation so the team can trust and understand what’s in the warehouse.
Set standards for data modeling, testing, and documentation, helping shape how the data team grows.
Work from a ticketed backlog (Jira or similar), scoping requests across the company and keeping priorities visible.
Handle sensitive health data with care in line with HIPAA and Teal’s data governance practices.

Core qualifications

5+ years of experience in data engineering or analytics engineering, including ownership of a production data warehouse.
Strong SQL, including window functions, date logic, and complex joins across marketing, product, and operational data.
Fluency in Postgres/Redshift/Snowflake-style SQL features (for example: ::type casts, date_trunc()).
Hands-on experience with dbt-core, including:
- Models and sources
- dbt_project.yml and packages.yml configuration
- Jinja templating
- Custom macros (e.g., generate_schema_name)
- dbt testing and docs framework
Experience designing and developing a data warehouse using a layered staging reporting architecture.
Experience with Fivetran-landed data and comfort investigating source-specific raw schema quirks.
Working knowledge of common dbt packages such as dbt_utils and dbt_date (including surrogate keys and date spines).
A habit of clear documentation and organized, ticket-driven work.

Technologies involved

SQL, Postgres, Redshift, Snowflake
dbt-core, Jinja
Fivetran
dbt_utils, dbt_date
Omni
HubSpot, PostHog, AWS
HIPAA, Jira
Ad platforms: Google, Meta, TikTok, Bing, Reddit, Pinterest, Quora, Spotify Ads

Role details

Location: United States (hybrid). Preferred hybrid or full-time in office (San Francisco); open to Remote-US.
Employment type: Contract (~5 to 20 hours per week as projects fluctuate).
Department: Engineering
Reports to: Head of Engineering
Hourly rate: $90–$125 per hour

Preferred experience

Experience with Omni or a similar semantic/modeling layer (e.g., Looker, LookML).
Python for scripting, integrations, or pipeline tooling.
Experience with healthcare or EHR integrations.
Deeper Jinja experience, including control flow and variables within dbt models.
Experience at an early-stage or fast-growing company where you owned a data function with limited support.

View full job page →

4d ago

Data Engineer

GM Performance Power Units Concord, NC

Concord, NC

4d ago

Full time Python Amazon Athena Amazon Emr

Apply Now

Job Description

GM Performance Power Units is seeking a Data Engineer to build and operate AWS-based data pipelines that support power unit test and performance activities. The role focuses on turning engineering outputs into data that is accessible, traceable, and ready for analysis, with a clear emphasis on connecting test results to approved engine, build, and component identities.

This onsite position in Concord, NC involves close collaboration with teams including Test, Performance, Controls, IT, and business or manufacturing data roles. You will help ensure that the right reference context accompanies each dataset, and you will publish agreed test and performance summaries from AWS for controlled exchange into the business and manufacturing data platform.

What you’ll do

Build and maintain ingestion pipelines for agreed dyno, test rig, instrumentation, and performance sources, supporting batch, file, and streaming patterns when required.
Preserve source files and relevant timestamps, units, calibration references, run identifiers, and acquisition context, with validation that makes missing or disputed context visible.
Develop documented datasets and processing pipelines using Python and SQL, including duplicate prevention, late-data handling, checkpoints, and controlled replay.
Link test runs to approved engine, build, and serialize component identities, working with system owners to resolve mismatches and maintain traceable mappings.
Prepare and publish agreed test and performance summaries from the AWS environment for use by the business and manufacturing data platform, establishing controlled data exchanges and the reference data needed to connect results to engines, builds, and components.
Monitor data freshness, pipeline failures, processing performance, and cloud consumption, tuning storage, retention, and compute to meet agreed engineering and cost requirements.
Use source control, peer review, automated checks, and controlled deployment, maintaining separate development and production configurations and protecting credentials.
Document pipelines, dependencies, and recovery procedures, train a nominated deputy, and contribute to an agreed support and incident response model.

Key requirements

Practical experience building and supporting production data pipelines on AWS, including Amazon S3 and relevant processing, orchestration, and monitoring services.
Strong Python and SQL skills, including experience working with large files, time-series data, or other complex engineering datasets.
Understanding of incremental processing, idempotency, schema changes, data quality controls, and recovery from partial failure.
Experience with Git, code review, testing, and repeatable deployments, with ability to work with infrastructure as code and CI/CD practices.
Knowledge of cloud access controls, service identities, encryption, and secure connectivity, with collaboration across infrastructure and security specialists.
Ability to diagnose failures, explain cost drivers, and document a service so another engineer can maintain it.
Ability to translate engineering requirements into clear data contracts and acceptance tests, and communicate effectively with technical and business colleagues.
Relevant qualification or equivalent practical experience, with evidence of delivered outcomes.

Technology focus

AWS, Amazon S3, Python, SQL
Git, infrastructure as code, CI/CD
Microsoft Fabric, Power BI, Parquet, Delta Lake
Glue, Athena, EMR, Kinesis, Databricks
Power BI integration

Benefits

Bonus scheme
Private healthcare
401(k) plan including company match
Employer-paid life insurance and disability coverage
32 days annual leave (including holidays)
Free financial advisor access
Employee Assistance Programs (EAP)
Subsidized on-site dining
On-site gym
Discounted GM vehicle purchase/lease program
Free on-site EV charging for personal GM vehicles

Preferred qualifications

Automotive, motorsport, aerospace, manufacturing, or another test-intensive engineering environment.
Experience with dyno or rig data, including signal alignment, timestamp synchronization, calibration context, telemetry formats, and engineering metadata.
Experience with Parquet or Delta Lake, distributed processing, and AWS services such as Glue, Athena, EMR, Kinesis, or equivalent tools selected for the workload.
Cross-cloud data exchange, Microsoft Fabric or Power BI integration, and linking test results to PLM, ERP, or lifing records.
Databricks on AWS where justified by processing requirements. Databricks experience is beneficial rather than a prerequisite.

View full job page →

4d ago

Data Engineer II, Sales Data Services (SDS)

Amazon.com Services LLC Seattle, WA

Seattle, WA

4d ago

$132k - $179k/yr Full time Amazon Web Services Analytics AWS

Apply Now

Job Description

Amazon Advertising’s Sales Data Services (SDS) team is building and operating analytics platforms that support pan-Amazon sales intelligence. As a Data Engineer II, you will help design scalable, highly available, secure, and cost-effective data warehouse and data lake infrastructure and the ETL pipelines that keep self-serve analytics running. This Seattle, WA onsite role includes a competitive USD 132,100 - 178,800 yearly salary range, along with sign-on payments, RSUs, and robust benefits.

Responsibilities

Design, implement, and support data warehouse and data lake infrastructure using the AWS big data stack, Python, and Redshift.
Develop and manage ETLs to source data from multiple data lakes and create a unified data model for analytics and reporting.
Enable internal customers to use self-serve reporting and support ad-hoc reporting when needed, for both technical and non-technical stakeholders.
Develop deep understanding of large data sources to determine which data to use, how to use it, and when it is needed to solve business problems.
Handle numerous concurrent requests, prioritize when necessary, and collaborate across teams to deliver results.
Mentor other engineers, help shape team culture positively, and contribute to team growth.

Requirements

3+ years of data engineering experience.
1+ year developing and operating large-scale data structures for business intelligence analytics using ETL/ELT processes.
1+ year developing and operating large-scale data structures for business intelligence analytics using OLAP technologies.
1+ year with data modeling for large-scale business intelligence analytics.
1+ year with SQL for large-scale business intelligence analytics.
1+ year with Oracle for large-scale business intelligence analytics.
3+ years in the job offered or a related occupation.
1+ year each with large-scale business intelligence analytics using ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) processes.
Bachelor’s degree (or foreign equivalent) in Computer Science, Engineering, Information Systems, Mathematics, or a related field.
Experience with data modeling, warehousing, and building ETL pipelines.

Technologies

AWS, Python, Redshift, ETL, ELT, OLAP, SQL, Oracle, data warehouse, data lake, data modeling, data warehousing, ETL pipelines, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, IAM.

Preferred Qualifications

Experience with AWS technologies including Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions.
Experience with non-relational databases/data stores such as object storage, document or key-value stores, graph databases, or column-family databases.