Cloud Data Warehouse

Cloud Data Warehouse Developer Jobs

15 jobs found

Today

Senior Data Engineer - AWS Data Platform (Redshift, Glue, and Airflow)

Versant Media Orlando, FL 🇺🇸 Remote

Orlando, FL

Today

Full time Backend Developer Senior 3d Design Tools

Apply Now

Job Description

Versant Media is hiring a Senior Data Engineer for a fully remote role from Orlando, FL. In this position, you will design and build data pipelines and analytics-ready structures across the data warehouse environment, with hands-on work spanning AWS Redshift, AWS Glue, and Airflow. If you enjoy solving production data challenges and mentoring other Data Engineers, this role combines engineering depth with direct impact on reporting and analytics needs.

What you’ll do

Own database architecture and design for data warehouses and data marts that support presentation layers, elastic cubes, reporting, and analytics.
Build and optimize SQL solutions using tsql or psql, including query tuning, table development, and development of stored procedures and functions.
Create indexes to improve performance across key workloads.
Develop and support ETL/ELT processes, including shared responsibility for monitoring data warehouses and data marts.
Develop and support data pipelines using Airflow, AWS Glue, Azure Data factory, Python, and Golang.
Troubleshoot and resolve data issues in production systems.
Collaborate with business users and project managers to resolve business problems and implement solutions.
Use technical experience to propose improved approaches for new and existing issues.
Coordinate with other IT departments on systems communication processes, including meetings with technical operations and infrastructure groups.
Mentor other Data Engineers.
Identify software solutions needed for new projects.
Provide weekly reporting to management on project status and issues.
Support on-call production support.

What you bring

7+ years of data warehousing / OLAP experience.
7+ years of multidimensional database architecture and design experience.
5+ years SQL experience.
3+ years Python experience.
2+ years Redshift experience.
2+ years NoSQL experience.
Team and vendor partner management.
Clear understanding of principles and techniques of Web development.
Experience with AWS Glue and Airflow.
Experience with API.
Dimensional database architecture experience.
Formal systems life cycle methodology experience.

Helpful experience

Cloud Data Warehouse operations experience.
Tableau, SSRS, big data, and Realtime BI experience.
Experience with data streaming.

Tools and technologies

tsql, psql, Airflow, AWS Glue, Azure Data factory, Python, Golang, Azure, AWS, GCP, Redshift

Fully remote: This role is designated as fully remote, expected to contribute from a non-Versant worksite, most commonly an employee’s residence.

View full job page →

1d ago

Data Engineer

Ookla Remote 🌍 Remote

Remote

1d ago

$85k - $125k/yr Full time 3d Design Tools Apache Airflow Aws Athena

Apply Now

Job Description

Ookla is seeking an entry-level Data Engineer to help build and maintain data pipelines that support data scientists and analysts working with mobile and fixed internet performance data. This role centers on creating reliable jobs and operational tooling for high-volume processing, along with practical debugging, monitoring, and performance improvements. You will also collaborate closely with stakeholders to keep data workflows running smoothly.

As a Remote Data Engineer, you will develop and operate systems that turn large-scale datasets into dependable inputs for analytics and reporting, while supporting cross-functional teams across engineering and product.

What you will do

Build high volume data processing jobs across platforms such as Redshift, Athena, Iceberg, Spark, and Airflow
Debug queries, monitor jobs, and identify bottlenecks affecting system performance
Work to improve efficiency in data processing workflows and operational execution
Support and collaborate with data scientists, analysts, and product managers

What you bring

Bachelor’s degree in Computer Science or a related field (or equivalent experience)
1+ year of professional experience in data engineering
Knowledge of SQL, databases including MySQL, Redshift, and Athena, plus data modeling
Experience with workflow orchestrators including Dagster, Airflow, or Prefect
Experience working with Python
Strong communication skills in person and via virtual mediums
Background check required

Technologies you will work with

Redshift, Athena, Iceberg, Spark, Airflow
SQL, MySQL, data modeling
Dagster, Prefect, Python

Helpful experience

ETL/ELT design patterns
Experience with AWS cloud services
Experience with high volume distributed data processing in Spark

Compensation

The salary compensation range for this role is $85,000 to $125,000 annually.

View full job page →

4d ago

Principal Data Engineer, People Data

Okta Bellevue, WA

Bellevue, WA

4d ago

$197k - $271k/yr Full time Apache Airflow Big Data Bigdata

Apply Now

Job Description

The Principal Data Engineer will join Okta’s People Data and Data & Insights team, shaping scalable enterprise data solutions for candidate and employee lifecycle information. This role combines technical architecture, data governance, and cross-functional leadership to improve data availability, integrity, and adoption across the organization.

Role Overview

As a Principal Data Engineer, you will architect, build, and maintain critical systems that support externally reported people-related numbers. You will lead complex technical initiatives spanning multiple data domains, with a focus on data modeling standards, governance rigor, and reliable data contracts that support global product teams.

Core Responsibilities

Design, build, and evolve high scale data solutions that establish reference architecture and simplify access to data across the organization
Create data quality frameworks including monitoring, anomaly detection, and alerting, with governance, lineage tracking, and change management practices appropriate for externally reported metrics
Drive adoption of consistent data modeling patterns, naming conventions, documentation norms, and metric governance standards across the data organization
Lead cross-functional technical initiatives across data verticals to accelerate delivery and improve the resilience of data systems
Make sound technical decisions in ambiguous environments, balancing near-term delivery with long-term infrastructure investment
Champion Data Contracts by implementing data contracts and schema evolution practices to support reliability across global product teams
Mentor and scale engineering execution by mentoring senior engineers, leading cross-functional task forces, and fostering a culture of engineering excellence and data-driven decision making
Stay current with emerging data technologies and practices to guide the team’s long-term technical direction

Requirements

10+ years of experience in data engineering, with proven experience in a senior or lead capacity; experience with Federal government compliance and security requirements is highly desirable
Expert-level experience with SQL, ETL/ELT tools (Airflow, dbt), and MPP databases (Snowflake, Redshift), plus extensive hands-on experience with AWS services (S3, Lambda, EMR, ECR, EKS)
HR data expertise, including candidate lifecycle, employee records, compensation, and organizational data, with experience designing data models for recruiting analytics, engagement signals, and workforce planning metrics
Familiarity with Workday data structures is a bonus
Experience building and maintaining both batch and realtime pipelines using technologies such as Spark and Kafka
Deep experience designing and working with modern lakehouse and warehouse architectures (Databricks, Snowflake) and modern file formats (Iceberg, Delta)
Demonstrated ability to integrate AI tools to optimize or redesign workflows and drive measurable impact such as efficiency and quality improvements
Track record of hands-on collaboration with Data Science, Business, and Product teams

Technologies

SQL, Airflow, dbt, Snowflake, Redshift
AWS: S3, Lambda, EMR, ECR, EKS
Spark, Kafka, Databricks
Iceberg, Delta

Location and Salary

Location: Bellevue, WA (hybrid)
Compensation: USD 197,000 - 270,600 per year
Experience Level: 10+ years

The Okta Experience

Supporting Your Well-Being
Driving Social Impact
Developing Talent and Fostering Connection + Community

View full job page →

4d ago

Principal Data Engineer, People Data

Okta Chicago, IL

Chicago, IL

4d ago

$197k - $271k/yr Full time Manager Senior 3d Design Tools

Apply Now

Job Description

Okta is building trusted identity experiences, and this Principal Data Engineer role helps power reliable people and workforce data across the employee lifecycle. You will architect, build, and maintain scalable data solutions for candidate and employee information, ensuring teams can access high-quality reference data with confidence. This Chicago-based hybrid role also offers a platform for long-term technical direction, mentorship, and cross-functional influence.

Compensation: USD 197,000 - 270,600 per year.

What you’ll do

Design, build, and evolve high-scale data solutions that act as reference architecture and simplify data access across the organization.
Create data quality frameworks including monitoring, anomaly detection, and alerting, with governance, lineage tracking, and change management rigor suited for externally reported metrics.
Drive consistent data modeling patterns, naming conventions, documentation norms, and metric governance standards across data teams.
Lead cross-functional technical initiatives across data verticals to accelerate delivery and strengthen data systems.
Make sound technical decisions in ambiguous environments by balancing short-term delivery with long-term infrastructure investment.
Champion Data Contracts by implementing data contracts and schema evolution practices that support reliability across global product teams.
Raise the technical bar through mentoring senior engineers, leading cross-functional task forces, and strengthening a culture of engineering excellence and data-driven decision making.
Stay current with the data landscape by adopting and advocating for emerging technologies and practices to guide the team’s long-term direction.

What you bring

10+ years of experience in data engineering in a senior or lead capacity. Experience with Federal government compliance and security requirements is highly desirable.
Expert-level SQL plus hands-on experience with ETL/ELT tools such as Airflow and dbt.
Experience with MPP databases including Snowflake and Redshift.
Extensive hands-on experience with AWS services: S3, Lambda, EMR, ECR, and EKS.
Expertise in HR data including candidate lifecycle, employee records, compensation, and organizational data.
Experience designing data models for recruiting analytics, engagement signals, and workforce planning metrics.
Bonus: familiarity with Workday data structures.
Experience building and maintaining batch and real-time pipelines using tools such as Spark and Kafka.
Deep experience with modern lakehouse and warehouse architectures (Databricks, Snowflake) and modern file formats (Iceberg, Delta).
Demonstrated ability to integrate AI tools to optimize or redesign workflows with measurable impact, such as efficiency gains and quality improvements.
A track record of hands-on collaboration with Data Science, Business, and Product teams.

Technologies you’ll work with

SQL, Airflow, dbt, Snowflake, Redshift, AWS S3, AWS Lambda, AWS EMR, AWS ECR, AWS EKS, Spark, Kafka, Databricks, Iceberg, Delta.

The Okta experience

Supporting Your Well-Being
Driving Social Impact
Developing Talent and Fostering Connection + Community

View full job page →

4d ago

Principal Data Engineer, People Data

Okta San Francisco, CA

San Francisco, CA

4d ago

$197k - $271k/yr Full time Apache Airflow Big Data Bigdata

Apply Now

Job Description

Okta’s Data and Insights team is hiring a Principal Data Engineer to architect, build, and maintain scalable data solutions for People (HR) data. This hybrid role in San Francisco, CA partners closely with People teams and cross-functional data and product stakeholders to keep data available and trustworthy across the employee lifecycle. You will help establish the organization’s data reference architecture while enabling consistent access to HR data at scale.

What you’ll do

Design, build, and evolve high-scale data solutions that act as organizational reference architecture and make data access simpler across the company.
Create data quality frameworks including monitoring, anomaly detection, and alerting, with governance, lineage tracking, and change management rigor for externally reported numbers.
Drive organization-wide adoption of consistent data modeling patterns, naming conventions, documentation norms, and metric governance standards.
Lead cross-functional technical initiatives across data verticals to accelerate delivery and harden data systems.
Operate effectively in ambiguity by making sound technical decisions that balance near-term delivery with long-term infrastructure investment.
Champion Data Contracts by implementing data contracts and schema evolution practices to improve reliability across global product teams.
Mentor and scale the team by raising the technical bar, mentoring senior engineers, leading cross-functional task forces, and strengthening a culture of engineering excellence and data-driven decision making.
Stay current with the data landscape by adopting and advocating for emerging technologies and practices to shape the team’s long-term direction.

What you bring

10+ years in data engineering, with a track record in a senior or lead capacity. Experience with Federal government compliance and security requirements is highly desirable.
Expert-level skills in SQL, ETL/ELT tools such as Airflow and dbt, and MPP databases like Snowflake and Redshift.
Extensive hands-on experience with AWS services including S3, Lambda, EMR, ECR, and EKS.
Deep expertise in HR data, including candidate lifecycle, employee records, compensation, and organizational data, plus experience designing data models for recruiting analytics, engagement signals, and workforce planning metrics.
Bonus: familiarity with Workday data structures.
Experience building and maintaining batch and realtime pipelines using technologies such as Spark and Kafka.
Deep experience with modern lakehouse and warehouse architectures (including Databricks and Snowflake) and modern file formats such as Iceberg and Delta.
Demonstrated ability to integrate AI tools to optimize and redesign workflows with measurable impact (for example efficiency gains and quality improvements).
A proven record of hands-on collaboration with Data Science, Business, and Product teams.

Technologies

SQL, Airflow, dbt, Snowflake, Redshift, AWS S3, AWS Lambda, AWS EMR, AWS ECR, AWS EKS, Spark, Kafka, Databricks, Iceberg, Delta

Compensation

USD 197,000 - 270,600 per year.

The Okta Experience

Supporting Your Well-Being
Driving Social Impact
Developing Talent and Fostering Connection + Community

View full job page →

4d ago

Staff Software Engineer, Data Platform (FedRAMP)

Okta San Francisco, CA

San Francisco, CA

4d ago

$194k - $267k/yr Full time Backend Developer Apache Beam Apache Mesos

Apply Now

Job Description

Okta’s Data Platform team is hiring a Staff Software Engineer to build and optimize streaming infrastructure for high volume, low-latency distributed data-platform services and data products.

Responsibilities

Design, implement, and own data-intensive, high-performance, scalable platform components
Partner with engineering teams, architects, and cross-functional stakeholders on project design and implementation
Participate in design reviews, code reviews, analysis, and performance tuning
Coach and mentor engineers to help the organization scale
Debug production issues across services and multiple layers of the stack

Requirements

8+ years of experience in an object-oriented language, preferably Java
Hands-on experience with cloud-based distributed computing technologies, including messaging systems such as Kinesis and Kafka
Hands-on experience with cloud-based distributed computing technologies such as Flink, Spark, and Beam
Hands-on experience with storage and compute systems such as Snowflake and Hadoop
Hands-on experience with coordinators and schedulers such as those in Kubernetes, Hadoop, and Mesos
Experience developing and tuning highly scalable distributed systems
Excellent grasp of software engineering principles
Solid understanding of multithreading, garbage collection, and memory management
Experience with reliability engineering, including data quality, data observability, and incident management
Ability to access federal environments and/or protected federal data, including submitting documentation establishing U.S. Person status upon hire (e.g., U.S. Citizen, National, Lawful Permanent Resident, Refugee, or Asylee per 22 CFR 120.15)

Technologies

Java
Kinesis, Kafka
Flink, Spark, Beam
Snowflake, Hadoop
Kubernetes, Mesos
ElasticSearch

About the Team

The Data Platform team delivers foundational data services, systems, and data products for Okta
Current focus areas include streaming analytics, interactive end-user reporting, data and ML platform capabilities for scaling, and telemetry of products and data
Culture emphasizes ownership, speed, creativity, and flexibility

About the Position

Join Okta’s Data Platform organization to help scale high volume, low-latency distributed data-platform services and data products
Build foundational infrastructure that supports Okta’s long-term scale needs
Design, build, and deploy systems powering data analytics and ML
Work within an analytics infrastructure stack that includes Kinesis, Flink, ElasticSearch, and Snowflake
Own and optimize streaming infrastructure across design, deployment, and performance
Engineering leadership directive: make Okta a leader in using data and machine learning to improve end-user security and expand that capability across engineering

Nice to Have

Maintained security, encryption, identity management, or authentication infrastructure
Leveraged major public cloud providers to build mission-critical, high volume services
Hands-on experience developing Data Integration applications for large scale environments (petabyte scale), with batch and online systems
Contributed to distributed systems and/or used systems at high volume or criticality such as Kafka or Hadoop
Experience developing Kubernetes-based services on AWS Stack

Location

San Francisco, CA (hybrid)

Compensation

USD 194,000 - 267,000 per year

Additional Okta Experience

Supporting Your Well-Being
Driving Social Impact
Developing Talent and Fostering Connection + Community

View full job page →

4d ago

Sr. Software Engineer

Viant Technology Irvine, CA

Irvine, CA

4d ago

$150k - $180k/yr Full time Backend Developer Senior APIs

Apply Now

Job Description

Viant Technology’s Potens team builds internal platforms that power workflow orchestration and large-scale data exploration, and the team is expanding AI-powered capabilities. In this onsite role in Irvine, CA, you’ll help evolve Magnus and Goliath with a hands-on, full-stack approach across backend services, data platforms, and production AI integrations.

You’ll collaborate on modernization work for established systems while developing new capabilities for how users and authorized AI agents create, manage, and execute workflows and explore BigQuery data.

What you’ll do

Maintain and modernize Magnus Java applications, REST APIs, and Goliath JavaScript/jQuery frontend
Develop and support backend capabilities using Java and Go
Build production AI features and integrations using LLMs, tool calling, guardrails, evaluation, and MCP
Integrate with BigQuery, MySQL, GCP services, and internal APIs
Diagnose and resolve application, workflow, database, performance, and production issues
Build automated tests and deliver reliable, production-quality software
Own projects end to end, from technical proposal and implementation through deployment and production support
Participate in code reviews and contribute to sound engineering practices across the team

How Magnus and Goliath work

Magnus is a visual workflow orchestration platform supporting BigQuery, Cloud Storage, MySQL, REST APIs, email, FTP, conditional routing, parallel execution, Go and JavaScript scripting, YAML workflow definitions, debugging, audit history, and access controls.

Goliath is a lightweight, high-performance BigQuery development interface for writing and executing SQL, browsing datasets and tables, visualizing results, and managing cost and quota allocation without requiring direct access to the GCP Console.

Benefits

Fully paid health insurance
Paid parental leave
Unlimited PTO

Technologies you may work with

Java, Go, JavaScript, jQuery
BigQuery, MySQL, GCP, REST APIs
LLMs, tool calling, guardrails, evaluation, MCP (including MCP server/client development)
Docker, Kubernetes, GKE, CI/CD pipelines, GitHub Actions
Python, Java 8, Tomcat, JSP, CodeMirror, Chart.js, YAML
Cloud Storage, REST, FTP, Email
MySQL performance optimization, GCP Console

Compensation: USD 150,000 - 180,000 per year.

Great to have

MCP server/client development and AI agent or tool-calling architectures
Go development in production environments
GCP and BigQuery
Docker, Kubernetes, or GKE
MySQL performance optimization
CI/CD pipelines, including GitHub Actions
Python development
Java 8, Tomcat, JSP, CodeMirror, or Chart.js
Incremental modernization of mature applications while maintaining production stability