Data Engineer

Dahl Consulting is hiring a Data Engineer for a contract role based in Brooklyn Park, MN. This position supports large-scale data modernization and analytics work for retail and consumer services, with an emphasis on building scalable platforms and dependable batch and streaming pipelines.

The work primarily takes place on Google Cloud Platform (GCP), where you will design and deliver high-performance data infrastructure using tools like BigQuery and Apache Spark, along with supporting components across ingestion, transformation, and operational monitoring.

What you’ll do

• Design, develop, test, and maintain scalable data pipelines and ETL/ELT workflows for high-volume datasets.
• Build and optimize distributed processing solutions using Apache Spark and GCP Dataproc.
• Develop and maintain analytical datasets and processing workloads in BigQuery.
• Create reliable batch and streaming data solutions using technologies such as Spark, Hadoop, and Kafka.
• Design and support ingestion and transformation pipelines across source systems, data lakes, and analytics platforms.
• Optimize Spark and BigQuery workloads for performance, scalability, reliability, and cost efficiency.
• Troubleshoot production issues using root-cause analysis and implement long-term solutions.
• Implement data quality controls plus monitoring, logging, and alerting workflows.
• Use software engineering and DevOps best practices, including source control, CI/CD, automated testing, and deployment automation.
• Partner with cross-functional teams to translate business needs into scalable data solutions.
• Participate in code reviews and contribute to reusable frameworks, standards, and engineering best practices.

What you bring

• Proven experience in Data Engineering with a track record supporting production-grade pipelines.
• Hands-on experience designing and developing ETL/ELT solutions.
• Experience working with GCP, with strong expertise in BigQuery including SQL development, performance tuning, and query optimization.
• Hands-on experience with Apache Spark and distributed data processing frameworks, including GCP Dataproc.
• Knowledge of Hadoop, Hive, Kafka, and the Apache Spark ecosystem.
• Strong SQL skills and experience processing and analyzing large datasets.
• Proficiency in Python and/or Java/Scala.
• Understanding of data modeling, partitioning strategies, distributed computing concepts, and common data storage formats.
• Experience with DevOps practices including Git, CI/CD, automated deployments, and production support.
• Strong analytical, troubleshooting, and problem-solving skills.

Technologies you’ll work with

• Google Cloud Platform (GCP): Google Cloud Dataproc, BigQuery, GCS, BigLake
• Data processing: Apache Spark, Apache Hadoop, Apache Hive
• Streaming: Kafka
• Data formats: Parquet
• Data lake / table formats: Apache Iceberg
• Infrastructure & tooling: SQL, Python, Java, Scala, Git, CI/CD, Terraform, Infrastructure as Code (IaC)
• Analytics: Looker, LookML

Additional details

• Location: Brooklyn Park, MN (hybrid)
• Compensation: USD 48 - 75 per hour
• Job type: Contract

Preferred qualifications

• Experience with Looker and/or LookML.
• Experience with GCS, BigLake, Hive, Apache Iceberg, and Parquet.
• Experience with Infrastructure as Code (IaC) tools such as Terraform.
• Experience building and supporting Kafka-based streaming pipelines.
• Experience migrating data platforms or workloads from on-premises Hadoop/Hive environments to GCP.
• Experience supporting large-scale data lake, cloud migration, or data platform modernization initiatives.
• Familiarity with data governance, data quality, lineage, metadata management, and related best practices.

Benefits

Dahl Consulting is proud to offer a comprehensive benefits package to eligible employees that will allow you to choose the best coverage to meet your family’s needs. For details, please review the DAHL Benefits Summary: https://www.dahlconsulting.com/benefits-w2fta/.

How to apply

• Click the apply button and complete the mobile-friendly online application.
• After your application is reviewed, a recruiter will reach out with next steps.