DeveloperJobs.io
← Back to all jobs

Job Description

The Data Engineer will design, build, and optimize large-scale data pipelines and platforms in Azure to support both batch and real-time workloads.

Responsibilities

  • Design, develop, and maintain scalable data pipelines and data ingestion frameworks
  • Build batch and real-time data processing solutions using Spark and PySpark
  • Develop and optimize Azure-based data engineering solutions
  • Implement and support orchestration workflows using ADF and/or Airflow
  • Tune and optimize queries across large-scale distributed datasets
  • Design denormalized data models for big data environments
  • Perform root cause analysis and implement permanent resolutions for data and process issues
  • Create and maintain technical documentation for systems and projects

Requirements

  • PySpark / Apache Spark
  • Azure Data Engineering
  • ADF or Airflow
  • SQL & Data Modeling

Technologies

  • Airflow
  • ADF
  • Apache Spark
  • Spark / PySpark
  • PySpark
  • SQL
  • Azure Data Engineering

Compensation

  • Contract hourly pay range: $34.88/hour - $54.50/hour

Benefits

  • Medical
  • Dental
  • Vision
  • Retirement benefits

Location: Seattle, WA, United States (onsite)

Job type: Contract

Similar Jobs