Data Engineer for Supply chain Team
Apache Airflow
Azure
Azure Data Engineer
Azure Data Factory
Azure Data Platform
Big Data
Bigdata
Cloud
Cloud Data Engineering
Cloud Data Platform
Cloud Engineer
Cloud Platform
Cloud Platforms
Cloud Platforms Cloud Platforms
Data
Data Analysis
Data Analytics
Data Engineer
Data Engineering
Data Factory
Data Factory Azure
Data Integration
Data Integration Tools
Data Pipeline
Data Platform
Data Processing
Database
Databases
Engineer
ETL
Informatica
Information Technology (IT)
Microsoft Azure
Pyspark
Software Development
Spark
SQL
Workflow Orchestration
Job Description
The Data Engineer will design, build, and optimize large-scale data pipelines and platforms in Azure to support both batch and real-time workloads.
Responsibilities
- Design, develop, and maintain scalable data pipelines and data ingestion frameworks
- Build batch and real-time data processing solutions using Spark and PySpark
- Develop and optimize Azure-based data engineering solutions
- Implement and support orchestration workflows using ADF and/or Airflow
- Tune and optimize queries across large-scale distributed datasets
- Design denormalized data models for big data environments
- Perform root cause analysis and implement permanent resolutions for data and process issues
- Create and maintain technical documentation for systems and projects
Requirements
- PySpark / Apache Spark
- Azure Data Engineering
- ADF or Airflow
- SQL & Data Modeling
Technologies
- Airflow
- ADF
- Apache Spark
- Spark / PySpark
- PySpark
- SQL
- Azure Data Engineering
Compensation
- Contract hourly pay range: $34.88/hour - $54.50/hour
Benefits
- Medical
- Dental
- Vision
- Retirement benefits
Location: Seattle, WA, United States (onsite)
Job type: Contract