Data Engineer - Experienced Associate
Apache Airflow
Azure
Azure Data Engineer
Azure Data Factory
Azure Data Platform
Big Data
Bigdata
Cloud
Cloud Data Engineering
Cloud Data Platform
Cloud Data Warehouse
Cloud Data Warehouse
Cloud Engineer
Cloud Operations
Cloud Platform
Cloud Platforms
Cloud Platforms Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Factory
Data Factory Azure
Data Integration
Data Integration Tools
Data Lakehouse
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Data Warehousing
Database
Databases
Databricks
ETL
Gcp Cloud
Informatica
Microsoft Azure
Snowflake
SQL
Job Description
Join PwC as an Experienced Associate Data Engineer to help clients modernize cloud data platforms for analytics and decision-making.
Responsibilities
- Build cloud data pipelines to ingest, transform, and integrate client data across AWS and Azure using Apache Airflow and Azure Data Factory
- Support migration from legacy data systems to cloud-based data lakes and data warehouses by documenting infrastructure, mapping dependencies, and implementing assigned components
- Develop data models and dimensional schemas for Snowflake and Databricks, aligning storage structures with analytics needs and documented architecture
- Write SQL and Java transformations for MySQL and PostgreSQL, using validation checks to investigate data quality issues
- Configure workflow dependencies in directed acyclic graphs and support data processing with Apache Hadoop; document pipeline behavior and troubleshoot failures
- Apply database administration, indexing, and query optimization techniques to investigate warehouse performance and resolve data management issues
- Implement data anonymization and database security controls as part of assigned tasks; verify data movement against documented client requirements
- Participate in client project discussions by clarifying requirements, sharing technical findings, incorporating feedback, and using digital and AI-assisted tools to explore integration options
Requirements
- Bachelor’s degree
- 1+ years of experience
Technology & Tooling
- AWS, Microsoft Azure, Google Cloud
- Apache Airflow, Azure Data Factory
- Databricks, Snowflake
- SQL, Java
- MySQL, PostgreSQL
- Apache Hadoop, directed acyclic graphs
- Data lakes, data warehouses
Benefits
- Annual discretionary bonus
- Medical
- Dental
- Vision
- 401k
- Holiday pay
- Vacation
- Personal and family sick leave
Additional Qualifications
- Preference for at least one field of study: Analytics/Data Science, Business Administration/Management, Computer Science/Information Systems, Economics, Engineering, Finance, Mathematics/Statistics, Operations/Supply Chain
- Experience building pipelines with Apache Airflow or Azure Data Factory for data integration and transformation
- Ability to apply data modeling and validation techniques on cloud data platform projects
- Experience with AWS or Microsoft Azure Databricks to support migration from legacy data systems
- Capability to troubleshoot Snowflake warehouse queries and evaluate performance improvements with project teams
- Comfort incorporating feedback while communicating data quality findings and asking questions during client work