Data Engineer
Apache Airflow
Big Data
Bigdata
Cloud
Cloud Data Engineering
Cloud Data Platform
Cloud Infrastructure
Cloud Native
Cloud Native Technologies
Cloud Operations
Cloud Platform
Cloud Platforms
Cloud Platforms Cloud Platforms
Cloud Technology
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Integration Tools
Data Lake
Data Lakehouse
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Database
Databases
Databricks
Databricks Lakehouse
Databricks Lakehouse Platform
DevOps
Devops Tools
DevSecOps
Engineer
Engineering
Engineering Software
ETL
Informatica
Information Technology (IT)
Kubernetes
Platform Engineering
Programming
Programming Language
Programming Languages
Security Devops
Software Development
SQL
Vector Databases
Job Description
PNC Financial Services Group is hiring a Data Engineer for its Data and Automation organization in Phoenix, AZ (onsite), focused on enterprise big data platforms and cloud-native data solutions.
Responsibilities
- Monitor, maintain, and improve the health and performance of the data platform
- Ensure stability, reliability, and scalability of data systems
- Apply platform operations and data engineering best practices, ensuring technical and business customers understand and follow standards
- Review data platform architecture and identify opportunities for automation, optimization, right-sizing, and cost reduction
- Drive user migration to a unified data platform
- Modernize legacy Hadoop systems to cloud-native architectures
- Design and build data observability analytics to support site reliability
- Develop ETL/ELT pipeline monitoring to detect bottlenecks, failures, and abnormal processing metrics
- Create intelligent alerts for high utilization Spark and Trino jobs to protect service ability for users
- Capture and report compute usage across Kubernetes, Docker, and containers to support job and query optimization
- Build dashboards and visualizations for real-time visibility into data platform health, performance, and availability
- Partner with business stakeholders to translate analytical needs into technical solutions
- Use data and BI tools to advance business initiatives through modern principles, methodologies, and tools
- Serve as an internal consultant on big data tools and capabilities
- Enhance query performance and improve data structures to support analytics
- Guide stakeholders on how to leverage data for business insights
- Define and standardize use of AI and Generative AI for task automation, faster development, and streamlined platform efficiency and governance
- Use code generation to support query and cost optimization
- Engineer solutions using vector databases, embedding pipelines, feature stores, and Retrieval-Augmented Generation (RAG) workflows
- Maintain integrity of engineering code and data through automated code generation, profiling, and data cleansing tools
- Develop internal process improvements using detailed analytics tied to key business performance metrics
- Develop, support, and implement data services for multiple applications to meet business objectives and user requirements
- Work with users, developers, operations, and business partners to define data service requirements and support data preparation process development
- Design and build data service infrastructure across multiple data platforms aligned to business processes and workflow
- Develop and implement scalable data solutions across applications, maintaining availability and maintainability
- Implement data migration and transformation activities to support accuracy and security
Requirements
- 3+ years of relevant direct industry experience; typical role requires a university/college degree (bachelor’s)
- Strong proficiency in programming languages such as Python, Spark, and Scala
- Strong practical experience in SQL development and enterprise database systems (e.g., Oracle, Teradata)
- Highly valued experience with cloud-native and open-source tools: Apache Iceberg
- Highly valued experience with cloud-native and open-source tools: Apache Airflow
- Highly valued experience with cloud-native and open-source tools: Trino
- Strong experience with modern data engineering and big data ecosystems/frameworks
- Hands-on experience building scalable data platforms and analytical solutions using Data Lakehouse architecture
- Knowledge of machine learning concepts for automation development
- Familiarity with cloud platforms such as Azure and AWS and related data services
- Experience with data observability tools (e.g., Monte Carlo, Acceldata) or monitoring stacks (e.g., Datadog, Grafana, Prometheus) is a plus
- Ability to go beyond data movement and contribute to solution design
- Strong communication skills to translate between technical and non-technical audiences
- Ability to bridge business and engineering teams
- Collaborative mindset across cross-functional teams
- Strong problem-solving and critical thinking skills
- In lieu of a degree, a comparable combination of education, job-specific certification(s), and experience (including military service) may be considered
- Bachelors
Technologies
- Python, Spark, Scala, SQL
- Oracle, Teradata
- Apache Iceberg, Apache Airflow, Trino, Hadoop
- Azure, AWS, cloud-native
- Monte Carlo, Acceldata, Datadog, Grafana, Prometheus
- Kubernetes, Docker, ETL, ELT
- Vector databases, embedding pipelines, feature stores, Retrieval-Augmented Generation, AI, Generative AI
- Data Lakehouse architecture, data observability analytics, data cleansing
Preferred Skills
- Big Data
- Data Architecture Development
- Database Management
- Data Governance
- Data Migrations
- Data Modeling
- Data Pipelines
- Data Warehousing (DW)
- Python (Programming Language)
- Structured Query Language (SQL)
Competencies
- Application Delivery Process
- Big Data Management and Analytics
- Business Intelligence
- Data Analysis - Software
- Data Architecture
- Database Structures
- Effective Communications
- Problem Solving
- Software Development Life Cycle
Benefits
- Medical/prescription drug coverage (with a Health Savings Account feature)
- Dental and vision options
- Employee and spouse/child life insurance
- Short and long-term disability protection
- 401(k) with PNC match
- Pension and stock purchase plans
- Dependent care reimbursement account
- Back-up child/elder care
- Adoption, surrogacy, and doula reimbursement
- Educational assistance, including select programs fully paid
- Robust wellness program with financial incentives
- Maternity and/or parental leave
- Up to 11 paid holidays each year
- 9 occasional absence days each year, unless otherwise required by law
- Between 15 to 25 vacation days each year, depending on career level
- Years of service
Compensation
- Base Salary: $86,250.00 – $158,125.00 (yearly)
- Salaries may vary based on geographic location, market data, and individual skills, experience, and education
- Role is incentive eligible with payment based upon company, business, and/or individual performance
Application Window
- Expected to be posted for two business days from 11/09/2026 (may be longer with business discretion)