Data Engineer, Senior - Substation Data & AI Solutions
Job Description
Join PG&E’s Energy Delivery team to help power the grid with scalable data platforms that support operational analytics, artificial intelligence, asset management, and business applications. This hybrid role in Oakland combines enterprise data engineering with practical integrations across Substation systems and tools, enabling reliable, secure pipelines for both structured and unstructured information.
As a Senior Data Engineer, you will design, build, and maintain reusable data solutions using AWS, Snowflake, Python, and SQL. You will also connect Substation data across enterprise systems so teams can work from consistent datasets for analytics, document processing, and AI/ML use cases.
Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines using Python, SQL, AWS, and Snowflake.
- Integrate Substation-related data from APM, SAP, Diagnostic/Operational systems, and other Substation data sources.
- Build solutions for both structured and unstructured data, including engineering documents, PDFs, images, and equipment test results.
- Create data models and reusable data services that support analytics, AI/ML, dashboards, and operational applications.
- Develop APIs and integration solutions connecting enterprise and cloud platforms.
- Improve data quality, reliability, availability, performance, and governance.
- Support automation and modernization of manual data-processing activities.
- Partner with data scientists, application developers, business analysts, engineers, and Substation SMEs.
Requirements
- BA/BS in Computer Science, Management Information Systems, or related field, or equivalent experience.
- 5+ years of experience with data engineering/ETL ecosystem (examples: Palantir Foundry, Spark, Informatica, SAP BODS, OBIEE).
- Strong proficiency in Python and SQL.
- Experience developing enterprise-scale ETL/ELT pipelines and data integrations.
- Experience with AWS and Snowflake (or comparable cloud/data platforms).
- Experience with data modeling, APIs, relational databases, and structured/unstructured data.
- Understanding of CI/CD, Git, security, access controls, and data governance.
- Hands-on experience with AWS S3, Glue, Lambda, and Airflow.
- Experience with Snowflake/Snowpark, PostgreSQL, or similar databases.
- Experience developing React and/or Streamlit applications.
- Experience with SAP, APM/EAM, utility, or industrial asset data.
- Data pipeline experience supporting AI/ML and document-processing solutions.
Compensation and work model
- Salary range: USD 116,000 to 194,000 per year.
- Location: Oakland, CA (Hybrid).
- Incentives: This role is also eligible to participate in PG&E’s discretionary incentive compensation programs.
Department overview: Electric T&D includes 6,500+ coworkers delivering clean, safe, reliable, and affordable energy to nearly 16 million people in Northern and Central California. The team supports grid reliability and resiliency through maintenance and operations of 100,000 miles of distribution lines and over 18,000 miles of transmission lines. Electric T&D coworkers use Lean Methodology and Visual Management through Operating Reviews to cross-functionally identify and solve problems and create standard work.