DeveloperJobs.io
← Back to all jobs

Job Description

Design and build reliable data infrastructure and pipelines that support data-driven decision-making in a hybrid environment.

Responsibilities

  • Design and implement robust, scalable ETL/ELT pipelines to ingest, transform, and load data from multiple sources
  • Enable a single source of truth for decision support and process optimization
  • Design and implement data snapshot capture and management
  • Architect queries in data lakes and relational databases, optimizing queries and indexing for performance
  • Synthesize complex datasets into user-friendly datasets
  • Build connectors and integration workflows to consolidate data across disparate systems and APIs
  • Improve reuse and value from data, including enabling usage of dark data
  • Develop data processing modules to improve data quality and link disparate data sources
  • Design, construct, and maintain data applications and tools for analytics and for data scientist use cases
  • Create automation workflows such as condition/routine emails and job scheduling
  • Establish data quality standards, validation rules, and documentation
  • Apply data governance best practices for quality, storage, and manipulation; regularly evaluate data sources and methodologies to protect data integrity and uncover patterns or insights
  • Ensure data security and compliance with all Federal, state, local requirements and Entergy policies
  • Administer business team virtual servers and manage schemas within data lakes
  • Partner with AI developers, data analysts, scientists, and business stakeholders to deliver solutions based on requirements
  • Contribute to the analytics roadmap and transform data usage for decision support and process optimization
  • Provide actionable insights into operational efficiency, reliability, and key business performance metrics
  • Create comprehensive documentation and unit/integration tests for data pipelines and systems through end-user views
  • As a provider of essential services, support additional hours, alternate locations, and additional duties related to storms, outages, emergencies, or other situations as needed; exempt employees may not be paid overtime for such duties

Requirements

  • Bachelor’s degree in Computer Science, Engineering, Mathematics, or related field
  • 3+ years of professional experience as a Data Engineer or in a closely related role
  • 3+ years developing ETL pipelines using Apache Airflow, Microsoft SQL Server Integration Services, and Python; familiarity with Google BigQuery and Snowflake
  • Strong proficiency in Apache Airflow, Python, SQL, and PowerBI
  • Solid understanding of relational databases and SQL, specifically MS SQL Server
  • Experience with cloud platforms (AWS, Azure, GCP) and associated data services
  • Familiarity with data warehouse technologies such as Snowflake and Redshift
  • Strong problem-solving skills and attention to detail
  • Ability to create and sustain a safe working environment by identifying and mitigating safety hazards
  • Ability to develop and maintain process and technical documentation
  • Foundational knowledge of change management and continuous improvement frameworks

Preferred Qualifications

  • At least 4 years developing and using tools to prepare, extract, and manipulate (big) data to create connected datasets for analytics (data lake)
  • Proficiency with data orchestration and workflow tools
  • Experience with Alation and Jira
  • Experience with real-time data processing
  • Familiarity with Entergy Work Practices and Processes
  • Deep expertise advising on applying project management principles to ensure systematic completion, identifying critical pathways and risks to delivery
  • Deep expertise leading development of data/information analyses to assist business decision-making, including detailed reports with data trends and insights

Technologies

  • Apache Airflow
  • Microsoft SQL Server Integration Services
  • Python
  • Google BigQuery
  • Snowflake
  • SQL
  • PowerBI
  • MS SQL Server
  • AWS
  • Azure
  • GCP
  • Redshift
  • ETL
  • ELT

Job Details

  • Location: The Woodlands, TX (hybrid)
  • Primary Locations: Texas - The Woodlands; Arkansas - Little Rock; Louisiana - New Orleans; Mississippi - Jackson
  • Job Function: Corporate
  • FLSA Status: Professional
  • Relocation: No Relocation Offered
  • Union Code: NON BARGAINING UNIT
  • Number of Openings: 1
  • Req ID: 125603
  • PS Job Title: Data Engineer II
  • Travel Percentage: Up to 25%
  • Working Conditions: Full-time; hybrid; occasional travel may be required

Similar Jobs