Data Engineer

The Electric Operations Technology Solutions (EOTS) Data Engineer designs, operationalizes, and maintains data pipelines that enable data, analytics, and AI use cases across hybrid and multi-cloud environments. This role also leads standardization efforts across data curation, data taxonomy, and Databricks and Azure solution delivery within Southern Company.

Key Responsibilities

• Design and build methods to process structured, semi-structured, and unstructured data using batch and real-time techniques
• Develop release pipelines to automate build, version control, and deployment tasks
• Create and maintain reusable templates, code libraries, and semantic models
• Implement gatekeeping and guard rail processes for promoting production data
• Collaborate with cross-functional teams across data, business, and technical stakeholders
• Advance data reusability and support modular data product delivery
• Define and enforce data quality and integrity controls
• Provide technical guidance to less experienced data engineers
• Optimize performance using parallel processing and minimizing data movement
• Stay current with data technologies and share insights across the organization
• Standardize, design, and develop Databricks applications, data integrations, and automated business processes
• Integrate data from multiple systems, databases, APIs, and business applications
• Provide technical guidance, knowledge sharing, and support for business users and fellow data engineers

Required Qualifications

• Bachelor’s degree in Computer Science, Engineering, Machine Learning, or related field
• Experience with batch and real-time data processing frameworks
• Experience with big data technologies such as Hadoop, HIVE, and Spark
• Experience with AI/ML solutions in Python
• 4+ years with on-prem tools such as MSBI, Informatica, Oracle Golden Gate, and SQL Server
• 2+ years with Microsoft Azure tools such as Data Lake, Data Factory, Databricks, Synapse, and Power BI
• Experience with containerization such as Docker and OpenShift
• Proficiency in data modeling, access, storage, and quality tools
• Familiarity with Agile, DevOps, and CI/CD methodologies
• Strong communication and collaboration skills
• Ability to lead and mentor others
• Familiarity with performance optimization and data governance
• Proactive approach to sharing knowledge and best practices
• Hands-on expertise with Databricks, SQL, Python, and Apache Spark
• Proficiency in data modeling for analytics and machine learning

Technologies

• Databricks
• Azure
• Python
• Apache Spark
• SQL
• Hadoop
• HIVE
• MSBI
• Informatica
• Oracle Golden Gate
• SQL Server
• Microsoft Azure Data Lake
• Data Factory
• Synapse
• Power BI
• Docker
• OpenShift

Location and Work Arrangement

Hybrid role based in Birmingham, AL (The Energy Center) or Atlanta, GA (30 Ivan Allen).

Onsite: 4 days per week; Remote: 1 day per week.

Education

Bachelor’s degree in Computer Science, Engineering, Machine Learning, or related field.

Experience Level

Minimum of 9 years of experience.

Benefits

• Competitive base salary
• Annual incentive awards for eligible employees
• Health, welfare and retirement benefits designed to support physical, financial, and emotional/social well-being
• Additional compensation, such as an incentive program (subject to the terms and conditions of the applicable incentive plan(s))
• A summary of benefits for this position is available at: https://seo.nlx.org/southernco/pdf/SOCO-Benefits.pdf

Equal Opportunity Employer

Southern Company is an equal opportunity employer. An applicant’s qualifications are considered without regard to race, color, religion, sex, national origin, age, disability, veteran status, genetic information, sexual orientation, gender identity or expression, or any other basis prohibited by law.