Sr Data Engineer

In this senior role, you will partner with analytics and business teams to design, build, and optimize enterprise data pipelines and warehouse solutions.

Responsibilities

• Provide technical leadership for incident management and deliver technical consulting and support for current applications and solutions.
• Assemble and clean BIG data, including complex datasets from various sources, to meet functional business requirements for medium to large enhancements and IT or technical modeling projects.
• Capture and evaluate data requirements from the data architect and business partners.
• Assess development alternatives and establish project timelines.
• Build analytic tools powered by the data pipeline to support actionable insights for customer acquisition, operational efficiency, and other key business performance metrics.
• Collaborate with stakeholders and IT to design and build efficient data pipelines for medium to large enhancements and IT or technical modeling projects.
• Design and create complex data visualizations for customer insight, operational efficiency, and other key business performance metrics using reporting tools.
• Prepare, review, and/or approve solution artifacts and document activities to support delivery.
• Provide technical expertise across solution alternatives, design, testing, and documentation for medium to large enhancements and IT or technical modeling projects.
• Identify and improve internal processes to automate manual data wrangling, optimize performance, and improve data quality.
• Perform other duties as assigned or needed.

Requirements

• Understanding of data test methodologies and testing tools.
• Understanding of database management principles and methodologies, including data structures, data modeling, data warehousing, and transaction processing.
• Knowledge of data design principles, methods, and approaches using systems engineering concepts: data structured design, supportability, survivability, reliability, scalability, and maintainability.
• Excellent verbal and written communication skills and ability to work with all organizational levels.
• Ability to establish and maintain effective working relationships with business and IT teams.
• Knowledge of project planning and full lifecycle delivery using Agile framework.
• Ability to work effectively with contract employees and vendors.
• Knowledge of change and release tools and processes used to implement solutions across multiple teams and technologies.
• Education and experience:
  • Bachelor’s Degree in Data Engineering, Computer Science, Engineering, Data Sciences, or related field, with four (4) or more years as a Data Engineer or Software Engineer and experience as an Intermediate Data Engineer
  • OR Associate Degree with six (6) or more years as a Data Engineer or Software Engineer and experience as an Intermediate Data Engineer
  • OR High School Diploma or GED with eight (8) or more years as a Data Engineer or Software Engineer and experience as an Intermediate Data Engineer
• Advanced analytic tool build, data architecture and design, user requirements definition, build of BIG data pipelines, understanding of ETL tool extraction, basic data testing aptitude, and understanding of analytic tool deployment processes and best practices.
• Immigration sponsorship: This position is not eligible for immigration sponsorship (e.g., H-1B, TN, etc.).

Technologies

• Databricks
• Lakehouse Architecture
• Delta Lake
• Delta Live Tables (DLT)
• Structured Streaming
• Unity Catalog
• Databricks Workflows
• Databricks Asset Bundles
• Medallion Architecture
• Star schema

Preferred Experience

• Demonstrated experience designing and supporting scalable enterprise data platforms using Databricks and Lakehouse Architecture.
• Experience with Delta Lake, Delta Live Tables (DLT), Structured Streaming, Unity Catalog, Databricks Workflows, and Databricks Asset Bundles.
• Strong understanding of Medallion Architecture and dimensional data modeling, including star schema design.
• Experience establishing data quality, governance, and validation standards.
• Experience with CI/CD automation and DevOps methodologies for data engineering and analytics solutions.

Benefits

• Competitive compensation packages
• Medical, Dental and Vision
• 401k with company match
• Paid parental leave
• Up to 13 paid Holidays
• Paid time off
• Educational Assistance Program

Location

• Jackson, MI, US (hybrid)
• Required onsite days: Monday, Tuesday, and Thursday at One Energy Plaza in Jackson, MI.
• Must be within commutable distance or willing to relocate (relocation package available for those who qualify).