Spark Streaming Developer Jobs

1 job found

27d ago

Senior Data Engineer, Growth, Insights & Analytics

Edgewell Personal Care Brands Shelton, CT

Shelton, CT

27d ago

$112k - $168k/yr Full time Senior Analytics Apache Airflow

Apply Now

Job Description

Edgewell Personal Care Brands is seeking a Senior Data Engineer in a hybrid role based in Shelton, CT to build scalable cloud data infrastructure that unlocks insights across our brands and unifies data from retail POS, syndicated data, retail media, ecommerce, and supply chain.

Responsibilities

Lead the design, development, and optimization of scalable cloud based data pipelines and architectures across AWS, Azure, or GCP to support analytics, reporting, and data science initiatives.
Build and operate a modern lakehouse style data platform using technologies such as Snowflake, Databricks, Redshift, or BigQuery to enable high performance analytics and broad data accessibility.
Collaborate with IT and Enterprise Architecture to align cloud strategy, data infrastructure, and technology roadmaps.
Ingest and manage diverse data sources including retailer POS, syndicated data (Nielsen/Circana), ecommerce, ERP systems, and retail media platforms such as AMC, Walmart Luminate, and Kroger Precision Marketing.
Develop and optimize pipelines for retail media, digital advertising, and campaign performance data (Amazon Ads, DSP, paid search, and social platforms).
Create scalable and reusable data models, APIs, and curated datasets to support self service analytics and BI tools such as Power BI.
Maintain high standards of data quality, governance, security, and privacy compliance with monitoring, metadata management, and lineage tracking.
Continuously evolve data engineering capabilities, including real time streaming pipelines (Kafka, Spark Streaming), automation frameworks, and AI ready data infrastructure.

Requirements

Bachelor’s degree required; advanced degree preferred.
6–8+ years of experience in Data Engineering, Data Platforms, or related technical field.
Proven experience designing and building cloud native data pipelines and architectures (ETL/ELT).
Strong SQL and Python skills, with proficiency in alternative languages such as Scala or Java.
Hands on experience with cloud platforms (AWS, Azure, or GCP) and modern data stack tools including Snowflake, Databricks, Airflow, dbt, Fivetran, or similar.
Experience with API based data ingestion and integration frameworks, especially for digital media and retail platforms.
Track record of transforming complex, high volume data into clean, scalable datasets.
Experience implementing data governance, quality frameworks, and observability tools.
Strong communication and stakeholder management skills, with ability to translate technical concepts into business friendly language.
Familiarity with consumer packaged goods and omnichannel data ecosystems including retailer POS, syndicated data (IRI/Nielsen/Circana), and digital commerce sources.
Hands on experience with retail media and advertising data platforms including AMC; Amazon Ads/DSP; Walmart Luminate, Kroger Precision Marketing, or CitrusAd (Criteo Retail Media).
Experience enabling marketing mix modeling, retail media measurement, or marketing analytics use cases.
Knowledge of data modeling techniques for marketing, media, and commercial analytics.
Experience with real time or streaming data pipelines (Kafka, Spark, or similar).

Technologies

SQL
Python
Scala
Java
AWS
Azure
GCP
Snowflake
Databricks
Redshift
BigQuery
Airflow
dbt
Fivetran
Power BI
Kafka
Spark Streaming
Amazon Marketing Cloud
Amazon Ads
DSP
Walmart Luminate
Kroger Precision Marketing
CitrusAd
Google Ads
Meta
TikTok

Benefits

Medical, dental & vision coverage
401(k)
Life, accident, and disability insurance
Wellness programs
Bonus
Long term incentive

Edgewell Values and Behaviors

People First: build relationships and foster inclusivity
Move Forward: innovate and take decisive action
Listen Up, Speak Up: encourage open dialogue and feedback
Own It, Together: drive results through collaboration and accountability

The EPC Insights and Analytics Team and Culture

We are a high performing, collaborative group that brings the voice of the consumer, shopper and customer into the business to drive tangible impact. The team develops cutting edge data, analytics and AI tools for a strong competitive advantage, while maintaining a supportive environment that values curiosity and diverse backgrounds.

Work Environment (Hybrid)

This position follows a hybrid model with regular presence at the Shelton, CT corporate office and some travel to the New York, NY office as needed, approximately three days per week onsite. Occasional travel may be required for key business meetings or enterprise collaboration.

View full job page →

Get Spark Streaming Developer Jobs alerts

New Spark Streaming Developer Jobs, daily.