Associate Data Engineer
Big Data
Bigdata
Cloud Operations
Cloud Platform
Cloud Platforms
Data
Data Analysis
Data Engineer
Data Engineering
Data Integration
Data Operations
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Warehouse
Data Warehousing
Database
Databases
ETL
Informatica
Information Technology (IT)
Integration
Spark
SQL
Job Description
The Associate Data Engineer role supports the S&S Data Science team’s External Data function by building and maintaining data pipelines that ingest third-party information into underwriting, claims, and business intelligence workflows.
Role Overview
In this position, you will create batch and streaming ETL/ELT processes that move external data into a cloud data warehouse. You will also develop job automation, reliability controls, and deployment practices so datasets remain consistent, model-ready, and suitable for downstream analytics.
Responsibilities
- Build and maintain batch and streaming ETL/ELT pipelines that feed a cloud data warehouse.
- Develop, schedule, and monitor cloud data jobs, diagnosing failures and tuning for both cost and performance.
- Write idempotent load logic that supports reprocessing and backfills without introducing duplicate records.
- Integrate external data providers and APIs, including authentication, error handling, and retry behavior.
- Implement data quality checks, validation, and alerting to surface pipeline issues early.
- Manage and deploy pipelines using infrastructure-as-code and CI/CD.
- Support data migrations and service updates with minimal downtime.
- Deliver clean, analytics- and model-ready datasets for data scientists and analysts.
Required Qualifications
- 1-5+ years of professional experience in data engineering or a related software/data role.
- Bachelor’s degree in Computer Science, Data Engineering, or a related technical field, or equivalent experience.
- Strong programming skills in Python and SQL.
- Familiarity with ETL/ELT concepts and building data pipelines.
- Experience with at least one major cloud platform, with AWS preferred.
- Familiarity with REST APIs and integrating external data sources.
- Strong attention to data quality and reliability.
- Ability to communicate clearly with both technical and business stakeholders.
Technologies
- Python, SQL
- AWS, ETL, ELT, REST APIs
- AWS Glue, AWS Lambda, S3
- Snowflake
- Apache Spark
- Kafka, Kinesis
- Infrastructure-as-code
- CDK, Terraform, CloudFormation
- CloudWatch
- CI/CD (CI CD)
Education
Bachelor’s degree in Computer Science, Data Engineering, or a related technical field (or equivalent experience).
Location
Morristown, NJ with remote work available.
Compensation
USD 71,600 - 105,000 per year.
Benefits
- Competitive compensation package
- Generous 401K employer match
- Employee Stock Purchase plan with employer matching
- Generous Paid Time Off
- Excellent benefits that go beyond health, dental & vision
- Tuition reimbursement, industry-related certifications and professional training
- Dynamic, ambitious, fun and exciting work environment
- Matching donation program, volunteer opportunities, and an employee-driven corporate giving program
Nice to Have
- Hands-on experience with AWS data services such as Glue, Lambda, and S3
- Experience loading and modeling data in a cloud data warehouse (e.g. Snowflake)
- Experience with distributed processing frameworks such as Apache Spark
- Experience with streaming technologies such as Kafka or Kinesis
- Experience with infrastructure-as-code (CDK, Terraform, or CloudFormation) and monitoring with CloudWatch
- Knowledge of geospatial analysis
- Familiarity with zero-downtime deployment patterns such as blue-green deployments
- Interest in insurance, underwriting, or claims
Similar Jobs
