Data Engineer

AmeriHealth Caritas is seeking an Azure Data Engineer to help build and improve large-scale cloud data platforms on Microsoft Azure. This hybrid role supports flexible work options and centers on designing reliable data ingestion, ETL/ELT pipelines, and dimensional models delivered through Agile sprints.

What you will do

• Design and implement scalable solutions using Azure Data Factory, Azure Databricks, Azure Event Hubs, Kafka, HVR, Snowflake, and Azure Data Lake Storage
• Build robust ETL/ELT pipelines for both batch and streaming workloads using PySpark and SQL, with fault tolerance, schema evolution support, and idempotency
• Implement event-driven ingestion and processing with Event Hubs and Kafka, including integration of CDC solutions using HVR
• Tune Databricks jobs and clusters to meet SLAs and cost targets, including cluster sizing, autoscaling, caching, partitioning, shuffle optimization, and Delta Lake optimizations
• Use Azure DevOps to manage backlogs, maintain Git workflows, build YAML pipelines, run automated testing, and deploy repeatably across environments
• Conduct code reviews, enforce engineering standards, and mentor junior developers to strengthen team execution
• Collaborate with product owners, data scientists, analysts, and architects to turn business needs into prioritized user stories and deliverables in Agile (Scrum or Kanban) sprints
• Automate manual processes, optimize data delivery, and redesign infrastructure for improved scalability
• Identify and resolve data management issues to improve data quality
• Apply best practices for managing master data, reference data, metadata, data quality, and data lineage

What you bring

• 4+ years of relevant experience
• A Bachelor’s degree in computer science, Information Systems, or Software Engineering
• Hands-on experience with:
  • Azure Data Factory (4+ years), Azure Databricks (4+ years)
  • HVR (2+ years), Event Hubs (2+ years)
  • Kafka (4+ years), Snowflake (4+ years)
  • Azure Data Lake Storage, PySpark (8+ years), and SQL (8+ years)
• Expertise in dimensional modeling, SCD implementation, and data warehouse best practices
• Proven delivery experience in Agile teams (Scrum or Kanban)
• Practical experience using Azure DevOps for CI/CD, branching strategies, and pipeline automation
• Ability to profile and optimize Databricks jobs and large scale data processing workloads
• Experience with code reviews and providing technical guidance
• Strong communication skills to present technical tradeoffs to both technical and non-technical stakeholders
• Experience with Collibra data governance features
• Familiarity with MLOps patterns and integrating data platforms with ML pipelines
• Azure certifications such as DP 700, AZ 400, or Databricks Data Engineer certification
• Experience with cost optimization and observability tools for cloud data platforms
• Practical experience applying Gen AI (LLMs, embeddings, retrieval augmentation) to data engineering workflows

Benefits

• Flexible work solutions including remote options and hybrid work schedules
• Competitive pay
• Paid time off including holidays and volunteer events
• Health insurance coverage for you and your dependents on Day 1
• 401(k)
• Tuition reimbursement
• More

Work arrangement

This is a HYBRID, office-based position working in the Ellis Preserve office located in Newtown Square, PA. Core office days are Tuesday, Wednesday, and Thursday.

For roles that are 100% remote or hybrid: a minimum bandwidth of 50 Mbps download and 5 Mbps upload is required. Those fully remote associates residing in states where service is required by contract, law, or regulation will be allowed to submit for reimbursement.