Senior Data Engineer (Healthcare)

This role is for a Senior Data Engineer to design, build, and support cloud-based data platforms in a healthcare setting. Based in Philadelphia, PA (hybrid), you will work with Azure and Databricks to deliver scalable pipelines, reliable data services, and analytics-ready models for data-driven decision-making.

Location

• Philadelphia, PA (hybrid)

Role Responsibilities

• Build and maintain ETL and ELT data pipelines.
• Develop data solutions using Azure Databricks, Azure Data Factory (ADF), and Azure Data Lake Storage (ADLS).
• Create and optimize PySpark and SQL data processing frameworks.
• Implement Delta Lake and Lakehouse architectures.
• Support data migration, modernization, and cloud transformation initiatives.
• Ensure data quality, reliability, and performance across pipelines and datasets.
• Build data models and curated datasets to support reporting and analytics.
• Implement CI/CD, monitoring, and DevOps best practices.
• Collaborate with business users, architects, and product teams in an Agile environment.

Required Skills & Technologies

• Azure Databricks
• Azure Data Factory (ADF)
• Azure Data Lake Storage (ADLS Gen2)
• PySpark
• Python
• SQL
• Delta Lake
• Data Modeling
• ETL/ELT Development
• Azure Cloud Platform
• Git & CI/CD
• Agile/Scrum

Preferred Skills

• Azure Synapse Analytics
• Power BI
• Azure DevOps
• Infrastructure as Code (IaC)
• FHIR/HL7
• AI/ML Data Pipelines

Required Experience

• 7+ years in Data Engineering
• 5+ years with Azure Data Technologies
• 2+ years in Healthcare, Payer, Health Plan, or Managed Care domains
• Experience with large-scale data pipelines and integration solutions

Additional “Nice to Have” Domains

• Claims Data
• Membership Data
• Provider Data
• Care Management Data