Lead Cloud Data Engineer

The Lead Cloud Data Engineer role at Baptist Health South Florida partners with cross-functional teams to design, build, and maintain data systems and applications. The position emphasizes scalable, reliable automated data pipelines, production support with service-level adherence, and strong healthcare data security and compliance knowledge.

Responsibilities

• Collaborate with multiple teams to design, build, and maintain data systems and applications.
• Design and analyze data storage structures and implement performant automated data pipelines that are reliable and scalable in a fast-growing data environment.
• Apply data modeling principles and modern data platform knowledge to design and implement pipeline solutions.
• Provide production support and adhere to defined SLA(s).
• Test and validate deliverables using industry best practices and communicate results effectively with peers across technology teams.

Requirements

• Self-starter with strong organization, problem-solving, and learning ability.
• Demonstrated technical proficiency with a strong attention to detail.
• Knowledge of data security, compliance, and healthcare service policies.
• Proven experience testing and validating using industry best practices and communicating with technology peers.
• Strong interpersonal, written, and oral communication skills, with the ability to work across all levels of the organization.
• Bachelor’s degree in computer science or a related field.
• At least 10 years experience with a Bachelor’s degree and 8 years experience with a Master’s degree, with recent experience in data engineering and end-to-end data pipeline automation.
• Strong understanding of relational and NoSQL databases and data structures.
• Understanding of data science and business intelligence workflows.
• Programming experience ideally in Python and Java.
• Experience with large-scale data warehousing and analytics projects, including AWS technologies.
• Track record of successful written communication, with technical depth and business awareness.
• Experience with machine learning toolkits.
• Experience in production support and troubleshooting.
• 10+ years hands-on experience with modern data platforms such as Snowflake and Redshift.
• 10+ years hands-on experience with data warehouse design and architecture using AWS, including Data Vault 2.
• Experience with (or preferred): 0 or dimensional modeling, orchestration tools such as Airflow and Control-M, containerization using Docker and Kubernetes, and infrastructure as code with CloudFormation and Terraform.
• Experience with AWS services including S3, AWS Glue, Athena, Lake Formation, DynamoDB, DMS, and RDS.
• Familiarity with Agile methodology and DevOps processes, plus modern data integration tools such as dbt, Informatica Power Center, and AWS Glue or similar.
• 3+ years of data modeling, and familiarity with AI/ML and BI tools (plus).
• Big data engineering experience with Python and SQL.
• Advanced proficiency in healthcare dimensional modeling, including designing star and snowflake schemas for healthcare analytics, clinical quality measures, operational efficiency, and revenue cycle reporting.
• Practical background mapping and normalizing internal hospital codes to standardized medical vocabularies including ICD-10, SNOMED-CT, LOINC, and RxNorm.
• Production engineering experience on Google Cloud Platform (GCP), including GCS, Dataproc, BigQuery, Cloud Run, Cloud Run Functions, and Cloud Composer.
• Cloud security and identity experience, including role-based access control with Cloud IAM, securing credentials with GCP Secret Manager, and following HIPAA security rules for PHI.
• Strong programming foundation in Python with hands-on big data processing using PySpark, including job tuning, partition skew handling, and Spark cluster resource optimization.
• Deep experience modeling and transforming with dbt Core or dbt Cloud, including reusable SQL models, automated testing, and data dictionary documentation.
• Advanced workflow orchestration using Apache Airflow (Cloud Composer) and enterprise schedulers such as Control-M.
• Hands-on data governance integration with Collibra to support business glossaries, technical data dictionaries, and automated data lineage tracking.

Key Technologies

• SQL, Python, Java, AWS S3, Hadoop, Hive, Redshift, AWS, Snowflake, Data Vault 2
• Airflow, Control-M, Docker, Kubernetes, CloudFormation, Terraform
• AWS Glue, Athena, Lake Formation, DynamoDB, DMS, RDS
• Agile methodology, DevOps process, dbt, Informatica Power Center
• Healthcare and analytics modeling: Snowflake schemas, star schemas, snowflake schemas, ICD-10, SNOMED-CT, LOINC, RxNorm
• GCP and tooling: Google Cloud Platform (GCP), Google Cloud Storage (GCS), Dataproc, Spark, PySpark, BigQuery, Cloud Run, Cloud Run Functions, Cloud Composer
• Security and governance: Cloud IAM, GCP Secret Manager, HIPAA, PHI, Collibra

Salary and Location

• Location: Florida (onsite)
• Estimated salary range: USD 128,671 to 167,273 per year (depending on experience)

Benefits

• Career growth and development opportunities, with clear pathways and ongoing support.
• Comprehensive health and wellness resources that go beyond traditional benefits.
• A wellness program designed to help employees reduce their medical plan deductible and lower out-of-pocket healthcare costs.
• Tuition reimbursement to support continued learning and advancement.

Education

• Bachelor’s degree