Data Engineer

Sentara Hospitals is hiring a Data Engineer for a fully remote role supporting a modern data platform on Databricks. The position emphasizes scalable pipeline development, metadata-driven ingestion, embedded data quality, and data governance.

Key Responsibilities

• Develop and maintain data pipelines using PySpark and Databricks
• Operate within a metadata-driven ingestion framework to onboard new datasets
• Implement data quality checks and validation rules as part of pipeline execution
• Support ingestion from file-based sources and ingestion tools such as Fivetran
• Manage schema changes, incremental loads, and recurring file processing patterns
• Contribute to data governance practices including tagging, metadata management, and lineage
• Troubleshoot and resolve pipeline failures and performance issues
• Collaborate with architects and stakeholders on data onboarding and requirements
• Follow and help improve coding standards, reusable components, and best practices

Required Qualifications

• 3 to 5 years of relevant experience (required), including experience in lieu of a Bachelor’s Degree
• Hands-on experience with PySpark and Databricks
• Strong SQL skills
• Experience building ETL/ELT data pipelines
• Understanding of Delta Lake concepts including merge, schema evolution, and partitions
• Familiarity with cloud platforms, with Azure preferred
• Basic experience with Git and version control
• Exposure to data catalog or governance tools such as DataHub
• Experience with Fivetran or similar ingestion tools
• Understanding of data quality and validation concepts
• Experience working with metadata-driven frameworks
• Strong problem-solving and debugging skills
• Ability to work effectively in a structured, framework-driven environment
• Focus on data quality alongside pipeline execution
• Willingness to learn and adapt in a fast-evolving data ecosystem

Technologies

• PySpark
• Databricks
• Fivetran
• SQL
• Delta Lake
• Azure
• Git
• DataHub

Compensation and Work Details

• Salary Range: USD 80,204 - 133,681 per year
• Location: Virginia Beach, VA (remote)
• Work Shift: First (Days)
• Remote Coverage States: Alabama, Delaware, Florida, Georgia, Idaho, Indiana, Kansas, Louisiana, Maine, Maryland, Minnesota, Nebraska, Nevada, New Hampshire, North Carolina, North Dakota, Ohio, Oklahoma, Pennsylvania, South Carolina, South Dakota, Tennessee, Texas, Utah, Virginia, Washington (state), West Virginia, Wisconsin, Wyoming

Benefits

• Medical, Dental, Vision plans
• Adoption, Fertility and Surrogacy Reimbursement up to $10,000
• Paid Time Off and Sick Leave
• Paid Parental & Family Caregiver Leave
• Emergency Backup Care
• Long-Term, Short-Term Disability, and Critical Illness plans
• Life Insurance
• 401k/403B with Employer Match
• Tuition Assistance – $5,250/year and discounted educational opportunities through Guild Education
• Student Debt Pay Down – $10,000
• Reimbursement for certifications and free access to complete CEUs and professional development
• Pet Insurance
• Legal Resources Plan
• Annual discretionary bonus opportunity if established system and employee eligibility criteria is met

Education

• Experience in lieu of a Bachelor’s Degree
• 3+ years of relevant experience with a degree
• 5+ years of relevant experience without a degree

Certification/Licensure

No specific certification or licensure requirements are listed.