Senior Data Engineer
Job Description
Robotics Technologies is seeking a Senior Data Engineer to join the Enrolment within its Product Platform team. The role will focus on building a modern, scalable healthcare enrollment data platform on Databricks, with an immediate priority to deliver X12 EDI 837/835 processing capabilities.
What You Will Do
- Design, develop, and maintain scalable data pipelines using Databricks.
- Build and support X12 EDI processing capabilities, with a focus on 837, 835, and 834 transactions.
- Develop high-volume, production-grade data engineering solutions for healthcare enrollment and related data flows.
- Use Delta Lake, Apache Spark, Databricks Notebooks, and Databricks Pipelines to implement and run pipelines.
- Process and transform healthcare enrollment, eligibility, and claims-related data.
- Ensure data security and compliance aligned with HIPAA guidelines, including handling of PII and PHI.
- Troubleshoot, optimize, and maintain existing data pipelines.
- Operate independently in a fast-paced program environment.
Required Qualifications
- 6+ years of experience in Data Engineering.
- Strong hands-on experience with Databricks, including Delta Lake, Spark, Notebooks, and Pipelines.
- Working knowledge of X12 EDI standards, specifically 837, 835, and 834.
- Proficiency in Python and PySpark.
- Experience building and maintaining high-volume, production-grade data pipelines.
- Healthcare domain experience with knowledge of PII, PHI, and HIPAA compliance.
- Familiarity with healthcare enrollment and eligibility data workflows.
- Ability to work independently and deliver in a fast-paced environment.
Technologies
- Databricks
- PySpark
- Python
- X12 EDI
- Delta Lake
- Apache Spark
- Databricks Notebooks
- Databricks Pipelines
Good to Have
- Previous experience with healthcare clearinghouse integrations.
- Experience with healthcare EDI transaction processing and integrations.
Role Details
- Location: New York, NY (onsite)
- Minimum Experience: 6 years