The Principal Data Engineer will define and implement enterprise-scale data architecture and engineering strategies within Mayo Clinic's Enterprise Data & Analytics program, delivering data pipelines and analytics capabilities as part of a remote product team.
Location
Rochester, Minnesota, with remote work supported.
Responsibilities
- Define and implement enterprise-scale data architecture and engineering strategies, contributing to solution design, development, optimization, and technical delivery.
- Develop and deploy data pipelines, integrations, and transformations to support analytics and machine learning applications using open-source languages and vendor software.
- Apply independent judgment and provide consultative services to departments, divisions, and leadership committees.
- Collaborate with product owners and Analytics and Machine Learning delivery teams to identify and retrieve data.
- Perform exploratory analysis, transform data, visualize trends, and build and validate analytical models.
- Translate qualitative and quantitative assessments into actionable insights.
- Design, develop, review, and optimize production code and platform capabilities.
- Provide technical leadership and mentorship to engineering teams.
- Maintain a strong understanding of the organization’s current solutions, coding languages, tools, and the Enterprise Data & Analytics technology framework.
Requirements
- Bachelor's degree in a relevant field and at least seven years of professional or research experience in data visualization, data engineering, or analytical modeling techniques; or Associate's degree with at least nine years of similar experience. In-depth business or practice knowledge will be considered.
- Ability to manage a varied workload with multiple priorities and stay current on healthcare trends and enterprise changes.
- Interpersonal, time management, and cross-functional collaboration skills; strong verbal and written communication; attention to detail; and a commitment to customer service.
- Advanced experience in SQL.
- Advanced experience in scripting languages such as Python, JavaScript, PHP, C++ or Java and API integration.
- Experience with hybrid data processing methods (batch and streaming) including Apache Spark, Hive, Pig, and Kafka.
- Experience with big data, statistics, and machine learning.
- Ability to navigate Linux and Windows operating systems.
- Knowledge of workflow scheduling (Apache Airflow, Google Composer), infrastructure as code (Kubernetes, Docker), CI/CD (Jenkins, GitHub Actions).
- Experience in DataOps/DevOps and agile methodologies.
The Preferred Candidate Will Possess
- Expert-level proficiency in Python and SQL with extensive experience developing enterprise-scale production systems.
- Advanced expertise in scalable distributed computing frameworks and modern data processing platforms.
- Advanced experience implementing and governing open data architectures utilizing Apache Iceberg, Delta Lake, Apache Hudi, and related technologies.
- Deep understanding of modern analytical storage formats including Parquet, Avro, and ORC.
- Demonstrated expertise in lakehouse architecture, data platform design, and large-scale data engineering practices.
- Experience architecting cloud-agnostic solutions across multiple technology ecosystems.
- Experience designing highly scalable, fault-tolerant, secure, and observable data platforms supporting analytics, AI, machine learning, and operational workloads.
- Experience establishing enterprise engineering standards, architecture patterns, and modernization strategies.
Technologies
- SQL, Python, JavaScript, PHP, C++, Java
- Apache Spark, Hive, Pig, Kafka
- Denodo, Tableau, Power BI, SAS, ThoughtSpot, DASH, d3, React
- Snowflake, SSIS, Google BigQuery, Apache Airflow, Google Composer
- Kubernetes, Docker, Jenkins, GitHub Actions
- Linux, Windows, Apache Iceberg, Delta Lake, Apache Hudi
- Parquet, Avro, ORC
Compensation
Salary range: USD 155,500 - 225,492 per year.
Compensation detail: $155,500.80 - $225,492.80/year. Education, experience and tenure may be considered along with internal equity when job offers are extended.
Benefits
- Medical: Multiple plan options.
- Dental: Delta Dental or reimbursement account for flexible coverage.
- Vision: Affordable plan with national network.
- Pre-Tax Savings: HSA and FSAs for eligible expenses.
- Retirement: Competitive retirement package to secure your future.
Schedule and Hours
- Schedule: Full Time
- Hours/Pay Period: 80
- Schedule Details: M-F daytime hours 100% remote role, the employee needs to live within the US.
- Weekend Schedule: As business needs dictate
Exemption Status
Exempt
Site Description
As Mayo Clinic expands beyond Minnesota roots, employees are located at three major campuses in Phoenix/Scottsdale, Arizona; Jacksonville, Florida; Rochester, Minnesota, and Mayo Clinic Health System campuses across Midwestern communities, as well as international locations.
Equal Opportunity
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender identity, sexual orientation, national origin, protected veteran status or disability status. Mayo Clinic participates in E-Verify and may provide information from new employees' Form I-9 to confirm work authorization.
Recruiter
Laura Percival
