MyHealthTeam is hiring a Senior Data Engineer (hybrid in Redwood City, CA) to take ownership of the data platform end-to-end, from ingestion and transformations through storage, querying, access, security, and ongoing roadmap execution.
Key Responsibilities
- Own the data platform end-to-end, including ingestion, transformation, storage, query, and access, and drive the platform roadmap as company data needs expand.
- Design and evolve batch and streaming pipelines using PySpark/EMR, Kinesis, Lambda, and Step Functions, ingesting data from Postgres, Salesforce, third-party vendors, and product event streams into an Iceberg-based lake.
- Model the warehouse by designing SCD tables, event tables, and data conventions that support consistent work for engineers and analysts adding new datasets.
- Collaborate with product, engineering, analytics, and operations stakeholders to translate data requests into well-scoped, reliable pipelines, and build documentation and tooling that enable self-service.
- Own the security and compliance foundation for data systems, including audit logging, access control, and temporary access workflows.
- Optimize backend query performance where the data layer interfaces with product code, including read-replica routing, indexing, caching, and IO instrumentation in Java/Spring services.
- Lead investigation and durable remediation when the data infrastructure misbehaves, such as IOPS spikes, pipeline failures, schema drift, and late data.
- Use AI daily to accelerate pipeline scaffolding, schema work, and ad-hoc investigations, and ship internal AI tooling that helps other teams do the same.
- Mentor engineers and analysts across the company on working effectively with the data platform.
Required Qualifications
- 5+ years of experience building production data pipelines and platforms.
- Deep Python (PySpark) and SQL fluency, including experience tuning Spark jobs at scale.
- Ability and willingness to work on services around the data layer, including Java and Spring Boot.
- Hands-on experience with distributed compute (Spark/EMR), streaming (Kinesis), and object storage (S3).
- Strong Postgres fundamentals, including query optimization, indexing, replication, replica routing, and diagnosing when the database is the bottleneck.
- Experience with Iceberg and Trino (or comparable technologies).
- Comfort working with CI/CD and Terraform.
- Evidence of using AI in practice, including frontier models, agentic coding tools, or internal tools developed independently.
- Proven ability to collaborate across teams that may not use the same technical language (for example, product and operations).
Technologies
- PySpark
- EMR
- Kinesis
- Lambda
- Step Functions
- Postgres
- Salesforce
- Iceberg
- Trino
- S3
- Java
- Spring Boot
- CI/CD
- Terraform
- SQL
About the Role
In this Senior Data Engineer position, you will own MyHealthTeam’s data platform, serving as the foundation for other teams to understand the business, ship product features, and meet compliance obligations. The impact of your work extends beyond individual tickets by enabling faster delivery for product, analytics, operations, and data science teams over time.
This role sits at the intersection of production engineering and data engineering. Success is measured by whether other teams move faster as a result of the platform work you deliver, including reliability, documentation, and tooling that support self-service.
What You Bring
- Ownership mindset focused on reliability, cost, accessibility, and compliance, not only task completion.
- Security-first approach to PII/PHI handling as core engineering work.
- A force-multiplier approach where documentation, tools, and reusable patterns continue improving team throughput after the initial work is complete.
- Bias for iterative shipping and instrumentation, prioritizing quick, measurable progress over extended polish cycles.
- Strong judgment on what to prioritize when priorities shift and timelines tighten.
Compensation
USD 205,000 - 240,000 per year. Hybrid location: Redwood City, CA (US).
