DeveloperJobs.io
← Back to all jobs

Job Description

Superhuman’s Data Foundations team needs a Senior Data Engineer to build and operate large-scale pipelines and lakehouse systems that turn billions of daily events into decision-grade datasets.

Responsibilities

  • Architect, build, and own large-scale data pipelines and data lakes using Spark/Databricks to ingest and process billions of events daily into reliable, decision-grade datasets.
  • Design and implement solutions that keep data available, secure, and scalable across the platform, supporting both real-time and batch processing.
  • Own data quality, freshness, and reliability for foundational datasets by implementing automated checks, monitoring, and alerting.
  • Build ETL frameworks and tooling enabling other data teams and data scientists to self-serve and model core business entities into clean, well-documented, reusable datasets.
  • Partner with product, back-end, ML, and Data Science teams to convert business questions into high-impact data products for business-critical features, research, and experimentation.
  • Collaborate with leadership to shape the team’s charter and technical roadmap.

Requirements

  • 7+ years building and operating large-scale distributed systems, with expertise in data engineering and data modeling.
  • 5+ years running live production environments, including high-load or data-intensive workflows, with a focus on uptime and reliability.
  • Highly proficient in SQL and Python, with deep hands-on experience in Spark and a modern lakehouse or cloud data warehouse (including Databricks, Delta Lake, dbt, Snowflake, or similar).
  • Strong knowledge of ETL/ELT design patterns, orchestration tools such as Airflow, dbt, or Dagster, data quality frameworks, and CI/CD for data using Git-based deployments.
  • Strong data modeling and data warehouse design skills, plus a rigorous approach to data quality and observability.
  • Hands-on experience with modern data storage technologies such as Delta Lake, Snowflake, BigQuery, or Redshift.
  • Strategic thinker who can evaluate in-house vs. third-party approaches, balancing speed, scalability, and long-term viability.
  • Clear communicator who collaborates across diverse teams and stakeholders to deliver robust data solutions and trustworthy metrics.
  • Strong ownership mindset taking end-to-end responsibility from strategy and architecture through production and ongoing reliability.
  • Acumen for scalable, highly complex data processing, thinking holistically and raising the bar on team craft.
  • Self-starting problem-solver who thinks from first principles, manages priorities across multiple projects, and thrives in a fast-paced environment.

Technologies

  • SQL, Python, Spark, Databricks, Delta Lake
  • dbt, Snowflake, Airflow, Dagster
  • BigQuery, Redshift

Nice to Have

  • Experience with high-throughput, real-time streaming systems (e.g., Kafka, Flink, or Spark Structured Streaming) at the scale of billions of events per day.
  • Comfort with lake and lakehouse technologies (e.g., Delta Lake, Iceberg, or Hudi) and managing cloud infrastructure as code (e.g., Terraform).
  • A track record building self-serve data products, tools, or frameworks other teams rely on.
  • Experience partnering with analytics, data science, or machine learning teams as a strategic data partner to productionize data and models.

Benefits

  • Excellent health care including medical, dental, vision, mental health, and fertility benefits
  • Disability and life insurance options
  • 401(k) and RRSP matching
  • Paid parental leave
  • 20 days of paid time off per year, 12 days of paid holidays per year, two floating holidays per year, and flexible sick time
  • Generous stipends for caregiving, pet care, wellness, home office, and more
  • Annual professional development budget and opportunities

Location and Employment

  • Location: San Francisco, CA (hybrid)
  • Hub: San Francisco; Hub: Seattle
  • Employment type: Full time
  • Location type: Hybrid

Compensation

  • Salary range: USD 206,000 - 290,000 per year
  • Zone: Zone 1 $206K – $290K

Equal Opportunity

  • Equal opportunity employer
  • Participant in the US federal E-Verify program (US)
  • Abides by the Employment Equity Act (Canada)

Similar Jobs