Data Engineer, Foundations
3d Design Tools
Apache Airflow
Aws Data Warehouse
Big Data
Bigdata
Cloud
Cloud Data Engineering
Cloud Data Platform
Cloud Data Warehouse
Cloud Data Warehouse
Cloud Platform
Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Build Tool
Data Engineer
Data Engineering
Data Integration
Data Integration Tools
Data Lakehouse
Data Management
Data Modeling
Data Operations
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Transforms
Data Warehouse
Data Warehousing
Database
Databases
Databricks
ETL
Google Cloud Bigquery
Informatica
Integration
Snowflake
Software Development
Spark
SQL
Job Description
Superhuman’s Data Foundations team needs a Senior Data Engineer to build and operate large-scale pipelines and lakehouse systems that turn billions of daily events into decision-grade datasets.
Responsibilities
- Architect, build, and own large-scale data pipelines and data lakes using Spark/Databricks to ingest and process billions of events daily into reliable, decision-grade datasets.
- Design and implement solutions that keep data available, secure, and scalable across the platform, supporting both real-time and batch processing.
- Own data quality, freshness, and reliability for foundational datasets by implementing automated checks, monitoring, and alerting.
- Build ETL frameworks and tooling enabling other data teams and data scientists to self-serve and model core business entities into clean, well-documented, reusable datasets.
- Partner with product, back-end, ML, and Data Science teams to convert business questions into high-impact data products for business-critical features, research, and experimentation.
- Collaborate with leadership to shape the team’s charter and technical roadmap.
Requirements
- 7+ years building and operating large-scale distributed systems, with expertise in data engineering and data modeling.
- 5+ years running live production environments, including high-load or data-intensive workflows, with a focus on uptime and reliability.
- Highly proficient in SQL and Python, with deep hands-on experience in Spark and a modern lakehouse or cloud data warehouse (including Databricks, Delta Lake, dbt, Snowflake, or similar).
- Strong knowledge of ETL/ELT design patterns, orchestration tools such as Airflow, dbt, or Dagster, data quality frameworks, and CI/CD for data using Git-based deployments.
- Strong data modeling and data warehouse design skills, plus a rigorous approach to data quality and observability.
- Hands-on experience with modern data storage technologies such as Delta Lake, Snowflake, BigQuery, or Redshift.
- Strategic thinker who can evaluate in-house vs. third-party approaches, balancing speed, scalability, and long-term viability.
- Clear communicator who collaborates across diverse teams and stakeholders to deliver robust data solutions and trustworthy metrics.
- Strong ownership mindset taking end-to-end responsibility from strategy and architecture through production and ongoing reliability.
- Acumen for scalable, highly complex data processing, thinking holistically and raising the bar on team craft.
- Self-starting problem-solver who thinks from first principles, manages priorities across multiple projects, and thrives in a fast-paced environment.
Technologies
- SQL, Python, Spark, Databricks, Delta Lake
- dbt, Snowflake, Airflow, Dagster
- BigQuery, Redshift
Nice to Have
- Experience with high-throughput, real-time streaming systems (e.g., Kafka, Flink, or Spark Structured Streaming) at the scale of billions of events per day.
- Comfort with lake and lakehouse technologies (e.g., Delta Lake, Iceberg, or Hudi) and managing cloud infrastructure as code (e.g., Terraform).
- A track record building self-serve data products, tools, or frameworks other teams rely on.
- Experience partnering with analytics, data science, or machine learning teams as a strategic data partner to productionize data and models.
Benefits
- Excellent health care including medical, dental, vision, mental health, and fertility benefits
- Disability and life insurance options
- 401(k) and RRSP matching
- Paid parental leave
- 20 days of paid time off per year, 12 days of paid holidays per year, two floating holidays per year, and flexible sick time
- Generous stipends for caregiving, pet care, wellness, home office, and more
- Annual professional development budget and opportunities
Location and Employment
- Location: San Francisco, CA (hybrid)
- Hub: San Francisco; Hub: Seattle
- Employment type: Full time
- Location type: Hybrid
Compensation
- Salary range: USD 206,000 - 290,000 per year
- Zone: Zone 1 $206K – $290K
Equal Opportunity
- Equal opportunity employer
- Participant in the US federal E-Verify program (US)
- Abides by the Employment Equity Act (Canada)