Lead Data Engineer with Databricks & DBT Exp
Manager
Apache Airflow
Automation
Big Data
Bigdata
CI/CD
Cloud
Cloud Data Engineering
Cloud Data Platform
Cloud Infrastructure
Cloud Platform
Cloud Platforms
Cloud Technology
Data
Data Analytics
Data Architecture
Data Build Tool
Data Engineer
Data Engineering
Data Engineering Lead
Data Integration
Data Integration Tools
Data Lakehouse
Data Management
Data Modeling
Data Operations
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Transforms
Data Warehouse
Database
Databricks
Dbt
DevOps
Devops Tools
DevSecOps
ETL
Facilities Management
Incident Management
Informatica
Information Technology (IT)
Infrastructure As Code
Integration
Lead Data Engineering
Management
Project Management
Security Automation
Security Devops
Software Development
Spark
Workflow Orchestration
Job Description
Realign LLC is seeking a Lead Data Engineer to direct enterprise-scale data engineering efforts in an onsite capacity in Irvine, CA. This role serves as a Data Engineering Tower/Pod Lead, coordinating onshore, nearshore, and offshore teams to deliver end-to-end data platform capabilities with strong attention to stability and SLA adherence, with relevant background in asset management.
Responsibilities
- Lead and manage the Data Engineering Tower, overseeing multiple teams and delivery pods.
- Own end-to-end data platform delivery, focusing on operational excellence and SLA adherence.
- Drive scalable data pipeline development, strengthening data quality and platform reliability.
- Manage cross-functional dependencies, support stakeholder communication, and coordinate issue escalations.
- Ensure high availability with monitoring, alerting, and production support readiness.
- Collaborate with business, portfolio management, and technology leadership teams.
- Define and implement best practices for platform governance, operational readiness, and performance optimization.
Required Qualifications
- Strong experience with Databricks, DBT, Apache Spark, and performance tuning.
- Expertise in Apache Airflow and Astronomer for workflow orchestration and DAG design.
- Deep understanding of Data Engineering, ETL/ELT, and large-scale data platforms.
- Experience with CI/CD, DevOps, Infrastructure as Code (IaC), and automation.
- Strong platform management, monitoring, and incident management experience.
- Excellent leadership and stakeholder management skills.
Technology Stack
The role emphasizes hands-on experience across the following technologies: Databricks, DBT, Apache Spark, performance tuning, Apache Airflow, Astronomer, ETL/ELT, CI/CD, DevOps, Infrastructure as Code (IaC), automation, monitoring, and incident management.
Preferred Domain Experience
- Asset Management
- Investment Management
- Capital Markets
- Portfolio & Market Data Platforms
Location and Compensation
This position is onsite in Irvine, CA and offers an annual salary of USD 120,000.
Similar Jobs
S
