Sr Databricks Data Engineer
Apache Spark
Azure
Big Data
Bigdata
Cloud
Cloud Native
Cloud Platform
Cloud Platforms
Data Architecture
Data Engineer
Data Governance
Data Integration
Data Lake
Data Lakehouse
Data Pipeline
Data Platform
Data Processing
Data Security
Data Warehouse
Databricks
Databricks Workflows
Delta Lake
Delta Live Tables
ETL
Google Cloud
Spark
Job Description
Senior Databricks Data Engineer with Deloitte in Dallas, TX onsite, offering USD 116,200 - 229,100 per year.
Responsibilities
- Establish and promote best practices for data architecture, integration, and modeling.
- Own the design, development, and upkeep of scalable data pipelines and architectures for enterprise needs.
- Lead initiatives to improve data quality, operational efficiency, and process scalability.
- Serve as a team and technology lead, evaluating, piloting, and integrating new big data and analytics technologies.
- Mentor and develop teams of data engineers and architects to support growth and effective project delivery.
- Provide governance, security, and compliance guidance tailored to modern cloud data ecosystems.
- Explain technical concepts and business value to executives, business leads, and technology teams.
- Oversee DevOps and automation with CI/CD practices using Azure DevOps, AWS CodePipeline, Jenkins, TFS, or PowerShell.
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related field.
- 5+ years of hands-on data engineering experience focusing on Databricks across AWS, Azure, or Google Cloud Platform.
- Experience with Lakehouse architectures, Apache Spark, Delta Lake, cloud-native databases, storage solutions, and distributed compute platforms.
- Background in data warehousing, 3NF, dimensional modeling, enterprise data lakes, incremental data loads, and metadata-driven ingestion and data quality frameworks using PySpark.
- 1+ year leading complex, cross-functional data projects and technical teams, including Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, Apache Airflow, Unity Catalog, automated CI/CD pipelines, and performance tuning of pipelines and compute resources.
- Ability to travel approximately 50% based on client engagements.
- Limited immigration sponsorship may be available.
Technologies
- Databricks, AWS, Azure, GCP
- Delta Lake, Apache Spark, PySpark
- Delta Live Tables, Autoloader, Structured Streaming
- Databricks Workflows, Apache Airflow, Unity Catalog
- Azure DevOps, AWS CodePipeline, Jenkins, TFS, PowerShell
- Databricks Lakeflow
Benefits
- Discretionary annual incentive program, subject to program rules, with awards depending on individual and organizational performance.
The Team
Deloitte's Core AI & Data practice helps organizations modernize data platforms, strengthen enterprise data foundations, and scale analytics and artificial intelligence capabilities across the business. The team collaborates with clients to architect, engineer, and deploy cloud-based data solutions that improve decision-making, enable innovation, and support large-scale transformation. Practitioners work across business and technology functions to address challenges in data modernization.
Similar Jobs