Databricks Data Engineer
Artificial Intelligence
Azure
Big Data
Bigdata
Cloud
Cloud Data Engineering
Cloud Data Platform
Cloud Engineer
Cloud Native
Cloud Operations
Cloud Platform
Cloud Platforms
Cloud Platforms Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Governance
Data Integration
Data Integration Tools
Data Lakehouse
Data Management
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Security
Data Warehouse
Database
Databases
Databricks
Databricks Lakehouse
Databricks Lakehouse Platform
Databricks Workflows
ETL
Google Cloud
Informatica
Information Technology (IT)
Programming Languages
Reporting and Analytics
Software Development
Spark
SQL
Job Description
Deloitte is seeking a Data Engineer II for the AI & Data team to design, build, and maintain Databricks-based data pipelines and workflows. The role emphasizes batch and streaming processing, modernization of enterprise data platforms, and data modeling that supports reporting, analytics, and artificial intelligence use cases.
Responsibilities
- Design, build, and maintain data pipelines and data engineering solutions using Databricks, Apache Spark, Python, and Structured Query Language (SQL)
- Assist with modernization of enterprise data platforms by implementing cloud-based ingestion, transformation, and storage patterns
- Develop and maintain batch and streaming data workflows for reporting, analytics, and AI use cases
- Apply data architecture, integration, and data modeling practices to improve data quality, scalability, and platform performance
- Collaborate with client and Deloitte teams to troubleshoot issues, implement enhancements, and support delivery of large-scale data transformation programs
Required Qualifications
- At least 3 years of experience in data engineering, extract transform load (ETL) development, or data platform engineering
- At least 2 years building data pipelines in Databricks using Apache Spark, Python, and SQL
- Experience implementing data models, data integration patterns, and cloud-based data processing workflows
- Experience working with at least one cloud platform: AWS, Microsoft Azure, or Google Cloud Platform (GCP)
- Bachelor’s degree in Computer Science, Engineering, Information Systems, Data Science, Mathematics, or Statistics
Technology Stack
- Databricks, Apache Spark, Python, SQL
- Delta Lake, Databricks Workflows, Unity Catalog
- Amazon Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP)
- Git-based version control, continuous integration/continuous deployment pipelines
- Lakehouse architecture
Compensation and Location
- Location: Dallas, TX (onsite)
- Salary Range: USD 86,700 to 170,900 per year
Benefits
- You may also be eligible to participate in a discretionary annual incentive program, subject to the rules governing the program
Preferred Qualifications
- Experience with Delta Lake, Databricks Workflows, and Unity Catalog
- Experience using Git-based version control and continuous integration/continuous deployment pipelines
- Experience supporting batch and streaming data workloads
- Experience with data warehousing, lakehouse architecture, and performance optimization
- Experience supporting analytics or machine learning data pipelines
- Experience working in consulting or client service delivery environments