Databricks Data Engineer

The Databricks Data Engineer role at Deloitte focuses on designing, building, and optimizing cloud-based data engineering solutions to modernize data platforms and enable large-scale analytics and AI use cases.

Responsibilities

• Design and implement data pipelines and engineering solutions using Databricks, Apache Spark, Python, and SQL
• Support modernization of enterprise data platforms by deploying cloud-centric ingestion, transformation, and storage patterns
• Create and manage batch and streaming data workflows that support reporting, analytics, and AI use cases
• Apply data architecture, integration, and modeling practices to enhance data quality, scalability, and platform performance
• Collaborate with client and Deloitte teams to troubleshoot issues, implement enhancements, and support large-scale data transformation initiatives
• A successful candidate would possess these skills:
  • Ability to work both independently and as part of a team
  • Strong written and verbal communication
  • Meticulous attention to detail and quality of work
  • Ability to build and maintain professional relationships
  • Experience leading projects or workstreams
  • Capable of managing and prioritizing multiple tasks in a fast paced environment
  • Strong interpersonal skills and a professional demeanor
  • Ability to meet deadlines
  • Ability to provide clear guidance to colleagues

Requirements

• Undergraduate degree in Computer Science, Engineering, Information Systems, Data Science, Mathematics, or Statistics
• At least three years of experience in data engineering, ETL development, or data platform engineering
• A minimum of two years building data pipelines in Databricks with Spark, Python, and SQL
• Background implementing data models, data integration patterns, and cloud-based data processing workflows
• Experience with one or more cloud platforms such as AWS, Azure, or Google Cloud Platform
• Willingness to travel up to 50 percent, depending on client engagements
• Limited immigration sponsorship may be available

Technologies

• Databricks
• Apache Spark
• Python
• SQL
• AWS
• Azure
• Google Cloud Platform (GCP)
• Delta Lake
• Databricks Workflows
• Unity Catalog
• Git
• CI/CD pipelines

Preferred

• Experience with Delta Lake, Databricks Workflows, and Unity Catalog
• Experience using Git-based version control and CI/CD pipelines
• Experience supporting batch and streaming data workloads
• Experience with data warehousing, lakehouse architecture, and performance optimization
• Experience supporting analytics or machine learning data pipelines
• Experience working in consulting or client service delivery environments