Sr Databricks Data Engineer

Deloitte seeks a Senior Databricks Data Engineer to design, build, and optimize cloud-based data engineering solutions using Databricks. This role supports modernization of data platforms and enables analytics and AI initiatives across AWS, Azure, and GCP. The position is onsite in Charlotte, NC.

Position Details

Location: Charlotte, NC (onsite)

Salary: USD 137,500 - 193,600 per year

Minimum Experience: 1 year

Education: Bachelor's degree

Responsibilities

• Establish and promote best-in-class approaches for data architecture, integration, and modeling.
• Own the design, development, and maintenance of robust data pipelines and architectures that support enterprise-scale data needs.
• Lead initiatives to improve data quality, operational efficiency, and scalability of processes.
• Evaluate, pilot, and integrate new big data and analytics technologies while guiding and developing teams of data engineers and architects.
• Consult on data governance, security, and compliance strategies tailored to cloud data ecosystems.
• Translate technical concepts and business value for executives, business leads, and technology teams.
• Oversee CI/CD adoption with tools such as Azure DevOps, AWS Code Pipeline, Jenkins, TFS, or PowerShell to streamline deployments.
• Provide clear, actionable guidance to colleagues and project teams.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field
• 5+ years of hands-on data engineering experience with a focus on Databricks on AWS, Azure, or GCP
• Experience with Lakehouse architecture, Apache Spark, Delta Lake, cloud-native databases, storage solutions, and distributed compute platforms
• Experience with data warehousing, third normal form (3NF), dimensional modeling, enterprise data lakes, incremental data loads, and metadata-driven ingestion and data quality frameworks using PySpark
• 1+ year leading complex, cross-functional data projects and technical teams, including Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, Apache Airflow, Unity Catalog, automated CI/CD pipelines, and performance optimization of data engineering pipelines, code, and compute resources
• Ability to travel 50% on average based on client needs and industry sectors
• Limited immigration sponsorship may be available
• Master's degree in Computer Science, Engineering, or a related field
• Experience in one or more of AWS, Azure, and GCP cloud ecosystems and associated big data services
• Experience tuning and optimizing performance in Databricks and Apache Spark environments
• Experience with Databricks Lakeflow
• Experience with artificial intelligence and machine learning solutions

Technologies

• Databricks
• AWS, Microsoft Azure, Google Cloud Platform (GCP)
• Lakehouse architecture
• Apache Spark, Delta Lake, PySpark
• Delta Live Tables, Autoloader, Structured Streaming
• Databricks Workflows, Apache Airflow
• Unity Catalog, CI/CD pipelines
• Azure DevOps, AWS Code Pipeline, Jenkins, TFS, PowerShell
• Databricks Lakeflow

The Team

Deloitte's Core AI and Data practice helps organizations modernize data platforms, strengthen enterprise data foundations, and scale analytics and AI capabilities across the business. The team designs, engineers, and deploys cloud-based data solutions that support improved decision-making, innovation, and large-scale transformation. Practitioners collaborate across business and technology functions to tackle data modernization challenges.