DeveloperJobs.io
← Back to all jobs
Deloitte

Sr Databricks Data Engineer

Deloitte
Morristown, NJ $116k - $229k/yr Full time Posted 6d ago
Big Data Data Architecture Data Engineer Data Governance Data Lake Data Pipeline Data Platform Data Security Data Warehouse Database Databases Databricks Databricks Workflows Spark Technical Lead
Apply Now

Job Description

At Deloitte, the Sr Databricks Data Engineer designs and optimizes cloud-based data pipelines on Databricks to modernize data platforms and empower analytics and AI across the enterprise. This onsite role in Morristown, NJ offers a competitive salary range of USD 116,200 to 229,100 per year and a mandate to lead cross-functional data initiatives that elevate data-driven decision making.

Responsibilities

  • Define and promote best-in-class approaches for data architecture, integration, and modeling.
  • Lead the design, development, and maintenance of scalable data pipelines and architectures that support large-scale enterprise data needs.
  • Drive improvements in data quality, operational efficiency, and process scalability through focused initiatives.
  • Assess, pilot, and integrate new big data and analytics technologies; mentor and develop data engineers and architects to ensure strong project delivery.
  • Advise on and implement governance, security, and compliance strategies tailored to modern cloud data ecosystems.
  • Translate technical concepts and business value for executives, business leads, and technology teams.
  • Oversee CI/CD practices with tools such as Azure DevOps, AWS Code Pipeline, Jenkins, TFS, or PowerShell to streamline deployments and operations.

Requirements

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 5+ years of hands-on data engineering experience focused on Databricks across AWS, Azure, or Google Cloud Platform (GCP).
  • Experience with Lakehouse architecture, Apache Spark, Delta Lake, cloud-native databases and storage, and distributed compute platforms.
  • Experience with data warehousing, 3NF, dimensional modeling, enterprise data lakes, incremental data loads, and metadata-driven ingestion and data quality frameworks using PySpark.
  • 1+ year leading complex, cross-functional data projects and technical teams, including Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, Apache Airflow, Unity Catalog, automated CI/CD pipelines, and optimization of data pipelines, code, and compute resources.
  • Ability to travel 50% on average based on client engagements.
  • Limited immigration sponsorship may be available.

Technologies

  • Databricks
  • AWS
  • Azure
  • Google Cloud Platform (GCP)
  • Delta Lake
  • Apache Spark
  • PySpark
  • Delta Live Tables
  • Autoloader
  • Structured Streaming
  • Databricks Workflows
  • Apache Airflow
  • Unity Catalog
  • Databricks Lakeflow
  • Azure DevOps
  • AWS Code Pipeline
  • Jenkins
  • TFS
  • PowerShell

Benefits

  • Discretionary annual incentive program

Preferred

  • Master's degree in Computer Science, Engineering, or a related field
  • Experience in one or more cloud ecosystems (AWS, Azure, GCP) and associated big data services
  • Experience tuning and optimizing performance in Databricks and Apache Spark environments
  • Experience with Databricks Lakeflow
  • Experience with artificial intelligence and machine learning solutions

Similar Jobs