Sr Databricks Data Engineer

Deloitte’s AI and Data practice is hiring a Sr Databricks Data Engineer to design, build, and optimize cloud-based data engineering solutions using Databricks and related technologies. This onsite role in Rosslyn, VA brings together pipeline engineering, governance, and DevOps practices, with opportunities to lead and coach teams responsible for enterprise-scale transformations.

Compensation: USD 116,200 - 229,100 per yearly. Deloitte also notes you may be eligible for a discretionary annual incentive program, subject to plan rules and factors including individual and organizational performance.

Core focus will include ownership of data pipelines and architectures, driving improvements in data quality and operational efficiency, and collaborating with executives, business leads, and technology teams to communicate technical concepts and business value.

What you’ll do

• Champion best practices by establishing, documenting, and promoting approaches for data architecture, integration, and modeling.
• Own data pipelines by overseeing the design, development, and maintenance of robust data pipelines and data architectures for large-scale enterprise needs.
• Drive excellence through initiatives that improve data quality, operational efficiency, and process scalability.
• Lead with technology by evaluating, piloting, and integrating new big data and analytics technologies, while leading, coaching, and developing data engineering teams and architects.
• Shape data governance by consulting on, designing, and implementing governance, security, and compliance strategies for modern cloud data ecosystems.
• Communicate clearly technical concepts and business value to diverse stakeholder groups, including executives and business and technology teams.
• Run DevOps and automation by overseeing CI/CD practices using tools such as Azure DevOps, AWS Code Pipeline, Jenkins, TFS, or PowerShell to streamline deployments and operations.

What you’ll need

• Independence and collaboration to work solo and as part of a team.
• Effective written and verbal communication across technical and business audiences.
• High attention to detail and a strong focus on quality of work product.
• Professional relationship-building and the ability to sustain working partnerships.
• Project or workstream leadership capability.
• Execution under pace with the ability to manage and prioritize multiple tasks in fast-changing environments.
• Interpersonal skills and professional demeanor.
• Deadline management.
• Bachelor’s degree in Computer Science, Engineering, or a related field.
• 5+ years of hands-on data engineering experience focused on Databricks on AWS, Microsoft Azure, or GCP.
• Experience with Lakehouse architecture, Apache Spark, Delta Lake, cloud-native databases, storage solutions, and distributed compute platforms.
• Experience with data warehousing, 3NF, dimensional modeling, enterprise data lakes, incremental data loads, and metadata-driven ingestion and data quality frameworks using PySpark.
• 1+ year leading complex, cross-functional data projects and technical teams, including experience with Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, Apache Airflow, Unity Catalog, automated CI/CD pipelines, and performance optimization of data engineering pipelines, code, and compute resources.
• Travel: ability to travel 50%, on average.
• Immigration: limited immigration sponsorship may be available.

Technologies you’ll work with

• Databricks, Lakehouse architecture, Apache Spark, Delta Lake, PySpark
• Amazon Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP)
• Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, Apache Airflow, Unity Catalog
• Data warehousing, third normal form (3NF), dimensional modeling, enterprise data lakes, incremental data loads
• Azure DevOps, AWS Code Pipeline, Jenkins, TFS, PowerShell, CI/CD

Preferred qualifications

• Master’s degree in Computer Science, Engineering, or a related field.
• Experience across one or more AWS, Azure, and GCP ecosystems and associated big data services.
• Experience tuning and optimizing performance in Databricks and Apache Spark environments.
• Experience with Databricks Lakeflow.
• Experience with artificial intelligence and machine learning solutions.

Accommodation and applicant information

Deloitte is committed to providing reasonable accommodations for people with disabilities. If you require an accommodation to participate in the recruiting process, contact the Global Call Center (GCC) at [email protected].

For applicant assistance, see: https://www2.deloitte.com/us/en/pages/careers/articles/join-deloitte-assistance-for-disabled-applic...

To view the associated benefit package document, reference: https://resources.deloitte.com/:b:/r/sites/dnet-tod-us/Shared Documents/Benefits/USBenefitsJourneyC...