What you get at Deloitte In Deloitte's Core AI & Data practice, you will help modernize data platforms, strengthen enterprise data foundations, and scale analytics and AI capabilities across the business. This onsite role in New York offers a competitive salary range of USD 116,200 to 229,100 per year, plus a discretionary annual incentive program. You will design and optimize cloud based data engineering solutions on Databricks to enable analytics and AI use cases across enterprise data platforms, collaborating with diverse teams to deliver impact.

Responsibilities

Promote data architecture, integration, and modelling best practices by documenting standards and guiding teams.
Own the design, development, and maintenance of scalable data pipelines and architectures that support enterprise data needs.
Lead efforts to enhance data quality, operational efficiency, and process scalability.
Guide teams and technology adoption by evaluating and integrating new big data and analytics technologies; mentor data engineers and architects to ensure successful project delivery.
Collaborate on data governance, security, and compliance strategies tailored to cloud data ecosystems.
Communicate technical concepts and business value to executives, business leads, and technology teams.
Oversee DevOps practices and automation to enable streamlined deployments using tools such as Azure DevOps, AWS Code Pipeline, Jenkins, TFS, and PowerShell.

Requirements

Bachelor's degree in Computer Science, Engineering, or a related field and at least 1 year of relevant experience.
Ability to work independently and as part of a team.
Effective written and verbal communication skills.
Meticulous attention to detail and a commitment to high quality.
Ability to build and sustain professional relationships.
Experience leading projects or workstreams.
Ability to manage and prioritize multiple tasks in a fast paced environment.
Strong interpersonal skills and a professional demeanor.
Ability to meet deadlines.

Technologies

Databricks, Delta Lake, Apache Spark, PySpark, Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, Unity Catalog
Apache Airflow
CI/CD pipelines, Azure DevOps, AWS Code Pipeline, Jenkins, TFS, PowerShell
AWS, Azure, GCP
Databricks Lakeflow

Benefits

Discretionary annual incentive program

The Team

Deloitte's Core AI & Data practice helps organizations modernize data platforms, strengthen enterprise data foundations, and scale analytics and artificial intelligence capabilities across the business. The team collaborates with clients to architect, engineer, and deploy cloud based data solutions that improve decision making, enable innovation, and support large scale transformation.

Preferred

Master's degree in Computer Science, Engineering, or a related field
Experience with one or more cloud ecosystems (AWS, Azure, or GCP) and related big data services
Experience tuning and optimizing performance in Databricks and Apache Spark environments
Experience with Databricks Lakeflow
Experience with artificial intelligence and machine learning solutions

Sr Databricks Data Engineer