DeveloperJobs.io
← Back to all jobs

Job Description

Join a team delivering an enterprise Databricks data platform on Microsoft Azure. This hybrid role in Jersey City, NJ focuses on building and supporting scalable data engineering solutions across integration, security, automation, and platform best practices. You will collaborate with application development, infrastructure, cloud, security, architecture, and data teams to help production workloads run reliably.

What you’ll do

  • Design, implement, and support the Databricks data platform, including ongoing development.
  • Work with technology and data teams to build and enhance scalable data solutions using Databricks and Microsoft Azure.
  • Concentrate on core areas including data engineering, integration, security, automation, and platform best practices.
  • Collaborate across application development, infrastructure, cloud, security, architecture, and data teams to align with enterprise standards.

Core technologies you’ll work with

Key tools and platforms include Azure, Azure Databricks, Apache Spark, Databricks Workspace, Unity Catalog, and Delta Lake. You’ll also use MLflow, Spark UI, Azure Data Lake Storage Gen2 (ADLS Gen2), Azure Data Factory, and CI/CD, with familiarity across Git and orchestration/monitoring practices supported by tools such as Apache Airflow.

Requirements

  • Azure and Databricks experience
  • Apache Spark
  • CI/CD experience
  • Hands-on experience with Databricks Workspace
  • Hands-on experience with Unity Catalog
  • Hands-on experience with Delta Lake
  • Hands-on experience with Spark UI
  • Hands-on experience with MLflow
  • Strong development experience with Python, PySpark, SQL, and/or Java
  • Experience developing and optimizing data processing plus ETL/ELT pipelines
  • Strong Microsoft Azure experience, including Azure Databricks, ADLS Gen2, and Azure Data Factory
  • Experience with AWS (including S3 and IAM) is desirable
  • Experience with Git and CI/CD pipelines
  • Experience with OpenShift and Kubernetes
  • Experience with Terraform / Infrastructure as Code (IaC)
  • Experience implementing or supporting Databricks security and access controls, including secrets management and identity integration
  • Experience implementing or supporting data governance and Unity Catalog
  • Experience with Databricks workflows, job orchestration, monitoring, troubleshooting, and production support
  • Ability to collaborate across technical teams and operate within enterprise architecture, security, change-management, and governance standards
  • Knowledge of Apache Airflow

Hybrid work setup and eligibility

  • Location: Jersey City, NJ
  • Hybrid schedule: ideally 5 days onsite, with flexibility to 3-4 days (discussed during interview)
  • Candidates local to the NJ/NY area
  • USC & GC only

Compensation

Estimated pay rate: USD $70 to $85 per hour.

Benefits

  • Medical, Prescription, Dental & Vision Benefits (for employees working 20+ hours per week)
  • Health Savings Account (HSA) (for employees working 20+ hours per week)
  • Life & Disability Insurance (for employees working 20+ hours per week)
  • MetLife Voluntary Benefits
  • Employee Assistance Program (EAP)
  • 401K Retirement Savings Plan
  • Direct Deposit & weekly epayroll
  • Referral Bonus Programs
  • Certification and training opportunities

What’s in it for you

  • Benefit eligibility is aligned with applicable laws and client requirements.
  • Displayed pay ranges are estimations; actual pay is based on experience, technical expertise, and qualifications listed in the job description.

Similar Jobs