DeveloperJobs.io
← Back to all jobs
Experis

Senior Apache Spark Developer

Experis
Jersey City, NJ $68 - $68/hr Full time Posted 8d ago
Backend Developer Apache Spark Aws Data Lake Big Data Bigdata Cloud Data Engineering Cloud Data Platform Cloud Operations Cloud Platform Cloud Platforms Data Analysis Data Analytics Data Architecture Data Engineer Data Engineering Data Integration Data Pipeline Data Pipelines Data Platform Data Processing Database Databases Databricks Engineer Engineering ETL Informatica Kafka Pyspark Spark Spark Sql SQL Stream Processing Structured Streaming
Apply Now

Job Description

Experis is seeking a Senior Apache Spark Developer for a hybrid role based in Jersey City, NJ. This position supports enterprise data engineering initiatives, with a focus on migrating and optimizing existing Spark workloads to Databricks on AWS and building data processing solutions using Kafka and Spark.

Role Overview

You will design and develop Spark-based applications for large-scale processing, improve the performance of existing ETL and data transformation pipelines, and help implement cloud-native data solutions. The work includes migration efforts from on-premises platforms to Databricks, along with building batch and streaming capabilities.

Responsibilities

  • Design, develop, and optimize Spark-based applications for large-scale data processing.
  • Build streaming and batch data solutions using Apache Kafka and Apache Spark.
  • Develop reusable frameworks and components to support enterprise data engineering initiatives.
  • Support migration activities from on-premises data platforms to Databricks and AWS.
  • Collaborate with architects and platform engineers to implement cloud-native data solutions.

Required Qualifications

  • 5+ years of hands-on development experience with Apache Spark.
  • Strong expertise in Spark SQL, Structured Streaming, and DataFrames and DataSets, including performance tuning.
  • Experience integrating Spark with Apache Kafka.
  • Strong development skills in Java and Python.
  • Experience designing and supporting large-scale distributed systems.

Technology Stack

  • Apache Spark
  • Databricks
  • AWS
  • Apache Kafka
  • Spark SQL
  • Structured Streaming
  • DataFrames and DataSets
  • Java and Python
  • On-premises data platforms and cloud storage

Location

Jersey City, New Jersey (hybrid)

Compensation

USD 68.26/hr W2 (may be some flex). Weekly pay is provided.

Benefits

  • Medical and Prescription Drug Plans
  • Dental Plan
  • Vision Plan
  • Health Savings Account
  • Health Flexible Spending Account
  • Dependent Care Flexible Spending Account
  • Supplemental Life Insurance
  • Short Term and Long Term Disability Insurance
  • Business Travel Insurance
  • 401(k), Plus Match
  • Weekly Pay

Work Authorization / Staffing Requirement

Due to client rules, Experis cannot work with 3rd party subcontractors. All candidates must be able to work on Experis W2 directly.

Similar Jobs