DeveloperJobs.io
← Back to all jobs
Robert Half

Data Engineer

Robert Half
Brookfield, WI $100k - $130k/yr Full time Posted 4d ago
Big Data Bigdata Data Data Analysis Data Architecture Data Engineer Data Integration Data Pipeline Data Pipelines Data Platform Data Processing Data Warehouse Database Engineer ETL Hadoop Informatica Information Technology (IT) Kafka Spark Streaming Data
Apply Now

Job Description

This Data Engineer role in Brookfield, WI focuses on developing a cloud-oriented data environment for analytics, reporting, automation, and emerging AI use cases.

Responsibilities

  • Design, build, and maintain scalable data pipelines that move and transform data for analytics, reporting, and operational use.
  • Collaborate with business stakeholders, analysts, software developers, and leaders to capture data requirements and deliver engineering solutions.
  • Develop and refine data models and platform architecture to support performance, flexibility, and long-term growth.
  • Implement and improve ETL processes integrating data from multiple sources while increasing consistency, completeness, and usability.
  • Use Python and distributed processing tools such as Apache Spark and Hadoop to process large and complex datasets efficiently.
  • Support streaming and event-driven workflows using tools such as Apache Kafka when real-time data delivery is required.
  • Monitor data quality, troubleshoot pipeline issues, and optimize workflows to maintain dependable delivery and strong system performance.
  • Identify opportunities to enhance the data platform, including scalability, automation, and engineering standards.
  • Maintain experience in building and supporting production data pipelines with a proven track record.

Requirements

  • Hands-on proficiency in Python for data processing, transformation, and workflow development.
  • Experience working with Apache Spark for large-scale data workloads.
  • Familiarity with Hadoop-based ecosystems and distributed data processing concepts.
  • Practical knowledge of Apache Kafka or comparable streaming technologies for real-time data movement.
  • Strong understanding of ETL design, implementation, and optimization across varied data sources.
  • Ability to collaborate across functions and translate business needs into reliable technical solutions.

Technologies

  • Python
  • Apache Spark
  • Hadoop
  • Apache Kafka

Location & Salary

  • Location: Brookfield, WI (onsite)
  • Salary: USD 100,000 - 130,000 per year

Benefits

  • Medical, vision, dental, and life and disability insurance (for contract/temporary professionals)
  • 401(k) plan eligibility for hired contract/temporary professionals

Similar Jobs