DeveloperJobs.io
← Back to all jobs
Capgemini

AWS/Kafka Data Engineer - Senior Software Engineer

Capgemini
Atlanta, GA $89k - $166k/yr Full time Posted 7d ago
Backend Developer Aws Data Engineer Aws Data Engineering Big Data Cloud Engineer Data Analysis Data Analytics Data Architecture Data Engineer Data Engineering Data Engineering Director Data Integration Data Pipeline Data Pipelines Data Platform Data Processing Database Databases Engineer Event Driven Architecture Kafka Kafka Connect Kafka Streams SQL Stream Processing Streaming Data
Apply Now

Job Description

Capgemini is hiring a Senior AWS/Kafka Data Engineer to design, build, and deploy real-time and batch data pipelines that connect enterprise systems to downstream data lakes and platforms. This hybrid role supports delivery across multiple geographies, with a primary base in Atlanta, GA 30305.

In this position, you will apply Apache Kafka and AWS services to process high-volume change data capture (CDC) and transactional data, and you will help create resilient microservices and integration layers that move and transform information reliably.

Responsibilities

  • Design, build, and deploy robust real-time and batch data pipelines integrating disparate ERP systems with downstream data lakes and platforms.
  • Use Apache Kafka, Kafka Connect, and stream processing engines (Kafka Streams or Apache Flink) to process and transform CDC and transactional data.
  • Build resilient microservices and integration layers in Java and Spring Boot to orchestrate complex data flows and enterprise APIs.
  • Package applications into Docker containers and manage scalable deployments using Kubernetes, including service discovery and orchestration.
  • Optimize data movement and performance across multi-database environments including PostgreSQL, MySQL, SQL Server, and Oracle.
  • Manage Infrastructure as Code (IaC) with Terraform or AWS CloudFormation, and create automated CI/CD deployment pipelines using GitHub Actions.
  • Set up end-to-end monitoring and alerting, including APM, log management, and pipeline health checks using tools such as DataDog, New Relic, or Splunk.

Requirements

  • 10+ years of software and/or data engineering experience.
  • Strong proficiency in AWS, Kafka, Java, Spring Boot, and Python.
  • Expertise in AWS Managed Kafka (data and integration).
  • Experience designing and configuring AWS Managed Kafka.
  • Experience with PostgreSQL, MySQL, SQL Server, and Oracle.

Technologies

  • AWS, Apache Kafka, Kafka Connect, Kafka Streams, Apache Flink
  • Java, Spring Boot, Docker, Kubernetes
  • PostgreSQL, MySQL, SQL Server, Oracle
  • Terraform, AWS CloudFormation, GitHub Actions
  • DataDog, New Relic, Splunk
  • AWS Managed Kafka

Benefits

  • Paid time off based on employee grade (A-F): Vacation 12-25 days depending on grade, plus company paid holidays, Personal Days, and Sick Leave.
  • Medical, dental, and vision coverage (or provincial healthcare coordination in Canada).
  • Retirement savings plans (for example, 401(k) in the U.S. or RRSP in Canada).
  • Life and disability insurance.
  • Employee assistance programs.

Location

  • Hybrid role based across locations: Atlanta, Dallas, Chicago, Nashville, New Jersey.

Compensation

The base compensation range for this role in the posted location is $89,400 - $166,398 per year.

IMPORTANT NOTICE: In addition to base salary, this role may be eligible for additional compensation such as variable incentives, bonuses, or commissions, depending on the position and applicable laws.

Similar Jobs