Senior Kafka Developer
Job Description
CGI Group, Inc. is seeking an experienced Senior Kafka Streaming Developer to join the Data & Automation portfolio in Strongsville, Ohio. This on-site role focuses on designing, implementing, and optimizing real-time data pipelines using Kafka to support enterprise streaming initiatives across integration points such as batch processing, APIs, and streaming systems. You will help build scalable, observable streaming solutions that drive data-driven decisions.
You will design robust architectures, champion data integrity, and collaborate across data engineering, DevOps, and observability teams to ensure resilient and well-monitored streaming platforms.
Responsibilities
- Design and deliver enterprise-grade Kafka streaming architectures using Confluent or equivalent platforms.
- Establish event-driven patterns and integration approaches spanning batch, API, and streaming workflows.
- Plan and manage Kafka topics, partitions, schemas, and retention policies.
- Build and tune real-time ingestion pipelines to achieve high throughput with low latency.
- Incorporate reconciliation steps and data integrity checks within streaming flows.
- Collaborate with data engineering, DevOps, and observability teams to embed monitoring using tools like LogScale and Dynatrace.
- Lead the troubleshooting of production issues including lag, data loss, duplication, and performance bottlenecks.
- Conduct architecture reviews, whiteboarding sessions, and provide technical leadership to the team.
- Mentor junior engineers and promote best practices in streaming and distributed systems.
Requirements
- 8+ years of experience in data engineering or distributed systems.
- 4+ years of hands-on experience with Apache Kafka.
- Strong expertise in event-driven architecture and microservices.
- Experience integrating Kafka with APIs, batch systems, and databases.
- Knowledge of schema management using Avro and Schema Registry.
- Experience with cloud platforms, including AWS and Azure.
- Solid understanding of data integrity, reconciliation, and observability concepts.
- Experience working with banking or financial services data systems.
- Familiarity with log-based ingestion tools such as LogScale or Elastic.
- Experience operating in Kubernetes or OpenShift environments.
Technologies
- Apache Kafka
- Hadoop Hive
- Python
- Splunk
- LogScale
- Dynatrace
- Confluent
- Avro
- Schema Registry
- AWS
- Azure
- Kubernetes
- OpenShift
- Elastic
Benefits
- Competitive compensation
- Comprehensive insurance options
- Matching contributions through the 401(k) plan and the share purchase plan
- Paid time off for vacation, holidays, and sick time
- Paid parental leave
- Learning opportunities and tuition assistance
- Wellness and well-being programs
Compensation and additional information
The annual salary range for this role is USD 57,100 to 154,300. Compensation decisions are based on factors such as skill set, level, experience, training, and certifications. CGI typically does not hire near the top of the range, to preserve room for merit-based progression and performance-based adjustments.