Data Engineer

CGI Group, Inc. is seeking an experienced Data Engineer to help design and build external-facing API solutions while delivering reliable data movement in AWS environments. This onsite role is based in Cary, NC and centers on hands-on ETL and batch processing using Spring Batch and Apache Spark on AWS EMR.

The role involves creating and operating batch data pipelines, developing client integrations for REST and SOAP services, and supporting squads that build and maintain applications in the cloud. You will also help guide architecture decisions to keep systems scalable, resilient, and extensible.

What you will do

• Design, develop, test, deploy, and maintain ETL batch jobs using Spring Batch and Apache Spark on EMR
• Schedule, monitor, and debug ETL batch jobs across Spring Batch and Spark workflows
• Build Java clients to consume REST and SOAP APIs, and develop Scala Spark batch applications
• Use Apache Spark to process large-scale data and write results to NoSQL databases including Cassandra or Yugabyte
• Build and deploy solutions on AWS cloud infrastructure
• Provide technical support to squads building, deploying, and maintaining applications in AWS
• Work across multiple development workstreams while helping ensure scalable, resilient, extensible architectures
• Ensure technology decisions align with Fidelity’s architecture standards and strategies
• Evaluate and recommend technologies and frameworks for flexibility, long-term viability, and time to market
• Collaborate with peers through code reviews, pair programming, and daily discussions across multiple squads

What you bring

• Bachelor’s degree in Computer Science, Information Systems, or a related field, with a proven track record in data engineering
• 6+ years of software development experience
• 6+ years developing Spark or Spring Batch services for data movement
• Hands-on experience scheduling, monitoring, and debugging ETL Spring Batch and Spark batch jobs
• Hands-on experience building Java clients consuming REST and SOAP APIs, plus Scala Spark batch applications
• Experience developing, testing, deploying, and maintaining ETL batch jobs using Spring Batch and Apache Spark/EMR
• Experience using Apache Spark to process big data and write to NoSQL databases such as Cassandra or Yugabyte
• Proven experience building and deploying software solutions on public cloud providers such as AWS
• Strong understanding of the software development lifecycle (analysis, design, coding, testing, problem resolution, planning)
• Strong collaboration and communication skills across multiple squads, with the ability to adapt to change
• Experience with cloud-based data warehousing and data lake solutions such as Snowflake
• Experience with data storage and management for large datasets (for example, Parquet and HDF5)

Tools and technologies

• Spring Batch
• Apache Spark and Spark SQL
• EMR, AWS
• Java, Scala
• REST, SOAP
• NoSQL (including Cassandra and Yugabyte)
• Snowflake, Parquet, HDF5

Compensation and location

• Location: Cary, NC (onsite)
• Salary: USD 91,800 - 160,700 per year

Benefits

• Competitive compensation
• Comprehensive insurance options
• Matching contributions through the 401(k) plan and the share purchase plan
• Paid time off for vacation, holidays, and sick time
• Paid parental leave
• Learning opportunities and tuition assistance
• Wellness and well-being programs

Additional information

• CGI provides a reasonable estimate of the compensation range for this role as required by law in some jurisdictions.
• CGI benefits are offered to eligible professionals on their first day of employment.
• All CGI offers in the U.S. are contingent upon successfully completing a background investigation.
• Qualified applicants receive consideration without regard to protected statuses required by applicable laws.
• CGI provides reasonable accommodations to qualified individuals with disabilities. For application accommodations in the U.S., email [email protected].