Data Engineer - AI (Spark, Databricks and GCP)

Cotiviti is seeking a Data Engineer with AI focus to design, implement, and maintain data pipelines, manage data quality and validation, and collaborate with engineering, database administration, and cloud operations teams to preserve data integrity and operational reliability. This remote role offers an annual salary range of USD 101,000 to 132,000 and centers on Spark, Databricks, and Google Cloud Platform.

Responsibilities

• Develop and maintain Spark scripts across basic to advanced levels to support data management, validation, and integration tasks.
• Create and upkeep SQL scripts of basic to intermediate complexity for data handling and validation purposes.
• Improve query performance to boost efficiency of daily workflows.
• Conduct data analysis to identify and resolve issues or anomalies.
• Collaborate with Engineering, DBA, Cloud Operations, and related teams to troubleshoot environmental or network issues impacting work; provide after hours or weekend support as needed.
• Design and sustain data pipelines as required to meet project needs.
• Verify task results to ensure all requirements are satisfied.
• Adhere to applicable industry and internal compliance standards to maintain data integrity.
• Track personal productivity and performance metrics.
• Complete assigned tasks in the department ticketing system within designated deadlines.
• Align with organizational and individual goals established through performance reviews and goal setting processes.
• Deliver on special projects and other duties as assigned.
• Perform duties with or without reasonable accommodation.

Requirements

• Bachelor's degree in Computer Science, Information Technology, or equivalent work experience.
• 3+ years of hands-on experience with big data technologies (Spark, S3, Kafka, Ray, Hadoop, etc.).
• 2+ years of experience with big data and cloud technologies (Databricks, AWS, Azure, Hadoop, Spark, Snowflake, etc.).
• 3+ years of cloud experience (AWS, Azure, GCP, OCI, etc.).
• 3+ years of experience with RDBMS (Oracle, MS SQL, Vertica, etc.) and proficiency in SQL, PL/SQL or related ETL tools.
• Databricks or AWS certifications are highly beneficial.
• Familiarity with data pipeline orchestration tools (e.g., Airflow, Databricks Workflows).
• 3+ years of data analysis experience, with a preference for healthcare data such as enrollment, medical claims, or pharmacy claims.
• Proficiency in Microsoft Office Suite (PowerPoint, Word, Excel, Outlook).
• Flexible work schedule and the ability to adapt to shifting priorities.
• Experience with project management tools like JIRA.
• Databricks and/or Snowflake environment familiarity is a plus.

Technologies

• Spark and Amazon S3
• Kafka, Ray, Hadoop
• Databricks, AWS, Azure, Snowflake
• Google Cloud Platform (GCP); Oracle, MS SQL, Vertica
• SQL, PL/SQL
• Airflow, Databricks Workflows
• JIRA, Microsoft Office Suite

Benefits

• Medical, dental, and vision insurance
• Disability and life insurance
• 401(k) savings plan
• Paid family leave
• Holidays (nine per year)
• Paid Time Off (PTO) ranging from 17 to 27 days annually

Mental Requirements

• Strong analytical capabilities
• Excellent verbal, listening, and written communication skills
• Ability to multitask and prioritize to meet deadlines
• Ability to work effectively both independently and in a team

Working Conditions and Physical Requirements

• Prolonged periods of stationary work or seated activity
• Repetitive motions involving wrists, hands, and fingers
• Capability to establish and maintain a dedicated, secure work area
• Access to high-speed internet and a reliable home office setup