DeveloperJobs.io
← Back to all jobs
American Medical Association

Sr Data Engineer

American Medical Association
Chicago, IL $99k - $132k/yr Full time Posted 9d ago
Senior Cloud Data Warehouse Cloud Data Warehouse Data Engineer Data Integration Data Pipeline Data Platform Data Processing Data Warehouse Data Warehousing ETL Integration Snowflake SQL
Apply Now

Job Description

Join the AMA Insurance Technology team as a Sr Data Engineer and help power reliable, automated data flows across claims and administration. This Chicago, IL hybrid role includes 3 days per week in-office and supports operational reporting and data needs through ingestion, transformation, and validation of file-based integrations.

Responsibilities

  • Process and clean Excel, CSV, and other flat files used for claims and administration data at high volumes
  • Identify and resolve duplicates, inconsistencies, and data quality issues within incoming files
  • Transform files into required schemas and formats for downstream consumption
  • Load, stage, update, and extract data in Snowflake
  • Run both manual and scheduled Snowflake processing jobs
  • Prepare and transform rate data across multiple processing stages and generate outbound data files
  • Generate CSV outputs and upload them to EXL
  • Implement best practices for ingestion, transformation, modeling, and orchestration within a modern lakehouse environment
  • Develop and maintain PowerShell scripts from scratch and enhance existing scripts
  • Automate file transfers, manage FTP interactions and directory workflows, and send email notifications as needed
  • Build automation solutions to improve operational efficiency
  • Write and optimize SQL queries, including complex joins and transformations
  • Update backend tables and implement data corrections when issues are identified
  • Prepare reports and datasets, and make recommendations for analytics and operational needs
  • Perform database troubleshooting and data validation activities
  • Develop Python scripts for file-based automation, including file movement, copying, editing, and integration tasks
  • Own end-to-end automation of data and file workflows
  • Conduct proactive query profiling, tune execution plans, establish indexing strategies, and define partitioning layers to reduce latency in high-compute workloads

Requirements

  • Bachelor’s degree required (P1+/M1+)
  • 5+ years of experience in ETL/ELT pipeline development, data integration, and process automation
  • Demonstrated ability to multi-task and manage multiple concurrent projects with minimal supervision

Technologies

Snowflake, PowerShell, SQL, Python, Excel, CSV, FTP, EXL

Compensation

USD 99,410 - 131,637 per year

Benefits

Employees are also eligible to participate in an incentive plan.

Similar Jobs