ETL Developer / HPCC Data Engineer

DataSeers Inc. is hiring an ETL Developer / HPCC Data Engineer to deliver and maintain large-scale financial data pipelines.

Responsibilities

• Develop, maintain, and optimize ETL workflows using HPCC Systems and ECL
• Build ECL datasets, records, transforms, joins, rollups, deduplication logic, and data validation routines
• Ingest structured and semi-structured financial data from multiple sources
• Create data mappings from client source formats into DataSeers canonical data structures
• Normalize inconsistent data for customers, accounts, business, signers, beneficial owners, transactions, and counterparties
• Implement entity-linking and relationship logic across financial datasets
• Develop large-scale join and matching processes to connect and identify records
• Troubleshoot issues including incorrect joins, duplicate records, missing relationships, data-shifting problems, malformed files, and inconsistent identifiers
• Create reusable ECL components and data-processing patterns
• Optimize HPCC jobs for performance and scalability
• Analyze Thor and Roxie workloads where applicable
• Build validation and reconciliation routines to support data completeness and accuracy
• Work with MySQL, Elasticsearch, Kafka, APIs, and other components in the DataSeers ecosystem
• Support batch and near-real-time processing requirements
• Partner with customer implementation teams to understand source data and integration needs
• Investigate data-quality issues before they reach compliance, fraud, reconciliation, or reporting systems
• Participate in code review, testing, deployment validation, and production troubleshooting

Requirements

• 3+ years of ETL, data engineering, or large-scale data-processing experience
• Hands-on experience with HPCC Systems
• Strong ECL development experience
• Strong understanding of ECL concepts: datasets, records, transforms, joins, normalize, denormalize, rollups, deduplication, and distributed processing
• Strong SQL skills
• Strong understanding of data structures, relationships, and data modeling
• Experience troubleshooting complex joins and data relationships
• Experience working with large datasets
• Understanding of data quality, reconciliation, referential integrity, and exception handling
• Experience with Git or equivalent source control
• Strong analytical and debugging skills

Technologies

• HPCC Systems
• ECL
• SQL
• MySQL
• Elasticsearch
• Kafka
• APIs
• Thor
• Roxie
• Git

Preferred Experience

• Banking, fintech, payments, or financial services experience
• Experience with ACH, wires, cards, RTP, FedNow, checks, or other payment data
• HPCC Thor and Roxie experience
• Experience optimizing large ECL jobs
• Elasticsearch experience
• MySQL experience
• Kafka or event-driven processing experience
• Experience with AML, fraud, KYC/KYB, or transaction monitoring
• Python, JavaScript, Node.js, or Java is useful, but secondary to HPCC/ECL expertise

Location: Alpharetta, GA (onsite)

Minimum Experience: 3 years