Senior Data Engineer
Job Description
NSPR Law Services LLC is hiring a Senior Data Engineer in San Juan, PR for in-person work. You’ll help build reliable production data pipelines that support operational PostgreSQL and an Iceberg/Athena lakehouse, with a focus on data quality, lineage, and safe migrations. The role includes ownership of change-data-capture replacement and migration approaches, backed by strong pipeline observability using OpenTelemetry where applicable.
Compensation: USD 100,000 - 110,000 per year. Experience: 5+ years.
What you’ll do
- Design and build production ETL pipelines and dbt transformation layers: tested transformations for the operational PostgreSQL layer and analytical models for the Iceberg/Athena lakehouse.
- Reverse-engineer undocumented business logic from legacy schemas, encoding and testing transformations rather than copying tables.
- Design and own the target PostgreSQL schema for the shared data layer consumed by every Bronson product.
- Build an identity-resolution pipeline using deterministic and probabilistic matching, confidence scoring, and a manual-resolution queue, while measuring false-merge and false-split rates.
- Implement data-quality and lineage controls across both layers, including schema-change detection, freshness monitoring, and traceability from source records to product-facing models.
- Own parallel run reconciliation so legacy systems and the new layer remain reconciled with documented discrepancies until the old side is switched off.
How the environment is set up
- Transactional core: managed PostgreSQL with schema-per-domain and a transactional outbox.
- Analytics: object storage lakehouse with Iceberg tables, a SQL query engine, and dbt transformations.
- Delivery & tooling: infrastructure as code using TypeScript and GitHub Actions CI/CD, with Python for data tooling.
- Observability: pipeline monitoring for CDC lag, data freshness, transformation failures, reconciliation results, and backfill status, using OpenTelemetry where applicable for tracing.
- Legacy sources: on-prem SQL Server and MySQL.
- Environments: dev uses synthetic data, staging uses de-identified data, and production is the only PHI environment.
What we need from you
- 5+ years of professional data engineering experience.
- Experience building and owning a dbt (or equivalent) transformation layer in production, including tests and CI for transformations, schema changes, and pipeline code.
- Led a migration from legacy on-prem databases to a modern platform with both systems running in parallel, including source-to-target reconciliation and documented, approved exceptions.
- Strong SQL and PostgreSQL skills, including comfort reading and working fluently with other teams’ schemas.
- Change-data-capture experience such as Debezium, DMS, or similar.
- Ability to be meticulous and patient when legacy data hides repeated issues, with a verify-then-rework mindset.
- Direct communication with product and business stakeholders to validate undocumented rules, resolve discrepancies, and document source-of-truth decisions.
Technologies you’ll work with
PostgreSQL, dbt, Iceberg, Athena, TypeScript, GitHub Actions CI/CD, Python, OpenTelemetry, SQL Server, MySQL
Benefits
- Dental insurance
- Employee assistance program
- Flexible schedule
- Health insurance
- Life insurance
- Paid time off
- Professional development assistance
- Referral program
- Retirement plan
- Vision insurance