Senior Data Engineer (Analytics & Applied AI)
Job Description
The Senior Data Engineer for Analytics & Applied AI will lead end-to-end ownership of data platforms, from ingestion and transformation through analytics and application-serving layers, while building production Python services and AWS data pipelines. This role is Contract To Hire and remote, with eligibility to obtain and maintain a Federal or DoD “public trust” required prior to onboarding.
Key Responsibilities
- Own data platforms end to end, spanning source ingestion, transformation, and the analytics and application layers that consume the data, with correctness, idempotency, and auditability treated as core requirements.
- Develop production-grade Python services and tooling (APIs, services, and well-tested maintainable code), focusing on building software rather than only writing SQL.
- Design and orchestrate AWS cloud data pipelines, including scheduling, retries, data-quality gates, and clean failure handling.
- Model data for both analytics and application serving, including dimensional and fact modeling, grain decisions, slowly-changing dimensions, and idempotent recompute patterns, with clear separation between an analytical warehouse and an application system-of-record.
- Implement recurring data-quality and reconciliation checks that run on every pipeline and gate publication.
- Independently drive architecture and technical decisions, evaluating tradeoffs and leading implementation with limited supervision.
- Use agentic coding assistants effectively to accelerate delivery while maintaining strong code quality and review discipline.
- Expand into applied AI/ML capabilities as the work grows, including entity resolution or record linkage, LLM-assisted analytics over structured and unstructured data, and anomaly or risk scoring.
Required Qualifications
- 6+ years of experience in data engineering and/or software engineering building and operating production systems.
- University Degree plus a minimum of 6 years of prior relevant experience.
- Education substitution: 4 years of relevant experience may substitute for formal education.
- Strong production software engineering, including clean architecture, testing, code review, and CI/CD.
- Ability to build software rather than scripts.
- Expert SQL, including window functions, complex joins, aggregation-grain reasoning, and query performance.
- Hands-on experience with multiple items in the AWS data and compute stack: Glue, Step Functions, S3, Redshift, Aurora/RDS, Lambda, EventBridge, ECS/Fargate, and IAM.
- Practical data modeling experience, including dimensional or analytical modeling, grain, SCDs, and idempotent recompute patterns.
- Demonstrated data-quality discipline, validating outputs, reconciling totals, and defending metrics.
- Infrastructure as code experience using Terraform or CDK on real projects.
- High autonomy with proven ability to own systems through completion and make sound architecture and tradeoff decisions.
- Effective, demonstrated use of agentic coding assistants in a real workflow.
- Analytics fluency, including profiling datasets, spotting anomalies, reasoning about metric meaning, and explaining discrepancies.
- Must be able to obtain and maintain a Federal or DoD “public trust”. Approved adjudication of the public trust is required prior to onboarding with the Client. Active public trust or suitability is preferred.
- Applied AI/ML capability, such as practical LLM use (RAG, structured extraction from unstructured text), embeddings, or ML risk scoring, with strong interest counting even without deep production experience.
- Agent framework experience, such as AWS Strands Agents, Bedrock AgentCore, or similar tool-using or multi-agent systems.
- Entity resolution and record linkage experience, including probabilistic matching.
- API development experience with FastAPI or similar, with enough front-end awareness to collaborate with UI engineers.
- Experience with DuckDB and Parquet-based data flows and data-lake table formats such as Iceberg or Delta.
- Experience working with regulated or government data environments.
Technologies
- Python, SQL
- AWS: Glue, Step Functions, S3, Redshift, Aurora/RDS, Lambda, EventBridge, ECS/Fargate, IAM
- Infrastructure as Code: Terraform, CDK
- API Development: FastAPI
- Agent and AI: AWS Strands Agents, Bedrock AgentCore, LLM-assisted analytics, RAG, embeddings
- Data: DuckDB, Parquet, Iceberg, Delta
Compensation & Job Details
- Salary: USD 160,000 per year
- Location: McLean, VA (remote)
- Job Type: Contract To Hire
- Work Model: Remote
- Security Clearance: Public Trust
Benefits
- Health and welfare benefits coverage options including medical, dental, vision, spending accounts, life insurance, and voluntary plans
- Participation in a 401(k) plan