DeveloperJobs.io
← Back to all jobs

Job Description

The Senior Data Engineer for Analytics & Applied AI will lead end-to-end ownership of data platforms, from ingestion and transformation through analytics and application-serving layers, while building production Python services and AWS data pipelines. This role is Contract To Hire and remote, with eligibility to obtain and maintain a Federal or DoD “public trust” required prior to onboarding.

Key Responsibilities

  • Own data platforms end to end, spanning source ingestion, transformation, and the analytics and application layers that consume the data, with correctness, idempotency, and auditability treated as core requirements.
  • Develop production-grade Python services and tooling (APIs, services, and well-tested maintainable code), focusing on building software rather than only writing SQL.
  • Design and orchestrate AWS cloud data pipelines, including scheduling, retries, data-quality gates, and clean failure handling.
  • Model data for both analytics and application serving, including dimensional and fact modeling, grain decisions, slowly-changing dimensions, and idempotent recompute patterns, with clear separation between an analytical warehouse and an application system-of-record.
  • Implement recurring data-quality and reconciliation checks that run on every pipeline and gate publication.
  • Independently drive architecture and technical decisions, evaluating tradeoffs and leading implementation with limited supervision.
  • Use agentic coding assistants effectively to accelerate delivery while maintaining strong code quality and review discipline.
  • Expand into applied AI/ML capabilities as the work grows, including entity resolution or record linkage, LLM-assisted analytics over structured and unstructured data, and anomaly or risk scoring.

Required Qualifications

  • 6+ years of experience in data engineering and/or software engineering building and operating production systems.
  • University Degree plus a minimum of 6 years of prior relevant experience.
  • Education substitution: 4 years of relevant experience may substitute for formal education.
  • Strong production software engineering, including clean architecture, testing, code review, and CI/CD.
  • Ability to build software rather than scripts.
  • Expert SQL, including window functions, complex joins, aggregation-grain reasoning, and query performance.
  • Hands-on experience with multiple items in the AWS data and compute stack: Glue, Step Functions, S3, Redshift, Aurora/RDS, Lambda, EventBridge, ECS/Fargate, and IAM.
  • Practical data modeling experience, including dimensional or analytical modeling, grain, SCDs, and idempotent recompute patterns.
  • Demonstrated data-quality discipline, validating outputs, reconciling totals, and defending metrics.
  • Infrastructure as code experience using Terraform or CDK on real projects.
  • High autonomy with proven ability to own systems through completion and make sound architecture and tradeoff decisions.
  • Effective, demonstrated use of agentic coding assistants in a real workflow.
  • Analytics fluency, including profiling datasets, spotting anomalies, reasoning about metric meaning, and explaining discrepancies.
  • Must be able to obtain and maintain a Federal or DoD “public trust”. Approved adjudication of the public trust is required prior to onboarding with the Client. Active public trust or suitability is preferred.
  • Applied AI/ML capability, such as practical LLM use (RAG, structured extraction from unstructured text), embeddings, or ML risk scoring, with strong interest counting even without deep production experience.
  • Agent framework experience, such as AWS Strands Agents, Bedrock AgentCore, or similar tool-using or multi-agent systems.
  • Entity resolution and record linkage experience, including probabilistic matching.
  • API development experience with FastAPI or similar, with enough front-end awareness to collaborate with UI engineers.
  • Experience with DuckDB and Parquet-based data flows and data-lake table formats such as Iceberg or Delta.
  • Experience working with regulated or government data environments.

Technologies

  • Python, SQL
  • AWS: Glue, Step Functions, S3, Redshift, Aurora/RDS, Lambda, EventBridge, ECS/Fargate, IAM
  • Infrastructure as Code: Terraform, CDK
  • API Development: FastAPI
  • Agent and AI: AWS Strands Agents, Bedrock AgentCore, LLM-assisted analytics, RAG, embeddings
  • Data: DuckDB, Parquet, Iceberg, Delta

Compensation & Job Details

  • Salary: USD 160,000 per year
  • Location: McLean, VA (remote)
  • Job Type: Contract To Hire
  • Work Model: Remote
  • Security Clearance: Public Trust

Benefits

  • Health and welfare benefits coverage options including medical, dental, vision, spending accounts, life insurance, and voluntary plans
  • Participation in a 401(k) plan

Similar Jobs