ICF is seeking a Senior Data Engineer to design, build, and operate scalable, reliable cloud data pipelines and trusted data products that support analytics, reporting, and AI initiatives. This role places strong emphasis on data governance (including Microsoft Purview), AI-enabled automation workflows, and DevOps and platform enablement through CI/CD and infrastructure-as-code.

Responsibilities

Design, build, and operate batch and streaming data pipelines on modern cloud data platforms.
Develop robust ETL/ELT processes using SQL, Python, and PySpark, with strong error handling, monitoring, and cost awareness.
Implement layered or medallion data architectures and analytics-ready data models for BI and AI workloads.
Partner with analysts and data scientists to deliver trusted, production-grade data assets.
Collaborate with platform and business stakeholders to support and enhance data governance practices using Microsoft Purview or comparable governance platforms.
Contribute to governance standards and best practices for data products, analytics solutions, AI/ML features, and agent-based workflows as organizational capabilities evolve.
Integrate governance considerations directly into platform workflows and data engineering practices rather than treating governance as an after-the-fact step.
Support ongoing data and AI governance initiatives and grow ownership of governance patterns over time as experience and standards develop.
Design and implement AI-enabled tools and automation workflows that support data platform and governance operations.
Work with technical teams to explore automation for metadata enrichment, data quality checks, anomaly detection, and governance workflows.
Ensure AI-enabled tools and automation operate only on approved, governed data sources with appropriate logging and auditability.
Build knowledge of evolving AI governance patterns, including agent lifecycle management and input/output traceability, with support from the broader team.
Implement and maintain CI/CD pipelines for data and AI assets.
Promote infrastructure-as-code practices using Terraform, Bicep, or equivalent tools for repeatable, governed environments.
Define environment promotion paths (dev, test, prod) with embedded governance and policy checks.

Requirements

Bachelor’s degree and 5+ years of experience in data engineering or data platform engineering in a production environment.
Strong SQL skills and hands-on experience with Python and PySpark.
Experience in data engineering on at least one major cloud or data platform (Azure, AWS, Databricks, or equivalent), with skills transferable across platforms.
Experience with Git-based development and CI/CD practices.
Working knowledge of data governance concepts such as cataloging, lineage, data quality, or access control.
Demonstrated engineering judgment to balance delivery speed, reliability, safety, and governance considerations.

Technologies

SQL, Python, PySpark
Azure, AWS, Databricks, Microsoft Fabric
Microsoft Purview, Git, CI/CD
Terraform, Bicep, ETL, ELT

Preferred Qualifications

Exposure to Microsoft Purview or comparable data governance platforms.
Interest in or experience supporting AI agents, LLM-based automation, intelligent assistants, or other automation for operational or platform workflows.
Exposure to embedding governance controls into DevOps workflows, or interest in developing a policy-as-code mindset.
Familiarity with Microsoft Fabric or Databricks-centric architectures, with ability to learn new platforms quickly.

Working at ICF

ICF is a global advisory and technology services provider.
ICF is an equal opportunity employer.
ICF will consider for employment qualified applicants with arrest and conviction records.
Reasonable Accommodations are available, including for disabled veterans, individuals with disabilities, and individuals with sincerely held religious beliefs. To request an accommodation, email [email protected].
All information provided will be kept confidential and used only as needed to provide reasonable accommodations.

Location, Salary, and Application Notes

Location: Reston, VA (onsite)

Pay Range: $98,614.00 - $167,644.00 per year (full-time)

Nationwide Remote Office (US99): Included for this posting

Application requirement: This application must be submitted directly by the applicant for consideration. Failure to do so may result in the application being excluded for consideration.

Candidate AI Usage Policy

For a fair interview process, using AI tools to generate or assist with interview responses (in-person or virtual) is not permitted.
AI-related interview accommodation requests may be considered; candidates should contact [email protected] in advance if needed.

Senior Data Engineer

Job Description