Data Engineer, Mid
Job Description
Booz Allen Hamilton is seeking a Mid-level Data Engineer to strengthen a U.S. Army program’s capability to capture, preserve, and reuse data generated from high-value system test events. The work focuses on creating secure, organized, and searchable data storage and processing services that support analytics, reporting, partner metrics, and evolving model training needs.
This role involves building automated ingestion and data-quality workflows, maintaining dataset context for trusted analysis, and implementing retention and recovery practices so teams can rely on data as software configurations change over time. You will collaborate with software developers, systems engineers, test personnel, and AI/ML practitioners to operationalize repeatable pipelines and controlled access to the right information.
Summary
Help modernize how test-event data is stored and reused by designing capabilities for secure repositories and processing workflows. Automate ingestion, validation, curation, indexing, version tracking, and backup or recovery so downstream analytics, government reporting, partner-facing metrics, and model training can stay aligned with changing configurations.
Responsibilities
- Design and implement dependable data storage and processing capabilities that reduce reliance on manual file transfers and fragmented local copies through secure, organized, searchable repositories.
- Support dataset discoverability, accuracy, and usefulness as deployed software systems and configurations evolve.
- Partner with software developers, systems engineers, test personnel, and AI/ML practitioners to automate data ingestion, quality validation, relevance-based curation, indexing, version tracking, and backup and recovery.
- Preserve source provenance and retain test-event and software-version context to enable trusted performance analysis, government reporting, partner-facing metrics, and model training.
- Establish a foundation for future automated dashboards and controlled data access by authorized stakeholders.
- Implement ingestion pipelines with validation, relevance-based filtering, logging, alerts, automated retries, and failure recovery to keep data accurate and available.
- Manage data retention and reuse using test-event and source metadata, dataset provenance, software-version traceability, relevance-based curation, automated backups, and recovery testing.
Requirements
- 4+ years of experience in data engineering, database development, or data-platform work supporting software or test environments, including Python, SQL, data transformation, complex queries, Git source control, automated testing, and peer review.
- Experience deploying, configuring, securing, monitoring, tuning, backing up, and troubleshooting locally hosted relational or NoSQL databases, including schema and data modeling, indexing, query optimization, data integrity, and controlled access.
- Experience building and operating scheduled batch or near-real-time ETL/ELT pipelines that ingest data from files, APIs, applications, and databases, with validation, relevance-based filtering, logging, alerts, automated retries, and failure recovery.
- Experience managing data retention and reuse through test-event and source metadata, dataset provenance, software-version traceability, relevance-based curation, automated backups, and recovery testing.
- Ability to translate developer, tester, and stakeholder needs into supportable data solutions.
- Secret clearance.
- HS diploma or GED.
Technologies
- Python, SQL, Git, ETL, ELT, Redis, PostgreSQL
- Object storage, Apache Airflow, Dagster, Prefect
- GitLab, Azure DevOps, Jira, DVC, lakeFS
- Power BI, Grafana, Tableau, Linux, Docker
- Kafka, Spark
Benefits
- Health, life, disability, financial, and retirement benefits
- Paid leave
- Professional development
- Tuition assistance
- Work-life programs
- Dependent care
- Recognition awards program acknowledging employees for exceptional performance and superior demonstration of the company’s values
- Full-time and part-time employees working at least 20 hours a week are eligible to participate in Booz Allen’s benefit programs
Nice If You Have
- Experience supporting U.S. Army or other DoD software development, testing, evaluation, or sustainment programs, particularly with test-event datasets, telemetry, application logs, system performance metrics, or technical reporting.
- Experience with Redis architectures, including data structures, indexing, and persistence, together with complementary technologies such as PostgreSQL, object storage, or on-premises data platforms for durable, high-performance retrieval.
- Experience preparing reproducible AI/ML training, evaluation, or inference datasets through profiling, labeling, normalization, deduplication, feature preparation, and version tracking.
- Experience supporting Agile or Scrum software teams with CI/CD and repeatable deployments, including orchestration tools such as Apache Airflow, Dagster, or Prefect and planning or release tools such as GitLab, Azure DevOps, or Jira.
- Experience implementing data catalogs, metadata management, data lineage, schema-evolution controls, or dataset versioning using methods and tools such as DVC, lakeFS, data contracts, or comparable governance practices.
- Experience building automated performance dashboards and traceable reports with Power BI, Grafana, Tableau, or Python visualization tools, including drill-down links or references to source datasets.
- Experience working in Linux-based, on-premises, restricted, or disconnected environments using Docker or other containers, secure networking, role-based access, audit logging, or controlled remote or API access.
- Experience with event-driven or distributed data processing such as Kafka or Spark.
Clearance
Applicants selected will be subject to a security investigation and may need to meet eligibility requirements for access to classified information. Secret clearance is required.
Work Model
- Onsite: Work will primarily be performed full-time at a customer facility, where employees will collaborate directly with colleagues and customers as required by the role.
Identity Statement
- The hiring process includes an identity verification step that leverages advanced biometrics and artificial intelligence to ensure authenticity and help protect against identity fraud.
- You are expected to be on camera during interviews and assessments.
- Booz Allen reserves the right to take your picture to verify your identity and prevent fraud.
Candidate AI Usage Policy
- The use of artificial intelligence or other tools to assist with responses during interviews (in-person or virtual) is prohibited unless permission is explicitly provided.
Location: Fort Belvoir, VA (onsite)
Salary Range: USD 62,000 - 141,000 per year