Data Engineer, Senior
Big Data
Bigdata
Code Repositories
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Integration
Data Pipeline
Data Platform
Data Processing
Database
Databases
ETL
Foundry Ecosystem
Informatica
Information Technology (IT)
Pipeline Builder
Programming Language
Programming Languages
Pyspark
SQL
Job Description
Booz Allen Hamilton seeks a Senior Data Engineer to design and operate data infrastructure for a Service-level Headquarters organization using the Palantir Foundry ecosystem in Arlington, VA.
Responsibilities
- Architect, build, and maintain scalable ETL/ELT pipelines with Palantir Foundry, including Pipeline Builder and Code Repositories, for highly unstructured data ingestion and processing.
- Design, implement, and optimize the Foundry Ontology to deliver secure, logically structured data models that support advanced analytics and Activity Based Intelligence (ABI).
- Develop high-performance transformation logic using PySpark, Python, and SQL for distributed, large-scale processing.
- Work with data scientists and analysts to operationalize statistical models and custom algorithms in secure production environments.
- Identify and resolve performance issues and bottlenecks to maintain high throughput across cloud and classified compute environments.
- Build data quality and validation frameworks, including automated pipeline monitoring, to protect the integrity of analytics inputs.
Requirements
- 5+ years of experience in data engineering or big data.
- Hands-on experience with PySpark, Python, and SQL.
- Experience building complex data pipelines and transformations within distributed platforms such as Palantir Foundry.
- Experience structuring, formatting, and optimizing large-scale datasets for use by engineering teams and mathematical or statistical models.
- Knowledge of distributed systems, data warehousing concepts, and data governance in secure enclaves.
- TS/SCI clearance.
- Bachelor’s degree in Computer Science or Engineering.
Technologies
- Palantir Foundry
- Pipeline Builder
- Code Repositories
- Foundry Ontology
- PySpark, Python, SQL
- AWS, Azure
Nice If You Have
- Experience with AWS, Azure, or similar cloud computing architectures that support large data platforms.
- Experience processing and scaling geospatial datasets for intelligence or operational mapping.
- Experience with CI/CD pipelines and version control best practices.
- Experience with DoW Global Force Management policies and processes.
- Knowledge of mathematical modeling and statistical analysis frameworks.
- Knowledge of DoW institutional datasets such as War Data Platform.
Clearance
- Selected applicants will be subject to a security investigation and may need to meet eligibility requirements for access to classified information; TS/SCI clearance is required.
Identity Verification
- During the hiring process, you will complete an identity verification process that uses advanced biometrics and AI to ensure authenticity and protect against identity fraud.
- You are expected to be on camera during interviews and assessments.
- Booz Allen may take your picture to verify identity and prevent fraud.
Candidate AI Usage Policy
- Using AI or other tools to assist with responses during interviews (in-person or virtual) is prohibited unless permission is explicitly provided.
Work Model
- Onsite: Work will primarily be performed full-time at a customer facility, where employees collaborate directly with colleagues and customers as required by the role.
Compensation
- USD 77,600 - 176,000 per year
Benefits
- Health, life, disability, financial, and retirement benefits
- Paid leave
- Professional development
- Tuition assistance
- Work-life programs
- Dependent care
- Recognition awards program
- Full-time and part-time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen’s benefit programs
Similar Jobs
S