Senior Data Engineer
Job Description
Expression is hiring a Senior Data Engineer in Shirlington, VA (onsite) to build secure, governed enterprise data services that enable AI and LLM use cases for the Department of Homeland Security (DHS).
Responsibilities
- Design, develop, and maintain secure enterprise data integrations connecting Government-approved data platforms to AI applications and agentic AI workflows within an existing AI environment.
- Build and integrate APIs, data connectors, and retrieval services for Palantir, Databricks, Elasticsearch, and other authorized enterprise data sources.
- Implement data access and retrieval for structured, semi-structured, and unstructured content, including records, documents, relationships, and analytical data products.
- Create and maintain schema mappings, transformations, and context-preparation steps to support RAG, intelligent search, AI-assisted document generation, and source-grounded analytical workflows.
- Implement permission-aware data access controls, including authentication, authorization, identity propagation, case-purpose restrictions, and source-level permissions.
- Ensure data provenance, lineage, and traceability by preserving source identifiers, timestamps, metadata, access restrictions, and document references during retrieval and AI processing.
- Develop data validation and quality checks to detect missing, stale, malformed, conflicting, or unauthorized records prior to downstream AI consumption.
- Optimize data retrieval and API performance, including query efficiency and response latency for reliable access to enterprise services.
- Collaborate with AI engineers to integrate authorized data into LLM and RAG workflows, ensuring outputs can be traced to supporting source records and remain compliant with access controls.
- Implement automated unit, integration, and regression tests for connectors, APIs, schema mappings, data quality, and authorization boundaries.
- Add secure error handling, audit logging, and observability to monitor performance, troubleshoot failures, and support operational reliability.
- Support controlled data synchronization and approved write-back operations where authorized, including input validation, human approval requirements, and safeguards against duplicate or unauthorized updates.
- Coordinate with platform owners, cybersecurity teams, and Government stakeholders to define interface specifications, resolve integration issues, and maintain compliance with approved data governance requirements.
- Produce and maintain interface control documents, data-flow diagrams, schema mappings, API specifications, test results, operational runbooks, and technical documentation.
- Support CI/CD integration, configuration management, software releases, and regression testing as schemas, interfaces, and access requirements evolve.
- Participate in technical design reviews, code reviews, engineering planning, and cross-functional troubleshooting.
- Support technical demonstrations, prototype evaluations, Government acceptance testing, and operational pilot deployments.
Requirements
- Bachelor's degree in Computer Science, Information Systems, Data Engineering, Software Engineering, Data Science, or a related technical field, or equivalent relevant professional experience.
- 7+ years of professional experience in data engineering, software engineering, or enterprise data integration, including 3+ years hands-on experience developing enterprise data pipelines, APIs, or governed data services.
- Strong SQL and Python skills, including data querying, transformation, API integration, scripting, debugging, and automated testing.
- Proven experience designing and maintaining enterprise data integrations, including RESTful APIs, data connectors, schema mappings, and secure data exchange.
- Hands-on integration experience with at least one of: Palantir, Databricks, Elasticsearch (platform APIs, data access mechanisms, or query interfaces).
- Experience with structured, semi-structured, and unstructured enterprise data, including data modeling, schema management, data transformation, and retrieval optimization.
- Experience implementing secure, permission-aware data access, including authentication, authorization, identity propagation, sensitive-data handling, and source-level access restrictions.
- Demonstrated experience implementing data quality, validation, lineage, and traceability controls.
- Experience building data retrieval services or pipelines for analytics, intelligent search, AI applications, or RAG workflows.
- Ability to troubleshoot complex integration issues such as API failures, schema inconsistencies, query performance, authorization errors, and data quality problems.
- Experience with modern delivery practices: Git, code reviews, CI/CD, automated testing, and configuration management.
- Ability to translate technical and data governance requirements into secure integration designs, data contracts, test cases, and engineering documentation.
- Strong written and verbal communication skills across AI engineers, software developers, platform owners, and Government stakeholders.
Technologies
- SQL, Python, RESTful APIs
- Git, CI/CD
- Palantir, Databricks, Elasticsearch
- RAG, LLM, AI
Benefits
- 401k matching
- PPO and HDHP medical/dental/vision insurance
- Education reimbursement up to $10,000/yr
- Complimentary life insurance
- Generous PTO and 11 days of holiday leave
- Commuter Benefits Plan
Security Clearance
- Secret clearance required with eligibility for TS/SCI.
Location
- Shirlington, VA (onsite)
Preferred Qualifications
- Hands-on integration experience with two or more of: Palantir, Databricks, Elasticsearch.
- Experience with Palantir data objects, relationships, APIs, or governed data-access capabilities.
- Experience with Databricks data products, SQL query services, data governance, lineage, or managed analytical datasets.
- Experience with Elasticsearch query APIs, index/alias management, document retrieval, and field-level access restrictions.
- Experience implementing RAG data pipelines, semantic or vector retrieval, document parsing, embeddings, and context preparation for LLM-powered applications.
- Experience supporting AI/ML or generative AI applications requiring secure retrieval, source attribution, and permission-aware context assembly.
- Experience with cloud-native data engineering and containerized applications using AWS, Azure, Docker, Kubernetes, or comparable technologies.
- Familiarity with Infrastructure as Code, DevSecOps practices, and automated deployment pipelines.
- Experience implementing controlled data synchronization, incremental updates, audit logging, and approved write-back operations across enterprise systems.
- Experience supporting Federal Government, Department of Defense, Intelligence Community, Department of Homeland Security, or similarly regulated data environments.
- Familiarity with Government cybersecurity, privacy, data governance, access control, and software authorization requirements.
- Experience supporting technical demonstrations, Government acceptance testing, operational pilots, or production data integration sustainment.
Salary: USD 180,000 - 200,000 per yearly