Data Engineer, Senior
Job Description
BigBear.ai is seeking a Lead Data Engineer to design and support data pipelines, reporting datasets, and analytics applications used in defense and intelligence operations. The role is based on-site in Norfolk, VA and focuses on building reliable data workflows, delivering mission-ready reporting, and ensuring secure access and production stability.
Responsibilities
- Develop, maintain, and troubleshoot data pipelines and transformations in Databricks using Python, PySpark, and SQL.
- Clean and validate source data, investigate discrepancies, and deliver datasets for operational reporting and analytics.
- Build and maintain Qlik Sense applications, dashboards, and SQL reports for mission users.
- Manage user access and permissions across data and analytics platforms in line with security and data governance requirements.
- Coordinate with engineering and operations teams to support database upgrades, system migrations, and production troubleshooting.
- Document data workflows, reporting logic, and support procedures so other team members can maintain them.
- Partner with mission stakeholders to convert operational reporting requirements into data products and application improvements.
Requirements
- Active TS/SCI clearance with the ability to maintain it.
- Bachelor’s degree in Information Systems, Information Technology, Computer Science, Engineering, or a related field.
- 5+ years of combined experience supporting data or information systems through data engineering, analytics, database administration, or technical systems support.
- Hands-on experience with Databricks, Python, Spark or PySpark, and SQL to transform, validate, or analyze data.
- Experience maintaining data pipelines and developing reports, dashboards, or analytics applications.
- Experience troubleshooting production data or application issues and administering user access in a secure environment.
- Ability to work on-site full time in Norfolk, Virginia.
Technologies
- Databricks
- Python
- Spark
- PySpark
- SQL
- Qlik Sense
- AWS
What We’d Like You to Have
- Experience supporting the Joint Staff, Combatant Commands, or other Department of Defense or intelligence organizations.
- Familiarity with Global Force Management data, systems, or workflows.
- Experience developing and supporting Qlik Sense applications.
- Experience supporting database upgrades, system migrations, or DoD security hardening.
- AWS Certified Cloud Practitioner certification or experience with AWS data services.
- Familiarity with API-based data integration.