Senior Data Engineer
Senior
Apache Airflow
Argo Workflows
Big Data
Cloud
Cloud Native
Cloud Platform
Cloud Platforms
Data Architecture
Data Engineer
Data Governance
Data Integration
Data Pipeline
Data Platform
Data Processing
Data Security
Data Warehouse
Data Warehousing
Database
Databricks
Elasticsearch
Engineer
Engineering
ETL
Kubernetes
Nifi
Opensearch
Platform Engineering
PostgreSQL
SQL
Job Description
Senior Data Engineer leading data engineering initiatives for high-priority government projects, building pipelines and architectures in a hybrid Fort Bragg, NC setting.
Responsibilities
- Design, build, and deploy data pipelines and ETL workflows using Python, Airflow, and NIFI as needed to ensure secure and efficient data processing
- Create scalable microservices for data intake and transformation capable of handling large volumes
- Curate, cleanse, and secure data to enable accurate transfers across multiple classification levels
- Engineer solutions that support both batch and streaming data processing
- Integrate pipelines with data lakes, data warehouses, and databases to boost accessibility and efficiency
- Collaborate with cross functional teams to deliver mission critical data requirements
- Enforce data handling best practices and security controls when working with classified datasets
- Apply data visualization techniques to render data more accessible and actionable for mission teams
Requirements
- Python
- Regular Expression scripting
- SQL: PostgreSQL and TSQL
- Git
- Docker
- Trino
- Familiarity with Kubernetes and Helm charts
- Deploying software in Kubernetes with Argo
- Airflow
- NIFI
- ElasticSearch and AWS OpenSearch
- Working in a Linux environment
- Database optimization
- Graph database management familiarity
Technologies
- Python
- Airflow
- NIFI
- PostgreSQL
- TSQL
- Git
- Docker
- Trino
- Kubernetes
- Helm charts
- Argo
- ElasticSearch
- AWS OpenSearch
- Linux
- Databricks
- Snowflake
- AWS
- GCP
- Graph database management familiarity
Benefits
- Career growth through an AI powered tool that identifies learning steps and development opportunities
- Internal mobility team dedicated to helping you achieve your career goals
- Comprehensive benefits and wellness packages, 401K with company match, competitive pay and paid time off
- Award winning culture of innovation and a military friendly workplace
Role Details
- Location: Fort Bragg, NC (hybrid)
- Salary: USD 111,350 - 150,650 per year
- Experience: 8+ years of related experience
- Education: Bachelor’s degree
- Travel: None required
- Citizenship: U.S. Citizenship Required
Identity Verification
- Identity verification uses advanced biometrics and artificial intelligence to confirm authenticity and prevent fraud
- On camera participation is required during virtual interviews
- Biometric data may be collected, processed, and stored for verification and security purposes
About Our Work
- General Dynamics Information Technology is a global technology and professional services provider delivering solutions to U.S. government, defense, and intelligence clients
- More than 26,000 experts help extract value from technology to deliver mission critical solutions
- Operations span over 50 countries, with capabilities in digital modernization, AI/ML, cloud, cyber, and application development
Similar Jobs
