Data Engineer
Job Description
The Data Engineer role at General Dynamics Information Technology centers on designing, building, deploying, and maintaining data architectures, pipelines, and databases within the AWS GovCloud environment to support mission-critical government programs. The position is based onsite in Mechanicsburg, Pennsylvania.
Responsibilities
- Collaborate with a team of Data and Cloud Architects, Engineers, and Administrators to design, deploy, and sustain data architectures and databases in the AWS GovCloud environment.
- Develop, test, and maintain high-performance, scalable data systems for OIS, including databases and large-scale processing infrastructures, and migrate data from on-premises databases to cloud-based solutions with required transformations.
- Create and maintain scalable data pipelines and new API integrations, ensuring pipelines are scalable, repeatable, and secure.
- Implement and manage databases and data delivery systems, translating data into actionable insights for analysis and reporting.
- Identify, research, and promote solutions that enhance the modern development environment so systems meet business requirements and industry best practices.
- Implement data extraction, loading, and synchronization routines as part of ETL processes.
- Establish data governance and quality controls, monitor ETL/ELT jobs, and address performance or issue trends.
- Improve system performance through testing, troubleshooting, and integration of new components while ensuring data platform solutions meet confidentiality and privacy requirements.
- Collaborate with data scientists, architects, and stakeholders to ensure the data infrastructure delivers required functionality and performance metrics.
- Design, model, document, and guide the logical and conceptual relationships of data and related database changes.
- Document data architecture and systems for both technical teams and non-technical stakeholders.
- Engage in technical planning, system integration, verification and validation, and cost and risk assessments.
Requirements
- Active Top Secret security clearance
- 10+ years of prior data engineering experience
- Experience implementing data warehousing concepts, ETL processes, and tools such as Pentaho
- Experience developing and administering PostgreSQL
- Strong proficiency in SQL and familiarity with additional querying languages
- Experience decomposing Oracle PL/SQL stored procedures and triggers to migrate to Amazon Aurora DB, Postgres, or MySQL
- Hands-on expertise in data modeling, schema design, and database optimization for production environments
- Knowledge of data security and compliance best practices
- Experience with GitLab, Liquibase, and CI/CD pipelines is highly preferred
- Experience with big data technologies such as Hadoop, Spark, Kafka, Debezium, and RabbitMQ
- Background in network and cyber security design, engineering, and operations with emphasis on Navy capabilities
- Prior Navy experience
- Experience with cloud data services (AWS, Azure, GCP)
- Experience with cloud relational database services (AWS RDS, Aurora DB)
- SAFe experience and knowledge
- Experience with data warehousing and BI tools such as RedShift, MicroStrategy, Erwin Data Modeler
- Proficiency in one or more programming languages such as Python, Java, Scala, or Go
- Excellent verbal and written communication skills for effective collaboration with technical and non-technical stakeholders
- Self-starter with the ability to work independently with limited supervision
- 8570/8140 IAT II CompTIA Security+ CE
- Computing environment certification: AWS Certified Solutions Architect or AWS Certified Data Engineer or equivalent cloud or Oracle database certification (highly preferred to have at start; if not, must obtain within 3 months of start)
- Work location: Mechanicsburg, PA or Yorktown, VA
- U.S. Citizenship required
Technologies
- AWS GovCloud, Pentaho, PostgreSQL, PostreSQL, SQL, Oracle PL/SQL
- Amazon Aurora DB, MySQL, AWS, Azure, GCP
- AWS RDS, Aurora DB, RedShift, MicroStrategy
- Erwin Data Modeler, Python, Java, Scala, Go
- GitLab, Liquibase, CI/CD
- Apache Hadoop, Spark, Kafka, Debezium, RabbitMQ
Benefits
- Growth: Access to an AI powered career tool that identifies career steps and learning opportunities
- Support: An internal mobility team focused on helping you achieve career goals
- Rewards: Comprehensive benefits and wellness packages, 401K with company match, competitive pay, and paid time off
- Community: An award winning culture of innovation and a military friendly workplace
Work Requirements
- 10+ years of related experience
- May vary based on technical training, certification(s), or degree
- CompTIA Security+ CE
- AWS Certified Solutions Architect - Associate
- Less than 10percent
- U.S. Citizenship Required