Senior Data Engineer

Castalia Systems is hiring a Senior Data Engineer to help ensure critical data is available through reliable movement, modification, and storage, while enabling scalable deployment of data pipelines. You will collaborate with Software Engineers and Data Scientists to support high-priority national security users and mission-focused AI and Machine Learning initiatives.

This full-time hybrid role is based in Arlington, VA, with an Active Secret clearance required and a U.S. Citizen requirement.

Role Overview

• Ensure data availability by supporting the end-to-end flow of critical data, including movement, modification, and storage.
• Support scalable deployment of data pipelines for national security users.
• Collaborate with engineering and analytics teams to deliver data capabilities that support AI and Machine Learning applications.

Requirements

• BS Degree.
• 8+ years of professional experience for most opportunities.
• Python experience with data manipulation and scripting.
• Databricks experience.
• Experience designing and implementing Extract Transform Load (ETL) data processes.
• Experience with at least one relational database, such as PostgreSQL, MySQL, or SQLite.
• Experience with Agile SCRUM methodologies.

Technologies

• Python, Databricks, and ETL (Extract Transform Load)
• PostgreSQL, MySQL, SQLite
• NiFi, SQL
• NoSQL, Graph Databases
• Data Lakes
• Dashboarding tools similar to Qlik
• Qlik

Preferred Qualifications

• Familiarity with database design, server management, connection protocols, database normalization, and principles of information theory.
• Experience with data cleaning or data organization.
• Familiarity with NiFi, SQL, NoSQL, Graph Databases, and Data Lakes.
• Familiarity with dashboarding tools similar to Qlik.
• Familiarity with cybersecurity with design and implementation of unique data transfer protocols.

Workplace, Travel, and Physical Requirements

• Workplace: Hybrid
• Onsite requirement: 3-5 days per week
• Environment: Normal office environment
• Travel: As needed

Mission Context

• Our team develops and deploys cutting-edge AI and Machine Learning applications that directly support national security missions.
• The work supports 19 key Principal Staff members (Senior Executive Service and General Officers) within the Office of the Undersecretary of Defense (OUSD) and the Intelligence Community.

Compensation and Benefits

• Compensation: $150,000.00 to $160,000.00 (annualized USD)
• Medical, dental, and vision coverage
• 401k matching
• Generous PTO
• Paid holidays
• Professional training opportunities
• Pet insurance

Job Type and Clearance

• Job Type: Full-Time
• Clearance: Active Secret clearance
• Citizenship: Must be a U.S. Citizen