Software Engineer

Leidos is seeking a Software Engineer to support an enterprise IT program with a focus on ETL workflows, data ingestion, and analytics across on-premises and cloud environments.

Responsibilities

• Provide analysts with large datasets, methodologies, and data visualizations to address critical intelligence questions.
• Ingest, clean, store, and analyze data as part of the data workflow.
• Develop and support ETL workflows for data movement.
• Collaborate regularly with data scientists, analysts, and managers.
• Load large datasets into on‑premises and cloud environments and develop ingestion algorithms and schemas for large data sets.
• Analyze new large‑volume datasets to optimize ingestion processes.
• Assist in creating Apache NiFi schemas for new data loads.
• Develop software tools to preprocess, modify, aggregate, load, index, and archive large data collections into clusters in near real time.
• Ensure proper access controls are implemented.
• Generate metrics to track data ingest statistics to maintain data integrity and provenance.
• Document data flows according to customer standards.

Requirements

• Active TS/SCI clearance with Poly is required.
• Bachelor's degree in Computer Science, Computer Engineering, Systems Engineering, or closely related discipline with at least 4 years of experience; or a Master's degree with at least 2 years of experience; or 8+ years of experience in lieu of a degree.
• Experience with AWS cloud services, including long-term storage options and cloud-based database services.
• Experience understanding SQL database structures and mapping between different SQL databases.
• Experience working with Apache NiFi.
• Experience with large data and high performance compute clusters such as Hadoop or similar.
• Experience with API development techniques.
• Experience developing and deploying ETL processes for large data sets.
• Experience creating operating system level scripts to perform ETL operations on SQL databases.
• Experience with version control systems, preferably Git.
• Experience testing software solutions for ETL using efficient languages for the task such as NiFi, Python, and SQL.
• Experience implementing multiprocessing data flows to parallelize ingest operations.

Technologies

• AWS
• Apache NiFi
• Hadoop
• Python
• SQL
• Git

Benefits

• Competitive compensation
• Health and Wellness programs
• Income Protection
• Paid Leave
• Retirement

Location

McLean, VA (onsite)

Salary

USD 87,100 - 157,450 per year