Data Engineer

This Data Engineer role at NeoMax is designed for candidates with a Systems Engineer background, focused on building and operating reliable data pipelines in support of IT and service delivery data. The position is based in Herndon, VA (onsite) and requires 16+ years of experience, along with bachelor’s or master’s degree credentials.

Responsibilities

• Integrate diverse data streams into a data lake.
• Ensure unstructured data is structured at the time of load.
• Establish data standards and act as custodian of IT and service delivery data sets and data streams.
• Analyze complex networks and systems.
• Analyze log data from network components and operating systems.
• Manage and troubleshoot data feeds across systems.
• Perform Python and BASH scripting to support pipeline and data operations.

Requirements

• Minimum 16 years of experience.
• Bachelor’s or master’s degree.
• Experience integrating diverse data streams into a data lake.
• Experience with ETL and structuring unstructured data at load time.
• Experience with data transfer tools (for example, NiFi, Cribl).
• Experience establishing data standards and serving as custodian of IT and service delivery data sets and streams.
• Experience analyzing complex networks and systems.
• Experience analyzing log data from various network components and operating systems.
• Knowledge of complex environments that involve shared networks and multiple security enclaves.
• Systems Engineer background with a Data Engineer focus.
• Ability to manage and troubleshoot data feeds.
• Splunk CORE User certification prior to start.
• Splunk CORE Power User certification within 3 months from start.

Technology Focus

• Python
• BASH Scripting
• NiFi
• Cribl
• Splunk
• ShellScript

Desired Skills

• Security Development and Operations (SecDevOps).
• Hands-on Splunk experience with certifications.
• Scripting tools including Python, ShellScript, or Ansible.
• Cloud security controls and implementation.
• Public, private, and hybrid cloud experience (including AWS and Microsoft Azure).
• AWS Certified Security Specialty.