Data Engineer

DCI Solutions is hiring a Data Engineer to integrate data, build decision-support applications, and support a cross-functional team in New York, NY.

Responsibilities

• Act as a Data Engineer on a cross-functional team addressing high-priority problems
• Integrate data, transform information into insights, and build applications for operational decisions
• Set up transfers of data feeds from source systems to a target location
• Create transformations and derive new datasets using Spark for distributed computation
• Monitor build progress and troubleshoot data build failures
• Design applications that answer operational questions
• Support RFI requests related to the platform’s data footprint
• Collaborate with product teams while debugging and understanding the code behind the platform

Requirements

• BS in Computer Science / Engineering (or related career field) preferred
• Strong Data Engineering background
• Experience with Spark, PySpark, and/or Pandas
• Extensive coding/programming experience in Python
• Extensive coding/programming experience in SQL, R or similar
• Strong understanding of algorithms and data structures as they apply to development
• Foundry experience preferred
• Active Secret Security Clearance (required)

Technologies

• Spark
• PySpark
• Pandas
• Python
• SQL
• R
• Foundry

Experience

• Data engineering: 5 years (preferred)
• Python coding/programming: 5 years (preferred)
• Building and managing data pipelines: 5 years (preferred)
• Data transformation: 5 years (preferred)
• Foundry: 1 year (preferred)
• Spark and/or PySpark: 3 years (preferred)
• Pandas: 3 years (preferred)

Security Clearance

• Secret (required)

Job Type

• Full-time

Location

• New York, NY (onsite / in person)

Salary

• USD 175,000 - 260,000 per year

Benefits

• 401(k)
• 401(k) matching
• Dental insurance
• Flexible schedule
• Flexible spending account
• Health insurance
• Health savings account
• Life insurance
• Paid time off
• Parental leave
• Professional development assistance
• Relocation assistance
• Retirement plan
• Tuition reimbursement
• Vision insurance