Spark Developer

Join a production support and DevOps-focused team to deliver Spark development, troubleshooting, and automation across technical stakeholders and the business.

Responsibilities

• Work within the production support / devops team to support production systems and middleware
• Collaborate with internal and external technical teams as well as production support partners
• Partner closely with the business team to address production and delivery needs
• Handle production support tasks by investigating issues, identifying root causes, and driving resolutions independently
• Perform Spark development alongside ongoing performance and operational improvements
• Identify and pursue optimization and automation opportunities to improve reliability and efficiency
• Troubleshoot and resolve issues involving performance, data integrity, and system behavior

Requirements

• Mid to senior level Software Engineer with experience working in Platform / Production Support / DevOps environments
• Hands-on experience with ETL, Bigdata, Hadoop, and SQL
• Working knowledge of Spark, Unix, data warehousing, scheduling tools, and scripting
• Strong experience in Spark development, performance optimization, and troubleshooting
• Strong data and code analysis skills, including troubleshooting data quality and integrity and determining root causes

Technologies

• Spark
• Unix
• ETL
• Hadoop
• SQL
• Data warehousing
• Bit Bucket
• Gradle
• Jenkins
• Ansible
• CI-CD pipeline

Desired Qualifications

• Comfortable collaborating with all levels of management
• Ability to surface risks early before they become issues
• Experience working in Agile teams
• Good understanding of Bit Bucket, Gradle, Jenkins, Ansible, and CI-CD pipeline practices

Location: Charlotte, NC (onsite)