Data Engineer IV

Join Airlines Reporting Corporation in Arlington, Virginia on site as a Data Engineer IV. You will shape the architecture, develop and optimize data products and platforms, and lead technical excellence across data teams. This role sits at the intersection of strategy and execution, guiding data initiatives that power industry-leading travel insights.

Benefits

• Be part of a motivated, diverse, creative, and collaborative team that drives innovation in the travel industry.
• Engage in hands-on learning and professional development to grow your skills and advance your career.
• Benefit from ARC’s WorkFlex hybrid program, enabling flexible remote work combined with in-person collaboration.
• Access a comprehensive benefits package designed to support you and your family.
• Collaborate with top minds in data and technology to push the boundaries of travel data solutions.

Responsibilities

• Technical Leadership: Provide expert guidance to development and platform engineering teams, act as a domain expert, and contribute to people leadership through communication, influence, relationship building, direction, and coaching. On call for incident response and production issues; perform forensic analysis when necessary for breaches and data incidents.
• Design: Lead the design and software development of complex data systems, ensuring scalable, efficient, and robust solutions. Optimize data platforms and pipelines for ARC products and services. Understand multi-region database architectures (Aurora RDS, Redshift) and coordinate with Ops for performance, resiliency, and high availability.
• Technology Evaluation: Explore, investigate, and recommend innovative tools and platforms to enhance data infrastructure.
• Data Strategy: Define and implement data strategies, best practices, and standards across the organization.
• Data Governance: Develop and enforce data governance and compliance policies.
• Innovation: Stay current with emerging technologies and industry practices, and implement new tools and approaches as appropriate.
• Optimization: Continuously optimize data platforms, processes, storage, codebases, and database performance.

Requirements

• Bachelor’s Degree or equivalent work experience preferred; equivalent experience considered.
• 7+ years designing and developing solutions for large-scale data systems, services, and platforms.
• 7+ years of full SDLC experience (design, development, delivery, etc.).
• 5+ years with Agile, Scrum, DevOps, and Continuous Integration and Continuous Delivery.
• 7+ years implementing modern data solutions using Cloud-based technologies in AWS, including Lambda, API Gateway, Security Groups, IAM Roles, Aurora (MySQL/Postgres), S3, CloudWatch, Secrets Manager.
• Expert in modern data and infrastructure design patterns, stream processing, and building data pipelines.
• Deep knowledge of modern database technologies (S3, Aurora, Python, Postgres, RDS, RDS Proxy, RedShift, NoSQL databases, DynamoDB, etc.).
• Deep knowledge of data warehousing platforms (Redshift, Snowflake, Teradata).
• Deep knowledge of SQL, database design/structures, ETL/ELT design patterns, and data mart structures.
• Expertise with ETL tools such as Glue, Kenesis, Athena, Ab Initio (preferred), Informatica or Talend.
• Experience with data lake and data lakehouse concepts and design patterns.
• Experience in data profiling and data analysis to investigate and validate data accuracy.
• Experience with BI technologies (AWS Quick, PowerBI, Tableau, Jasper, Cognos, Qlik, Looker, Metabase, and others).
• Deep knowledge of monitoring tools such as Datadog, CloudHealth, and the Atlassian Suite.
• Experience in data management and data governance.
• Excellent leadership skills and experience leading projects with other engineers.
• Proven ability to lead a group through an architectural development process and collaborate with stakeholders at all levels.
• Ability to translate functional and nonfunctional requirements into technical requirements and solution definitions.
• Proven ability to influence technology strategy and best practices across peers and leadership to support an agile development culture.
• Outstanding communication skills, with the ability to explain technical concepts to nontechnical audiences and document best practices and SOPs.
• Strong intellectual curiosity to challenge the status quo and adapt to evolving business needs.
• Commitment to supporting peers and helping meet timelines on large initiatives.

Technologies

Stack includes AWS services such as Lambda, API Gateway, Security Groups, IAM Roles, Aurora (MySQL/Postgres), S3, CloudWatch, Secrets Manager, Redshift, RDS, RDS Proxy, NoSQL databases (DynamoDB), Python, Postgres, Snowflake, Teradata, SQL, Glue, Kenesis, Athena, Ab Initio, Informatica or Talend, data lake and data lakehouse concepts, Datadog, CloudHealth, and Atlassian Suite, plus BI and analytics tools like AWS Quick, PowerBI, Tableau, Jasper, Cognos, Qlik, Looker, Metabase, and more.