Principal Data Engineer
Artificial Intelligence
Azure Blob Storage
Azure Data Factory
Azure Data Lake
Cloud Data Engineering
Data Architecture
Data Build Tool
Data Engineer
Data Engineering
Data Integration
Data Lake
Data Modeling
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Warehouse
Data Warehousing
ETL
Generative AI
Snowflake
Snowpark
SQL
Streaming Data
Job Description
New Balance is hiring a Principal Data Engineer II to lead Snowflake-focused enterprise data infrastructure for the Global Data & Analytics team.
Responsibilities
- Architect, design, and develop reliable data pipelines to acquire, ingest, transform, and deliver data from on-premises, cloud, batch, streaming, and event-driven sources
- Define reusable architecture patterns and engineering standards for the data platform
- Unify batch, streaming, and event-driven processing in a cohesive cloud data architecture with monitoring, alerting, recovery, and operational controls
- Partner with business and IT stakeholders to define requirements, identify source systems and integration methods, and model processes through use case scenarios, workflow diagrams, and data models aligned to the enterprise data architecture
- Design and deliver reusable, well-governed data products across business domains with data owners and consumers, including data requirements, quality standards, documentation, ownership, and operational expectations
- Lead technical design reviews and guide engineering decisions across scalability, reliability, security, maintainability, performance, and cost optimization
- Apply practical AI capabilities, including AI coding agents (e.g., Snowflake CoCo) and LLM-powered techniques (e.g., Snowflake Cortex AI Functions), to improve pipeline development, testing, and operations
- Automate data-quality validation and source-to-target reconciliation with security, governance, human review, and production controls
- Debug, profile, and optimize integrations and ETL/ELT workflows for performance, reliability, and efficient platform resource consumption
- Drive process improvements by automating manual tasks, optimizing data delivery, strengthening CI/CD and testing, and improving scalability and supportability
- Document application and data architecture, engineering standards, operating procedures, and technology decisions; maintain operational runbooks; recommend improvements and alternatives
- Handle production issues promptly, provide on-call support as needed, keep stakeholders informed, and surface delivery risks or obstacles with lead time
- Support team effectiveness through open communication, technical mentorship, knowledge sharing, succession planning, and staying current with emerging data engineering and platform capabilities
Requirements
- Bachelor’s degree in Computer Science, Management Information Systems, or a related field, or equivalent professional experience
- 11-13 years of experience in data warehouse and data engineering development, including building, managing, and optimizing enterprise data pipelines in cloud environments
- Demonstrated capability to lead architecture and development of complex data pipelines and integrations across multiple source systems, with understanding of the software development life cycle
- Strong understanding of data architecture, data modeling, data quality, observability, and secure engineering practices
- Expert proficiency in SQL and Python, with strong analytical, troubleshooting, and problem-solving skills
- Deep experience with Snowflake data warehousing and data engineering capabilities, including performance optimization, cost-conscious design, and development using SQL, Python, and Snowpark
- Ability to translate business requirements into technical specifications, including sources, integration methods, transformations, data models, validation controls, and operational requirements
- Experience designing and delivering reusable data products across multiple business domains, including modeling, pipeline development, quality controls, documentation, and operational support
- Experience with Azure data integration services, including Azure Data Factory and Azure Data Lake Storage or Azure Blob Storage
- Experience with data transformation and software delivery practices using dbt, GitHub, GitHub Actions, automated testing, and CI/CD
- Experience using AI coding agents to accelerate pipeline development and testing and applying LLM-powered techniques to automate data-quality validation or reconciliation in ELT pipelines
- Technical thoroughness and accuracy, with enough understanding of technical databases and business applications to analyze issues and reach results-oriented conclusions
- Excellent written and verbal communication skills; ability to explain concepts to technical and non-technical audiences and influence cross-functional decisions; proactive risk and issue escalation
- Sense of urgency, initiative, and adaptability to changing priorities; strong judgment and attention to detail; ability to mentor engineers; required confidentiality
Technologies
- Snowflake, SQL, Python, Snowpark
- Snowflake CoCo, Snowflake Cortex AI Functions, LLM
- ETL, ELT
- Azure Data Factory, Azure Data Lake Storage, Azure Blob Storage
- dbt, GitHub, GitHub Actions
- CI/CD, automated testing
- Streaming, event-driven
Location and compensation
- Brighton, MA (hybrid)
- Annual salary range: $138,500 - $207,500
- Pay range (Boston, MA headquarters - (NB) only): Annual base pay range $138,500.00 - $173,000.00 - $207,500.00
Benefits
- Comprehensive traditional benefits including three options for medical insurance, plus dental, vision, life insurance, and 401K
- Online learning and development courses
- Tuition reimbursement
- $100 monthly student loan support
- Mentorship programs
- $1,000 yearly lifestyle reimbursement
- 4 weeks of vacations
- 12 holidays
- Generous parental leave
Flexible work schedule
- Hybrid model: in office three days per week (Tuesday, Wednesday, Thursday)
- Work from Anywhere (WFA) for four weeks per calendar year
Additional associate details (as listed)
- Regular associate benefits include yearly $1,000 lifestyle reimbursement, 4 weeks of vacations, 12 holidays, and generous parental leave
- Temporary associates are provided three options for medical insurance, plus dental and vision insurance and an associate discount
- Part time associates are provided 401k, short term disability, a yearly $300 lifestyle reimbursement, and an associate discount