Data Engineer II
Azure Data Factory
Azure Data Platform
Big Data
Bigdata
Cloud Data Engineering
Cloud Platform
Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Factory
Data Factory Azure
Data Governance
Data Integration
Data Lake
Data Lakehouse
Data Management
Data Pipeline
Data Platform
Data Processing
Data Security
Data Warehouse
Database
Databases
Databricks
Delta Lake
DevOps
ETL
Informatica
Microsoft Azure
Pyspark
Spark
SQL
Job Description
The Data Engineer II role at TD Bank focuses on delivering end-to-end data engineering capabilities, from modeling and quality management to ingestion, ETL, and metadata and lineage governance. The position also contributes to testing, release support, and compliance activities that ensure data platforms meet enterprise standards.
Location and Work Setup
- Work location: Mount Laurel, New Jersey, United States of America
- Onsite: Yes
- Hours: 40
- Domestic travel: Occasional
- International travel: Never
Compensation
Base pay: USD 79,160 - 127,670 per year
Responsibilities
- Provide data engineering functions including data modeling, data quality, data profiling, data acquisition and ingestion, and ETL/metadata/lineage management.
- Perform data analysis and assess data management requirements for a specific Platform or Journey, including complex analysis spanning multiple pods or products.
- Maintain expert knowledge of upstream data using inputs such as profiling, data quality reporting, and metadata production.
- Articulate complex, large-scale technical design and development details to non-technical business partners.
- Elucidate, analyze, and translate business and data requirements into complete business solutions, including entity relationship diagrams, dimensional data models, ETL and business rules, data life-cycle management, governance, lineage, and metadata.
- Ensure data is maintained in compliance with enterprise data standards, policies, and guidelines.
- Develop and maintain complex data models using industry standard modeling tools.
- Develop and maintain complex ETL jobs and frameworks using the Bank’s standard tools.
- Support development and testing teams to resolve data issues, including escalation support for complex issues.
- Support partners and stakeholders with interpreting and analyzing data.
- Build effective working relationships within the pod and across partner teams to support all pod deliverables.
- Coordinate with technology work teams such as ITS, ARE, Architecture, and Enterprise Protect to help ensure delivery success.
- Support QA with data analysis and investigations of complex issues and test cases as part of SIT/UAT/PAT testing.
- Provide oversight on post-implementation activities during the warranty period.
- Execute and approve code check-in and check-out into the source code repository as part of source code management.
- Work with ITS and ARE teams to support code packaging and deployment using CI/CD into higher environments.
- Participate as a lead participant in design and architecture reviews.
- Raise ServiceNow requests and work with change management to support release management activities.
- Lead data engineering initiatives and capabilities, including the application of data governance principles across the organization.
- Ensure metadata and data lineage are captured and compatible with enterprise metadata and data management tools and processes.
- Adhere to standard security coding practices to help prevent common coding vulnerabilities.
- Identify, document, and implement technical decisions, technical risks, and lessons learned through enhancements.
- Identify and manage risks, and escalate non-standard, high-risk activities as necessary.
- Adhere to internal policies and procedures and applicable regulatory guidelines.
- Share knowledge, leverage engineering best practices, and enable team members through mentoring and guidance.
- Keep stakeholders informed about day-to-day project status and relevant updates.
- Provide thought leadership for data engineering best practices and participate in knowledge transfer within the team and business unit.
- Participate in personal performance management and development activities, including cross training.
- Contribute to a fair, positive, and equitable environment supporting a diverse workforce.
- Act as a brand ambassador for the business area/function and the bank internally and/or externally.
Required Qualifications
- Degree, postgraduate degree, or technical certificate in Data Management or a related discipline (e.g., Computer Science, Engineering), or equivalent practical experience.
- 3+ years of relevant experience.
- Advanced knowledge of data engineering frameworks, technologies, tools, processes, patterns, and procedures, including their impact on other technology areas such as Architecture or Infrastructure.
- Ability to perform complex technical tasks independently.
- Advanced knowledge of TD applications, systems, networks, innovation, design activities, business, organization, best practices, and standards.
- Experience designing and developing to meet business and technical requirements, including analysis, adaptation, integration, coding, testing, debugging, and execution.
- Experience using established patterns to solve complex problems and leading development of new patterns when needed.
- May be recognized as a subject matter expert in areas directly related to key accountabilities.
- 3+ years of experience with: Azure Databricks, PySpark, SQL, Azure Data Factory (ADF), Big Data, ETL, and Data Engineering, and GitHub or Bitbucket.
- Analytical and problem-solving skills.
- 1+ years of experience with: Delta Lake, Unity Catalog, CI/CD and DevOps practices, data governance and lineage, and cloud migration and modernization.
Technology Stack
- Azure Databricks
- PySpark and Apache Spark
- SQL
- Azure Data Factory (ADF)
- ETL
- GitHub, Bitbucket
- Delta Lake
- Unity Catalog
- CI/CD and DevOps
- Data governance and data catalogs
- SIT/UAT/PAT testing
- ServiceNow
Benefits
- Base salary and variable compensation/incentive awards (eligibility for cash and/or equity incentive awards, generally through participation in an incentive plan)
- Health and well-being benefits
- Savings and retirement programs
- Paid time off (Vacation PTO, Flex PTO, and Holiday PTO)
- Banking benefits and discounts
- Career development, reward, and recognition
- Training and onboarding sessions
Accommodation
If you are an applicant with a disability and need accommodations to complete the application process, email TD Bank US Workplace Accommodations Program at [email protected]. Include your full name, best way to reach you, and the accommodation needed to assist you with the applicant process.