Data Engineer 2

Comcast Advertising is hiring a Data Engineer 2 in Willow Grove, PA with an onsite schedule. In this role, you will build and optimize large-scale data pipelines using SQL, Python, Apache Spark, and AWS, while helping enable reliable, self-service analytics for many users.

What you’ll do

• Architect, design, and build high-performance, scalable data pipelines to support large-scale data processing.
• Develop complex Big Data ETL workflows using modern frameworks such as Databricks Delta Live Tables (DLT).
• Design and implement robust data lake architectures, including open table formats such as Delta Lake and Apache Iceberg.
• Define, promote, and enforce data engineering best practices to support data quality, integrity, reliability, and performance.
• Implement observability and monitoring across pipelines, including data cataloging, lineage, and metadata management.
• Participate in peer reviews, knowledge sharing, production support, incident resolution, and change management.
• Follow code management and version control best practices across development workflows.
• Create high-quality documentation covering data flows, lineage diagrams, and architecture details aligned to data engineering documentation standards.
• Ensure comprehensive code coverage by building unit and integration tests using test-driven development (TDD).
• Own critical components of large-scale batch ETL systems and clearly explain data models and design decisions to Product, Engineering, and Leadership stakeholders.
• Balance multiple priorities, aligning long-term architectural direction with immediate business needs.
• Build advanced semantic layers and support customer-facing self-service analytics solutions.
• Use independent judgment and discretion when handling complex and impactful technical decisions.
• Maintain regular, consistent, and punctual attendance, with flexibility to work nights, weekends, or variable schedules as needed.
• Perform additional duties and responsibilities as assigned.

Qualifications

• Minimum 2 years of experience in Data Engineering.
• Proficiency in Python and PySpark, with a good grasp of SQL.
• Hands-on experience with Databricks and/or Snowflake is preferred.
• Data Warehouse modeling paradigms.
• Understanding of cloud-based architectures; the team uses AWS.
• Problem-solving skills.
• Nice to have: AWS Certified Developer Associate, Databricks Certified Data Engineer Associate, SnowPro Advanced: Data Engineer.

Tools and technologies

• SQL, Python, PySpark, Apache Spark
• AWS
• Databricks Delta Live Tables (DLT), Databricks, Delta Lake, Apache Iceberg
• Looker, Tab, Snowflake

Education

• Bachelor’s Degree
• Comcast may also consider applicants with some combination of coursework and experience, or extensive related professional experience.

Pay range and application window

Salary: USD 79,728 - 132,880 per year.

• This job can be performed in Illinois and Massachusetts with a pay range of $79,728.27 - $132,880.46.
• Comcast intends to offer base pay within this range based on job-related, non-discriminatory factors such as experience.
• The application window is 30 days from the date the job is posted, unless the number of applicants requires the posting to close sooner or later.