Senior Data Engineer

Mastercard is hiring a Senior Data Engineer for DC&E to design, build, and scale cloud-enabled data pipelines and Lakehouse or warehouse platforms. This role supports analytics, BI, regulatory reporting, and data-driven decision making, with a hybrid schedule in O’Fallon, Missouri requiring three days onsite each week.

Responsibilities

• Design, develop, test, and deploy secure, scalable, high-performance, resilient data pipelines using Apache Spark, Java or Scala, Hadoop, and cloud-native object storage platforms.
• Build and maintain batch and near-real-time data processing frameworks for petabyte-scale workloads and enterprise-grade data requirements.
• Create reusable engineering components, frameworks, and design patterns to accelerate data product delivery while maintaining enterprise architecture and engineering standards.
• Implement “build once, run anywhere” architectures to support deployment across on-premises and public cloud environments without code changes.
• Deliver enterprise data capabilities including data lineage, metadata management, data cataloging, data quality, monitoring, and observability across the data ecosystem.
• Partner with architects and platform teams to define scalable architecture patterns, distributed computing practices, and engineering standards, and to drive adoption of modern Lakehouse architectures.
• Support cloud modernization by migrating legacy ETL, data warehouse, and analytics workloads to cloud-native architectures using Amazon S3, Amazon EMR, and AWS Glue.
• Own end-to-end engineering work such as requirements analysis, solution design, coding, testing, deployment, production support, and continuous optimization.
• Collaborate with product owners, analysts, architects, and business stakeholders to convert requirements into scalable solutions and deliver committed outcomes on schedule.
• Troubleshoot complex production incidents, conduct root cause analysis, and implement sustainable remediation aligned to Mastercard security, quality, and operational governance standards.
• Mentor engineers through code reviews, technical coaching, knowledge sharing, and best practices, with a focus on improving performance, automation, monitoring, and engineering efficiency.

Requirements

• Hands-on experience as a Data Engineer or Senior Data Engineer delivering enterprise-scale Data Warehouse, Data Lake, or Data Lakehouse solutions.
• Proven ability to deliver multiple end-to-end data engineering initiatives in large-scale distributed computing environments.
• Hands-on experience migrating ETL or ELT, data warehouse, and analytics workloads from on-premises platforms to cloud-native architectures.
• Strong development background with Apache Spark, Scala and/or Java, Hadoop ecosystem technologies, and cloud object storage platforms.
• Experience building orchestration and workflow solutions using Apache Airflow, Apache NiFi, or comparable enterprise scheduling and workflow frameworks.
• Strong SQL skills and experience with relational and NoSQL databases, including Oracle, SQL Server, Cassandra, and DynamoDB.
• Working knowledge of cloud platforms, preferably AWS, including Amazon S3, Amazon EMR, AWS Glue, and other cloud-native data services.
• Strong understanding of security, privacy, regulatory, and compliance requirements relevant to sensitive financial and customer data.
• Ability to lead complex technical initiatives across multiple teams and influence engineering direction without direct authority.
• Demonstrated capability to mentor engineers and elevate technical performance through design guidance, knowledge sharing, and constructive feedback.
• Excellent communication and stakeholder management skills, including the ability to explain technical concepts, trade-offs, risks, dependencies, and recommendations to technical and business audiences.
• Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related STEM discipline, or equivalent practical experience.

Technologies

• Apache Spark
• Java
• Scala
• Hadoop
• Apache Airflow
• Apache NiFi
• Amazon S3
• Amazon EMR
• AWS Glue
• AWS

Benefits

• Competitive base salary and may be eligible for an annual bonus or commissions depending on the role.
• Insurance including medical, prescription drug, dental, vision, disability, and life insurance.
• Flexible spending account and health savings account.
• Paid leaves including 16 weeks of new parent leave and up to 20 days of bereavement leave.
• 80 hours of Paid Sick and Safe Time, 25 days of vacation time, and 5 personal days (pro-rated based on date of hire).
• 10 annual paid U.S. observed holidays.
• 401k with a best-in-class company match.
• Deferred compensation for eligible roles.
• Fitness reimbursement or on-site fitness facilities.
• Eligibility for tuition reimbursement.
• For eligible interns: 56 hours of Paid Sick and Safe Time, jury duty leave, and on-site fitness facilities in some locations.

Corporate Security Responsibility

• Abide by Mastercard’s security policies and practices.
• Ensure the confidentiality and integrity of the information being accessed.
• Report any suspected information security violation or breach.
• Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.

Pay Range

O’Fallon, Missouri: $115,000 - $184,000 USD per year