Data Engineer 5 (Enterprise Platforms Technology)

Capital One is seeking a Data Engineer 5 to help drive a company-wide transformation by building and supporting cloud-first data platforms and solutions. This role focuses on designing, developing, testing, implementing, and operating data pipelines using modern data engineering practices and technologies.

Onsite Location

• New York, NY (onsite)

Compensation

• USD 250,800 - 286,200 per year

This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI).

Responsibilities

• Work with and across Agile teams to design, develop, test, implement, and support technical solutions across full-stack development tools and technologies
• Influence a team of developers, data analysts, and data scientists with deep experience in machine learning, distributed microservices, lakehouse architecture, and full-stack systems
• Use Python and Spark, along with open-source relational and NoSQL databases and cloud-based data warehousing platforms including Databricks and Snowflake
• Stay current on data engineering trends, experiment with new technologies, participate in internal and external technology communities, and mentor members of the data community
• Collaborate with product managers and software engineers to deliver robust cloud-first data solutions that support experiences for millions of Americans seeking financial empowerment
• Independently design, build, and deliver cloud data solutions and applications with little or no support from supervisors or managers
• Architect and enforce common data engineering design patterns to improve code quality, maintainability, and reusability across platforms and pipelines
• Design and build data pipelines and platforms with a focus on scalability, resilience, and operational efficiency, maintaining strong performance as data volume and business demands grow
• Act as a force-multiplier by combining hands-on technical contributions and innovation with mentoring and skill elevation for peers and junior engineers
• Lead end-to-end, large-scale data initiatives by driving critical architectural decisions and evaluating platform choices (including Snowflake versus Databricks) based on technical and business requirements
• Serve as an ambassador for the data engineering team by communicating technical concepts and data outcomes clearly to internal and external stakeholders

Required Qualifications

• Bachelor’s Degree or higher in Computer Science or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering)
• 6+ years of experience in application development (internship experience does not apply)
• 4+ years of experience in distributed data
• 4+ years of experience with SQL
• 4+ years of experience programming with Python, Java, or Scala
• 4+ years designing and developing data pipelines
• 2+ years in data modeling and designing end-to-end data solutions using both relational and non-relational database systems

Technology Stack

• Python, Spark, Databricks, Snowflake, SQL
• NoSQL databases
• EMR, Glue, AWS, Microsoft Azure, Google Cloud
• Airflow, Dagster
• Monte Carlo, Splunk
• MongoDB, Cassandra, DynamoDB
• Redshift
• Java, Scala

Additional Information

• Capital One will consider sponsoring a new qualified applicant for employment authorization for this position
• Applications are expected to accept for a minimum of 5 business days
• No agencies please
• Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination
• Capital One promotes a drug-free workplace
• If you require an accommodation to apply, contact Capital One Recruiting at 1-800-304-9102 or via email at [email protected]
• For technical support or questions about the recruiting process, email [email protected]
• Capital One does not provide, endorse, or guarantee and is not liable for third-party products, services, educational tools, or other information available through this site
• Capital One Financial is made up of several different entities; positions posted in Canada, the United Kingdom, and the Philippines are for specific Capital One entities