Data Engineer 5

Capital One is hiring a Data Engineer 5 in New York, NY (onsite) to help drive a major transformation in enterprise data technology. The role focuses on scalable, resilient, cloud-first data pipelines and platforms that support AI and the broader data lifecycle.

What You’ll Do

• Collaborate across Agile teams to design, develop, test, implement, and support solutions across full-stack development tools and technologies.
• Lead and influence developers, data analysts, and data scientists with expertise in machine learning, distributed microservices, lakehouse architecture, and full-stack systems.
• Build using Python and Spark, working with open-source relational and NoSQL databases and cloud data warehousing platforms including Databricks and Snowflake.
• Stay current on data engineering trends, experiment with new technologies, and participate in internal and external technology communities.
• Partner with product managers and software engineers to deliver robust cloud-first data solutions that support financial empowerment for millions of Americans.
• Independently design, build, and deliver cloud data solutions and applications with limited guidance from supervisors or managers.
• Architect and enforce common data engineering design patterns to improve code quality, maintainability, and reuse across platforms and pipelines.
• Communicate technical concepts and data outcomes clearly to internal and external stakeholders to align on shared understanding.
• Design and build data pipelines and platforms with scalability, resilience, and operational efficiency, maintaining performance as data volume and business needs grow.
• Act as a force multiplier by balancing hands-on engineering contributions with mentoring and skills growth for peers and junior engineers.
• Lead end-to-end, large-scale transformative data initiatives, including independent architectural decisions and platform evaluations such as Snowflake vs. Databricks.

Required Qualifications

• Bachelor’s Degree or higher in Computer Science or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering).
• 6+ years of experience in application development (internship experience does not apply).
• 4+ years of experience in distributed data.
• 4+ years of experience with SQL.
• 4+ years programming with at least one of: Python, Java, or Scala.
• 4+ years designing and developing data pipelines.
• 2+ years in data modeling and end-to-end data solutions using both relational and non-relational database systems.

Technologies

• Python, Spark, SQL
• Databricks, Snowflake
• EMR, Glue, AWS
• NoSQL (MongoDB, Cassandra, DynamoDB)
• Redshift
• Airflow, Dagster
• Monte Carlo, Splunk
• Java, Scala

Preferred Qualifications

• Master’s Degree in Computer Science or a related field.
• 8+ years of experience in data engineering.
• 5+ years hands-on experience designing, deploying, and operating data workloads in AWS.
• 5+ years experience building or supporting distributed data or compute workloads using tools such as EMR, Spark, Glue, or Databricks.
• 5+ years experience designing, implementing, and operating real-time or streaming data pipelines.
• 5+ years experience working with unstructured or semistructured data using NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB).
• 5+ years experience designing and supporting data warehousing solutions (e.g., Snowflake, Redshift).
• 4+ years of data modeling experience.
• 3+ years experience working in an Agile development environment.
• 3+ years experience developing user-centric reusable data products.
• 3+ years experience in data observability (e.g., Monte Carlo, Splunk) or data orchestration tools (e.g., Airflow, Dagster).

Compensation

• New York, NY (onsite): USD 250,800 - 286,200 per year
• Performance-based incentive compensation may be available, which may include cash bonus(es) and/or long term incentives (LTI).

• Cambridge, MA: $229,900 - $262,400 for Data Engineer 5
• McLean, VA: $229,900 - $262,400 for Data Engineer 5

Benefits

Capital One offers a comprehensive, competitive, and inclusive set of health, financial, and other benefits.