DeveloperJobs.io
← Back to all jobs

Job Description

Capital One is building cloud-first data solutions that help power financial empowerment for millions of Americans. This Data Engineer 4 (Manager, IC) role is based onsite in Richmond, VA and supports a major transformation by combining hands-on engineering with team influence. You will design and deliver scalable data pipelines and platforms, mentor and guide developers across experienced machine learning and distributed systems practitioners, and help enforce security and engineering design patterns.

Responsibilities

  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions across full-stack development tools and technologies
  • Influence a team of developers, data analysts, and data scientists with deep experience in machine learning, distributed microservices, lakehouse architecture, and full-stack systems
  • Build using Python and Spark, plus open-source relational and NoSQL databases, and cloud data warehousing platforms including Databricks and Snowflake
  • Stay current with data and engineering trends by experimenting with new technologies, participating in internal and external communities, and mentoring others in the data space
  • Work with product managers and software engineers to deliver robust cloud-first data solutions and drive impactful customer experiences
  • Independently design, build, and deliver cloud data solutions and applications with little or no support from supervisors or managers
  • Architect and enforce common data engineering design patterns to improve code quality, maintainability, and reusability across platforms and pipelines
  • Act as a data engineering ambassador by clearly communicating technical concepts and data outcomes to internal and external stakeholders
  • Design and build pipelines and platforms focused on scalability, resilience, and operational efficiency, maintaining performance as data volume and demand increase
  • Implement data security standards, including encryption at rest and in transit and fine-grained access control, to support compliance with data privacy regulations

Requirements

  • Bachelor’s Degree or higher in Computer Science or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering)
  • 4+ years of experience in application development (internship experience does not apply)
  • 2+ years of experience in distributed data
  • 2+ years of experience with SQL
  • 2+ years of experience with one programming language: Python, Java, or Scala
  • 2+ years of experience in data pipeline design and development
  • 1+ year of experience in data modeling and end-to-end solution design using both relational and non-relational database systems

Technology Stack

  • Python, Spark
  • Databricks, Snowflake
  • SQL, relational databases, NoSQL databases (MongoDB, Cassandra, DynamoDB)
  • Machine learning, distributed microservices, lakehouse architecture
  • Security: encryption at rest/transit, fine-grained access control
  • Cloud and tooling: AWS, Microsoft Azure, Google Cloud, EMR, Glue, Airflow, Dagster
  • Observability and testing/ops: Monte Carlo, Splunk
  • Data warehouses and languages: Redshift, Scala, Java

Preferred Qualifications

  • 7+ years of experience in application development with demonstrated proficiency in Python, SQL, Scala, or Java
  • 4+ years designing, deploying, and operating data workloads in at least one public cloud environment (AWS, Microsoft Azure, or Google Cloud)
  • 4+ years building or supporting distributed data or compute workloads using tools such as EMR, Spark, Glue, or Databricks
  • 4+ years designing, implementing, and operating real-time or streaming data pipelines
  • 2+ years working on data observability (e.g., Monte Carlo, Splunk) or data orchestration tools (e.g., Airflow, Dagster)
  • 4+ years working with unstructured or semistructured data using NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB)
  • 4+ years designing and supporting data warehousing solutions (e.g., Snowflake, Redshift)
  • 2+ years of experience working in an Agile development environment
  • 2+ years developing user-centric reusable data products

Salary range (full-time annual): $179,400 - $204,700 for Richmond, VA. This role may also be eligible for performance-based incentive compensation, which may include cash bonus(es) and/or long-term incentives (LTI).

Additional details: Capital One does not sponsor new applicants for employment authorization and does not offer immigration-related support for this position. No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) and promotes a drug-free workplace.

Application window: expected to accept applications for a minimum of 5 business days.

Accommodation and contact: For accommodation requests, contact Capital One Recruiting at 1-800-304-9102 or via email at [email protected]. For technical support or questions about the recruiting process, email [email protected].

Similar Jobs