Data Engineer 4 (Manager, IC)
Manager
Big Data
Bigdata
Cloud Data Engineering
Cloud Data Platform
Cloud Platform
Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Lakehouse
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Database
Databases
Databricks
ETL
Informatica
Information Technology (IT)
Integration
Spark
SQL
Job Description
Capital One is seeking a Data Engineer 4 (Manager, IC) in Richmond, VA to lead cloud-first data transformation work. The role focuses on designing, building, and supporting scalable data solutions, while applying engineering patterns, enforcing security standards, and coordinating across Agile teams.
Responsibilities
- Collaborate with Agile teams to design, develop, test, implement, and support technical solutions across full-stack development tools and technologies
- Influence a team spanning developers, data analysts, and data scientists with experience in machine learning, distributed microservices, lakehouse architecture, and full-stack systems
- Develop solutions using Python and Spark, including open-source relational and NoSQL databases and cloud data warehousing platforms such as Databricks and Snowflake
- Stay current with data technology trends through experimentation, learning, internal and external technology communities, and mentorship within the data community
- Partner with product managers and software engineers to deliver robust cloud-first data solutions that support financial empowerment for millions of Americans
- Independently design, build, and deliver cloud data solutions and applications with limited support from supervisors or managers
- Architect and enforce common data engineering design patterns to support code quality, maintainability, and reuse across pipelines and platforms
- Design and build data pipelines and platforms with scalability, resilience, and operational efficiency in mind, maintaining performance as data and business demands grow
- Implement data security standards, including encryption at rest and in transit and fine-grained access control, to meet data privacy requirements
- Serve as a data engineering ambassador, communicating technical concepts and outcomes clearly to internal and external stakeholders to support alignment
Required Qualifications
- Bachelor’s Degree or higher in Computer Science or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering)
- At least 4 years of experience in application development (internship experience does not apply)
- At least 2 years of experience in distributed data
- At least 2 years of experience with SQL
- At least 2 years of experience with one programming language (Python, Java, or Scala)
- At least 2 years of experience in data pipeline design and development
- At least 1 year of experience in data modeling and designing end-to-end data solutions using both relational and non-relational database systems
Preferred Qualifications
- 7+ years of application development experience with demonstrated proficiency in Python, SQL, Scala, or Java
- 4+ years of hands-on experience designing, deploying, and operating data workloads in at least one public cloud environment (AWS, Microsoft Azure, or Google Cloud)
- 4+ years of experience building or supporting distributed data or compute workloads using tools such as EMR, Spark, Glue, or Databricks
- 4+ years of experience designing, implementing, and operating real-time or streaming data pipelines
- 2+ years of experience in data observability (e.g., Monte Carlo, Splunk) or data orchestration tools (e.g., Airflow, Dagster)
- 4+ years of experience working with unstructured or semistructured data using NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB)
- 4+ years of experience designing and supporting data warehousing solutions (e.g., Snowflake, Redshift)
- 2+ years of experience working in an Agile development environment
- 2+ years of experience developing user-centric reusable data products
Technologies
- Python, Spark, Scala, Java
- Databricks, Snowflake
- SQL, EMR, Glue, Airflow, Dagster
- NoSQL, MongoDB, Cassandra, DynamoDB
- Redshift
- Monte Carlo, Splunk
- AWS, Microsoft Azure, Google Cloud
- Relational databases
- Encryption at rest, encryption in transit, fine-grained access control
Salary, Location, and Incentives
- Location: Richmond, VA (onsite)
- Salary: USD 179,400 - 204,700 per year
- Eligible for performance-based incentive compensation, which may include cash bonus(es) and/or long-term incentives (LTI)
Capital One also offers a comprehensive, competitive, and inclusive set of health, financial, and other benefits that support total well-being.