Data Engineer 4 - ERM Transformation
Backend Developer
Big Data
Bigdata
Cloud
Cloud Data Engineering
Cloud Data Platform
Cloud Data Warehouse
Cloud Data Warehouse
Cloud Platform
Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Lakehouse
Data Pipeline
Data Platform
Data Processing
Data Security
Data Warehouse
Data Warehousing
Database
Databases
Databricks
Distributed Systems
Engineer
Engineering
ETL
Informatica
Integration
Nosql Databases
Snowflake
Software Architecture
Software Development
Software Engineering
SQL
Job Description
Capital One is seeking a Data Engineer 4 to support ERM Transformation efforts by designing, building, and operating cloud-first data solutions and pipelines. The role focuses on risk management capabilities powered by modern AI technologies, with an emphasis on scalability, security, and operational efficiency.
Role Responsibilities
- Partner with and across Agile teams to design, develop, test, implement, and support technical solutions using full-stack development tools and technologies
- Provide technical influence across a team of developers, data analysts, and data scientists with expertise in machine learning, distributed microservices, lakehouse architecture, and full-stack systems
- Use programming languages such as Python and Spark, along with open-source relational and NoSQL databases and cloud data warehousing platforms including Databricks and Snowflake
- Stay current on data engineering trends by experimenting with and learning new technologies, participating in internal and external technology communities, and mentoring members of the data community
- Work with product managers and software engineers to deliver robust cloud-first data solutions that support experiences for millions of Americans
- Independently design, build, and deliver cloud data solutions and applications with limited supervision
- Architect and enforce common data engineering design patterns to improve code quality, maintainability, and reusability across platforms and pipelines
- Build data pipelines and platforms with focus on scalability, resilience, and operational efficiency to maintain performance as volume and business demands increase
- Implement data security standards, including encryption at rest/transit and fine-grained access control, to support compliance with data privacy regulations
- Act as an ambassador for the data engineering team by communicating technical concepts and data outcomes clearly to internal and external stakeholders
Required Qualifications
- Bachelor’s Degree or higher in Computer Science or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering)
- 4+ years of experience in application development (internship experience does not apply)
- 2+ years of experience in distributed data
- 2+ years of experience with SQL
- 2+ years of experience with one programming language: Python, Java, or Scala
- 2+ years of experience in data pipeline design and development
- 1+ year of experience in data modeling and designing end-to-end data solutions using both relational and non-relational database systems
Technologies
- Python, Spark
- Databricks, Snowflake
- SQL
- Java, Scala
- NoSQL, relational databases
- Machine learning
- Distributed microservices
- Lakehouse architecture
- Agile
- Encryption at rest/transit, fine-grained access control
Preferred Qualifications
- 7+ years of experience in application development with demonstrated proficiency in Python, SQL, Scala, or Java
- 4+ years designing, deploying, and operating data workloads in at least one public cloud environment (AWS, Microsoft Azure, or Google Cloud)
- 4+ years building or supporting distributed data or compute workloads using tools such as EMR, Spark, Glue, or Databricks
- 4+ years designing, implementing, and operating real-time or streaming data pipelines
- 2+ years experience with data observability (e.g., Monte Carlo, Splunk) or data orchestration tools (e.g., Airflow, Dagster)
- 4+ years working with unstructured or semistructured data using NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB)
- 4+ years experience designing and supporting data warehousing solutions (e.g., Snowflake, Redshift)
- 2+ years working in an Agile development environment
- 2+ years developing user-centric reusable data products
Compensation and Location
Location: Richmond, VA (onsite)
Estimated annual salary range: USD 179,400 - 204,700
This role may also be eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.
Other location salary ranges: McLean, VA ($197,300 - $225,100) and New York, NY ($215,200 - $245,600).