Data Engineer 4
Apache Airflow
Automation
AWS
Aws Data Engineer
Big Data
Bigdata
Cassandra
Cloud Data Engineering
Cloud Data Platform
Cloud Data Warehouse
Cloud Data Warehouse
Cloud Platform
Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Engineering Security
Data Integration
Data Integration Tools
Data Lakehouse
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Science
Data Warehouse
Data Warehousing
Database
Databases
Databricks
Dynamodb
Engineer
ETL
Informatica
Information Technology (IT)
Integration
Machine Learning Data Engineer
MongoDB
Snowflake
Software Development
SQL
Job Description
Capital One is driving a major data transformation focused on simplifying the auto refinance journey through Refi Tech, with the goal of bridging pre-qualification to agent funding. In this Data Engineer 4 role, you will help design, build, and operate cloud-first data solutions and pipelines using modern distributed systems and data engineering technologies.
What you’ll do
- Partner with Agile teams to design, develop, test, implement, and support technical solutions across full-stack development tools and technologies
- Guide delivery through deep expertise spanning machine learning, distributed microservices, lakehouse architecture, and full-stack systems
- Build data solutions using Python and Spark, along with open-source relational and NoSQL databases and cloud data warehousing platforms including Databricks and Snowflake
- Experiment with new data technologies, share knowledge through internal and external communities, and mentor others in the data engineering space
- Work with product managers and software engineers to deliver robust cloud-first data solutions that support experiences for millions of Americans
- Independently design, build, and deliver cloud data solutions and applications with minimal support from supervisors or managers
- Define and enforce common data engineering design patterns to improve code quality, maintainability, and reusability across pipelines and platforms
- Create data pipelines and platforms with scalability, resilience, and operational efficiency in mind to sustain performance as data volumes grow
- Implement data security standards, including encryption at rest and encryption in transit, along with fine-grained access control to support data privacy compliance
- Act as a data engineering ambassador by communicating data outcomes and technical concepts clearly to internal and external stakeholders
Minimum qualifications
- Bachelor’s Degree or higher in Computer Science or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering)
- 4+ years of experience in application development (internship experience does not apply)
- 2+ years of experience with distributed data
- 2+ years of experience with SQL
- 2+ years of experience with one programming language: Python, Java, or Scala
- 2+ years of experience in data pipeline design and development
- 1+ year of experience in data modeling and designing end-to-end solutions using both relational and non-relational database systems
Tools and technologies you may use
- Python, Spark, SQL, Scala, Java
- Databricks, Snowflake, AWS (including EMR, Glue), Microsoft Azure, Google Cloud
- NoSQL systems and databases including MongoDB, Cassandra, DynamoDB
- Data tooling and platforms such as Redshift, Airflow, Dagster, Monte Carlo, Splunk
- Security and access controls including encryption at rest, encryption in transit, fine-grained access control
- Lakehouse and distributed systems patterns, including distributed microservices
Benefits
- Comprehensive, competitive, and inclusive set of health, financial, and other benefits to support total well-being
Salary
Plano, TX: $179,400 - $204,700 per year. The role may also be eligible for performance-based incentive compensation, which may include cash bonus(es) and/or long-term incentives (LTI).