Data Engineer 5
Apache Airflow
Azure
Big Data
Bigdata
Cloud
Cloud Data Engineering
Cloud Data Platform
Cloud Data Warehouse
Cloud Data Warehouse
Cloud Native
Cloud Operations
Cloud Platform
Cloud Platforms
Cloud Platforms Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Lakehouse
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Warehouse
Data Warehousing
Database
Databases
Databricks
Engineer
ETL
Google Cloud
Informatica
Information Technology (IT)
Nosql Databases
Programming Language
Programming Languages
Snowflake
SQL
Job Description
Capital One is hiring Data Engineers for Risk Tech to build and deploy proprietary risk management solutions powered by modern AI.
Responsibilities
- Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions using full-stack development tools and technologies
- Provide technical leadership to a team of developers, data analysts, and data scientists with experience in machine learning, distributed microservices, lakehouse architecture, and full-stack systems
- Use Python and Spark, along with open-source relational and NoSQL databases and cloud data warehousing platforms such as Databricks and Snowflake
- Partner with product managers and software engineers to deliver cloud-first data solutions supporting experiences for millions of Americans
- Independently design, build, and deliver cloud data solutions and applications with minimal supervision
- Architect and enforce shared data engineering design patterns to improve code quality, maintainability, and reuse across platforms and pipelines
- Design and build data pipelines and platforms focused on scalability, resilience, and operational efficiency for growing data volume and business demand
- Act as a data engineering ambassador by communicating technical concepts and data outcomes clearly to internal and external stakeholders
- Serve as a force-multiplier through deep hands-on delivery, innovation, and mentoring of peers and junior engineers
- Lead end-to-end, large-scale data initiatives, including critical architectural decisions (for example, evaluating Snowflake vs. Databricks) aligned to technical and business requirements
Requirements
- Bachelor's Degree or higher in Computer Science or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering)
- 6+ years of experience in application development (internship experience does not apply)
- 4+ years of experience in distributed data
- 4+ years of experience with SQL
- 4+ years of programming with at least one of: Python, Java, Scala
- 4+ years designing and developing data pipelines
- 2+ years in data modeling and designing end-to-end data solutions using both relational and non-relational database systems
Technologies
- Python, Spark
- Databricks, Snowflake
- SQL
- Java, Scala
- NoSQL databases: MongoDB, Cassandra, DynamoDB
- Relational databases
- AWS, Microsoft Azure, Google Cloud
- EMR, Glue, Airflow, Dagster
- Monte Carlo, Splunk
- Redshift
Preferred Qualifications
- Master’s Degree in Computer Science or a related field
- 8+ years of experience in data engineering
- 4+ years of data modeling experience
- 9+ years of experience in application development with demonstrated proficiency in Python, SQL, Scala, or Java
- 5+ years of hands-on experience designing, deploying, and operating data workloads in at least one public cloud environment (AWS, Microsoft Azure, or Google Cloud)
- 5+ years of experience building or supporting distributed data or compute workloads using tools such as EMR, Spark, Glue, or Databricks
- 5+ years of experience designing, implementing, and operating real-time or streaming data pipelines
- 3+ years of experience in data observability (e.g., Monte Carlo, Splunk) or data orchestration tools (e.g., Airflow, Dagster)
- 5+ years of experience working with unstructured or semistructured data using NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB)
- 5+ years of experience designing and supporting data warehousing solutions (e.g., Snowflake, Redshift)
- 3+ years of experience working in an Agile development environment
- 3+ years of experience developing user-centric reusable data products
Compensation & Salary Ranges
- McLean, VA: USD 229,900 - 262,400 (Data Engineer 5)
- Richmond, VA: USD 209,000 - 238,500 (Data Engineer 5)
- Eligible for performance-based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
Benefits
- Eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
- Comprehensive, competitive, and inclusive set of health, financial, and other benefits supporting total well-being
Other Information
- Onsite location: McLean, VA
- Capital One will consider sponsoring a new qualified applicant for employment authorization for this position
- Expected to accept applications for a minimum of 5 business days
- No agencies please
- Equal opportunity employer (EOE, including disability/vet)
- Promotes a drug-free workplace
- Considers qualified applicants with a criminal history in accordance with applicable laws
- Accommodation contact: 1-800-304-9102 or [email protected]
- Technical support or recruiting questions: [email protected]