Data Engineer 5, Insights Platform
Apache Airflow
Automation
Azure
Big Data
Bigdata
Cloud
Cloud Data Engineering
Cloud Data Platform
Cloud Data Warehouse
Cloud Data Warehouse
Cloud Operations
Cloud Platform
Cloud Platforms
Cloud Platforms Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Lakehouse
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Warehouse
Data Warehousing
Database
Databases
Databricks
ETL
Gcp Cloud
Information Technology (IT)
Integration
Nosql Databases
Programming Languages
Snowflake
Spark
SQL
Job Description
Capital One is hiring a Data Engineer 5 for its Insights Platform in Plano, TX, focused on cloud-first data engineering and platform transformation. This role involves building and operating scalable data pipelines and services across distributed systems, lakehouse architectures, and modern data platforms.
Responsibilities
- Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions using full-stack development tools and technologies
- Provide technical influence to a group of developers, data analysts, and data scientists with experience across machine learning, distributed microservices, lakehouse architecture, and full-stack systems
- Use Python and Spark alongside open-source relational and NoSQL databases and cloud data warehousing platforms, including Databricks and Snowflake
- Stay current on data engineering and related trends through experimentation, learning, participation in internal and external technology communities, and mentoring
- Work with product managers and software engineers to deliver robust cloud-first data solutions that support impactful experiences for millions of Americans
- Independently design, build, and deliver cloud data, API, and MCP solutions and applications with limited or no support from supervisors or managers
- Architect and enforce common data engineering design patterns to support code quality, maintainability, and reusability across pipelines and platforms
- Design and build data pipelines and platforms with a focus on scalability, resilience, and operational efficiency to meet growing volume and business demands
- Act as a force multiplier by balancing hands-on technical contributions and innovation with mentoring and elevating peer and junior engineer skills
- Lead and execute large-scale, transformative data initiatives end to end, including independent architectural decision-making and platform evaluations such as Snowflake versus Databricks
- Communicate technical concepts and data outcomes clearly to internal and external stakeholders to drive alignment and shared understanding
Requirements
- Bachelor’s Degree or higher in Computer Science or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering)
- At least 6 years of experience in application development (internship experience does not apply)
- At least 4 years of experience in distributed data
- At least 4 years of experience with SQL
- At least 4 years of experience programming with at least one of Python, Java, or Scala
- At least 4 years of experience designing and developing data pipelines
- At least 2 years of experience in data modeling and designing end-to-end data solutions using both relational and non-relational database systems
Technologies
- Python, Spark, SQL, NoSQL
- Databricks, Snowflake
- AWS, Microsoft Azure, Google Cloud
- EMR, Glue, Redshift
- Airflow, Dagster
- Monte Carlo, Splunk
- MongoDB, Cassandra, DynamoDB
- Java, Scala
Benefits
- Eligible for performance-based incentive compensation, which may include cash bonus(es) and/or long-term incentives (LTI)
- Comprehensive, competitive, and inclusive health, financial, and other benefits supporting total well-being (eligibility varies by role)
Preferred Qualifications
- Master’s Degree in Computer Science or a related field
- 8+ years of experience in data engineering
- 4+ years of data modeling experience
- 9+ years of experience in application development with demonstrated proficiency in Python, SQL, Scala, or Java
- 5+ years of hands-on experience designing, deploying, and operating data workloads in at least one public cloud environment (AWS, Microsoft Azure, or Google Cloud)
- 5+ years of experience building or supporting distributed data or compute workloads using tools such as EMR, Spark, Glue, or Databricks
- 5+ years of experience designing, implementing, and operating real-time or streaming data pipelines
- 3+ years of experience working on data observability (e.g., Monte Carlo, Splunk) or data orchestration tools (e.g., Airflow, Dagster)
- 5+ years of experience working with unstructured or semistructured data using NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB)
- 5+ years of experience designing and supporting data warehousing solutions (e.g., Snowflake, Redshift)
- 3+ years of experience working in an Agile development environment
- 3+ years of experience developing user-centric reusable data products
Location and Salary
Location: Plano, TX (onsite)
Full-time annual salary range: $209,000 - $238,500 for Data Engineer 5
Other Role and Application Notes
- Capital One will consider sponsoring a new qualified applicant for employment authorization for this position
- This role is expected to accept applications for a minimum of 5 business days
- No agencies please
- Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws
- Capital One promotes a drug-free workplace
- Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with applicable laws regarding criminal background inquiries
- If you require an accommodation, contact Capital One Recruiting at 1-800-304-9102 or via email at [email protected]
- For technical support or questions about Capital One’s recruiting process, send an email to [email protected]