Etl Tools Developer Jobs

1 job found

Today

Data Engineer 5

Capital One New York, NY

New York, NY

Today

$251k - $286k/yr Full time Backend Developer Apache Airflow Big Data

Apply Now

Job Description

Capital One is hiring a Data Engineer 5 in New York, NY (onsite) to help drive a major transformation in enterprise data technology. The role focuses on scalable, resilient, cloud-first data pipelines and platforms that support AI and the broader data lifecycle.

What You’ll Do

Collaborate across Agile teams to design, develop, test, implement, and support solutions across full-stack development tools and technologies.
Lead and influence developers, data analysts, and data scientists with expertise in machine learning, distributed microservices, lakehouse architecture, and full-stack systems.
Build using Python and Spark, working with open-source relational and NoSQL databases and cloud data warehousing platforms including Databricks and Snowflake.
Stay current on data engineering trends, experiment with new technologies, and participate in internal and external technology communities.
Partner with product managers and software engineers to deliver robust cloud-first data solutions that support financial empowerment for millions of Americans.
Independently design, build, and deliver cloud data solutions and applications with limited guidance from supervisors or managers.
Architect and enforce common data engineering design patterns to improve code quality, maintainability, and reuse across platforms and pipelines.
Communicate technical concepts and data outcomes clearly to internal and external stakeholders to align on shared understanding.
Design and build data pipelines and platforms with scalability, resilience, and operational efficiency, maintaining performance as data volume and business needs grow.
Act as a force multiplier by balancing hands-on engineering contributions with mentoring and skills growth for peers and junior engineers.
Lead end-to-end, large-scale transformative data initiatives, including independent architectural decisions and platform evaluations such as Snowflake vs. Databricks.

Required Qualifications

Bachelor’s Degree or higher in Computer Science or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering).
6+ years of experience in application development (internship experience does not apply).
4+ years of experience in distributed data.
4+ years of experience with SQL.
4+ years programming with at least one of: Python, Java, or Scala.
4+ years designing and developing data pipelines.
2+ years in data modeling and end-to-end data solutions using both relational and non-relational database systems.

Technologies

Python, Spark, SQL
Databricks, Snowflake
EMR, Glue, AWS
NoSQL (MongoDB, Cassandra, DynamoDB)
Redshift
Airflow, Dagster
Monte Carlo, Splunk
Java, Scala

Preferred Qualifications

Master’s Degree in Computer Science or a related field.
8+ years of experience in data engineering.
5+ years hands-on experience designing, deploying, and operating data workloads in AWS.
5+ years experience building or supporting distributed data or compute workloads using tools such as EMR, Spark, Glue, or Databricks.
5+ years experience designing, implementing, and operating real-time or streaming data pipelines.
5+ years experience working with unstructured or semistructured data using NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB).
5+ years experience designing and supporting data warehousing solutions (e.g., Snowflake, Redshift).
4+ years of data modeling experience.
3+ years experience working in an Agile development environment.
3+ years experience developing user-centric reusable data products.
3+ years experience in data observability (e.g., Monte Carlo, Splunk) or data orchestration tools (e.g., Airflow, Dagster).

Compensation

New York, NY (onsite): USD 250,800 - 286,200 per year
Performance-based incentive compensation may be available, which may include cash bonus(es) and/or long term incentives (LTI).

Cambridge, MA: $229,900 - $262,400 for Data Engineer 5
McLean, VA: $229,900 - $262,400 for Data Engineer 5

Benefits

Capital One offers a comprehensive, competitive, and inclusive set of health, financial, and other benefits.

View full job page →

Get Etl Tools Developer Jobs alerts

New Etl Tools Developer Jobs, daily.