Lead Software Engineer - Data Engineer

The Lead Software Engineer - Data Engineer will join JPMorgan Chase within the Cloud Financial Management Technology group, contributing as a core technical member on an agile team. This role emphasizes trusted delivery of secure, stable, and scalable technology products, with an added focus on secure, AI-assisted engineering practices and production data pipeline development on AWS.

Responsibilities

• Deliver creative software solutions across design, development, and technical troubleshooting, applying the ability to think beyond routine approaches when solving complex problems.
• Write secure, high-quality production code and perform reviews and debugging for code produced by others.
• Drive enterprise-authorized AI-assisted engineering practices to improve code quality, delivery speed, and operational outcomes, including AI-assisted code review and refactoring, test strategy acceleration, and incident and root-cause analysis support.
• Establish consistent validation standards across the team, including secure coding, peer review, and automated testing, while promoting reuse of proven patterns.
• Apply knowledge of Software Development Life Cycle toolchain capabilities, including enterprise-authorized AI-assisted development and automation, to increase value from automation.
• Identify recurring remediation opportunities and work to eliminate or automate them to improve operational stability across software applications and systems.
• Lead evaluation sessions with external vendors, startups, and internal teams to assess architectural designs, technical credentials, and fit for existing systems and information architecture.
• Lead communities of practice across Software Engineering to increase awareness and adoption of new and leading-edge technologies.
• Support a team culture focused on diversity, opportunity, inclusion, and respect.

Requirements

• Formal training or certification on software engineering concepts, plus 5+ years of applied experience.
• Proficiency in system design, testing, and operational ownership.
• Advanced Python experience and cloud-native engineering on AWS, including IAM, VPC, KMS, and CloudWatch.
• Demonstrated production delivery of ETL/ELT pipelines (batch and/or streaming) on AWS using services such as AWS Glue, Amazon EMR, AWS Lambda, and orchestration via Amazon MWAA (Airflow) and/or AWS Step Functions.
• Strong data engineering fundamentals including CDC/incremental processing, backfills, idempotency, late-arriving data handling, and schema evolution.
• Experience building on AWS analytics and storage services such as Amazon S3, Amazon Redshift, Amazon Athena, and AWS Lake Formation/Glue Data Catalog, along with streaming and messaging systems including Amazon Kinesis and Amazon MSK.
• Data reliability experience covering data quality controls, monitoring and alerting, and CI/CD for pipelines (for example CodePipeline/CodeBuild), with performance and cost optimization and security and governance compliance (for example CloudTrail and least-privilege access).
• Proven experience leading effective use of approved AI-assisted software development tools for coding, code review, test acceleration, and troubleshooting, including the ability to set team expectations for validating AI outputs for correctness, performance, and security.
• Knowledge of responsible AI use in engineering workflows, including data sensitivity, secure handling of inputs and outputs, and adherence to resiliency and security expectations, plus experience coaching engineers on safe and compliant adoption.
• Practical experience using Large Language Models (LLMs) to accelerate advanced coding workflows.

Required Technologies

• Python, AWS, IAM, VPC, KMS, CloudWatch
• AWS Glue, Amazon EMR, AWS Lambda
• Amazon MWAA (Airflow), AWS Step Functions
• CDC/incremental processing, Amazon S3, Amazon Redshift, Amazon Athena
• AWS Lake Formation/Glue Data Catalog, Amazon Kinesis, Amazon MSK
• CodePipeline, CodeBuild, CloudTrail
• Large Language Models (LLMs)

About the Team

JPMorgan Chase professionals in Corporate Functions support a wide range of areas, including finance and risk, human resources, and marketing. These corporate teams help ensure the organization is positioned for success across its businesses, clients, customers, and employees.

Location

Atlanta, GA (onsite)