J
Lead Software Engineer - AI Engineer (AI Tool & Framework Development)
Agentic Ai Engineer
Ai Ml
Application Security
Artificial Intelligence
Automation
Cloud
Data Pipeline
Data Pipelines
Engineer
Event Driven Architecture
Generative AI
Generative Ai Engineering
Kubernetes
Large Language Models
Lead Ai Engineer
Machine Learning
Rag Architectures
Software Development
Software Security
Workflow Orchestration
Job Description
As a Lead Software Engineer in JPMorganChase’s Consumer & Community Banking organization and the JPM Wealth Management Technology team, you’ll help shape how enterprise teams use AI-assisted engineering to deliver higher-quality software faster. The work focuses on building and operating production-ready LLM and RAG pipelines and LLMOps capabilities that support secure, validated outcomes.
This onsite role is based in Jersey City, NJ, with an annual salary range of USD 156,750 - 215,000. You’ll bring 5+ years of applied software engineering experience to lead technical adoption, evaluation rigor, and reliable operations for AI-generated specifications and code.
What you’ll do
- Lead team adoption of enterprise-authorized AI-assisted engineering practices to improve code quality, delivery speed, and operational outcomes, including AI-assisted code review/refactoring, test strategy acceleration, and incident or root-cause analysis support.
- Establish and reinforce consistent validation standards such as secure coding, peer review, and automated testing, and promote reusable patterns across the team.
- Apply knowledge of Software Development Life Cycle toolchains, including enterprise-authorized AI-assisted development and automation, to increase the value realized from automation.
- Build and operate AI-enabled pipelines that use LLMs and retrieval-augmented generation (RAG) to ingest legacy artifacts (including source code, job schedules, database schemas, and captured subject-matter knowledge) and generate structured specifications for validation.
- Design and iterate on multi-agent workflows that analyze legacy logic and translate it into target-state services, using orchestration, tool integrations, and guardrails to support accurate, production-ready results.
- Develop evaluation and verification infrastructure, including automated test harnesses, parity tests, regression suites, and confidence scoring, to assess AI-generated specifications and code and guide production-readiness decisions.
- Partner with domain subject-matter experts to validate AI-generated specifications and code, refine prompts and agent workflows, and close knowledge gaps in source artifacts and specifications.
- Integrate AI-enabled workflows with data pipelines, event sourcing, and change-data-capture processes, contributing reusable tooling and runtime capabilities for reliable, auditable execution.
- Develop secure, high-quality production code and perform reviews, debugging, and troubleshooting for code and systems, including AI-generated outputs.
- Own LLMOps for the production toolchain, including deployment, monitoring, cost and token-budget management, latency optimization, and incident response, while identifying opportunities to automate recurring remediation.
Required skills
- Formal training or certification on software engineering concepts and 5+ years applied experience.
- Proven experience leading effective use of approved AI-assisted software development tools (for coding, code review, test acceleration, and troubleshooting), with the ability to set team expectations for validating AI outputs for correctness, performance, and security.
- Strong understanding of responsible AI in engineering workflows, including data sensitivity, secure input/output handling, and resiliency and security expectations, plus experience coaching engineers on safe, compliant adoption.
- Hands-on experience building production LLM-based applications, including agentic architectures, RAG pipelines, prompt engineering, and evaluation frameworks.
- Experience applying AI to ingest, analyze, or transform complex artifacts or data into structured, validated outputs, including agent workflows with orchestration, tool use, and output controls.
- Strong software engineering fundamentals in distributed systems, event-driven architectures, API design, and testing, with experience using AWS cloud platforms such as EKS or ECS.
- Proficiency in at least one programming language, such as Java/JVM or Python, with experience developing and operating production applications.
- Expert day-to-day proficiency with AI-assisted development tools such as Claude Code, GitHub Copilot, or Cursor, including the ability to review, debug, and validate code produced with these tools.
- Proficiency across the Software Development Life Cycle, including agile delivery and CI/CD, with cloud-native experience and the ability to communicate technical trade-offs to engineering teams and business stakeholders.
Technologies you may use
- Java, Python, JVM
- AWS, EKS, ECS
- Claude Code, GitHub Copilot, Cursor
- LLMs, retrieval-augmented generation (RAG), multi-agent workflows
- Temporal, Airflow, Kafka, PostgreSQL
- Kubernetes, COBOL, JCL, DB2
About the team
- Consumer & Community Banking serves Chase customers through personal banking, credit cards, mortgages, auto financing, investment advice, small business loans, and payment processing.
- Chase is proud to lead the U.S. in credit card sales and deposit growth and to rank first in customer satisfaction.
Preferred qualifications
- Experience using AI or agentic workflows to analyze or modernize legacy systems, including mainframe technologies such as COBOL, JCL, or DB2, or to support large-scale migration programs.
- Familiarity with workflow orchestration tools such as Temporal or Airflow.
- Familiarity with event-sourcing and change-data-capture patterns, and experience with Kafka.
- Experience with PostgreSQL and container orchestration platforms such as Kubernetes or EKS.
- Background in financial services, such as retirement, wealth management, brokerage, or capital-markets processing.
- Experience building AI-enabled code analysis, translation, or verification tooling; a master’s degree in Computer Science or equivalent experience.
Similar Jobs
J
J
J
J
J
J