JPMorganChase is building production AI agents through its NEO agent runtime platform on AWS and Azure, helping teams deliver measurable impact across the Corporate & Investment Bank and Payments. You’ll design, productionize, and operate LLM-powered agents within a regulated environment, leveraging capabilities like secure execution, agent-to-agent communication, MCP-based tool access, managed memory, and permission-aware, auditable operations.
What you’ll do
- Design and ship production agents on NEO across the federated portfolio, owning builds from prototype through production.
- Build retrieval systems that hold up in production, including chunking, ranking, and grounding approaches that support accurate and auditable answers.
- Design agent memory using episodic and semantic memory organized as memory nodes, with recall, summarization, and decay policies tailored per use case.
- Own organizational context management, assembling entitlement-, lineage-, and tenant-aware context so agents reason only over information they are allowed to access.
- Compose multi-agent workflows using A2A, integrating tools and data through MCP servers (Bitbucket, Confluence, Databricks, Kubernetes, Snowflake, Splunk).
- Build and run evaluations, including task-level and end-to-end agent evaluations, regression suites, LLM-as-judge, and quality or safety gating before release.
- Deploy and operate solutions on AWS and/or Azure with strong SDLC, security, resiliency, and observability.
- Partner with product and business stakeholders across the Corporate & Investment Bank and Payments to turn use cases into supported, shipped agents.
What you bring
- MS in Computer Science, Statistics, Mathematics, Machine Learning, or related field (or equivalent experience).
- 7+ years of development experience, with at least 4 years focused on AI/ML solutions.
- Hands-on experience building LLM-powered or agentic applications in production, including tracing, evaluations, and guardrails.
- Strong programming skills in Python, with deep knowledge of data structures, algorithms, machine learning, data mining, information retrieval, and statistics.
- Practical RAG experience, including retrieval quality, embeddings, and vector stores.
- Expert knowledge of at least one: AWS, Azure, or Kubernetes.
- Knowledge of data management and data model design, including real-time processing with SQL (for example Postgres) and NoSQL stores (for example OpenSearch, Redis).
- Excellent communication skills and the ability to collaborate with senior technical and business stakeholders.
Helpful skills (preferred)
- Graph RAG experience (for example combining knowledge-graph traversal with vector search).
- Experience with agent frameworks or runtimes, A2A, or MCP.
- Agent memory design (memory nodes, episodic/semantic memory) and organizational context management.
- Knowledge graphs and graph databases used for retrieval.
- Understanding of LLM fine-tuning and small language model inference.
- Ability to build agent UI experiences using modern JavaScript/TypeScript frameworks (for example Next.js, Svelte) with AG-UI / NEO UI SDK.
- Experience in financial or payments domain at a large institution (Investment Banking, Markets, Securities Services, or adjacent).
- Knowledge of high-performance languages such as Go or Rust.
Tools and technology you’ll work with
NEO, AWS, Azure, Python, Databricks, GenAI Gateway, MCP, Bitbucket, Confluence, Kubernetes, Snowflake, Splunk, SQL, Postgres, NoSQL, OpenSearch, Redis, A2A, LLM-as-judge, vector stores, embeddings, Graph RAG, knowledge graphs, graph databases, JavaScript, TypeScript, Next.js, Svelte, AG-UI, NEO UI SDK, Go, Rust.
Role details
Location: Jersey City, NJ (onsite)
Compensation: USD 171,000 to 260,000 per year
Experience: 7+ years
Education: MS (CS/Statistics/Mathematics/Machine Learning or related) or equivalent experience
About the team
J.P. Morgan’s Commercial & Investment Bank is a global leader across banking, markets, securities services, and payments. Corporations, governments, and institutions in more than 100 countries entrust the firm with their business. The Commercial & Investment Bank provides strategic advice, raises capital, manages risk, and extends liquidity in markets worldwide.