JPMorganChase Logo

JPMorganChase

AI/LLM Product Manager - Senior Associate

Posted 6 Days Ago
Be an Early Applicant
Hybrid
New York, NY, USA
Senior level
Hybrid
New York, NY, USA
Senior level
Own end-to-end product for LLM-powered, agentic systems: define requirements and roadmaps, lead pilots to production, build integrations and infrastructure, run model validation and drift detection, monitor performance and safety, manage delivery and stakeholder alignment, and ensure compliance and governance in a regulated banking environment.
The summary above was generated by AI

Join us in building the next generation of AI and autonomous agents to solve mission‑critical operational and banking productivity challenges at the scale of the world’s largest bank. In this role, you’ll own AI use cases end‑to‑end—from discovery and problem framing through requirements, delivery, and long‑term reliability. You’ll design, build, and extend production-grade agentic systems, partnering closely with data science, engineering, and business stakeholders. Success means more than shipping: you’ll be accountable for performance, safety, and day‑to‑day behavior once real bankers rely on these capabilities. 


Key Responsibilities 


  • Define product requirements, features, and roadmap components for AI use cases, translating business problems into agentic solutions and workflows. 
  • Lead end-to-end delivery from pilot through production, owning what the agent does, what it is permitted to do, how it acts under uncertainty, and where autonomy boundaries sit. 
  • Build and extend the agents and the net-new infrastructure they depend on: the services, APIs, and integrations that surround the model and make the system work. 
  • Drive model validation, performance monitoring, drift detection, and iterative improvement, keeping behavior correct as you ship and extend. 
  • Manage backlog prioritization, sprint planning, and delivery tracking. 
  • Partner with stakeholders to identify opportunities for AI-driven efficiency or revenue growth, and run user feedback sessions, folding insights into product enhancements. 
  • Define success metrics and measure business impact, including reliability, adoption, and reuse. 
  • Ensure alignment with data governance, compliance, and risk standards, working across Engineering, Data Science, Controls, and the business. 

Required Skills & Experience 


  • 3–6+ years in product management, data products, or technology delivery, or equivalent expertise. 
  • Have shipped an LLM-powered, autonomous, or agentic system to production 
  • Demonstrated experience designing and running evals for such systems as needed to meet product driven success criteria. You reason about probabilistic behavior and drift, not deterministic pass or fail. 
  • Strong understanding of the AI/ML lifecycle (training, validation, deployment, monitoring) 
  • Understanding of production-grade data judgment: what good data looks like, where it degrades, pipeline stability, and how quality propagates into behavior. 
  • Experience building net-new infrastructure and integrations, with the ability to hold your own on architecture, APIs, and data pipelines. 
  • Experience working with cross-functional teams (Tech, Data Science, Business), with strong communication and stakeholder-management skills. 
  • Comfort operating inside a large, regulated institution where governance and controls are design inputs, not obstacles. 
  • Ability to ship AI-enabled products and lead complex programs in large, matrixed organizations. 
  • Previous experience in commercial and investment banking a plus 


Success Profile 


Ownership mindset. Takes a use case from ambiguous problem to reliable production system and stays accountable for how it behaves. Builds for an institution, not a demo. Treats governance, auditability, and real constraints as the interesting part of the problem, and knows the difference between a weekend prototype and a system bankers depend on. 

About Us
JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world’s most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.

We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process. 

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.

JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans

About the TeamJ.P. Morgan’s Commercial & Investment Bank is a global leader across banking, markets, securities services and payments. Corporations, governments and institutions throughout the world entrust us with their business in more than 100 countries. The Commercial & Investment Bank provides strategic advice, raises capital, manages risk and extends liquidity in markets around the world. 
HQ

JPMorganChase New York, New York, USA Office

270 Park Avenue, New York, NY, United States, 10017-2014

JPMorganChase New York, New York, USA Office

4 Metrotech Center, New York, NY, United States, 11201

Similar Jobs

18 Minutes Ago
Remote or Hybrid
US
128K-145K Annually
Expert/Leader
128K-145K Annually
Expert/Leader
Automotive • Professional Services • Software • Consulting • Energy • Chemical • Renewable Energy
Manage regional field inspection and audit operations to meet budgets and customer requirements. Oversee staffing, performance management, continuous improvement, client technical engagement, and adherence to UL policies and procedures. Drive customer satisfaction, subcontractor relationships, and implementation of preventive/corrective actions.
19 Minutes Ago
Remote or Hybrid
United States
55K-73K Annually
Entry level
55K-73K Annually
Entry level
Automotive • Professional Services • Software • Consulting • Energy • Chemical • Renewable Energy
Support execution of Americas marketing and go-to-market plans for Engineered Materials. Collaborate with product, sales, and marketing on messaging, ABM, content and materials, project coordination, market research, competitive analysis, and performance reporting.
19 Minutes Ago
Hybrid
108K-143K Annually
Mid level
108K-143K Annually
Mid level
Automotive • Professional Services • Software • Consulting • Energy • Chemical • Renewable Energy
Lead an engineering team for wiring devices supporting global customers: manage capacity, resources, and performance; coordinate cross-functional stakeholders; drive process improvements, compliance, quality, and financial goals; support sales and customer technical issues; delegate and guide test programs; coach and develop staff to foster a high-performance culture.
Top Skills: MS Office

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account