JPMorganChase Logo

JPMorganChase

Director of Infrastructure Engineering - AI

Reposted 10 Days Ago
Be an Early Applicant
Hybrid
New York, NY, USA
Expert/Leader
Hybrid
New York, NY, USA
Expert/Leader
Leads AI infrastructure engineering strategy, roadmaps, governance, and delivery across Consumer & Community Banking. Builds and manages high-performing engineering teams, oversees budgets and vendors, and partners with senior stakeholders on AI platform requirements, risk, security, compliance, and reliability. Directs production ML and GenAI workloads using cloud infrastructure, Kubernetes, GPU orchestration, infrastructure as code, automation, observability, model serving, and AI gateways. Drives large initiatives, operational excellence, cost optimization, and auditable AI-assisted engineering practices.
The summary above was generated by AI

At a world-renowned company like JPMorganChase, you can take the lead in shaping the future of technology, unleashing your full potential, and making your mark on the industry.

As a Director of Infrastructure Engineering at JPMorganChase within the Core Engineering Solutions and Architecture group, you manage one large area or multiple smaller ones with advanced technical knowledge to resolve complex issues. Exercise independent judgement within general guidelines and parameters to determine appropriate actions.

Job responsibilities
  • Manages technical area(s) within infrastructure engineering, collaborates with others across different technical areas and anticipates the needs of multiple disciplines within the function
  • Sets the multi-year strategy and roadmap for AI infrastructure across Consumer & Community Banking, aligned to business priorities and the firm's technology direction
  • Sets reuse-first expectations for enterprise-authorized AI adoption within the work environment across the function to accelerate delivery and improve decision quality, with human-in-the-loop validation and appropriate handling of sensitive data
  • Manages and implements corporate and divisional operational plans, develops and executes the function objectives, and provides broad direction to teams, team leads, and supervisors with accountability for outcomes, including building, leading, and growing a high-performing organization of engineers and engineering managers through hiring, coaching, performance management, and succession planning
  • Manages key senior stakeholders and ensures teams deliver in accordance with compliance standards, risk and security, service level agreements, and business requirements, including partnering with business and product leaders to translate AI use cases into infrastructure requirements prioritized against value and risk
  • Represents the business's needs to firm-wide technology and platform teams, shaping roadmaps, negotiating priorities and timelines, and escalating when commitments slip
  • Drives multiple large complex projects, processes and initiatives through to delivered outcomes — use cases in production, measurable cost savings, and improved reliability
  • Responsible for staffing, budget, and relevant profit and loss, including managing and developing budgets
  • Establishes governance standards for AI-assisted workflows used in delivery and operational routines, ensuring traceability/auditability and alignment to resiliency, security, and risk expectations
Required qualifications, capabilities, and skills
  • Formal training or certification on infrastructure engineering concepts and 10+ years applied experience

  • Experience managing cross-functional teams of infrastructure engineers, with a demonstrated track record of setting technical strategy and delivering it against measurable outcomes

  • Demonstrated experience leading teams in the safe use of enterprise-authorized AI capabilities within the work environment for infrastructure engineering workflows, including validation habits and awareness of data sensitivity
  • Ability to define review and approval expectations for AI-assisted recommendations and ensure outcomes align to resiliency, security, and auditability expectations
  • Experience hiring, developing, and recognizing talent, and creating a culture of ownership and engineering excellence
  • Extensive knowledge of hardware aligned to infrastructure engineering, including deep background in cloud infrastructure, platform, or site reliability engineering with hands-on depth on at least one major cloud provider (AWS: compute, networking, IAM, managed Kubernetes, observability)
  • Experience turning business needs into technical roadmaps and influencing central or shared technology teams not directly managed, with strong cross-team collaboration across engineering, product, security, risk, and finance
  • Excellent stakeholder management and executive communication, written and verbal, including presenting to senior leadership, together with budget and vendor management experience and comfort making investment and cost trade-off decisions
  • Experience running ML or GenAI workloads in production, such as hosted model APIs (Amazon Bedrock, Azure OpenAI, Google Vertex AI or similar) behind API gateways, with authentication, rate limiting, and resilience, as well as building AI skills, plugins, and agents
  • Experience with Kubernetes, including GPU scheduling and auto-scaling, infrastructure as code with Terraform (or equivalent), and CI/CD for infrastructure
  • Python and automation fluency to convert manual efforts into automated solutions, paired with observability expertise using tools such as Splunk, Datadog, Prometheus/Grafana, or OpenTelemetry
Preferred qualifications, capabilities, and skills
  • Experience with GPU compute – orchestration, scheduling, reclaim policies
  • Model serving and optimization: AI Gateways, vLLM, Triton, TensorRT, batching, quantization, latency and throughput
  • Distributed training: PyTorch FSDP, DeepSpeed, Megatron-LM; high-speed GPU interconnects (NVLink, InfiniBand)
  • RAG and vector databases (OpenSearch, pgvector, Pinecone or similar); agent frameworks (LangChain, LlamaIndex or similar)
  • GPU capacity planning and FinOps for AI workloads: cost allocation, chargeback, reserved capacity
  • Experience leading an LLM gateway, AI platform, or ML platform organization
  • Leadership experience in the financial services industry, including working with risk, compliance, and audit teams
 
 
About Us

Chase is a leading financial services firm, helping nearly half of America’s households and small businesses achieve their financial goals through a broad range of financial products. Our mission is to create engaged, lifelong relationships and put our customers at the heart of everything we do. We also help small businesses, nonprofits and cities grow, delivering solutions to solve all their financial needs. 

We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions.  We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process. 

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.

Equal Opportunity Employer/Disability/Veterans

About the TeamOur Consumer & Community Banking division serves our Chase customers through a range of financial services, including personal banking, credit cards, mortgages, auto financing, investment advice, small business loans and payment processing. We’re proud to lead the U.S. in credit card sales and deposit growth and have the most-used digital solutions – all while ranking first in customer satisfaction.
HQ

JPMorganChase New York, New York, USA Office

270 Park Avenue, New York, NY, United States, 10017-2014

JPMorganChase New York, New York, USA Office

4 Metrotech Center, New York, NY, United States, 11201

Similar Jobs

11 Minutes Ago
Remote or Hybrid
USA
292K-366K Annually
Senior level
292K-366K Annually
Senior level
Cloud • Fintech • Information Technology • Machine Learning • Software • App development • Generative AI
Leads engineering teams responsible for delivering high-quality software and features. Establishes technical direction, architecture, development standards, testing and automation practices, cloud transformation, CI/CD, performance monitoring, and continuous improvement. Builds and mentors cross-functional teams of backend and frontend engineers, Scrum Masters, and managers while fostering a quality-first, servant-leadership culture and ensuring reliable, maintainable, and performant software delivery.
Top Skills: Backend EngineeringCi/CdCloud ComputingFrontend EngineeringSoftware Development Lifecycle (Sdlc)Technical ArchitectureTest Automation
52 Minutes Ago
Remote or Hybrid
United States
86K-144K Annually
Mid level
86K-144K Annually
Mid level
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
Leads organizational change and enablement for enterprise AI and autonomous-agent initiatives. Designs training, communications, adoption metrics, champion networks, workflow guidance, and change plans. Partners with PMO, business, security, legal, and governance stakeholders to build trust, address resistance, measure adoption, and integrate AI change activities into project delivery. Delivers hands-on workshops, playbooks, prompt libraries, and executive briefings while driving adoption across IT and go-to-market teams.
Top Skills: Adoption AnalyticsAi AgentsClaudeDashboardsGeminiGenerative AiSurvey Tools
52 Minutes Ago
Remote or Hybrid
United States
Senior level
Senior level
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
Owns program management for the SAA FDE development team, including reporting, release communications, metrics, capacity, risks, dependencies, and roadmap coordination. Manages the customer modernization reference program and oversees the Beacon artifact delivery process. Leads cross-functional stakeholders without direct authority, improves customer-facing workflows, coordinates client-ready deliverables, tracks conversion and cycle-time metrics, and drives automation and process improvement.
Top Skills: ConfluenceJIRAPower BISailpoint IdentityiqSalesforceTableau

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account