American Express Logo

American Express

Senior Agentic AI Infrastructure Engineer I - Core Platforms

Posted 2 Days Ago
Be an Early Applicant
Hybrid
New York, NY, USA
Senior level
Hybrid
New York, NY, USA
Senior level
Designs, operates, and optimizes secure infrastructure for agentic AI and production machine-learning workloads. Leads GPU and accelerator platforms, Kubernetes-based delivery, model serving, distributed AI infrastructure, observability, FinOps, automation, and high-performance networking and storage. Partners across engineering, security, risk, and platform teams to ensure reliability, scalability, compliance, cost efficiency, and operational readiness while mentoring junior engineers.
The summary above was generated by AI

The Enterprise Technology Services organization partners with every part of the American Express business to power the company’s growth and innovation with trust and efficiency, and drive competitive differentiation with speed. We support the delivery and operations of technology, digital, and data capabilities, platforms, and services globally. Specifically, our team is responsible for the company’s technology engineering, architecture, and infrastructure, providing 24x7 support to ensure an uninterrupted, high-quality experience for customers and colleagues. We also provide product management for core enterprise platforms, and lead technology risk and information security, enterprise data governance and platforms, digital product and design, and enterprise AI platforms on behalf of the company.

The AI Infrastructure Engineer collaborates with application and platform teams to design, implement, and optimize secure, scalable infrastructure solutions for AI-enabled workloads. This role resolves complex technical issues, ensures strong system performance, reliability, and security, and leads infrastructure initiatives that align with business objectives and platform strategy. 

Responsibilities
  • Mentors junior Infrastructure Engineers and cross-functional team of colleagues, fostering a culture of excellence and innovation
  • Leads projects collaborating with multiple cross-functional teams within budget and schedule, ensuring timely issue resolution and maintaining high standards of design, implementation, testing, and compliance
  • Guides stakeholders on aligning processes with industry best practices and business objectives
  • Provides guidance and support to junior engineers, fostering professional growth and development within the team
  • Collaborates with application teams to integrate business needs into comprehensive infrastructure solutions, aligning with business objectives and platform roadmap
  • Leads infrastructure design and selection, ensuring solutions meet customer needs and strategic goals
  • Diagnoses and resolves complex infrastructure issues, providing support during outages to ensure minimal disruption
  • Monitors and addresses capacity and availability issues, conducts performance and security assessments, and supports certification and accreditation processes
  • Leads the efforts towards defining and maintaining processes, documentation, and engineering diagrams for technical and operational support
  • Embeds AI-assisted observability, automation, and documentation capabilities into team workflows to improve deployment efficiency, issue detection, infrastructure analysis, troubleshooting, production support, system readiness, and operational support for specialized compute environments supporting AI-enabled workloads.
  • Embeds ML-powered AIOps and custom anomaly detection into team workflows, using metrics, logs, and traces to detect anomalies, predict failures, and correlate incidents across distributed systems.
  • Embeds AI-assisted infrastructure-as-code development and review practices using tools such as GitHub Copilot, Claude Code, Cursor, and similar capabilities into engineering workflows, improving consistency, deployment quality, and operational efficiency.
  • Supports infrastructure environments hosting AI-enabled workloads, including cloud-based LLM platforms such as AWS Bedrock, Azure AI Foundry/Azure OpenAI, and Google Vertex AI, while mentoring engineers on responsible use of AI-enabled infrastructure tools, prompt engineering, runbook generation, incident troubleshooting, postmortem summarization, operational analysis, validation, oversight, and operational readiness of GPU- and TPU-enabled infrastructure environments.
  • Designs and operates GPU- and accelerator-enabled compute platforms, including cluster scheduling, workload placement, capacity management, quota and reservation controls, and utilization optimization.
  • Builds reusable platform capabilities for model training, fine-tuning, inference, and agentic workloads using Kubernetes, containers, infrastructure as code, and automated delivery pipelines.
  • Engineers high-performance storage, networking, and data-movement patterns required for distributed AI workloads, with measurable service-level objectives for availability, latency, throughput, and recovery.
  • Implements end-to-end observability and FinOps controls for AI infrastructure, including workload telemetry, accelerator utilization, cost attribution, anomaly detection, performance tuning, and capacity forecasting.
  • Partners with AI engineers, security, risk, and platform teams to establish secure multi-tenant isolation, identity and access controls, secrets management, software supply-chain controls, and operational readiness. 
Qualifications

Work Experience

  • Designing infrastructure for AI agents, including agent runtimes, orchestration frameworks, tool integrations, asynchronous execution, and stateful workflows. Examples include LangGraph, Semantic Kernel, and comparable frameworks.

  • Experience applying Agentic AI tools to support infrastructure engineering, platform support, or cloud operations work, including reviewing AI-generated operational insights.

  • Experience validating AI-generated operational outputs and incorporating AI-enabled practices into infrastructure workflows, including AI-assisted operational recommendations requiring human review and approval.

  • Experience with Kubernetes-based AI platforms, containers, workload schedulers, and GPU or accelerator orchestration in cloud or hybrid environments.

  • Experience operating model-serving or inference platforms and optimizing throughput, latency, availability, and cost for production AI workloads.

  • Experience with distributed training or inference infrastructure, high-performance networking and storage, accelerator telemetry, and capacity planning.

  • Experience implementing security, reliability engineering, observability, and FinOps practices for multi-tenant AI infrastructure.

  • Experience in different programming languages, DevOps tools such as Ansible, Puppet, Terraform, Python, Shell scripting and PowerShell, and their applications in infrastructure.

  • Experience in infrastructure components such as servers, storage, networking, and virtualization technologies.

  • Experience in network protocols and their job in infrastructure management. 

  • Experience in networking fundamentals.

  • Experience in databases.

  • Experience in tools used in planning, analyzing, crafting, building, testing, configuring, and maintaining applications.

  • Experience in cloud platforms (e.g., AWS, Azure, Google Cloud).

  • Experience in monitoring technologies such as Prometheus, ElasticSearch and Grafana.

Education and Knowledge

  • 5+ Years of experience in infrastructure engineering, cloud engineering, DevOps, or a related technical field, including at least 2 years of hands-on experience supporting AI-enabled infrastructure, AI automation, or agentic AI technologies. 

  • Bachelor's degree in Computer Science, Information Technology, Engineering, and/or comparable experience; advanced degree preferred

  • Knowledge of application infrastructure and standards

  • Knowledge of storage management (e.g., SAN, NAS) design and support

  • Knowledge of middleware technologies 

  • Knowledge of software defined networking, automation, and orchestration and their applications

  • Knowledge of platform delivery methodology (Agile, Scrum, Agile XP, Best in Class Development, Waterfall, etc.)

  • Knowledge of scripting and automation skills (e.g., PowerShell, Bash, Python)

  • Knowledge of DevOps practices and tools (e.g., continuous integration/continuous deployment pipelines, Docker, Kubernetes)

  • Knowledge of cloud technologies

  • Knowledge of Windows and Linux administration

  • Working knowledge of AI-assisted infrastructure automation, observability, and deployment support capabilities, and infrastructure services commonly used to support AI-enabled workloads

  • Working Knowledge of AI use cases in configuration management, incident analysis, infrastructure operations, and AI-assisted operational workflows that incorporate human oversight and approval controls. 

Employment eligibility to work with American Express in the United States is required as the company will not pursue visa sponsorship for these positions. 


About Us

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. From delivering differentiated products to providing world-class customer service, we operate with a strong risk mindset, ensuring we continue to uphold our brand promise of trust, security, and service.

As part of Team Amex, you’ll experience our powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express.

About the Team

We back you with benefits that support your holistic well-being so you can be and deliver your best. This means caring for you and your loved ones' physical, financial, and mental health, as well as providing the flexibility you need to thrive personally and professionally:

  • Competitive base salaries
  • Bonus incentives
  • 6% Company Match on retirement savings plan
  • Free financial coaching and financial well-being support
  • Comprehensive medical, dental, vision, life insurance, and disability benefits
  • Flexible working model with hybrid, onsite or virtual arrangements depending on role and business need
  • 20+ weeks paid parental leave for all parents, regardless of gender, offered for pregnancy, adoption or surrogacy
  • Free access to global on-site wellness centers staffed with nurses and doctors (depending on location)
  • Free and confidential counseling support through our Healthy Minds program
  • Career development and training opportunities

For a full list of Team Amex benefits, visit our Colleague Benefits Site.

American Express is an equal opportunity employer and makes employment decisions without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, disability status, age, or any other status protected by law. American Express will consider for employment all qualified applicants, including those with arrest or conviction records, in accordance with the requirements of applicable state and local laws, including the California Fair Chance Act, the Los Angeles County Fair Chance Ordinance for Employers, and the City of Los Angeles’ Fair Chance Initiative for Hiring Ordinance. For positions covered by federal and/or state banking regulations, American Express will comply with such regulations as it relates to the consideration of applicants with criminal convictions.

We back our colleagues with the support they need to thrive, professionally and personally. That's why we have Amex Flex, our enterprise working model that provides greater flexibility to colleagues while ensuring we preserve the important aspects of our unique in-person culture. Depending on role and business needs, colleagues will either work onsite, in a hybrid model (combination of in-office and virtual days) or fully virtually.

US Job Seekers - Click to view the “Know Your Rights” poster. If the link does not work, you may access the poster by copying and pasting the following URL in a new browser window: https://www.eeoc.gov/poster.


The below represents the expected salary range for this job requisition. Ultimately, in determining your pay, we’ll consider your location, experience, and other job-related factors.​
HQ

American Express New York, New York, USA Office

World Financial Center, New York, NY, United States, 10285

American Express Hoboken, New Jersey, USA Office

Hoboken, United States

American Express Jersey City, New Jersey, USA Office

Jersey City, United States

American Express New York, New York, USA Office

200 Vesey St, New York, NY, United States, 10281

American Express New York, New York, USA Office

New York, United States

American Express Roseland, New Jersey, USA Office

Roseland, United States

Similar Jobs

An Hour Ago
Easy Apply
Remote or Hybrid
US
Easy Apply
100K-300K Annually
Senior level
100K-300K Annually
Senior level
Enterprise Web • Hardware • Internet of Things • Software
Drive full-cycle SaaS sales for mid-market and enterprise manufacturing accounts, from prospecting through closing strategic deals. Develop sales strategies, exceed revenue targets, forecast pipeline in Salesforce, present technical value propositions, and build relationships with executive and technical stakeholders. Collaborate with Sales Engineering, Marketing, and Customer Success while staying current on SaaS, PaaS, IoT, cloud, AI, and manufacturing technology trends.
Top Skills: AICloud ComputingIiotIotLinkedin Sales NavigatorMesOutreachPaasSaaSSalesforceZoominfo
An Hour Ago
In-Office or Remote
New York, NY, USA
253K-306K Annually
Expert/Leader
253K-306K Annually
Expert/Leader
Blockchain • Fintech • Payments • Financial Services • Cryptocurrency • Web3
Leads Circle National Trust’s operations, compliance, governance, business planning, regulatory engagement, audits, risk mitigation, and cross-functional resource coordination. The role reports to Circle executives and the Trust Board, ensures efficient and compliant fiduciary and custody operations, develops the business foundation, and promotes strong governance, communication, and operational performance within a regulated financial services environment.
Top Skills: Artificial IntelligenceAutomationBlockchainDigital CurrencyFintechRegtech
An Hour Ago
Remote or Hybrid
45K-85K Annually
Junior
45K-85K Annually
Junior
Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Handle inbound calls and warm leads, consult customers on insurance needs, recommend appropriate Property and Casualty coverage, and convert prospects into policyholders. The role includes paid training and licensing support, customer relationship management, sales closing, and representing the Liberty Mutual brand. Employees must work a set weekday and weekend schedule, maintain a professional home workspace, and meet high-speed internet requirements.
Top Skills: Cable InternetDsl InternetFiber InternetPcWired High-Speed Internet

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account