BNY Logo

BNY

Senior Vice President, Infrastructure Engineer

Posted 19 Days Ago
Be an Early Applicant
In-Office
Lake Mary, FL
Senior level
In-Office
Lake Mary, FL
Senior level
Lead deployment, monitoring, and scaling of enterprise NVIDIA GPU AI infrastructure. Manage containerized AI workloads with Kubernetes/Docker, automate provisioning with Terraform/Ansible and Python/Bash, and integrate training/inference pipelines into CI/CD. Ensure platform observability, troubleshoot performance bottlenecks, and drive reliability for hybrid cloud GPU environments.
The summary above was generated by AI

AI Infrastructure Engineer

At BNY, our culture allows us to run our company better and enables employees’ growth and success. As a leading global financial services company at the heart of the global financial system, we influence nearly 20% of the world’s investible assets. Every day, our teams harness cutting-edge AI and breakthrough technologies to collaborate with clients, driving transformative solutions that redefine industries and uplift communities worldwide.

Recognized as a top destination for innovators, BNY is where bold ideas meet advanced technology and exceptional talent. Together, we power the future of finance – and this is what #LifeAtBNY is all about. Join us and be part of something extraordinary.

We’re seeking a future team member for the role of Senior Vice President, AI Infrastructure Engineer to join our Technology team. This role is located in Lake Mary, FL or Pittsburgh, PA

In this role, you’ll make an impact in the following ways:

  • Be hands-on with enterprise-grade NVIDIA AI infrastructure, supporting GPU-based compute, high-performance storage, and network systems designed for ML/AI at scale.
  • Deploy, monitor, and troubleshoot containerized AI workloads using Kubernetes, Docker, and GPU orchestration tools like Run:AI and NVIDIA BCM.
  • Own the observability of our AI platforms—monitor health, identify performance bottlenecks, and make strategic recommendations to drive platform reliability and maturity.
  • Automate infrastructure operations and provisioning using Python, Bash, and tools like Terraform or Ansible to reduce manual toil and accelerate experimentation.
  • Maintain and scale AI training and inference pipelines, integrating infrastructure workflows into CI/CD systems to enable seamless, automated deployment of AI workloads.

To be successful in this role, we’re seeking the following:

  • Bachelor's degree in computer science or a related discipline, or equivalent work experience required; advanced degree preferred8-10 years of related experience required; experience in the securities or financial services industry is a plus.
  • Experience with Linux administration (RHEL/Ubuntu), shell scripting, and system-level debugging.
  • Proven experience running distributed systems in Kubernetes and containerized environments using Docker.
  • Familiarity with GPU resource management, including NVIDIA GPU Operator and device plugin lifecycle.
  • Experience with CI/CD workflows and infrastructure automation tools such as GitLab CI, Jenkins, Terraform, Helm, or Ansible.
  • Knowledge of networking fundamentals and persistent storage systems.
  • Exposure to cloud platforms (AWS, GCP, Azure) and hybrid GPU environments.
  • Ability to read and support Python code focused on ML/AI pipeline integration.
  • Strong analytical and troubleshooting skills with a collaborative mindset.
  • Effective communication skills and proactive ownership of platform reliability and performance.

At BNY, our culture speaks for itself, check out the latest BNY news at:

BNY Newsroom

BNY LinkedIn 

Here’s a few of our recent awards:

America’s Most Innovative Companies, Fortune, 2025
World’s Most Admired Companies, Fortune 2025
“Most Just Companies”, Just Capital and CNBC, 2025

Our Benefits and Rewards:

BNY offers highly competitive compensation, benefits, and wellbeing programs rooted in a strong culture of excellence and our pay-for-performance philosophy. We provide access to flexible global resources and tools for your life’s journey. Focus on your health, foster your personal resilience, and reach your financial goals as a valued member of our team, along with generous paid leaves, including paid volunteer time, that can support you and your family through moments that matter.

BNY is an Equal Employment Opportunity/Affirmative Action Employer - Underrepresented racial and ethnic groups/Females/Individuals with Disabilities/Protected Veterans.


About Us

At BNY, our culture allows us to run our company better and enables employees’ growth and success. As a leading global financial services company at the heart of the global financial system, we influence nearly 20% of the world’s investible assets. Every day, our teams harness cutting-edge AI and breakthrough technologies to collaborate with clients, driving transformative solutions that redefine industries and uplift communities worldwide.

Recognized as a top destination for innovators, BNY is where bold ideas meet advanced technology and exceptional talent. Together, we power the future of finance – and this is what #LifeAtBNY is all about. Join us and be part of something extraordinary. About the Team

At BNY, our culture speaks for itself, check out the latest BNY news at BNY Newsroom & BNY LinkedIn

 Here’s a few of our recent awards:

  • America’s Most Innovative Companies, Fortune, 2025
  • World’s Most Admired Companies, Fortune 2025
  • “Most Just Companies”, Just Capital and CNBC, 2025

    Our Benefits and Rewards:

    BNY offers highly competitive compensation, benefits, and wellbeing programs rooted in a strong culture of excellence and our pay-for-performance philosophy. We provide access to flexible global resources and tools for your life’s journey. Focus on your health, foster your personal resilience, and reach your financial goals as a valued member of our team, along with generous paid leaves, including paid volunteer time, that can support you and your family through moments that matter.

    BNY is an Equal Employment Opportunity/Affirmative Action Employer - Underrepresented racial and ethnic groups/Females/Individuals with Disabilities/Protected Veterans.

    BNY assesses market data to ensure a competitive compensation package for our employees. The expected base salary for this position when employment commences can be found in the Job Info section at the bottom of the posting. 

    Base salary offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, and experience. Base salary is only part of the total rewards package, which may include eligibility for an annual discretionary incentive award. Subject to the terms and conditions of the applicable plans then in effect, eligible employees may enroll in a 401(k) plan as well as participate in Company-sponsored medical, dental, vision, and basic life insurance plans for the employee and the employee’s eligible dependents. Eligible employees also may receive other benefits (including various paid time off benefits, such as vacation and sick time), dependent on the position offered. Details of participation in these benefit plans will be provided if an employee receives an offer of employment.

    If hired, the employee will be in an “at will” position and the Company reserves the right to modify base salary (as well as any other discretionary payments or compensation programs) at any time, including for reasons related to individual performance, Company or individual department/team performance, and market factors.

    HQ

    BNY New York, New York, USA Office

    240 Greenwich St, New York, NY, United States, 10007

    BNY Edison, New Jersey, USA Office

    Edison, United States

    BNY Florham Park, New Jersey, USA Office

    Florham Park, United States

    BNY Jersey City, New Jersey, USA Office

    Jersey City, United States

    BNY New York, New York, USA Office

    New York, United States

    BNY New York, New York, USA Office

    New York, United States

    BNY Newark, New Jersey, USA Office

    Newark, United States

    BNY Somerset, New Jersey, USA Office

    Somerset, United States

    BNY Woodland Park, New Jersey, USA Office

    Woodland Park, United States

    Similar Jobs

    10 Hours Ago
    In-Office
    2 Locations
    Senior level
    Senior level
    Fintech • Financial Services
    Lead and modernize mainframe infrastructure engineering across z/OS environments. Oversee lifecycle management of hardware/software, mentor managers, drive cross-functional modernization, ensure security/operations (JCL, DB2, CICS, RACF), and guide architecture, tooling, and large program delivery to achieve reliable, automated mainframe operations.
    Top Skills: Acf2Ca Session ManagerCa SpoolCicsCmdbDb2Ibm Connect:DirectIbm Operating SystemsImsIspf/TsoIsv SoftwareItil/ItsmJclRacfSdlcSource Code ManagementTcpipTssVtamZ/Os
    5 Days Ago
    In-Office
    2 Locations
    104K-190K Annually
    Senior level
    104K-190K Annually
    Senior level
    Fintech • Financial Services
    Lead installation, configuration, upgrade, and support of DB2 and related middleware across mainframe and distributed platforms. Troubleshoot DB2 subsystems, manage changes/incidents, run POCs, participate in disaster recovery, provide 24x7 coverage, collaborate with app teams and vendors, and lead complex multi-tier software projects and performance tuning.
    Top Skills: Bmc-ApptuneBmc-Catalog ManagerBroadcom SysviewData Center EquipmentDb2Db2 ConnectDb2 Data SharingIbm OptimIbm Q/Sql-RepInformatica PowerexchangeJIRALuwMiddlewarePerformance/Monitoring ProductsRexxRocket-ShadowServicenowSmpeZ/Os
    Senior level
    Fintech • Financial Services
    The role involves designing, developing, and maintaining scalable backend services and APIs, implementing observability solutions, ensuring software quality and security, building containerized delivery pipelines, and leveraging AI tools for operational improvement.
    Top Skills: AppdynamicsCi/CdDockerDynatraceGitGrafanaJavaKubernetesMoogsoftOpen TelemetryPrometheusPythonSolarwindsSplunkSpringThousandeyes

    What you need to know about the NYC Tech Scene

    As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

    Key Facts About NYC Tech

    • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
    • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
    • Key Industries: Artificial intelligence, Fintech
    • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
    • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
    • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

    Sign up now Access later

    Create Free Account

    Please log in or sign up to report this job.

    Create Free Account