Microsoft Logo

Microsoft

Senior Technical Program Manager, Global AI Scaling

Posted 4 Days Ago
Be an Early Applicant
In-Office or Remote
Hiring Remotely in United States
120K-261K Annually
Senior level
In-Office or Remote
Hiring Remotely in United States
120K-261K Annually
Senior level
Drive global readiness and technical program management to scale next-generation GPU-based AI infrastructure across datacenters. Lead cross-functional assessments, resolve infrastructure constraints (power, cooling, networking), define deployment methodologies, operationalize lessons learned, and deliver actionable recommendations to leadership to enable rapid, scalable worldwide adoption of new AI platforms.
The summary above was generated by AI
Overview

Cloud Operations + Innovation (CO+I) is the organization that builds, operates, and continuously evolves the infrastructure behind the Microsoft Cloud, powering services used by more than 95% of Fortune 500 companies. CO+I is responsible for the full datacenter lifecycle from global planning and site acquisition through design, construction, deployment, operations, and eventual decommissioning, spanning 400+ datacenters across more than 70 Azure regions and connected by one of the world's largest global networks.

The CO+I AI Delivery organization is responsible for enabling the next generation of hyperscale AI capacity. The team works across engineering, datacenter planning, deployment, operations, supply chain, and product organizations to translate rapidly evolving AI technologies into scalable, production-ready infrastructure solutions delivered around the world.


Responsibilities

We are seeking a Senior Technical Program Manager, Global AI Scaling to drive CO+I readiness to scale the next generations of AI hardware into our global datacenter infrastructure. In this role, you will drive technical readiness for emerging GPU technologies, partnering across engineering, infrastructure, supply chain, and deployment organizations to enable rapid global adoption of new AI platforms. You will help define how new technologies are introduced into Microsoft's datacenter ecosystem, ensuring infrastructure, deployment, supply chain and operational capabilities evolve to meet the demands of rapidly evolving AI workloads.

This role requires a technically strong leader who can navigate complex infrastructure challenges, drive alignment across diverse stakeholders, and simplify complex topics into clear recommendations to support effective leadership decision-making.

Responsibilities
  • Lead readiness efforts for next-generation GPU infrastructure, ensuring datacenter, deployment, operational, and supply chain requirements are understood and incorporated into future deployment plans.
  • Partner across engineering, supply chain, datacenter design, deployment, and operations teams to assess the impact of new AI hardware technologies and enable successful global adoption at scale.
  • Support development of improved deployment methodologies to increase speed, predictability, scalability, and operational readiness for future generations of AI infrastructure.
  • Collaborate with stakeholders to establish scalable processes and frameworks that support rapid worldwide deployment of new GPU technologies.
  • Drive infrastructure-related feasibility assessments for new programs, identifying technical risks, dependencies, constraints, and readiness gaps associated with emerging AI platforms.
  • Lead cross-functional efforts to resolve complex technical challenges related to datacenter infrastructure, power, cooling, deployment readiness, and operational scale.
  • Translate technical risks, infrastructure tradeoffs, and deployment challenges into actionable recommendations for leadership and partner organizations.
  • Capture and operationalize lessons learned from large-scale AI infrastructure deployments to improve future delivery efficiency, quality, and scalability.
  • Drive alignment across a broad range of stakeholders to identify practical, technically sound solutions that balance business objectives, deployment timelines, and infrastructure constraints.
  • Contribute to planning and execution activities that shape Microsoft's future AI infrastructure deployment capabilities.

Qualifications

Required Qualifications:

  • Bachelor's Degree AND 4+ years experience in engineering, product/technical program management, data analysis, or product development OR equivalent experience.
  • 2+ years of experience managing cross-functional and/or cross-team projects

Other Requirements: 

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: 

  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred Qualifications

  • Bachelor's Degree in Electrical Engineering, Mechanical Engineering, Computer Science, Industrial Engineering, Business or related field AND 6+ years of experience in Technical Program Management, Engineering, Product Management, Infrastructure Delivery, Hardware Deployment, Datacenter Infrastructure, Technology Strategy or related disciplines
    • OR equivalent experience
  • Experience with datacenter power systems, cooling systems, networking infrastructure, electrical systems, or facility design considerations
  • Experience with GPU-based infrastructure, AI clusters, accelerated computing platforms, or large-scale AI hardware deployments
  • Experience evaluating infrastructure feasibility, deployment readiness, operational readiness, or technology introduction programs
  • Experience supporting the launch and scaling of new technology platforms in production environments
  • Knowledge of supply chain planning, manufacturing, deployment operations, or infrastructure scaling processes
  • Experience working across engineering, operations, and business organizations to deliver complex technology programs
  • Passion for solving difficult technical problems and enabling the next generation of cloud and AI infrastructure
  • Experience with hyperscale cloud infrastructure, AI infrastructure, datacenter delivery, hardware deployment, or large-scale technology deployment programs
  • Experience driving ambiguous technical challenges to resolution through structured analysis, technical leadership, and cross-functional collaboration
  • Demonstrated ability to influence outcomes and drive alignment across organizations without direct authority

#COICareers | #EPCCareers | #DCDCareers


Technical Program Management IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.



Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Similar Jobs

51 Minutes Ago
Remote or Hybrid
United States
137K-174K Annually
Senior level
137K-174K Annually
Senior level
Artificial Intelligence • Consumer Web • Edtech • Enterprise Web • HR Tech • Social Impact • Generative AI
Lead category-level growth initiatives from diagnosis through execution to improve revenue, paid conversion, retention, and LTV. Analyze portfolio performance, prioritize high-impact opportunities, design experiments and operating mechanisms, and drive cross-functional teams to deliver measurable business outcomes and scalable decision frameworks.
Top Skills: SQL
51 Minutes Ago
Remote or Hybrid
United States
132K-166K Annually
Senior level
132K-166K Annually
Senior level
Artificial Intelligence • Consumer Web • Edtech • Enterprise Web • HR Tech • Social Impact • Generative AI
The Senior Data Scientist partners with Customer Success to perform deep-dive analyses, diagnose metric shifts, build predictive models (churn/upsell), apply causal inference and experimentation, measure business impact, and develop AI/LLM solutions. Responsibilities include self-serving across the data stack for extraction, pipelining, and dashboards, defining KPIs, and delivering actionable insights to reduce churn, drive revenue, and improve operational efficiency.
Top Skills: Ai/LlmAirflowDbtPythonSigmaSQLTableau
An Hour Ago
Remote or Hybrid
45K-85K Annually
Junior
45K-85K Annually
Junior
Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Handle inbound and warm sales leads remotely, consult with customers to recommend and sell Property & Casualty insurance, meet sales targets, complete paid licensing and training, maintain required remote workspace and internet standards, work specified weekday/weekend shifts, and provide excellent customer service.
Top Skills: Dsl)FiberHigh-Speed Internet (100 Mbps Download / 20 Mbps Upload)PcWired Internet (Cable

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account