Build and operate Arm’s production AI platform infrastructure, including MCP servers, model gateways, runtime services, and control-plane components. Develop scalable, secure, observable, and cost-aware platform patterns using Kubernetes, cloud infrastructure, infrastructure as code, and GitOps. Responsibilities include automation, monitoring, incident response, reliability engineering, secrets and identity management, network controls, auditability, lifecycle management, and participation in an on-call rotation.
Job Description:
We are building a central AI control plane to support the safe, scalable, and efficient use of AI across Arm's engineering teams.
This hands-on platform engineering role will help deliver and be responsible for the runtime platforms that make AI services reliable, secure, observable and supportable at Arm scale. You will work across Kubernetes, cloud, identity, secrets, networking, telemetry, incident management and automation to provide the production foundation for Arm's AI platform.
You will initially contribute in three key areas:
Production AI runtime platforms:
Reliability, observability and support:
Secure operations by default:
Responsibilities:
Required Skills and Experience:
"Nice To Have" Skills and Experience :
In Return:
This is a chance to help build a new AI Platform capability for Arm. In return, we'll welcome you into a collaborative, low-ego but high performing team, alongside a highly capable and deeply technical set of peers. We will give you room to grow technically, an interesting and challenging role, and an opportunity to improve the lives of thousands of engineers across Arm!
Salary Range:
$161,500-$218,500 per year
We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.
Our 10x Mindset
At Arm, we believe progress happens when people are empowered to think bigger and push beyond what seems possible. Our 10x mindset is about curiosity, ambition and creating impact that will be used by millions. We learn fast, prioritise collaboration and turn bold ideas into real technology. We look for people who are inspired by this way of working and want to grow in an environment where bold ideas are welcomed. Discover how the 10x mindset shapes life at Arm: https://careers.arm.com/10x-mindset
Use of AI in Your Application
At Arm, we embrace the benefits AI can bring, including in recruitment. You may use AI to support your preparation, such as improving the clarity of written responses, practicing interview questions, or learning more about our industry. However, your application and interview responses must reflect your own thinking, experience, and abilities. We want to understand your authentic perspective, creativity, and approach to problem solving. As such, you may not use AI to complete assigned tasks as part of any assessments. If you plan to use AI-supported or assistive technologies as part of a reasonable adjustment, please contact [email protected] so we can support you.
Recruitment Adjustments and Accommodations
At Arm, we want to build extraordinary teams. If you need an adjustment or an accommodation during the recruitment process, please email [email protected] . To note, by sending us the requested information, you consent to its use by Arm to arrange for appropriate accommodations. All accommodation or adjustment requests will be treated with confidentiality, and information concerning these requests will only be disclosed as necessary to provide the accommodation. Although this is not an exhaustive list, examples of support include breaks between interviews, having documents read aloud, or office accessibility. Please email us about anything we can do to accommodate you during the recruitment process.
Hybrid Working
Arm's approach to hybrid working is designed to create a working environment that supports both high performance and personal wellbeing. We believe in bringing people together face to face to enable us to work at pace, whilst recognizing the value of flexibility. Within that framework, we empower groups/teams to determine their own hybrid working patterns, depending on the work and the team's needs. Details of what this means for each role will be shared upon application. In some cases, the flexibility we can offer is limited by local legal, regulatory, tax, or other considerations, and where this is the case, we will collaborate with you to find the best solution. Please talk to us to find out more about what this could look like for you.
Equal Opportunities
Arm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues. We are a diverse organization of dedicated and innovative individuals, and don't discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
We are building a central AI control plane to support the safe, scalable, and efficient use of AI across Arm's engineering teams.
This hands-on platform engineering role will help deliver and be responsible for the runtime platforms that make AI services reliable, secure, observable and supportable at Arm scale. You will work across Kubernetes, cloud, identity, secrets, networking, telemetry, incident management and automation to provide the production foundation for Arm's AI platform.
You will initially contribute in three key areas:
Production AI runtime platforms:
- Build/deploy and operate the infrastructure for centrally hosted AI platform services, including MCP server infrastructure, model gateway services and supporting control-plane components.
- Implement runtime patterns for isolation, scalability, secure execution, capacity management and cost-aware operation.
- Automate provisioning, configuration, upgrades and lifecycle management using infrastructure-as-code and GitOps patterns.
Reliability, observability and support:
- Implement service-level indicators, service-level objectives, alerting, dashboards, runbooks and support workflows.
- Incident response, post-incident review and vendor outage handling for AI services embedded in engineering workflows.
- Build telemetry that helps Arm understand AI platform health, usage, performance, cost and operational risk.
Secure operations by default:
- Ensure platform components meet production readiness, security and compliance expectations.
- Help make secure AI usage the default by providing reliable paved paths rather than manual or fragmented infrastructure.
Responsibilities:
- Build, operate and continuously improve the production infrastructure for Arm's AI platform services, using both custom and third party solutions.
- Contribute to reliability, scalability, monitoring, alerting, incident response, runbooks and operational readiness for AI platform components.
- Develop automation for provisioning, deployment, configuration, backup, recovery, patching, upgrades and lifecycle management.
- Implement secure runtime patterns, including workload isolation, secrets management, identity integration, network controls and auditability.
- Participate in production support and our paid on-call rota for high impact incident response.
Required Skills and Experience:
- Familiarity with AI platform concepts such as model routing, MCP servers, agentic workflows, RAG systems or LLM observability.
- Experience deploying and operating production infrastructure or platform services in a Linux-based environment using Kubernetes, containers, cloud or private-cloud platforms, infrastructure-as-code and CI/CD/GitOps tooling.
- Automation and scripting skills, for example Terraform, Go, Python or similar.
"Nice To Have" Skills and Experience :
- Awareness of security fundamentals for production platforms, including identity, secrets, access control, network segmentation, vulnerability management and audit logging.
- Experience operating internal developer platforms, AI platforms, model gateways, MCP infrastructure or other shared engineering platforms.
- Experience with service mesh, policy-as-code, workload identity, sandboxing, secure runtime environments or multi-tenant platform designs.
- Experience with regulated or security-sensitive engineering environments.
- Working knowledge of Open AI tools, products and APIs
In Return:
This is a chance to help build a new AI Platform capability for Arm. In return, we'll welcome you into a collaborative, low-ego but high performing team, alongside a highly capable and deeply technical set of peers. We will give you room to grow technically, an interesting and challenging role, and an opportunity to improve the lives of thousands of engineers across Arm!
Salary Range:
$161,500-$218,500 per year
We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.
Our 10x Mindset
At Arm, we believe progress happens when people are empowered to think bigger and push beyond what seems possible. Our 10x mindset is about curiosity, ambition and creating impact that will be used by millions. We learn fast, prioritise collaboration and turn bold ideas into real technology. We look for people who are inspired by this way of working and want to grow in an environment where bold ideas are welcomed. Discover how the 10x mindset shapes life at Arm: https://careers.arm.com/10x-mindset
Use of AI in Your Application
At Arm, we embrace the benefits AI can bring, including in recruitment. You may use AI to support your preparation, such as improving the clarity of written responses, practicing interview questions, or learning more about our industry. However, your application and interview responses must reflect your own thinking, experience, and abilities. We want to understand your authentic perspective, creativity, and approach to problem solving. As such, you may not use AI to complete assigned tasks as part of any assessments. If you plan to use AI-supported or assistive technologies as part of a reasonable adjustment, please contact [email protected] so we can support you.
Recruitment Adjustments and Accommodations
At Arm, we want to build extraordinary teams. If you need an adjustment or an accommodation during the recruitment process, please email [email protected] . To note, by sending us the requested information, you consent to its use by Arm to arrange for appropriate accommodations. All accommodation or adjustment requests will be treated with confidentiality, and information concerning these requests will only be disclosed as necessary to provide the accommodation. Although this is not an exhaustive list, examples of support include breaks between interviews, having documents read aloud, or office accessibility. Please email us about anything we can do to accommodate you during the recruitment process.
Hybrid Working
Arm's approach to hybrid working is designed to create a working environment that supports both high performance and personal wellbeing. We believe in bringing people together face to face to enable us to work at pace, whilst recognizing the value of flexibility. Within that framework, we empower groups/teams to determine their own hybrid working patterns, depending on the work and the team's needs. Details of what this means for each role will be shared upon application. In some cases, the flexibility we can offer is limited by local legal, regulatory, tax, or other considerations, and where this is the case, we will collaborate with you to find the best solution. Please talk to us to find out more about what this could look like for you.
Equal Opportunities
Arm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues. We are a diverse organization of dedicated and innovative individuals, and don't discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Similar Jobs at Arm
Artificial Intelligence • Internet of Things • Semiconductor
Build and operate Arm’s production AI platform infrastructure, including model gateways, MCP services, and control-plane components. Own scalability, reliability, observability, security, incident response, automation, lifecycle management, and operational readiness. Develop infrastructure-as-code and GitOps workflows, secure runtime patterns, telemetry, monitoring, alerting, and support processes across Kubernetes, cloud, identity, networking, secrets, and compliance systems. Participate in a paid on-call rotation for high-impact incidents.
Top Skills:
Ci/CdCloud PlatformsContainersGitopsGoInfrastructure-As-CodeKubernetesLinuxLlm ObservabilityMcp ServersModel GatewaysOpenai ApisPolicy-As-CodePrivate CloudPythonRag SystemsService MeshTerraformWorkload Identity
Artificial Intelligence • Internet of Things • Semiconductor
Design and verification engineer for Arm’s next-generation network-on-chip interconnect products. Responsibilities include specifying, creating, and debugging SystemVerilog/UVM constrained-random testbenches; verifying multiprocessing microarchitectures, cache coherence, and AMBA protocols; applying software engineering, scripting, and formal verification skills to ensure reliable, high-performance silicon IP.
Top Skills:
AmbaAmba4 AceAmba5 ChiAxiFormal VerificationPerlPythonRtlSystemverilogUvm
Artificial Intelligence • Internet of Things • Semiconductor
Define next-generation Arm CPU microarchitecture for Cortex-X and Neoverse processors. Develop performance models, analyze workloads, evaluate architectural innovations with cycle-accurate and functional simulators, and assess performance, power, and area trade-offs. Collaborate with CPU design teams and ecosystem partners, communicate technical findings, mentor engineers, and improve engineering methodologies and tools.
Top Skills:
Arm Cortex-XArm NeoverseC++Cycle-Accurate SimulatorsFunctional SimulatorsPerformance Modeling InfrastructurePython
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
