Design and implement scalable platform services, runtimes, and developer tooling for deploying and managing AI workloads on Arm-based edge devices. Build abstractions, observability, and performance optimizations across heterogeneous hardware while collaborating with architects and AI engineers to produce robust, maintainable systems and SDKs for on-device AI.
We seek a Software Engineer to contribute to the next generation of Physical and Edge AI platforms on Arm. Your work will focus on building foundational software for AI tasks such as vision, robotics, speech, and intelligence based on sensor input. This software enables AI workloads to be deployed, managed, and used optimally on the device, independent of cloud services.
You will focus on building platform-level services, developer tooling, and runtime infrastructure that boost developer efficiency and make advanced AI capabilities accessible through clean, stable abstractions. This is a high-impact role working on systems that sit at the intersection of distributed systems, edge computing, and AI infrastructure.
Key Responsibilities :
Platform & systems development
Developer experience & tooling
Performance, reliability, and scale
Multi-functional collaboration
Vital Skills and Experience
Preferred Skills and Experience
Why this role matters
Edge and physical AI systems impose outstanding requirements on software platforms. These platforms need to be secure, reliable, updatable, and easy for developers to use. They must also function within real-world limits not found in the cloud.
This role involves guiding the development and deployment of AI on Arm-powered devices used in real-world scenarios. You will help build platforms that unlock new application categories in robotics, industrial systems, and consumer technology. It offers a chance to create a strong impact on the future of AI!
Salary Range:
$209,100-$282,900 per year
We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.
Accommodations at Arm
At Arm, we want to build extraordinary teams. If you need an adjustment or an accommodation during the recruitment process, please email [email protected] . To note, by sending us the requested information, you consent to its use by Arm to arrange for appropriate accommodations. All accommodation or adjustment requests will be treated with confidentiality, and information concerning these requests will only be disclosed as necessary to provide the accommodation. Although this is not an exhaustive list, examples of support include breaks between interviews, having documents read aloud, or office accessibility. Please email us about anything we can do to accommodate you during the recruitment process.
Hybrid Working at Arm
Arm's approach to hybrid working is designed to create a working environment that supports both high performance and personal wellbeing. We believe in bringing people together face to face to enable us to work at pace, whilst recognizing the value of flexibility. Within that framework, we empower groups/teams to determine their own hybrid working patterns, depending on the work and the team's needs. Details of what this means for each role will be shared upon application. In some cases, the flexibility we can offer is limited by local legal, regulatory, tax, or other considerations, and where this is the case, we will collaborate with you to find the best solution. Please talk to us to find out more about what this could look like for you.
Equal Opportunities at Arm
Arm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues. We are a diverse organization of dedicated and innovative individuals, and don't discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
You will focus on building platform-level services, developer tooling, and runtime infrastructure that boost developer efficiency and make advanced AI capabilities accessible through clean, stable abstractions. This is a high-impact role working on systems that sit at the intersection of distributed systems, edge computing, and AI infrastructure.
Key Responsibilities :
Platform & systems development
- Build and implement reliable, scalable system services for edge and physical AI workloads.
- Develop runtime infrastructure that enables deployment, lifecycle management, and updates of AI-powered components on-device.
- Develop abstractions that decouple applications from underlying AI frameworks, models, and hardware accelerators.
Developer experience & tooling
- Build APIs, SDKs, and developer tooling that streamline how engineers build and integrate AI-powered features.
- Improve end-to-end developer workflows, from local development to on-device deployment and updates.
- Build observability and diagnostics capabilities to help developers understand performance, failures, and system behavior.
Performance, reliability, and scale
- Build software that performs reliably under edge constraints such as limited resources, real-time requirements, and heterogeneous hardware.
- Contribute to system-level performance optimization across CPUs and AI accelerators.
- Ensure systems are maintainable, testable, and robust in production environments.
Multi-functional collaboration
- Work closely with architects, product managers, and AI engineers to build platform capabilities and developer-facing abstractions.
- Collaborate across teams to build clean APIs, service boundaries, and integration points.
- Contribute to reference implementations, documentation, and example workflows.
Vital Skills and Experience
- Strong experience crafting and building systems software, platform services, or distributed systems in production.
- Proficiency in C/C++, Rust, Go, or Python (language choice depends on component).
- Solid understanding of:
- Linux-based systems
- Process isolation, IPC, and service lifecycles
- API build and versioning
- Experience building developer platforms, SDKs, or internal tooling.
- Strong fundamentals in algorithms, data structures, and performance optimization.
- Ability to work across multiple layers of the stack, from APIs down to system behavior.
- Excellent problem-solving, communication, and collaboration skills.
Preferred Skills and Experience
- Experience with container technologies and modern packaging/deployment approaches.
- Familiarity with edge computing, embedded Linux, or real-time systems.
- Exposure to AI/ML inference systems, even from a platform or infrastructure perspective.
- Experience with heterogeneous computing (CPUs, GPUs, NPUs, DSPs).
- Background in robotics, vision systems, or physical AI applications.
- Contributions to open-source systems or developer tooling projects.
- Familiarity with security concepts such as secure boot, isolation, or attestation.
Why this role matters
Edge and physical AI systems impose outstanding requirements on software platforms. These platforms need to be secure, reliable, updatable, and easy for developers to use. They must also function within real-world limits not found in the cloud.
This role involves guiding the development and deployment of AI on Arm-powered devices used in real-world scenarios. You will help build platforms that unlock new application categories in robotics, industrial systems, and consumer technology. It offers a chance to create a strong impact on the future of AI!
Salary Range:
$209,100-$282,900 per year
We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.
Accommodations at Arm
At Arm, we want to build extraordinary teams. If you need an adjustment or an accommodation during the recruitment process, please email [email protected] . To note, by sending us the requested information, you consent to its use by Arm to arrange for appropriate accommodations. All accommodation or adjustment requests will be treated with confidentiality, and information concerning these requests will only be disclosed as necessary to provide the accommodation. Although this is not an exhaustive list, examples of support include breaks between interviews, having documents read aloud, or office accessibility. Please email us about anything we can do to accommodate you during the recruitment process.
Hybrid Working at Arm
Arm's approach to hybrid working is designed to create a working environment that supports both high performance and personal wellbeing. We believe in bringing people together face to face to enable us to work at pace, whilst recognizing the value of flexibility. Within that framework, we empower groups/teams to determine their own hybrid working patterns, depending on the work and the team's needs. Details of what this means for each role will be shared upon application. In some cases, the flexibility we can offer is limited by local legal, regulatory, tax, or other considerations, and where this is the case, we will collaborate with you to find the best solution. Please talk to us to find out more about what this could look like for you.
Equal Opportunities at Arm
Arm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues. We are a diverse organization of dedicated and innovative individuals, and don't discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Similar Jobs at Arm
Artificial Intelligence • Internet of Things • Semiconductor
The Developer Relations Engineer will aid developers in building hybrid edge to cloud systems, crafting reference architectures and advocating for SDK and tooling improvements.
Top Skills:
APIsCloud InfrastructureContainersKubernetesMicroservicesOn-Device Ml RuntimesServerless Architectures
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

