Build and operate the infrastructure for Ornn Fabric across heterogeneous GPU clusters and datacenters. Design and implement provisioning, scheduling, isolation, monitoring, and node management systems. Build infrastructure software (Rust, Python), operate Kubernetes and Slurm, debug across stack layers (Linux, networking, storage, virtualization, GPUs), and automate lifecycle management to ensure predictable reliability and observability.
Senior Engineer, Infrastructure Services
About Ornn
About the Role
What You'll Do
What We're Looking For
Nice-to-Haves
Why This Role Matters
Compensation and Benefits
Equal Opportunity Statement
Ornn is building the financial infrastructure for AI compute. Our price indices are live on Bloomberg Terminal. We structure and trade compute hedging instruments. And we're now building a platform that brings exchange-grade mechanics like order management, matching, scheduling, and settlement to how compute capacity gets reserved and allocated. We're a lean team in New York, backed by leading venture and strategic investors.
You would be one of the first infrastructure engineers responsible for the systems underneath Ornn Fabric. Fabric spans heterogeneous GPU clusters, datacenter infrastructure, schedulers, virtualization, networking, and the control plane that makes physical compute capacity available as a reliable financial product.
This is not a traditional cloud infrastructure role. You will work across Linux hosts, Kubernetes and Slurm clusters, containers and VMs, bare-metal provisioning, node management, networking, storage, and distributed control systems.
You will work directly with our Head of Engineering and have significant ownership over how Ornn operates infrastructure across multiple datacenters and compute providers. Expect to debug failures across the entire stack, from a process inside a container down to the physical node it is running on.
- Build and operate the infrastructure layer powering Ornn Fabric across heterogeneous GPU clusters and datacenters.
- Design systems for provisioning, scheduling, isolating, monitoring, and managing compute across bare-metal, containerized, and virtualized environments.
- Build infrastructure software in Rust and Python for node management, orchestration, telemetry, networking, and cluster operations.
- Operate and extend Kubernetes and Slurm environments, including technologies such as RKE2, Slinky, container runtimes, and GPU scheduling.
- Design secure multi-tenant compute environments using containers, VMs, hypervisors, Kata Containers, device passthrough, virtio, and related isolation technologies.
- Debug complex failures across Linux, networking, storage, schedulers, virtualization, GPUs, and distributed systems.
- Build systems for collecting and querying infrastructure state, telemetry, inventory, health, and utilization data.
- Automate infrastructure deployment and lifecycle management across clusters rather than relying on one-off operational procedures.
- Make reliability a feature: design systems that degrade predictably, recover automatically, and expose enough information to understand failures when they occur.
- Strong Linux systems knowledge. You are comfortable debugging processes, networking, memory, filesystems, devices, permissions, namespaces, cgroups, and system-level performance issues.
- Strong Rust knowledge and experience building production systems software.
- Working knowledge of SQL and experience designing or interacting with data-intensive backend systems.
- Experience operating containerized and virtualized workloads in production.
- Deep familiarity with Kubernetes and/or Slurm and the systems surrounding them. Experience with technologies such as RKE2, Slinky, Docker/containerd, Kata Containers, or similar infrastructure is strongly preferred.
- Understanding of virtualization fundamentals including hypervisors, KVM/QEMU-style architectures, virtio, device passthrough, and workload isolation.
- Strong understanding of distributed systems, including failure handling, coordination, state management, idempotency, consistency, and observability.
- Comfort working across abstraction boundaries. You should be willing to debug an application, kernel interaction, network path, scheduler, hypervisor, or physical server depending on where the problem actually is.
- Ability to operate independently in a lean engineering team and own systems from design through production.
- BS, MS, or equivalent experience in computer science, computer engineering, electrical engineering, or a related technical field.
- Experience deploying or operating infrastructure inside datacenters, particularly large GPU or HPC clusters.
- Knowledge of modern GPU architecture, including CUDA execution, GPU memory, kernels, PCIe, NVLink, RDMA, GPUDirect, and multi-GPU communication.
- Experience debugging GPU workloads and performance at the kernel, runtime, or communication layer.
- Understanding of server management and node tenancy architectures, including BMCs, IPMI, Redfish, iDRAC/iLO, out-of-band management networks, and secure tenant access.
- Experience with high-performance networking such as InfiniBand, RoCE, RDMA, BGP, ECMP, or high-bandwidth Ethernet fabrics.
- Experience with distributed storage systems such as Ceph, WEKA, or other high-performance storage architectures.
- Experience building infrastructure for cloud providers, neoclouds, HPC environments, exchanges, or other systems where downtime and incorrect state have direct financial consequences.
Ornn Fabric ultimately turns physical compute infrastructure into something that can be scheduled, reserved, financed, and traded reliably.
That abstraction only works if the underlying machines can actually be provisioned, isolated, monitored, recovered, and delivered as promised. A failed node, broken network path, scheduler inconsistency, or tenancy issue is not merely an infrastructure problem when contractual capacity commitments depend on the system being correct.
The infrastructure layer is therefore foundational to everything Ornn is building. The systems you build will determine how reliably Fabric can onboard new datacenters, expose capacity to customers, and scale from individual clusters to a distributed compute market.
Benefits include competitive salary, meaningful equity, health coverage, free meals, and additional benefits. This is a high-ownership engineering role with significant influence over Ornn's infrastructure architecture and technical direction.
Ornn is committed to building a diverse team. We evaluate candidates based on their ability to do the work, not on pedigree or background. We encourage applications from people of all backgrounds and experiences.
Similar Jobs
Big Data • Information Technology • Productivity • Software • Analytics • Business Intelligence • Consulting
Lead AI- and data-driven business transformations for Life Sciences customers using the Celonis Platform. Own value realization from discovery through ROI, manage executive stakeholders, facilitate business value workshops, and oversee global transformation programs. Develop account strategies, CoE roadmaps, adoption plans, and AI-assisted project management processes while partnering with sales and technical teams. Apply expertise across supply chain, finance, commercial, and clinical R&D domains to deliver measurable process improvements.
Top Skills:
Artificial IntelligenceCelonis PlatformOracleProcess Intelligence GraphProcess MiningSalesforceSAPWorkday
Artificial Intelligence • Cloud • Security • Software • Cybersecurity
Partners with strategic customers to architect, prototype, implement, and migrate feature flag systems across complex technology environments. Writes production code in customer codebases, supports pre- and post-sales delivery, resolves technical risks, and collaborates with Sales, Solutions, Product, and Engineering. The role drives successful migrations, customer adoption, and product improvements while simplifying complex technical decisions for technical and nontechnical stakeholders.
Top Skills:
Configuration Management SystemsDatadog Feature FlagsExperimentation PlatformsFeature Flagging Systems
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Leads global Sales operations, including budget management, dashboards, KPI tracking, executive special projects, organizational development, communications, annual planning, and cross-functional alignment. Partners with sales and company leadership to drive operational excellence, consistent priorities, strategic execution, team culture, and measurable business outcomes in a dynamic global environment.
Top Skills:
AIServicenow
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
