The Lead Infrastructure and Reliability Engineer will enhance GPU operations, define scalability strategies, and develop organizational strengths in a high-demand AI infrastructure setting.
About Luma AI
Where You Come In
What You’ll OwnReliability of the Frontier
Scaling Training & Inference
Building the Organization
Who You AreRequired:
Leadership Expectations
Why This Role Is Special
A new class of intelligence is emerging, systems that understand and generate the world across video, images, audio, and language.
Building multimodal AGI is not just a modeling challenge. It is an infrastructure challenge at the edge of what hardware, software, and organizations can support.
At Luma, we operate rapidly scaling 10k+ GPU fleets, pushing utilization, throughput, and reliability hard enough that yesterday’s solutions break regularly. Researchers depend on this infrastructure to move the frontier forward. Customers depend on it to power real creative work.
Many companies run accelerators. Very few sit directly next to the teams inventing the models that redefine what those accelerators must do.
At Luma, improvements to scheduling, efficiency, and reliability immediately translate into faster research iteration and entirely new product capabilities.
We are still early. The playbook is still being written. A single exceptional engineer can reshape how the company operates.
Our Infrastructure Engineering team is a systems engineering group with company-level responsibility. At Luma, reliability engineers work directly with the researchers and products pushing the limits of multimodal intelligence.
We operate close to the metal:
- Kernels
- Containers
- Schedulers
- Networking
- Storage
- GPU behavior
But we are also responsible for something bigger:
Turning deep systems knowledge into repeatable, scalable reliability for the entire company. We are hiring a leader who will define that direction. You will be a technical authority, an organizational force multiplier, and a magnet for other great engineers.
- Architect and operate large, heterogeneous GPU environments under extreme demand
- Improve utilization and performance where small gains materially change company outcomes
- Resolve failures that span hardware, OS, runtimes, and orchestration
- Eliminate entire classes of instability
- Build mechanisms that make heroics unnecessary
- Define how infrastructure and workloads evolve as cluster size and concurrency grow
- Design scheduling, placement, and resource management approaches for increasingly complex jobs
- Work directly with research to build the systems required for new model capabilities
- Ensure inference platforms scale rapidly without sacrificing reliability or latency
- Anticipate where today’s abstractions will fail and redesign ahead of them
- Hire and develop exceptional systems and reliability engineers
- Set the bar for technical depth, judgment, and production ownership
- Shape architecture early through strong partnerships with research and product
- Translate reliability constraints into long-term platform strategy
- Deep expertise in Linux and distributed systems
- Experience operating GPU / accelerator clusters in real production environments
- Strong fluency in Kubernetes and modern open-source infrastructure
- Comfortable debugging across hardware → kernel → runtime → orchestration
- You understand how systems behave under contention and at scale
- You write code and build automation
- You think in bottlenecks, failure modes, and tradeoffs
- Engineers trust your judgment, especially when things break
Important: This role requires comfort operating close to upstream and close to the metal. If most of your experience has been inside highly abstracted internal platforms where others owned the underlying machinery, this is unlikely to be a match.
Leadership Expectations
- You raise reliability standards across the company
- You influence product and research architecture early
- You build strong partnerships, not ticket queues
- You attract and level up exceptional engineers
- You are curious how models use infrastructure, because improving systems expands what becomes possible
Most infrastructure roles optimize mature systems. This one helps define how reliability works for a new generation of AI infrastructure.
The decisions you make here will influence:
- How research progresses
- How products scale
- How customers trust us
- And how the engineering organization grows
If you want to build the reliability foundations of a company operating at the technological frontier, we should talk.
CompensationThe base pay range for this role is $230,000 – $360,000 per year.
About LumaLuma’s mission is to build unified general intelligence that can generate, understand, and operate in the physical world.
We believe that multimodality is critical for intelligence. To go beyond language models and build more aware, capable and useful systems, the next step function change will come from vision. So, we are working on training and scaling up multimodal foundation models for systems that can see and understand, show and explain, and eventually interact with our world to effect change.
Similar Jobs
Artificial Intelligence • Fintech • Information Technology • Marketing Tech • Payments • Social Impact • Software
Leads and builds Donorbox’s product marketing function, owning positioning, messaging, product-led growth, launches, enablement, competitive intelligence, and performance measurement. Partners with Product, Sales, Customer Success, and Marketing to drive acquisition, conversion, retention, and expansion. Manages one direct report, establishes scalable processes and KPIs, influences roadmap priorities, and presents data-driven insights to executive leadership.
Top Skills:
Product-Led Growth (Plg)SaaS
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Le Security Champion dirige la sécurité logicielle et la conformité des programmes SSC. Il accompagne les évaluations de conformité, gère les risques, vulnérabilités et plans de remédiation, développe des normes de sécurité et représente l’équipe dans des forums spécialisés. Le rôle exige également du leadership technique, du mentorat, la connaissance des risques liés à l’IA et la capacité à conduire des changements technologiques et culturels dans un environnement R&D complexe.
Top Skills:
Cloud SecurityCveGenerative AiMachine LearningPrompt InjectionPsirt
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Build and operate end-to-end full-stack features for Loom billing, subscriptions, integrations, and platform migrations. Develop responsive React interfaces, scalable backend APIs and microservices, payment and identity integrations, and reliable cloud-based systems. Responsibilities include observability, monitoring, testing, code reviews, documentation, security, performance optimization, and participation in Agile ceremonies and technical design reviews.
Top Skills:
AWSBitbucketCi/CdConfluenceCypressDockerGitJavaJavaScriptJestJIRAMicroservicesMochaMySQLNode.jsPostgresPythonReactRest ApisTypescript
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
