Luma AI
Research Scientist / Engineer - Controllability, Personalization & Productization
Be an Early Applicant
The role focuses on refining Luma's foundation models for better controllability and personalization while collaborating across research, product, and design teams.
About the Role
What You’ll Do
Who You Are
Bonus Points
This is a foundational opportunity to refine, personalize, and build the final capabilities and control interface of Luma’s foundation models and drive real-world value.
You’ll sit at the intersection of research, product, and partnerships, helping close the gap between generalist capability and production needs. Your mission is to make our video foundation models more expressive, controllable, and personalized – solving the “last mile” challenges demanded by top-tier creative workflows.
You will work as a fullstack researcher across modeling, data, systems, and evaluation to translate foundational capabilities into the personalized and high-fidelity tools required by top-tier creative production.
- Controllability and Features: You will use SFT, RL, distillation, and adapter-based methods to give Luma’s models precise control and creative capabilities for high-fidelity, partner-grade workflows.
- Personalization: You will use context management, PEFT, and preference learning to embed domain expertise and long-horizon memory into our models. You’ll ground our data engine in real-world workflows, translating usage into training and data insights that shape future models.
- End-User Quality: You will define and drive end-user quality – setting success metrics, building user-aligned evaluations, and iterating on the model/data/evals loop to meet strict fidelity and reliability targets in specific verticals.
- Cross-functional Collaboration: You will partner with Product and Design to turn creative intent and user feedback into clear specs and shippable model behaviors, delivering intuitive control and dependable capabilities for users and partners.
Who You Are
- Strong foundation in machine learning with deep experience in visual generative models (diffusion/transformers or related architectures). Ideal candidates also have a deep understanding of at least one: fine-tuning, personalization, domain adaptation, data curation, targeted distillation, interpretability, or human-feedback-driven refinement.
- You are a product-obsessed researcher/engineer. You treat end users and partners as collaborators and enjoy solving specific “last mile” problems – not just optimizing public metrics.
- Hands-on experience with PyTorch and large model training.
- Contributions to state-of-the-art models in image/video generation.
- Experience collaborating with creative partners (VFX, animation, film, design tools).
- Track record building workflows/tools that materially improve iteration speed and evaluation rigor.
- Familiarity with large-scale training infrastructure and distributed systems (Ray, Slurm, Kubernetes).
The base pay range for this role is $200,000 – $450,000 per year.
About LumaLuma’s mission is to build unified general intelligence that can generate, understand, and operate in the physical world.
We believe that multimodality is critical for intelligence. To go beyond language models and build more aware, capable and useful systems, the next step function change will come from vision. So, we are working on training and scaling up multimodal foundation models for systems that can see and understand, show and explain, and eventually interact with our world to effect change.
Similar Jobs
Artificial Intelligence • Fintech • Information Technology • Marketing Tech • Payments • Social Impact • Software
Leads and builds Donorbox’s product marketing function, owning positioning, messaging, product-led growth, launches, enablement, competitive intelligence, and performance measurement. Partners with Product, Sales, Customer Success, and Marketing to drive acquisition, conversion, retention, and expansion. Manages one direct report, establishes scalable processes and KPIs, influences roadmap priorities, and presents data-driven insights to executive leadership.
Top Skills:
Product-Led Growth (Plg)SaaS
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Le Security Champion dirige la sécurité logicielle et la conformité des programmes SSC. Il accompagne les évaluations de conformité, gère les risques, vulnérabilités et plans de remédiation, développe des normes de sécurité et représente l’équipe dans des forums spécialisés. Le rôle exige également du leadership technique, du mentorat, la connaissance des risques liés à l’IA et la capacité à conduire des changements technologiques et culturels dans un environnement R&D complexe.
Top Skills:
Cloud SecurityCveGenerative AiMachine LearningPrompt InjectionPsirt
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Build and operate end-to-end full-stack features for Loom billing, subscriptions, integrations, and platform migrations. Develop responsive React interfaces, scalable backend APIs and microservices, payment and identity integrations, and reliable cloud-based systems. Responsibilities include observability, monitoring, testing, code reviews, documentation, security, performance optimization, and participation in Agile ceremonies and technical design reviews.
Top Skills:
AWSBitbucketCi/CdConfluenceCypressDockerGitJavaJavaScriptJestJIRAMicroservicesMochaMySQLNode.jsPostgresPythonReactRest ApisTypescript
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
