The role focuses on optimizing AI models for efficiency, involving GPU/CPU code profiling, high-performance programming, and developing performance tools.
About Luma AI
About the Role
Responsibilities
Experience
Luma's mission is to build multimodal AI to expand human imagination and capabilities. We believe that multimodality is critical for intelligence. To go beyond language models and build more aware, capable and useful systems, the next step function change will come from vision. So we are working on training and scaling up multimodal foundation models for systems that can see and understand, show and explain, and eventually interact with our world to effect change.
The Performance Optimization team at Luma is dedicated to maximizing the efficiency and performance of our AI models. Working closely with both research and engineering teams, this group ensures that our cutting-edge multimodal models can be trained efficiently and deployed at scale while maintaining the highest quality standards.
- Profile and optimize GPU/CPU/Accelerator code for maximum utilization and minimal latency
- Write high-performance PyTorch, Triton, CUDA, deferring to custom PyTorch operations if necessary
- Develop fused kernels and leverage tensor cores and modern hardware features for optimal hardware utilization on different hardware platforms
- Optimize model architectures and implementations for distributed multi-node production deployment
- Build performance monitoring and analysis tools and automation
- Research and implement cutting-edge optimization techniques for transformer model
- Expert-level proficiency in Triton/CUDA programming and GPU optimization
- Strong PyTorch skills
- Experience with PyTorch kernel development and custom operations
- Proficiency with profiling tools (NVIDIA Nsight, torch profiler, custom tooling)
- Deep understanding of transformer architectures and attention mechanisms
- (Preferred) Experience with compilers/exporters such as torch.compile, TensorRT, ONNX, XLA
- (Preferred) Experience optimizing inference workloads for latency and throughput
- (Preferred) Experience with Triton compiler and kernel fusion techniques
- (Preferred) Knowledge of warp-level intrinsics and advanced CUDA optimization
Your applications are reviewed by real people.
CompensationThe base pay range for this role is $187,500 – $395,000 per year.
Top Skills
Cuda
Nvidia Nsight
Onnx
PyTorch
Tensorrt
Torch Profiler
Triton
Xla
Similar Jobs
Healthtech • Information Technology • Software • Telehealth
As a Specialist in Customer Experience, you will provide exceptional service to healthcare providers, upsell features, and ensure a positive experience through various communication channels. You will maintain records and strive to make Zocdoc's services easy to use for providers.
Healthtech • Information Technology • Software • Telehealth
The Specialist, Customer Experience is responsible for delivering exceptional customer service to healthcare providers, upselling features, and ensuring a positive user experience across multiple communication channels.
Top Skills:
Customer Service Platforms
Healthtech • Information Technology • Software • Telehealth
As a Specialist in Customer Experience at Zocdoc, you'll provide exceptional service to healthcare providers, upsell features, resolve issues, and maintain accurate records. Your role involves various communication channels to ensure providers can access Zocdoc's platform effectively.
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
