Nidus Technologies Logo

Nidus Technologies

Staff ML Engineer, VLA Training

Posted 18 Days Ago
In-Office
New York City, NY, USA
Senior level
In-Office
New York City, NY, USA
Senior level
Develop and scale vision-language-action models for robotic manipulation, owning dataset construction, training recipes, distributed GPU infrastructure, evaluation, and on-robot validation. Build reproducible ML pipelines, optimize multimodal data processing and model training, diagnose failures across data and robot behavior, and translate research into production-quality systems. Collaborate across research, robotics, hardware, data, and operations teams while mentoring engineers.
The summary above was generated by AI
About Us

Nidus is building autonomous manufacturing systems powered by AI and robotics. U.S. manufacturers are under growing pressure to increase output while navigating workforce constraints, underutilized equipment, and increasingly complex supply chains. We believe the next generation of manufacturing will be enabled by more intelligent, flexible automation—systems that help people and machines work together to expand capacity and improve productivity.

We're building the intelligence layer that makes that possible.

Our team comes from the intersection of defense technology and AI. We've built and shipped products to DoD customers, and we bring deep experience across ML, robotics, product development, and defense.

We're a small, in-person team in New York City working on hard problems that matter. If you want to build the future of American manufacturing, we'd love to hear from you.

About the role

We are building intelligent robots that can perceive the world, understand instructions, and perform useful physical tasks in dynamic, real-world environments.

We are looking for a Staff Machine Learning Engineer to develop and scale the vision-language-action models that power our robots. You will own major parts of the model development lifecycle—from dataset construction and training recipes to distributed training infrastructure, evaluation, and on-robot validation.

This is a hands-on role at the intersection of machine learning research, large-scale systems, and robotics. You will work closely with researchers, robotics engineers, data teams, and operators to turn new modeling ideas into reliable robot capabilities. The right person is equally comfortable investigating why a policy failed on a robot, designing the next training experiment, and improving the infrastructure required to run that experiment efficiently at scale.

What you’ll do
  • Train and improve vision-language-action models for robotic manipulation and other embodied tasks.

  • Develop model architectures and training recipes spanning imitation learning, behavior cloning, transformer- and diffusion-based policies, multimodal pretraining, and post-training.

  • Build scalable pipelines for pretraining, fine-tuning, evaluation, checkpointing, and model release.

  • Train models across multi-node GPU clusters while improving utilization, throughput, stability, and cost efficiency.

  • Design data mixtures, sampling strategies, augmentations, and curriculum approaches for large, heterogeneous robot datasets.

  • Develop data loaders and preprocessing systems for synchronized video, language, robot state, actions, and other sensor modalities.

  • Create reproducible experimentation systems, including configuration management, dataset and model versioning, experiment tracking, and automated regression testing.

  • Define offline and on-robot metrics that measure task success, generalization, robustness, latency, safety, and failure modes.

  • Build tools for inspecting trajectories, visualizing model behavior, comparing experiments, and diagnosing data or training failures.

  • Run structured experiments on physical robots and use the results to guide model, data, and infrastructure improvements.

  • Partner with data collection teams to identify coverage gaps, improve demonstration quality, and prioritize collection based on model performance.

  • Translate promising research into maintainable, production-quality systems that can support repeated deployment across robots and environments.

  • Make technical decisions across model architecture, data, compute, and evaluation, and communicate the associated tradeoffs clearly.

  • Mentor other engineers and establish strong engineering practices for the ML codebase.

What we’re looking for
  • Five or more years of professional experience in machine learning, robotics, computer vision, or a closely related field, or equivalent demonstrated impact.

  • Strong experience training modern deep learning models using PyTorch, JAX, or a comparable framework.

  • Experience with transformer-based models, multimodal models, generative models, or learned control policies.

  • Experience building and operating distributed training pipelines on multi-GPU or multi-node accelerator clusters.

  • Experience with large-scale datasets, high-throughput data loading, experiment tracking, and reproducible ML workflows.

  • Strong understanding of optimization, model architecture, data quality, evaluation methodology, and experimental design.

  • Ability to debug failures across the full stack, from input data and training dynamics to inference and robot behavior.

  • Experience independently owning technically ambiguous projects and delivering working systems.

  • Clear communication skills and an ability to collaborate across research, infrastructure, robotics, hardware, and operations teams.

  • A bachelor’s degree in computer science, machine learning, robotics, electrical engineering, or a related field—or equivalent practical experience.

Nice to have
  • Experience developing vision-language-action models, vision-language models, or robotics foundation models.

  • Experience with imitation learning, reinforcement learning, behavior cloning, diffusion policies, action tokenization, or action-conditioned world models.

  • Experience training policies using data from multiple robot embodiments, task domains, or sensor configurations.

  • Familiarity with large-scale pretraining, post-training, parameter-efficient fine-tuning, distillation, or model adaptation.

  • Experience optimizing distributed training using techniques such as FSDP, tensor or pipeline parallelism, mixed precision, gradient checkpointing, or sharded data loading.

  • Familiarity with robotics middleware and simulation environments such as ROS/ROS 2, MuJoCo, Isaac Sim, or Gazebo.

  • Experience deploying and evaluating learned policies on physical robotic systems.

  • Publications or meaningful open-source contributions in machine learning, robotics, computer vision, or related areas.


Nidus Technologies is an equal opportunity employer, and qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender perception or identity, national origin, age, marital status, protected veteran status, or disability status.

 

We encourage candidates from all backgrounds to apply, even if you don't feel like you're a perfect fit. If you're passionate about contributing to our mission, we'd love to hear from you!

Similar Jobs

29 Minutes Ago
In-Office or Remote
United States
160K-240K Annually
Senior level
160K-240K Annually
Senior level
Aerospace • Artificial Intelligence • Machine Learning • Robotics • Software • Defense Technology
Leads enterprise strategy and operational execution across aerospace, defense, AI, hardware, software, and international growth. Responsibilities include strategic planning, portfolio tradeoff analysis, market sizing, competitive analysis, financial modeling, capital allocation, business case development, KPI tracking, performance reviews, root-cause analysis, and cross-functional execution. The role requires influencing senior stakeholders and translating strategic priorities into measurable outcomes.
37 Minutes Ago
Remote or Hybrid
US
91K-128K Annually
Senior level
91K-128K Annually
Senior level
Information Technology
Sell hybrid infrastructure services and products through the full enterprise sales lifecycle. Develop account strategies, identify and qualify opportunities, build client and partner relationships, coordinate internal technical resources, manage pipelines and forecasts, meet revenue and profit targets, and provide consultative sales support. The role also includes mentoring entry-level Solutions Executives, participating in industry events, and maintaining expertise across multiple infrastructure solution areas.
Top Skills: Data ProtectionDatacenter NetworkingEnterprise NetworkingHyperconverged InfrastructureIbm PowerMainframeMainframe StorageSalesforceStorageWireless
39 Minutes Ago
Remote or Hybrid
45K-85K Annually
Junior
45K-85K Annually
Junior
Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Handle inbound calls and warm leads, assess customers’ insurance needs, recommend appropriate property and casualty coverage, and convert prospects into policyholders. Representatives receive paid training and licensing support, maintain sales and service standards, and work remotely on a schedule including one weekend day. The role requires strong communication, persuasion, organization, PC proficiency, and compliance with home-office internet requirements.
Top Skills: PcWired High-Speed Internet

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account