Protege Logo

Protege

Senior Researcher - Diffusion and Vision Research

Posted 7 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in USA
Senior level
Remote
Hiring Remotely in USA
Senior level
Seeking a Senior Researcher to evaluate and optimize video datasets for training generative video models, ensuring data quality and effectiveness through analysis and characterization.
The summary above was generated by AI

Company Overview:

We are building Protege to solve the biggest unmet need in AI — getting access to the right training data. The process today is time intensive, incredibly expensive, and often ends in failure. The Protege platform facilitates the secure, efficient, and privacy-centric exchange of AI training data.

Solving AI’s data problem is a generational opportunity. We’re backed by world-class investors and already powering partnerships with some of the most ambitious teams in AI. The company that succeeds will be one of the largest in AI — and in tech.

We’re a lean, fast-moving, high-trust team of builders who are obsessed with velocity and impact. Our culture is built for people who thrive on ambiguity, own outcomes, and want to shape the future of data and AI.

Role Overview

Data is the foundation of AI performance, and we believe model quality starts with data quality. For video and multimodal models in particular, the bar for data precision, coverage, and curation is even higher.

We’re seeking a Senior Researcher focused on Diffusion Models or Vision Models to lead the evaluation and optimization of large-scale datasets used to train generative video models. You will be responsible for building the systems, processes, and standards that ensure Protege’s video data is diverse, representative, high-impact, and ready for production-grade training. You’ll run targeted evaluations, characterizing our video assets, and creating the technical artifacts (metrics, benchmarks, internal scorecards) that define, measure, and communicate the value of our video data assets.

This is an ideal role for someone who is deeply obsessed with video data quality and understanding, comfortable operating in both strategic and hands-on modes, and excited to help Protege become the ubiquitous platform for video training data.

Key Responsibilities

  • Video dataset characterization and metrics: Analyze and summarize Protege’s video catalog and maintain clear, up-to-date data scorecards and metrics for key datasets

  • Model and data evaluation: Design and run targeted evaluations of video models, connect failures to concrete data gaps, and test which data changes actually improve model performance

  • Benchmark and slice design: Define and maintain eval sets and slices that reflect real-world video use cases and stress-test models in meaningful ways

  • External researcher engagement: Build and maintain relationships with external researchers and labs to surface emerging video data needs and model pain points

About You

  • PhD or equivalent Master’s degree + 4+ years industry experience in machine learning, computer science, statistics, engineering, or a related quantitative field, with a focus on diffusion models or video data

  • Proven experience designing and running model evaluations and data analyses (benchmarks, ablations, slice‑based analyses)

  • Ability to understand data impact on models at various stages of the training stack.

  • Excellent written and verbal communicator; able to write concise technical docs and explain empirical results clearly

  • High ownership and bias toward action; you independently scope questions, design experiments, and drive them to decisions

Bonus if you have these attributes

  • Publications or open-source contributions in data-centric AI or related areas

  • Experience developing evaluation frameworks or performance metrics for training data

  • Cross-functional collaboration with product, infrastructure, or partnership teams

  • Prior work on video generation or understanding models and their datasets or benchmarks

  • Experience collaborating with industry or academic labs on video research or data projects

Protege Values

  1. We pass the loved ones' test — integrity isn't negotiable, even when it's costly

  2. We always find a way — obstacles are expected, giving up isn't

  3. We go fast and grow fast — velocity is a competitive advantage and we treat it that way

  4. We practice kindness and candor — hard conversations happen here, and they happen with care

  5. We deliver together — no silos, no lone heroes, no passengers

  6. We own the outcome — full accountability, continuous improvement, mastery over time

Protege New York, New York, USA Office

New York, New York, United States

Similar Jobs

15 Minutes Ago
Easy Apply
Remote or Hybrid
Easy Apply
Junior
Junior
Beauty • Enterprise Web • Fintech • Payments • Software
GlossGenius seeks Software Engineers of all levels to develop scalable web applications and AI features that support small businesses. Responsibilities include enhancing user experiences, building robust back-end systems, and contributing to a microservice-based infrastructure.
Top Skills: AWSGrpcJavaScriptKotlinKubernetesPostgresProtobufReactReact NativeRubyTerraformTypescript
15 Minutes Ago
Easy Apply
Remote or Hybrid
Easy Apply
Senior level
Senior level
Beauty • Enterprise Web • Fintech • Payments • Software
As a Staff Frontend Engineer, you will architect scalable frontend components, lead technical direction, enhance web performance, and improve developer workflows while championing AI tools.
Top Skills: Ai-Assisted Development ToolsCss-In-JsGithub CopilotJavaScriptReactTypescript
16 Minutes Ago
Remote or Hybrid
Senior level
Senior level
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
The Tax Manager will oversee tax consulting for partnerships, manage client engagements, mentor staff, and ensure compliance with tax regulations.
Top Skills: Tax-Related Software

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account