Protege Logo

Protege

Human Data Project Lead

Posted Yesterday
Be an Early Applicant
In-Office
New York, NY, USA
Junior
In-Office
New York, NY, USA
Junior
Own human data projects from scoping through delivery, including task design, piloting, staffing annotators and vendors, calibration, quality control, budget and timeline tracking, and stakeholder reporting. The role handles sensitive healthcare data, identifies operational issues early, manages vendor performance, and improves project processes. It requires strong analytical and communication skills, comfort with coding tools, and direct collaboration with researchers and external partners.
The summary above was generated by AI

Company Overview:

We are building Protege to solve the biggest unmet need in AI — getting access to the right training data. The process today is time intensive, incredibly expensive, and often ends in failure. The Protege platform facilitates the secure, efficient, and privacy-centric exchange of AI training data.

Solving AI’s data problem is a generational opportunity. We’re backed by world-class investors and already powering partnerships with some of the most ambitious teams in AI. The company that succeeds will be one of the largest in AI — and in tech.

We’re a lean, fast-moving, high-trust team of builders who are obsessed with velocity and impact. Our culture is built for people who thrive on ambiguity, own outcomes, and want to shape the future of data and AI.

About the team

The Human Data team produces the human judgments that make AI training data trustworthy. That includes annotating data, verifying model output, and the human review that makes healthcare data safe to use. We work with an in-house team of annotators and a network of partners ranging from annotation platforms to practicing physicians. Our work feeds the research teams building AI evaluations and training environments, and the AI labs that license our data.

About the role

You'll own human data projects from start to finish. A project might be 800 scanned medical documents reviewed by five annotators over three weeks, or thousands of physician ratings on model output for a research team. You scope it with the team that needs it, design and test the task, staff it, keep it on schedule and on budget, catch quality problems before they spread, and deliver results the customer can trust. This role is built for someone early in their career who wants to own outcomes quickly, and who is as comfortable in a spreadsheet as in a room with researchers.

What You'll Do
  • Own human data projects end to end: scope them with the requesting team, set timelines and budgets, and deliver on them.

  • Design tasks and instructions with the requesting team, and pilot them on a small batch before anything scales.

  • Staff projects across our in-house annotators and partner vendors, and manage those vendor relationships day to day.

  • Run calibration before production. Every annotator passes a known-answer test before their work counts, and anyone who doesn't gets feedback and a retry.

  • Track throughput, cost and quality by annotator and vendor, and report progress to leadership every week.

  • Catch problems early (an annotator drifting, a vendor slipping, an instruction that isn't working) and fix them before they reach the customer.

  • Handle sensitive data, including protected health information, under strict security procedures.

  • Travel on short notice when a project needs someone on site.

  • Make every project easier to run than the last one.

What Success Looks Like
  • 30 days: learn the machine. You've shadowed a live project, taken over its roster and returns intake, and met each of our annotation partners.

  • 60 days: own a project. You've taken one project from scoping to delivery on your own, and every open project is tracked in one place.

  • 90 days: own the portfolio. You're running two to three projects at once, you've scoped a new one directly with a requesting team, and you've delivered our first cost-and-quality comparison across vendors.

What You Bring

Must have

  • One to three years in consulting, finance, a startup, or another operationally intense environment where you owned complex projects with real stakes. Strong new grads with that kind of experience are welcome.

  • Strong analytical skills, with instincts for statistics

  • Comfort and experience with agentic coding/work tools, willingness to learn new ones

  • Comfort working directly with demanding stakeholders, including researchers and outside partners.

  • The judgment to notice when something is off and the instinct to raise it early rather than guess.

  • Clear, fast written communication.

  • Authorization to work in the U.S. as a W2 employee (required for access to protected health information).

Nice to have

  • Experience running data annotation, labeling or AI training data projects

  • Healthcare, clinical research or HIPAA-regulated work

  • Experience managing contractors, vendors or freelancers

  • Python or SQL

Protege Values

Pass the Loved Ones' Test. We act with integrity and do the right thing — especially when it's hard and no one is watching.

Always Find a Way. We are resourceful, resilient builders who solve hard problems and push through obstacles.

Go Fast and Grow Fast. Velocity matters. We move with urgency, learn quickly, and continuously improve as individuals and as a company.

Practice Kindness and Candor. We communicate directly and respectfully, building trust through honest feedback and genuine care for one another.

Deliver Together. We win as one team. Collaboration, accountability, and shared ownership drive our success.

Own the Outcome. Hone the Craft. We take pride in our work, sweat the details, and continuously raise the bar for excellence.

How this role lives the values: the loved ones' test is literal here, since this person handles patients' health information every day, and the whole job is owning the outcome.

Protege New York, New York, USA Office

New York, New York, United States

Similar Jobs

37 Minutes Ago
Remote or Hybrid
2 Locations
75K-115K Annually
Junior
75K-115K Annually
Junior
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Works with account managers to expand customer relationships by leading cybersecurity technical discussions, presentations, demonstrations, and Proof of Value engagements. Explains platform capabilities, competitive differentiation, and security technologies to technical and executive audiences. Requires knowledge of endpoint security, threat intelligence, vulnerability management, cloud platforms, identity systems, scripting, virtualization, and AI/ML security applications. The role is fully remote within the United States, with travel as required.
Top Skills: Active DirectoryAi SecurityAi/MlAvAWSAzureBashCisa KevCvssDigital ForensicsEdrEntra IdGCPIncident ResponseLinuxmacOSMdrPamPowershellPythonSIEMSsoThreat IntelligenceVdiVirtualizationVulnerability ManagementWindows
49 Minutes Ago
Hybrid
New York City, NY, United States
200K-210K Annually
Mid level
200K-210K Annually
Mid level
Artificial Intelligence • Information Technology
Own the full sales cycle for midmarket API and web app customers, from discovery through closing. Build pipeline through outbound and inbound opportunities, use MEDDPICC to qualify deals, manage strategic accounts, and maintain accurate HubSpot activity. Collaborate with BDR, Marketing, Product, and ML teams while helping develop sales processes and playbooks. Travel to strategic customers as needed.
Top Skills: APIsHubspot
Yesterday
Hybrid
New York, NY, USA
230K-317K Annually
Entry level
230K-317K Annually
Entry level
Cloud • Information Technology • Security • Software • Cybersecurity
Lead and grow Cloudflare’s models team responsible for model integrations, launches, catalog accuracy, pricing, reliability, evaluations, rankings, auto-routing, and provider coordination. Build automation and agent workflows, monitor model health, detect regressions, and turn Gateway traffic data into trusted recommendations. The role combines people management, technical execution, product judgment, operational scalability, and hands-on debugging across AI model providers.
Top Skills: Ai GatewayCloudflare WorkersCurlPythonReplicateRustTypescriptWorkers Ai

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account