Weekday, Inc. Logo

Weekday, Inc.

General Clinician (MD/DO) - HLS

Posted One Month Ago
Be an Early Applicant
Remote
Hiring Remotely in United States
150-150 Hourly
Junior
Remote
Hiring Remotely in United States
150-150 Hourly
Junior
Evaluate and improve clinical AI systems through grading-criteria development, dialogue evaluation, clinical reasoning annotation, output review, guideline authoring, and difficult-case writing. The role requires physicians to assess accuracy, safety, completeness, clinical reasoning, and escalation guidance without providing direct patient care. Work is assigned across shared clinical AI workstreams and requires at least 20 hours weekly.
The summary above was generated by AI

This role is for one of our clients

Compensation: $150 per hour

We are hiring residency-trained physicians across specialties for non-clinical work developing and evaluating clinical AI systems. You will apply your clinical judgment to grading-criteria development, dialogue evaluation, and structured annotation work that determines how these systems are measured.

This is a non-clinical role — no direct patient care, and no responsibility for live diagnosis.

This is a shared expert pool. After onboarding you may be matched to any of several concurrent clinical workstreams based on your specialty, availability, and interest. You are not committing to a single project, and you may move between streams as priorities shift.


Requirements

What you may work on

Work varies by workstream and may include:

  • Grading criteria development — taking a clinical question and breaking the ideal answer into discrete, checkable criteria, so a model response can be graded consistently rather than impressionistically.
  • Clinical dialogue evaluation — reviewing multi-turn clinical conversations and judging them for accuracy, safety, completeness, appropriate hedging, and whether escalation advice was correct.
  • Clinical reasoning annotation — recording how you would work through a case, including the differential you considered and rejected, not only the conclusion.
  • Output review — flagging hallucinated findings, dangerous omissions, unsupported certainty, and advice that is technically correct but clinically unsafe.
  • Guideline authoring — defining edge cases and standards of care for your specialty so annotation stays consistent across a large group of clinicians.
  • Difficult-case writing — constructing clinical questions that probe the limits of current model reasoning.

Task length varies by stream, from roughly 45 minutes for a dialogue evaluation up to an hour or more for grading-criteria authoring. You will get a specific throughput target for whichever stream you are matched to.

Required qualifications

  • MD or DO with a completed residency in any specialty
  • Active, unrestricted medical license in your country of practice
  • 2+ years post-residency clinical experience, practising or previously practising
  • Comfort writing structured clinical rationale that a non-specialist reviewer can follow
  • Written and spoken English fluency
  • Minimum 20 hours per week, with the ability to concentrate hours when a stream is time-boxed

Preferred qualifications

  • Board certification in your specialty
  • U.S. licensure, and familiarity with U.S. standards of care and clinical guidelines
  • Primary care, internal medicine, emergency medicine, or hospitalist background, where breadth of presentation matters most
  • Prior clinical annotation, AI evaluation, medical education, or question-writing experience
  • Grading-criteria design, resident assessment, or clinical guideline development experience
  • Published research or sustained technical writing (please link a sample)

Why this work

Most clinical AI failures are not exotic — they are ordinary questions answered with misplaced confidence. Catching that requires someone who has actually carried clinical responsibility. The standard these systems get held to is written by physicians, and here you would be writing it.

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

Similar Jobs

3 Minutes Ago
In-Office or Remote
United States
43K-58K Annually
Mid level
43K-58K Annually
Mid level
Big Data • Information Technology • Software • Analytics • Energy
Handles incoming owner-relations calls involving revenue, land, division orders, joint interest billing, accounts receivable, and accounts payable. Logs and follows up on inquiries, resolves customer issues, builds client trust, manages difficult interactions professionally, and provides accurate, timely responses by phone and email. The role also involves cross-training and collaboration to improve customer experience and business operations.
Top Skills: Case Tracking SystemMS OfficeOil And Gas Software Programs
2 Hours Ago
Remote or Hybrid
United States
75K-75K Annually
Senior level
75K-75K Annually
Senior level
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Manages strategic partnerships with benefits technology firms to drive sales growth, market expansion, partner enablement, data integration, and go-to-market initiatives. Owns partner relationships, develops joint business plans, coordinates cross-functional teams, manages pipeline development, and tracks performance metrics. Requires experience in group benefits or insurance distribution, benefits administration platforms, relationship management, and strategic stakeholder influence.
Top Skills: AIAPIsBenefits Administration PlatformsHcm SystemsPayroll Systems
2 Hours Ago
Remote or Hybrid
United States
100K-130K Annually
Senior level
100K-130K Annually
Senior level
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Leads operational risk management activities supporting Mexico and South America within MetLife’s Global Customer Service & Operations organization. Maintains risk and control data in OpenPages, performs non-financial risk assessments and control environment reviews, supports issue and control-metric identification, evaluates AI opportunities, and produces executive and detailed risk reporting. The role partners with regional stakeholders, Global Risk Management, Internal Audit, and Compliance while requiring fluent Spanish and English.
Top Skills: Microsoft CopilotExcelMicrosoft PowerpointMicrosoft VisioOpenpages

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account