Harvey Logo

Harvey

Engineering Manager, AI Quality

Reposted 12 Hours Ago
Be an Early Applicant
Hybrid
New York, NY, USA
260K-330K Annually
Senior level
Hybrid
New York, NY, USA
260K-330K Annually
Senior level
Drive AI and quality improvements at Harvey by establishing evaluation processes, building reusable AI building blocks, and collaborating with product teams.
The summary above was generated by AI
Why Harvey

At Harvey, we’re transforming how legal and professional services operate — not incrementally, but end-to-end. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re reshaping how critical knowledge work gets done for decades to come.

This is a rare chance to help build a generational company at a true inflection point. With 1000+ customers in 60+ countries, strong product-market fit, and world-class investor support, we’re scaling fast and defining a new category in real time. The work is ambitious, the bar is high, and the opportunity for growth — personal, professional, and financial — is unmatched.

Our team is sharp, motivated, and deeply committed to the mission. We move fast, operate with intensity, and take real ownership of the problems we tackle — from early thinking to long-term outcomes. We stay close to our customers — from leadership to engineers — and work together to solve real problems with urgency and care. If you thrive in ambiguity, push for excellence, and want to help shape the future of work alongside others who raise the bar, we invite you to build with us.

At Harvey, the future of professional services is being written today — and we’re just getting started.

Role Overview

The quality of Harvey’s AI & Search systems is of critical importance. Our customers expect us to produce accurate, specific, verifiable and personalized results across all of our product surfaces. They also expect the quality of our answers to continuously get benchmarked and improved.

In this role, you will drive overall AI & results quality across all of Harvey’s products (Assistant, Harvey Word, Vault, Workflows & Agents, and net new products). This includes establishing the right evaluation processes and tools, creating and evangelizing reusable AI building blocks, and working closely with all product teams to continuously improve the quality of Harvey’s AI outputs. You will be responsible for building out tools and processes and for establishing a strong culture of scientific experimentation, rigorous evaluation, and iterative improvements.

What You'll Do
  • Establish an AI & Results Quality Program at Harvey: Establish offline and online eval processes and tools, and a culture of continuous iteration and experimentation.

  • Build out core AI quality building blocks that can be reused across different teams and surface areas.

  • Own search & retrieval quality, both for AI applications as well as other use cases.

  • Work closely with product engineering to continuously improve the quality and capabilities of our AI & search products.

  • Work closely with platform engineering to scale our capabilities.

What You Have
  • Significant industry experience leading AI or other related quality efforts (search or ads ranking systems, recommender systems, etc) at industry-leading companies.

  • Excellent software engineering skills; experience working in teams that built and operated production systems

  • Excellent communication skills, both written and verbal.

  • Ability to roll up your sleeves and build team, processes, and technology from the ground up.

  • A strong academic or professional background in Machine Learning, Generative AI, Information Retrieval or other related fields.

Compensation Range

$260,000 - $330,000 USD

#LI-ML1

Harvey is an equal opportunity employer and does not discriminate on the basis of race, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition, or any other basis protected by law.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made by emailing [email protected]

Top Skills

Generative Ai
Information Retrieval
Machine Learning
Software Engineering

Harvey New York, New York, USA Office

New York, New York, United States, 10010

Similar Jobs

7 Minutes Ago
Easy Apply
Remote or Hybrid
United States
Easy Apply
102K-154K Annually
Senior level
102K-154K Annually
Senior level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
The Senior Program Manager will drive AI program delivery, work with cross-functional teams, manage projects, and support AI initiatives in sales.
Top Skills: Ai-Related TechnologiesDatabricksGongNetSuitePythonSalesforce
28 Minutes Ago
Remote or Hybrid
United States
119K-140K Annually
Senior level
119K-140K Annually
Senior level
Cloud • Fintech • Information Technology • Machine Learning • Software • App development • Generative AI
The SAP Account Executive at BlackLine is responsible for managing the sales process from prospecting to closing, targeting C-level executives in large corporations to sell SaaS solutions. This role requires building relationships, generating revenue, and achieving sales targets.
Top Skills: Saas SoftwareSalesforce
33 Minutes Ago
In-Office
New York, NY, USA
150K-300K Annually
Senior level
150K-300K Annually
Senior level
Information Technology • Software • Financial Services • Big Data Analytics
As a Software Engineer at Citadel, you will build systems for investments, collaborate with researchers, and tackle complex problems.
Top Skills: C++JavaPython

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account