Appen Logo

Appen

Strategic Project Lead - AI Post-Training (United States)

Posted 21 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in US
Junior
Remote
Hiring Remotely in US
Junior
Leads end-to-end AI post-training and model evaluation projects, managing scope, timelines, budgets, staffing, risks, client communication, and delivery quality. Translates model improvement goals into data requirements, workflows, rubrics, evaluation plans, and acceptance criteria. Advises on preference data, model comparisons, quality standards, and feasibility; develops SOPs and QA frameworks; resolves ambiguous requirements; mentors operations specialists; and supports project scoping and new capability development.
The summary above was generated by AI
About the Role

The Strategic Project Lead – AI Post-Training will help lead AI companies develop and improve frontier models through high-quality data programs. We’re looking for someone with experience in AI post-training, preference data, or model evaluation to lead projects that shape how models respond, reason, and perform. 

You’ll own delivery while bringing practical knowledge of the data, evaluation methods, and quality standards behind model improvement. Working closely with clients and internal teams, you’ll help translate evolving AI research needs into clear workflows, reliable datasets, and measurable outcomes. 

Your Impact

  • Own end-to-end project delivery, including scope, timelines, budgets, staffing, and risk management. 
  • Lead client communication, status reporting, planning sessions, and escalations. 
  • Translate model improvement objectives into data requirements, workflows, rubrics, and evaluation plans. 
  • Define quality standards and acceptance criteria for preference data, model comparisons, and evaluation outputs. 
  • Monitor delivery quality, investigate inconsistencies, and resolve ambiguous requirements with clients. 
  • Advise on data design, evaluation approaches, and project feasibility based on your domain expertise. 
  • Develop reusable guidelines, SOPs, and QA frameworks to improve consistency across programs. 
  • Mentor Operations Specialists and contribute to project scoping, pilots, and new capability development. 

What You Bring

  • 1–2+ years of experience in AI data operations, project coordination, or delivery, ideally in a GenAI or frontier AI environment.
  • Familiarity with at least one AI post-training or model evaluation workflow. 
  • Experience coordinating projects or workstreams, managing stakeholders, and communicating with clients.
  • Understanding of data quality, annotation workflows, and quality assurance methods.
  • Ability to translate evolving requirements into clear workflows, rubrics, and measurable quality standards. 
  • Strong troubleshooting and organizational skills, with the ability to manage multiple priorities. 
  • Interest in current AI developments, including frontier models and post-training approaches. 

Nice to Have

  • Experience with reinforcement learning from human feedback (RLHF), preference data, or model response evaluation.
  • Familiarity with rubric design, model comparison, benchmark development, or evaluation creation.
  • Experience assessing model responses for quality, accuracy, reasoning, or instruction following.
  • Exposure to AI companies, frontier AI labs, or model evaluation programs.
  • Bilingual capabilities, particularly German or a Nordic language. 

Why You'll Love Working Here

    At Appen, we foster a culture of innovation, collaboration, and excellence. We value curiosity, accountability, and a commitment to delivering the highest quality AI solutions for frontier models.

    You'll work on complex challenges that shape the future of AI across industries and geographies, alongside talented people in a culture that values humility over ego. You'll have the flexibility to deliver in a way that works for you and your team, supported by tools, resources, and development opportunities to continue to build your capability over time.

About Appen

    Appen has been a leader in AI training data for over 30 years. We specialise in human generated data to train, fine tune, and evaluate models across generative AI, large language models, computer vision, and speech recognition. Our AI assisted data annotation platform and global crowd of more than 1 million contributors in over 200 countries support model pre training, supervised fine tuning, evaluation and benchmarking, safety and red teaming, and multilingual global expansion.

Appen New York, New York, USA Office

New York, United States

Similar Jobs

An Hour Ago
Easy Apply
Remote
United States
Easy Apply
175K-241K Annually
Senior level
175K-241K Annually
Senior level
Artificial Intelligence • Fintech • Hardware • Information Technology • Sales • Software • Transportation
Own the company’s product demand forecasting strategy, from topline forecasts through SKU-level unit demand and inventory plans. Build forecasts for new products, markets, and regions using complex data from CRM, ERP, shipment, and activation systems. Automate forecasting workflows with SQL, AI, and planning tools; establish accuracy and bias metrics; lead monthly demand reviews; and advise Finance, Sales, Product, and Supply Chain executives on scenarios, risks, inventory, and build decisions.
Top Skills: Adaptive PlanningAi AgentsAnaplanCRMErpLlmsPigmentSQL
An Hour Ago
In-Office or Remote
New York, NY, USA
90K-110K Annually
Senior level
90K-110K Annually
Senior level
Artificial Intelligence • Cloud • Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Develops strategic employee-benefit enrollment strategies for clients, brokers, Sales, and Client Management. Uses enrollment data, market insights, client objectives, and product knowledge to recommend approaches that improve engagement and participation. Serves as an enrollment subject matter expert, supports client conversations and pilots, evaluates outcomes, identifies improvements, and partners with Marketing, Implementation, and other teams to execute effective enrollment solutions.
An Hour Ago
Easy Apply
Remote or Hybrid
TX, USA
Easy Apply
102K-154K Annually
Senior level
102K-154K Annually
Senior level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Leads transformational go-to-market programs across Sales and Revenue Operations. Responsibilities include scoping and prioritizing strategic initiatives, developing project roadmaps, coordinating cross-functional stakeholders, partnering with executives, managing organizational change, measuring outcomes, and driving continuous improvement. The role requires strong analytical, communication, project management, and stakeholder influence skills, with a focus on scalable solutions, operational excellence, and applying AI to improve program delivery.
Top Skills: AIIotSaaS

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account