ReflectionAI Logo

ReflectionAI

Forward Deployed Engineer, Lead - LLM Post-training

Reposted 14 Days Ago
Be an Early Applicant
In-Office
New York, NY, USA
Senior level
In-Office
New York, NY, USA
Senior level
The Forward Deployed Engineer will lead the deployment of AI solutions, working closely with sales and research teams, ensuring effective solutions for enterprise needs.
The summary above was generated by AI
Our Mission

Reflection’s mission is to build open superintelligence and make it accessible to all.

We’re developing open weight models for individuals, agents, enterprises, and even nation states. Our team of AI researchers and company builders come from DeepMind, OpenAI, Google Brain, Meta, Character.AI, Anthropic and beyond.

Role Overview
We're seeking an exceptional technical leader to build and scale Reflection's post-training and evaluation capabilities within the Applied AI team. This team works at the intersection of model adaptation, sovereign deployment, and enterprise deployment: taking Reflection's open-weight models and making them work for specific customer domains, tasks, and constraints. As a Forward Deployed Engineer Lead, Post-Training, you will own the end-to-end technical strategy for model customization, from synthetic data generation and reward modeling through training and production deployment. You will work directly with customers to understand their needs and with research teams to push what's possible with our models.

What You'll Do

  • Lead post-training engagements with enterprise customers: assess their data, define training strategies, design reward signals and verifiers, prepare datasets, run training loops, and evaluate results against customer-specific benchmarks.

  • Design and build RL training environments for model adaptation, including synthetic data generation pipelines, reward model training, and preference data collection workflows.

  • Design and build evaluation infrastructure: define what "better" means for each customer use case, build eval harnesses, curate test sets, and establish baselines that measure real-world performance.

  • Own the data pipeline from raw customer data through training-ready datasets, including synthetic data generation, data quality inspection, cleaning, and format standardization.

  • Deploy post-trained models across hybrid environments (public cloud, VPC, and on-premises), working with infrastructure teams to ensure inference performance, cost efficiency, and reliability at scale.

  • Shape and scale the post-training and evaluation practice by defining playbooks, best practices, and technical standards. Mentor engineers on the team and help define what great applied AI work looks like at Reflection.

What We're Looking For

  • Hands-on post-training experience with large language models at scale. You have built and operated RL training environments, designed preference optimization workflows on models at 50B+ parameter scale, and shipped the results to production.

  • Experience building synthetic data generation pipelines, reward models, and verifiers for reinforcement learning workflows. You've architected the data and feedback loops that make post-training work.

  • Deep understanding of evaluation methodology: how to design evaluations that measure what matters, how to interpret training dynamics, and how to tell the difference between a model that looks good on a benchmark and one that actually works.

  • Practical experience with training infrastructure at scale: comfortable working with multi-node GPU clusters, managing large training runs, debugging distributed training, and optimizing for cost.

  • Strong software engineering fundamentals. You write production-quality code, not just notebooks. Experience with data pipelines, version control for datasets and models, and reproducible workflows.

  • 6+ years of engineering experience, including 2+ years focused on LLM post-training in a leadership capacity (e.g., Tech Lead on a post-training team, Senior MLE owning preference optimization for a product, or Lead Applied Scientist running RL training pipelines in production).

  • Experience in customer-facing technical roles, or a genuine interest in developing this skill. In either case, you are comfortable translating domain requirements into training strategies and delivering measurable outcomes.

  • Self-starter with high agency and ownership, excelling in fast-paced startup environments where playbooks are still being written.

What We Offer:

We believe that to build superintelligence that is truly open, you need to start at the foundation. Joining Reflection means building from the ground up as part of a small talent-dense team. You will help define our future as a company, and help define the frontier of open foundational models.

We want you to do the most impactful work of your career with the confidence that you and the people you care about most are supported.

  • Top-tier compensation: Salary and equity structured to recognize and retain the best talent globally.

  • Health & wellness: Comprehensive medical, dental, vision, life, and disability insurance.

  • Life & family: Fully paid parental leave for all new parents, including adoptive and surrogate journeys. Financial support for family planning.

  • Benefits & balance: paid time off when you need it, relocation support, and more perks that optimize your time.

  • Opportunities to connect with teammates: lunch and dinner are provided daily. We have regular off-sites and team celebrations.

HQ

ReflectionAI New York, New York, USA Office

300 Kent Ave, New York, New York, United States, 11249

Similar Jobs

4 Minutes Ago
Hybrid
New York City, NY, USA
200K-220K Annually
Senior level
200K-220K Annually
Senior level
Events • Social Media • Software
The Senior Data Scientist will lead the development of personalization algorithms, collaborate cross-functionally, build data pipelines, and optimize machine learning models.
Top Skills: Aws PersonalizePythonSagemakerSQL
4 Minutes Ago
Hybrid
New York City, NY, USA
180K-220K Annually
Senior level
180K-220K Annually
Senior level
Events • Social Media • Software
Lead complex technical projects at Posh, focusing on platform architecture, system reliability, and mentoring engineers while driving performance and scalability improvements.
Top Skills: AWSReactReact NativeTypescript
4 Minutes Ago
In-Office
New York City, NY, USA
180K-220K Annually
Senior level
180K-220K Annually
Senior level
Events • Social Media • Software
Lead frontend development for Posh's web and mobile applications, ensuring high performance and scalability, while mentoring engineers and influencing product direction.
Top Skills: ExpoReact Native

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account