Surge AI Logo

Surge AI

Research Scientist

Posted 11 Hours Ago
Be an Early Applicant
Remote
Hiring Remotely in United States
Entry level
Remote
Hiring Remotely in United States
Entry level
Research data strategies for large language model development, including designing data slices to identify model failure modes, modeling annotator behavior, and optimizing instruction clarity and reward-signal reliability. Develop metrics and evaluation frameworks to assess dataset quality, diversity, alignment impact, and downstream model performance. Collaborate with AI research teams and test data-centric methodologies in production environments.
The summary above was generated by AI
About Us

Our mission is to raise AGI with the richness of human intelligence — curious, witty, imaginative, and full of unexpected brilliance.

Surge was founded by engineers and researchers who dreamed of building the next generation AI. We're building a platform that powers the most powerful models in the world in partnership with companies like Anthropic, Google, Microsoft, and Meta.

At Surge, we believe the path to AGI isn't just about scaling compute—it's about embracing the unlimited ceiling of human intelligence and creativity in the data that shapes these systems. Our platform combines elite human expertise with cutting-edge tools for scalable oversight, from building rich RL environments to conducting rigorous evaluations that go beyond benchmarks. We've run a profitable business from day one without raising venture funding.

The Role

As a Research Scientist focused on data, you’ll work at the cutting edge of LLM development by designing the datasets that shape how frontier models behave. You’ll partner directly with AI research teams to experiment with new data collection strategies, evaluate dataset quality, and uncover insights that improve alignment, safety, and model performance.

This is a research-driven, impact-heavy role: you’ll have the opportunity to test ideas quickly in live production environments, shape data-centric methodologies for some of the world’s top AI labs, and help define how high-quality data fuels the next generation of AI systems.

What We’re Looking for
  • Deep Curiosity About Data – Obsession with understanding how the structure, quality, and selection of data influence LLM performance

  • Bias Toward Insight and Iteration – You think critically but move fast, designing lightweight experiments to generate actionable results

  • Desire to Shape AI Development – Drive to build the foundational data layer that defines how the next generation of AI systems behave

What You'll Do
  • Research data collection strategies and designing high-impact data slices that uncover model failure modes

  • Model annotator behavior and designing experiments to optimize instruction clarity and reward signal reliability

  • Develop metrics and frameworks for evaluating dataset quality, diversity, and impact on downstream model alignment

Similar Jobs

Yesterday
Remote
United States
120K-170K Annually
Junior
120K-170K Annually
Junior
Aerospace • Artificial Intelligence • Analytics • Defense
Conduct AI and machine learning research focused on physics-driven modeling, simulation, reinforcement learning, multi-agent systems, and hybrid models. Develop and integrate novel algorithms into prototypes and production AI systems. Collaborate with research, engineering, and product teams, contribute to technical publications and patent disclosures, and support mission-critical modeling and decision-support solutions for space operations.
Top Skills: Artificial IntelligenceC++Ci/CdComputer VisionDeep LearningDiffusion ModelsGenerative AiGitJavaLarge Language ModelsMachine LearningPythonRReinforcement Learning
Yesterday
In-Office or Remote
Senior level
Senior level
Biotech • Pharmaceutical
Lead hands-on in-vitro neuroscience drug discovery research using cellular, biochemical, immunohistochemical, histochemical, and imaging-based pharmacology assays. Design and troubleshoot assays, analyze data, maintain rigorous QC standards, support program decisions, develop automation-ready workflows, and communicate findings to project teams and senior leadership. The role also provides technical leadership in CNS tissue endpoints, high-content imaging, and innovative assay technologies while mentoring scientists.
Top Skills: Assay AutomationBioluminescence AssaysElisa/MsdGenomic Target ValidationHigh-Content ImagingHistochemistryImmunohistochemistryPlate-Based Data AnalysisPlate-Based PharmacologyProtacQuantitative Western BlotSmall-Molecule Target Validation
Yesterday
Remote
United States
130K-200K Annually
Junior
130K-200K Annually
Junior
Professional Services • Consulting
Conduct original research on reliable agentic AI, developing methods for simulation, evaluation, optimization, regression control, and continuous learning. Analyze agent failures, traces, and human feedback; create experiments and prototypes; and translate research into production-facing systems. Collaborate with product and engineering teams, contribute to technical strategy, and provide rigorous experimental evidence. The role requires strong research depth, publication or open-source contributions, hands-on Python development, and expertise in LLM agents or agentic systems.
Top Skills: Agent FrameworksAi AgentsContinuous LearningLarge Language Models (Llms)PythonReinforcement LearningSimulation Systems

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account