Evaluate AI communication for tone and empathy, identifying errors and writing samples to model ideal interactions, while maintaining scoring consistency with the team.
Overview: Join a collaborative remote team working to make AI communication emotionally intelligent, culturally aware, and engaging.
Core Responsibilities
- Score AI messages for tone, empathy, and contextual awareness
- Identify subtle errors like “overly agreeable” or “lack of personality”
- Write short creative samples to model ideal AI tone
- Evaluate humor, pop culture references, and archetype use
- Maintain high scoring consistency with the evaluation team
Requirements
Qualifications
- Native or near-native US English proficiency
- Strong reading comprehension and precision tagging skills
- Deep familiarity with American conversational norms and humor
- Background in writing, editing, moderation, or customer engagement
Bonus
- Psychology, creative writing, or linguistics degree
- AI tools or chatbot evaluation experience
Benefits
$25–$30/hr
Similar Jobs
Fintech • Real Estate • PropTech
As a Sales Development Representative, you will generate qualified sales opportunities through prospect outreach via phone, email, and social media, collaborate with the sales team, and engage inbound leads.
Fintech • Real Estate • PropTech
Own the full sales cycle for Agora's SaaS platform: prospect, run demos/POCs, negotiate and close deals, manage pipeline in HubSpot, collaborate with Customer Success and Product, and complete post-sale finance processes while meeting quarterly and annual sales targets.
Top Skills:
Hubspot,Crm,Saas,Proptech,Fintech
Fintech • Mobile • Software • Financial Services
Process borrower documents to prepare complete loan files for initial underwriting. Verify documentation, order and track vendor items, communicate with borrowers and third parties, complete submission checklists, manage pipeline within SLAs, and document all communications.
Top Skills:
Google DocsGoogle SheetsMS OfficeWindows
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory


