Evaluate search results for relevance and usefulness, answer simple quality questions, follow client guidelines, complete online tasks to improve AI/search systems, pass training and client exam, and sign an NDA.
OVERVIEW
Welo Data is looking for English speakers to join a remote project as a Search Quality Rater. In this role, you will help improve how search engines understand and deliver useful results to users.
What you’ll do:
Review search results and evaluate how helpful and relevant they are to the user’s query
Answer simple true/false questions about the quality of content
Rate whether search results meet the user’s needs using clear guidelines
Complete straightforward online tasks that contribute to improving AI systems
No specialized technical experience is required - we provide the guidelines and support you need to succeed!
Please click here for a short demo of these types of tasks: What Does a Search Quality Rater Do? (youtube.com)
Why this work matters:
Your feedback helps train and improve AI technology, making search engines smarter and more useful for people around the world.
Schedule & Support:
Fully remote position
Set your own schedule and complete tasks when it’s convenient for you
Support is available from the project management team during business hours (Monday–Friday, 9:00 AM – 5:30 PM Pacific)
Project Details
Job Title: Search Quality Rater
Location: Remote, US-based
Hours: Minimum 10 hours per week, up to 29 hours per week; set your own schedule
Start date: ASAP
Employment Type: W2 Part-Time Employee, payment every 2 weeks
Longevity of project: 12 months with possibility of extension.
This work is based on project needs. Weekly hours may vary.
Benefits:
Paid Sick Time
Employee Assistance Program
Following eligibility requirements:
Medical Insurance
Dental Insurance
Vision Insurance
HSA
Voluntary Life Insurance
Accident, Critical Illness,Hospital Indemnity Insurance
401(k) Retirement Plan
Currently hiring in: Alabama, Florida, Georgia, Indiana, Kansas, Kentucky, Montana, New Hampshire, North Carolina, Ohio, Oklahoma, Pennsylvania ,South Carolina, Tennessee, Texas, Utah, Virginia, West Virginia, Wisconsin.
Applicants must be of at least 18 years of age to apply.
Requirements
- Fluency in English
- Strong understanding of popular culture in the United States
- Must be dedicated only to "Search Quality rating program" and NOT other search or ads rating programs
- Must not have current or previous experience with "Ads quality rating"
- Web-savvy and able to work in a fast-paced environment
- Excellent online research skills
- Reliable computer system and internet connection
- Reliable anti-virus software (as you will be surfing the web as part of the work)
- Ability to follow instructions in English and comply with the project conventions and rules expected by the client
- Must sign a Non-Disclosure Agreement to protect client confidentiality
- Must pass learning modules and a required quality test designed by our client before starting work
Recruitment process
- Application & Initial Screening: Submit your interest through our Careers Page and answer a few brief project-related questions.
- Candidate Portal Registration: Keep an eye on your inbox! You’ll receive an invite to create your profile on our internal platform, where you will complete your final application steps.
- Skill & Language Evaluation: Take a quick assessment to showcase your linguistic expertise.
- Project Guidance: Access our exclusive "Know-How" guides and project documentation to set you up for success.
- Client Exam: Complete a client entrance exam to ensure you're ready for the live project.
- Onboarding & Launch: Once verified (ID & Tax only), you’ll be officially onboarded. Set your own schedule and start working!
In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification form upon hire. In addition, we employ anti-fraud checks to ensure all candidates meet the requirements of the program.
If you are currently working or have previous experience as an "Ads Quality Rater", unfortunately, you will not be able to work on our Search Quality Rating project.
However, we often have an open Ads Rating job posting. Please check our careers page here to apply: https://jobs.lever.co/welocalize
Similar Jobs
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Assess and harden software supply chain security by performing technical assessments, designing and implementing security controls and monitoring for build pipelines, investigating systems for vulnerabilities, creating tooling to address gaps, and leading cross-team projects to improve CrowdStrike's product security posture.
Top Skills:
Argo CdArtifactoryBitbucketCi/CdCloud PlatformsDatadogGitGoGroovyJavaScriptJenkinsLinuxLogscalePkiPrometheusPythonRest ApisS3ShellSoftware SigningSplunkTlsUnix
Cryptocurrency
Support daily crypto market operations by monitoring prices, liquidity, and trading activity across spot, futures, and options. Assist with rebalancing across CEX/DEX, track issues for developers, analyze data and charts for signals, ensure trading bots meet risk and performance rules, and coordinate treasury and client reporting.
Edtech • Social Impact
Lead and scale delivery operations for large, live education programs. Manage 1-2 layers of staff, own end-to-end program launches and live course streams, author playbooks and runbooks, ensure data-driven interventions, and maintain delivery quality and retention across formats and large cohorts.
Top Skills:
AsanaClaudeGitGoogle SuiteNotionZoom
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory


