Real-world data is the competitive edge in AI.
HumanSignal is a human data partner for companies building AI models and products. Our customers ship better AI, faster, because we partner with their researchers from real-world data creation to annotation to delivery.
We design and create datasets from scratch, recruit and manage the domain experts who evaluate model output, and run everything through our own platform, Label Studio, the open-source standard for data labeling and evaluation, used by over 1 million practitioners worldwide.
We specialize in the operationally complex: real-world data collection, multimodal pipelines, and multi-step workflows. Advanced ML and AI teams use our enterprise platform to run their own data factories, and our services team to extend their reach where in-house capacity runs out.
If you want to do work that materially shapes how the next generation of AI products gets built, we'd love to talk.
About the Opportunity
We're looking for graphic design professionals to rate the quality of design work, helping AI models learn what makes a design effective.
Key Details
- Type: Freelance, project-based opportunity
- Project length: 3 weeks, with new projects launching regularly
- Compensation: Paid per accepted task. On this project, you can earn the equivalent of up to $9 per hour, with pay rates varying by country of residence.
What You'll Do
- Rate design samples for typography, visual hierarchy, design execution, color, layout, and overall polish
- Follow detailed rubrics to keep your ratings consistent across high volumes of design samples
- Identify flaws in one slide within the overall design, from minor issues like font size to major ones that require a full reconstruction of the slide
- Edit the flawed slide using the other slides in the design as a reference, to build more cohesion across the entire design
Please note: you won’t create your own designs. You’ll rate and edit the samples we provide, following our guidelines.
What We're Looking For
Must have
- Education in design or arts (degree or certificate)
- 2+ years of experience as a graphic designer, illustrator, SMM specialist, or marketing professional
- English proficiency at B2 (Upper-Intermediate) level or higher
- Strong grasp of composition, color theory, typography, visual hierarchy, and overall design effectiveness
- Exceptional attention to detail and ability to maintain focus during repetitive tasks
Nice to have
- Experience with Figma, Adobe Illustrator, or other modern design tools
- Prior data annotation or AI training experience
How It Works
- Apply with your portfolio
- Register on our platform
- Confirm your identity
- Validate your skills
- Start earning on projects
Why Join Us
- Work from anywhere: fully remote, with just a laptop and a stable internet connection.
- Set your own schedule: work whenever suits you, alongside your current job, studies, or other commitments.
- Get paid every week: weekly payouts for the work you deliver.
- Shape the future of AI: your expertise helps train the AI tools people use every day.
- More projects ahead: once you're validated, get access to new projects that match your skills.
Similar Jobs
What you need to know about the NYC Tech Scene
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
