Builds a talent network of experienced data scientists for potential future AI evaluation projects. Responsibilities may include creating grading criteria, evaluating AI-generated or human-produced data science work, writing evidence-based justifications, applying consistent judgment, and incorporating reviewer feedback. Candidates should have professional data science experience, strong Python and SQL skills, expertise in statistical modeling, machine learning, experimentation, causal inference, and excellent technical communication.
This role is for one of our clients
Compensation: $100-$150 per hour
We are building a network of experienced data scientists for potential future projects with leading AI research organizations. These projects may focus on evaluating how effectively AI systems perform real-world data science work.
There is no immediate project opening, but qualified applicants may be contacted as relevant opportunities become available.
Requirements
Potential Responsibilities
Future projects may involve:
- Designing precise, task-specific grading criteria for data science deliverables, including exploratory data analyses, statistical modeling work, machine learning pipelines, experimentation and A/B test write-ups, feature engineering, and technical reports or notebooks
- Evaluating AI-generated or human-created work against established criteria
- Providing detailed written justifications for evaluations and scores
- Applying consistent, evidence-based judgment so that assessments are reproducible and defensible
- Incorporating structured feedback from senior reviewers and iterating on submitted work
Specific responsibilities will vary depending on the project.
Ideal Qualifications
- 1+ years of professional data science experience
- Experience at a leading technology, research, or quantitative firm (such as top FAANG, AI labs, top-tier quant funds, or equivalent)
- Strong command of Python, SQL, statistical modeling, machine learning, experimentation and causal inference, and translating messy real-world data into rigorous analyses
- Exceptional written communication skills, including the ability to convey technical findings clearly
- A detail-oriented and consistent approach to evaluating complex work
- Comfort receiving feedback and calibrating judgment against established standards
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Similar Jobs
Aerospace • Artificial Intelligence • Machine Learning • Robotics • Software
Own production operations for workplace AI platforms, including configuration, integrations, observability, secrets, access controls, model and prompt changes, benchmarking, and incident response. Translate technical findings into governance, risk, compliance, and training materials while collaborating with Security, Legal, HR, and business stakeholders. Investigate failures, implement mitigations, document root causes, and maintain reliable, secure AI services.
Top Skills:
Access ControlAi/Llm PlatformsAlertingAPIsInfrastructure As CodeJSONLoggingMetricsMonitoring And ObservabilityPrompt EngineeringRpa/Workflow EnginesSecrets ManagementYaml
Aerospace • Artificial Intelligence • Machine Learning • Robotics • Software
Build and lead a scalable application security and secure SDLC program across engineering teams. Establish policies, standards, tooling, vulnerability management, threat modeling, developer enablement, security champions, software supply-chain controls, and executive reporting. Partner with development, platform, DevOps, product, and leadership teams to integrate security into CI/CD, source control, build, release, and deployment workflows while supporting audits, advisories, incident response, and regulatory requirements.
Top Skills:
Api SecurityBlack DuckBurp SuiteCheckmarxCi/CdContainer Security ScanningCyclonedxDastGithub Advanced SecurityGitlab Security ToolsInfrastructure-As-Code Security ScanningKubernetesMendNist Sp 800-218Nist SsdfOwasp SammOwasp ZapSastSbomScaSecrets DetectionSemgrepSlsaSnykSonarqubeSpdxVeracodeVex
AdTech • Artificial Intelligence • Cloud • Digital Media • Marketing Tech • Analytics • Consulting
Lead client-facing analytics consulting engagements, implementing Google Analytics and tag management solutions with minimal oversight. Analyze client data, develop technical strategies, connect marketing platforms, manage project tasks in Asana, communicate with clients, and support consultant mentoring and training. The role requires strong implementation expertise, data visualization skills, project management experience, and familiarity with analytics, customer data, mobile, consent management, and cloud platforms.
Top Skills:
Adobe AnalyticsAdobe LaunchAmazon Web ServicesAsanaData StudioGoogle AnalyticsGoogle Cloud PlatformGoogle Tag ManagerLookerAzurePower BISegmentTableauTealium Tag Management System
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory


