Top Tech Jobs & Startup Jobs in NYC, NY

Design task-specific grading criteria for B2B sales deliverables and evaluate AI-generated and human work against those rubrics. Provide detailed, evidence-based written justifications, refine rubrics with senior reviewers, and ensure consistent, reproducible evaluations across large volumes of work.

Design evaluation rubrics and scoring frameworks for marketing deliverables, assess AI-generated and human-created marketing work with evidence-based judgments, provide written justifications, and iterate with stakeholders to improve consistency and scoring quality.

Review and evaluate quantitative finance tasks for technical accuracy and real-world realism. Identify missing assumptions, unrealistic constraints, edge cases, and data or backtesting issues. Provide concise, structured written feedback and actionable recommendations. Collaborate with other experts to calibrate evaluations and maintain consistent quality standards throughout a high-engagement, remote contractor sprint.

Conduct 20-minute structured interviews with subject-matter experts, evaluate domain expertise and communication using a rubric, verify availability and work authorization, provide evidence-based hiring recommendations (Advance/Hold/Pass), coordinate scheduling, document outcomes, and collaborate with the program team to ensure consistent evaluation standards. Approximately 10 hours/week, fully remote with U.S. Eastern Time overlap.

Review, create, and evaluate professional operational finance deliverables (P&L reconciliations, month-end close, AP/P2P, three-statement models, pro forma analysis, covenant and partnership accounting). Analyze complex documents, assess AI-generated financial work for technical accuracy and completeness, and produce executive-ready summaries with assumptions, variances, impacts, and recommendations.

Design and author realistic, multi-step software engineering benchmarks in Python; create reproducible reference solutions and validation checks; evaluate AI-generated code, identify failures, and improve benchmark quality; review peers tasks and collaborate with AI researchers to refine evaluation methodologies.

Evaluate finance workflows and tasks for realism, technical accuracy, and practical applicability in trading, derivatives, and crypto markets. Identify ambiguous assumptions, unrealistic constraints, missing edge cases, and provide concise, actionable feedback. Collaborate with domain experts to maintain consistency and ensure high-quality assessments throughout a fast-paced, remote sprint engagement.

Remote contract role to create, review, and refine high-quality consulting deliverables (M&A, post-merger integration, corporate strategy, operational improvement). Analyze due diligence, financial models, and market research to produce client-ready presentations, memos, and financial models. Provide rigorous evaluation and structured feedback to improve analytical rigor, business judgment, and decision-ready recommendations.

Provide insurance subject-matter expertise to improve generative AI models: design insurance tasks, create reference solutions, evaluate AI outputs with structured rubrics, refine scoring guidelines, and collaborate with research and engineering teams to produce high-quality training and evaluation data. Commitment of 35+ hours/week and proven senior insurance experience required.

Design real-world computer vision tasks, build reference solutions and evaluation components in Python, assess AI model outputs, identify failure modes, and develop structured rubrics and guidelines. Collaborate with experts to maintain high-quality training data and evaluation standards for multimodal and generative vision systems. Part-time, remote contractor role (~20 hours/week).