Top Tech Jobs & Startup Jobs in NYC, NY

Develop and evaluate coding tasks for AI systems, including bug fixes, feature development, refactoring, optimization, reproducible environments, reference solutions, automated testing, and deterministic evaluation. The role also involves debugging complex codebases, reviewing contributions, documenting technical decisions, and refining evaluation criteria. Candidates should have strong software engineering fundamentals, backend or API development experience, open-source contributions, and proficiency in at least one listed programming language.

Develop coding tasks and reference solutions for evaluating AI systems. Build deterministic verifiers, test suites, scalable backend services, and APIs. Debug complex defects, assess code quality, refactor legacy implementations, optimize performance, and evaluate AI-generated technical reasoning. Document requirements and verification criteria while independently applying software engineering judgment across algorithms, system design, testing, and reliability.

Build and maintain software engineering infrastructure for AI development and evaluation workflows. Develop rubrics, review and label preference data, create scalable pipelines, document findings, navigate complex codebases, and improve evaluation quality and consistency. Collaborate with researchers and engineers in an ambiguous, fast-paced environment while applying strong judgment, debugging, communication, and system-design skills.

Perform contract drafting, review, redlining, and simulated negotiations while evaluating AI-generated legal responses. Identify contractual risks, assess legal accuracy using structured rubrics, and provide actionable feedback to improve AI systems for contract review. Collaborate with legal, product, engineering, and research teams on datasets, evaluation guidelines, and quality standards.

Designs challenging data science and machine learning tasks, builds reproducible environments and verified reference solutions, and develops automated tests and evaluation frameworks for AI-generated code. The role analyzes AI agent performance, identifies bugs, leakage, overfitting, and methodological weaknesses, documents technical requirements, and iteratively improves task reliability and complexity.

Evaluates AI-generated software for correctness, quality, efficiency, security, and maintainability. Designs programming challenges, reference solutions, test cases, and evaluation criteria. Reviews technical reasoning related to debugging, architecture, and system design, then provides structured feedback and documentation. The role requires strong programming fundamentals, software testing and code review experience, analytical problem-solving ability, and clear technical communication.

Prepare and review individual U.S. income tax returns, identify complex tax edge cases, validate product outputs against professional tax software, and collaborate with engineers and founders to improve tax product functionality, roadmap, and user experience. The role requires substantial tax-season experience, strong federal tax knowledge, and expertise with professional tax preparation platforms.

Prepare and review individual U.S. income tax returns, identify complex tax scenarios and product edge cases, validate tax engine outputs against professional tax software, and collaborate with engineers on tax rules, product improvements, and user experience. Serve as a tax subject matter expert embedded within an early-stage product and engineering team.

Reviews and evaluates domain-specific documents, providing structured feedback on quality, accuracy, and relevance. The role requires strong analytical and written communication skills, detailed document review, proficiency with spreadsheet and presentation software, and the ability to follow structured guidelines. Candidates must have a bachelor’s degree, at least three years of relevant professional experience, English proficiency, and reside in the United States, Europe, the United Kingdom, or Canada.

Builds a talent network of experienced data scientists for potential future AI evaluation projects. Responsibilities may include creating grading criteria, evaluating AI-generated or human-produced data science work, writing evidence-based justifications, applying consistent judgment, and incorporating reviewer feedback. Candidates should have professional data science experience, strong Python and SQL skills, expertise in statistical modeling, machine learning, experimentation, causal inference, and excellent technical communication.