Software Engineer, Product

Braintrust is the AI observability platform. By connecting evals and observability in one workflow, Braintrust gives builders the visibility to understand how AI behaves in production and the tools to improve it.

Teams at Notion, Stripe, Zapier, Vercel, and Ramp use Braintrust to compare models, test prompts, and catch regressions — turning production data into better AI with every release.

We're looking for a product engineer who is passionate about building tools that users love and use every day. You'll work on the core product, hang out with users (developers, product managers, and designers working in AI), and play a key role in shaping the roadmap.

Under the hood, Braintrust is a high performance, local-first, visualization-heavy UI built with modern Typescript and React. Our users work at some of the world's best technology companies and expect our product to be lightning fast, reliable, and intuitive.

Core responsibilities:

• Ensuring our customers always have a frictionless experience for enabling AI observability in their systems.

• Contribute to foundation UI architecture that focuses on performance and efficient data loading patterns.

Build the user-facing pieces of Braintrust, such as:

• A first-class prompt playground experience supporting multiple models across thousands of user inputs.

• A system for prompt management, configuration, and versioned comparisons.

• A fully multiplayer, scalable human review system.

• LLM output analysis and comparison across arbitrarily large datasets.

• Expert-level understanding of Typescript, React, HTML, CSS, SQL, NextJS

• Previous experience founding or working at startups is a plus

• Has written prompts / tinkered with GPT models and apps

• Medical, dental, and vision insurance

• Daily lunch, snacks, and beverages

• Flexible time off

• Competitive salary and equity

• AI Stipend

Braintrust is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.