LaunchDarkly Logo

LaunchDarkly

Head of Experimentation

Posted 19 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in United States
256K-414K Annually
Senior level
Remote
Hiring Remotely in United States
256K-414K Annually
Senior level
Lead the Experimentation pillar: set strategy, deliver roadmap, and drive commercial outcomes. Productize AI-native experimentation, expand warehouse-native capabilities, win high-maturity data-science buyers, run a high-performing product organization, and represent the category externally to drive adoption and competitive wins.
The summary above was generated by AI
About the Job:

Feature management and experimentation have converged into a single market, and the buying dynamic at the top has shifted. Engineering teams are no longer the sole evaluator — data scientists and data-focused PMs now carry equal weight on the largest deals. The bar for statistical depth, warehouse ergonomics, and experiment-first workflows is rising quickly.

In traditional experimentation we have built the foundation: a trusted runtime control plane, a growing experimentation engine, and early warehouse-native capabilities. We are winning lower-maturity buyers at healthy rates. We are not yet consistently winning the most sophisticated data organizations. Closing that gap is the job.

In AI experimentation, we have an early lead: the AI-native tooling category has invested in evaluation and conceded production experimentation, and we already have the primitives (statistical significance, multi-armed bandits, experiment-aware guardrails) that no AI-native competitor ships. Extending that lead is the other half of the job.

This leader will own whether LaunchDarkly becomes the definitive experimentation platform in an AI-accelerated world.

Responsibilities:
  • Own the Experimentation pillar. Direct leadership of the Product team. Partner with Engineering and Design counterparts in a triad model. Accountable for the pillar's strategy, roadmap delivery, and commercial outcomes. Make the investment case across the in-product experimentation experience, the warehouse-native analysis layer, and the infrastructure that scales them.
  • Make experimentation the measurement layer of the AI SDLC. Partner with our AI product, observability, and core feature management leaders to productize the capabilities we already have as AI-native primitives. Build a closed loop from offline evaluation through production experiments, to automatic promotion and rollback, to a self-improving feedback loop for agents.
  • Win the high-maturity buyer. Earn the technical confidence of senior data scientists and data-focused PMs. Decide what statistical depth, warehouse coverage, and experiment-first workflow capabilities are non-negotiable, and get them shipped on a timeline that wins pivotal reference deals.
  • Make warehouse-native a weapon. Expand coverage across major data warehouses and query layers. Deliver parity on analysis-only mode, variance reduction, ratio and percentile metrics, exposure validation, and arbitrary-window analysis.
  • Operate a high-performing function. Run a disciplined roadmap, ship predictably against quarterly commitments, drive AI-assisted engineering productivity inside the org, and hire where gaps exist.
  • Be the external face of the category. Credibly represent the product with Data scientists, PMs, experimenters, analysts, and partners. Translate the strategy to the field and equip sales to win head-to-head.
How you'll be measured: 
  • Win rate on experimentation-involved deals, especially head-to-head competitive evaluations — step change in the first year, sustained improvement thereafter.
  • Reference-grade customers at the top of the maturity curve, including named strategic logos.
  • Monthly active customers and active-account ARR growth against plan.
  • Experimentation attach rate on new and expansion enterprise deals.
  • Engineering throughput — roadmap delivery velocity and AI-assisted development adoption inside the function.
Qualifications:
  • Senior product leader (GM, VP, or equivalent) with a track record of owning a product line that competes on statistical rigor and data infrastructure.
  • Deep, operator-level fluency in experimentation methodology: causal inference, variance reduction, ratio metrics, sequential testing, exposure design, multi-armed bandits, and composite/multi-objective metrics — and the realities of running these at scale against production data warehouses and against non-deterministic systems where output variance, not just user variance, drives sample-size and significance decisions.
  • Has earned credibility with data science leaders and experimentation specialists at sophisticated organizations — and can recruit them.
  • Has led a function that includes engineering, design, and data science. Comfortable setting a multi-quarter roadmap, championing investment allocation, and reporting results to an executive team and board.
  • Clear, direct communicator. Decides fast with incomplete information. Prefers shipping and learning to requirements documents.
  • Opinionated about where experimentation is going in an AI-native world — and specifically, how agents and autonomous systems will use experimentation infrastructure differently than human teams do.

Preferred Qualifications: 

  • You have built or scaled experimentation at an organization where it was core infrastructure, not a secondary analytics capability.
  • You have personally won competitive evaluations where a sophisticated data-science organization was the deciding voice.
  • You have shipped warehouse-native data products and understand the operational realities of running experiments directly against customer data infrastructure.
  • You see experimentation as how software teams prove that any change — whether built by a person or an AI agent — actually worked. That evidence layer is core infrastructure, not a reporting afterthought.

Pay:

Target pay ranges based on Geographic Zones* for Level M5: 

  • Zone 1: San Francisco/Bay Area or NYC Metropolitan Area, Boston, Seattle - $301,000 - $414,000**
  • Zone 2: Irvine, LA, Monterey, Santa Barbara, Santa Rosa, Austin, Portland, Philadelphia, Chicago - $271,000 - $373,000**
  • Zone 3: All other US locations - $256,000 - $352,000**
  • All Zones inclusive of 20% Bonus   

LaunchDarkly operates from a place of high trust and transparency; we are happy to state the pay range for our open roles to best align with your needs. Exact compensation may vary based on skills, experience, and location.

*Within the United States, our geographic pay zones are defined by counties surrounding major metropolitan areas.
**Restricted Stock Units (RSUs), health, vision, and dental insurance, and mental health benefits in addition to salary.

About LaunchDarkly:

Modern software delivery was supposed to be the foundation for a thriving digital business but reality has proven otherwise. Slow, inefficient development cycles, costly outages, and fragmented customer experiences are preventing developers from building their best software. The LaunchDarkly platform helps developers innovate on new features faster while protecting them with a safety valve to instantly rewind when things go wrong. Developers can target product experiences to any customer segment and maximize the business impact of every feature. And by gradually rolling out new application components, they escape nightmare "big-bang" technology migrations. 

The LaunchDarkly platform was built to guide engineers to the next frontier of DevOps by:

  • Improving the velocity and stability of software releases, without the fear of end customer outages
  • Delivering targeted experiences by easily personalizing features to customer cohorts
  • Maximizing the business impact of every feature through the ability to experiment and optimize
  • Coordinating the release and optimization of software to provide consistent experiences across mobile platforms and device types
  • Improving the effectiveness and productivity of engineering teams, by providing insights into engineering cadence and stability

At LaunchDarkly, we believe in the power of teams. We're building a team that is humble, open, collaborative, respectful and kind. We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, gender identity, sexual orientation, age, marital status, veteran status, or disability status. LD invites any applicant to review our written Affirmative Action Plan. To do so, contact People Ops at [email protected]

Do you need a disability accommodation?

Fill out this accommodations request form and someone from our People Operations team will contact you for assistance. 

Your safety matters to us. To protect yourself from potential scams, LaunchDarkly recruiters will only contact you from @LaunchDarkly.com email addresses or via LinkedIn from "Verified Recruiter" accounts. Be cautious of emails from other domains.  Legitimate LaunchDarkly recruiters will never ask for money, fees, or banking information before making a job offer. LaunchDarkly will never make a job offer without conducting a formal interview process. Our interview process does not involve asking detailed questions by email. If you are ever unsure about a communication that you receive, don't click any links—visit Careers | LaunchDarkly  directly for confirmed job openings and links to apply.

Please notify us of any fraudulent representation by sending an email to [email protected].

Similar Jobs

14 Days Ago
Remote
United States
100K-170K Annually
Mid level
100K-170K Annually
Mid level
Digital Media
Own the first 30-day client experience from signed contract to handoff: lead kickoff/onboarding, build initial paid-ad campaign infrastructure, validate assets/tracking, manage multiple onboardings, prevent risks, and partner with Sales and Growth to improve close rates and onboarding through AI, automation, and process improvements.
Top Skills: AIAsanaGoogle AdsHubspotKiteLinkedin AdsMeta Ads
6 Minutes Ago
Remote or Hybrid
67K-126K Annually
Mid level
67K-126K Annually
Mid level
Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Analyze procurement data, develop dashboards and reports, validate complex datasets, identify savings opportunities, improve reporting infrastructure, and present strategic insights to management. Collaborate with data providers and procurement partners while recommending improvements to tools, processes, and data quality.
Top Skills: EmblemExcelPowerPointSASSnowflakeSQL
6 Minutes Ago
In-Office or Remote
150K-180K Annually
Senior level
150K-180K Annually
Senior level
Artificial Intelligence • Fintech • Information Technology • Logistics • Payments • Business Intelligence • Generative AI
As a Senior Account Director at Coupa, you will drive growth by targeting enterprise accounts, building relationships with key decision-makers, and closing large deals for Coupa's spend management solutions.
Top Skills: B2B SoftwareCloud-Based Spend Management SolutionsSaaS

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account