Rwazi Logo

Rwazi

Decision Intelligence Analyst

Reposted 2 Months Ago
In-Office or Remote
Hiring Remotely in United States
Mid level
In-Office or Remote
Hiring Remotely in United States
Mid level
Own decision quality by evaluating AI-generated decisions, identifying reasoning failures, designing feedback and training loops, defining decision-quality metrics, and collaborating with Product, R&D, and Engineering to improve robustness, explainability, and drift detection.
The summary above was generated by AI
Decision Intelligence Analyst

Team: Product
Location: Flexible / Remote
Reporting to: VP of Product

Role Overview

Rwazi’s platform produces decision-grade outputs powered by structured reasoning and AI-assisted judgment.

The Decision Intelligence Analyst owns decision quality.

This role evaluates system outputs, identifies reasoning weaknesses, and strengthens AI judgment through structured feedback and training loops.

It ensures the platform does not merely generate outputs — but generates sound, defensible decisions.

The Decision Intelligence Analyst is the quality control layer for decision intelligence.

Core Mandate

The Decision Intelligence Analyst is accountable for:

  • Evaluating decision outputs for logical integrity and sound reasoning

  • Identifying patterns of judgment failure or inconsistency

  • Designing structured feedback loops to improve AI reasoning

  • Training and refining AI judgment frameworks

  • Defining measurable standards for decision quality

This role governs the reliability of Rwazi’s decision engine.

Key ResponsibilitiesDecision Output Evaluation
  • Review system outputs for logical coherence and reasoning rigor

  • Assess signal interpretation accuracy

  • Identify tradeoff miscalculations or flawed inference pathways

  • Document recurring reasoning gaps

AI Judgment Training
  • Create structured examples to refine reasoning performance

  • Develop edge-case libraries for training robustness

  • Formalize evaluation rubrics for decision quality

  • Collaborate with R&D to improve reasoning architecture

Quality Standards & Metrics
  • Define measurable criteria for decision-grade output

  • Track improvements in reasoning consistency

  • Monitor drift in output quality over time

  • Establish acceptance thresholds for release

Failure Mode Analysis
  • Identify systemic reasoning weaknesses

  • Surface blind spots in signal modeling

  • Propose structured adjustments to logic layers

  • Escalate structural flaws early

Cross-Functional Collaboration
  • Partner with Product to align quality with roadmap goals

  • Collaborate with R&D on advanced reasoning improvements

  • Provide structured feedback to Engineering when system behavior deviates

Role Impact

Strong performance in this role results in:

  • Higher confidence in decision outputs

  • Reduced reasoning inconsistencies

  • Improved explainability

  • Faster detection of system drift

  • Stronger enterprise trust

This role protects the intellectual credibility of the platform.

What This Role Is Not
  • This is not general QA

  • This is not surface-level data validation

  • This is not simple output review

This role evaluates reasoning quality, not formatting correctness.

Qualifications and Profile

We are looking for individuals who demonstrate:

  • Strong analytical and logical reasoning ability

  • Experience evaluating AI systems, decision frameworks, or complex models

  • Comfort dissecting multi-step reasoning chains

  • Ability to formalize judgment criteria

  • Strong written clarity and structured thinking

  • Comfort working with ambiguity and edge cases

Candidates may come from applied AI evaluation, consulting, operations research, economics, philosophy of logic, or technically rigorous analytical fields.

Cultural Fit

We value analysts who:

  • Obsess over reasoning integrity

  • Question outputs rather than accept them

  • Care about intellectual rigor

  • Prefer structured evaluation over intuition

  • Are comfortable holding high standards

How Candidates Are Evaluated

Candidates are evaluated based on:

  • Their ability to critique and improve structured reasoning

  • Clarity of their evaluation frameworks

  • Depth of logical analysis

  • Ability to identify hidden failure modes

  • Their rigor in defining measurable quality standards

We prioritize demonstrated reasoning discipline over titles alone.

Summary

The Decision Intelligence Analyst safeguards the quality and integrity of Rwazi’s decision engine.

This role ensures that as AI capabilities expand, decision outputs remain structured, defensible, and enterprise-grade.

Similar Jobs

Yesterday
Remote
191K-259K Annually
Senior level
191K-259K Annually
Senior level
Artificial Intelligence • Cloud • Consumer Web • Productivity • Software • App development • Data Privacy
Designs, deploys, and operates IAM controls across cloud and on-premises infrastructure. Secures human, service, workload, and AI-agent identities through authentication, authorization, least privilege, identity lifecycle automation, and policy guardrails. Builds monitoring for anomalous access, supports incident response, conducts threat modeling, and maintains reliable IAM services with on-call responsibilities. Requires substantial security engineering and IAM experience, knowledge of modern identity protocols, programming or scripting proficiency, and security automation expertise.
Top Skills: AbacAPIsBashCi/CdCis BenchmarksFedrampGoInfrastructure-As-CodeIso 27001JavaKubernetesMfaNist Sp 800-207Nist Sp 800-63Oauth 2.0Oauth 2.1OktaOkta For Ai AgentsOpenid ConnectPolicy-As-CodePythonRbacRubySailpointSAMLScimSoc 2SpiffeSpire
Yesterday
Remote
United States
117K-184K Annually
Senior level
117K-184K Annually
Senior level
Cloud • Greentech • Social Impact • Software • Consulting
Own a portfolio of mid-market customers and drive software expansion through upselling, cross-selling, strategic account planning, executive engagement, and complex deal management. Build multi-threaded relationships, identify whitespace, self-source pipeline, maintain accurate forecasts, and exceed expansion quotas. Collaborate with Customer Success and Renewals while using Salesforce, 6sense, and structured sales methodologies to prioritize opportunities and close new business within existing accounts.
Top Skills: 6SenseG2GongLinkedin Sales NavigatorOutreachSalesforceZoominfo
Yesterday
Remote
United States
74K-111K Annually
Junior
74K-111K Annually
Junior
Cloud • Greentech • Social Impact • Software • Consulting
Manage and grow mid-market customer accounts for EHS and ESG software solutions. Build customer relationships, conduct business reviews, identify upsell and cross-sell opportunities, support revenue growth, resolve issues, guide software adoption, maintain CRM records, and provide account health and revenue forecasts. The role requires quota-carrying sales experience and includes limited potential travel for customer or prospect onsite visits.
Top Skills: KaiaOutreachSalesforce

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account