Decision Intelligence Analyst

Posted 5 Hours Ago
Be an Early Applicant
7 Locations
In-Office or Remote
Mid level
Big Data • Information Technology • Analytics • Business Intelligence
Our mission is to build data infrastructure to connect developing markets to the global market.
The Role
Own decision quality by evaluating AI-generated decisions, identifying reasoning failures, designing feedback and training loops, defining decision-quality metrics, and collaborating with Product, R&D, and Engineering to improve robustness, explainability, and drift detection.
Summary Generated by Built In
Decision Intelligence Analyst

Team: Product
Location: Flexible / Remote
Reporting to: VP of Product

Role Overview

Rwazi’s platform produces decision-grade outputs powered by structured reasoning and AI-assisted judgment.

The Decision Intelligence Analyst owns decision quality.

This role evaluates system outputs, identifies reasoning weaknesses, and strengthens AI judgment through structured feedback and training loops.

It ensures the platform does not merely generate outputs — but generates sound, defensible decisions.

The Decision Intelligence Analyst is the quality control layer for decision intelligence.

Core Mandate

The Decision Intelligence Analyst is accountable for:

  • Evaluating decision outputs for logical integrity and sound reasoning

  • Identifying patterns of judgment failure or inconsistency

  • Designing structured feedback loops to improve AI reasoning

  • Training and refining AI judgment frameworks

  • Defining measurable standards for decision quality

This role governs the reliability of Rwazi’s decision engine.

Key ResponsibilitiesDecision Output Evaluation
  • Review system outputs for logical coherence and reasoning rigor

  • Assess signal interpretation accuracy

  • Identify tradeoff miscalculations or flawed inference pathways

  • Document recurring reasoning gaps

AI Judgment Training
  • Create structured examples to refine reasoning performance

  • Develop edge-case libraries for training robustness

  • Formalize evaluation rubrics for decision quality

  • Collaborate with R&D to improve reasoning architecture

Quality Standards & Metrics
  • Define measurable criteria for decision-grade output

  • Track improvements in reasoning consistency

  • Monitor drift in output quality over time

  • Establish acceptance thresholds for release

Failure Mode Analysis
  • Identify systemic reasoning weaknesses

  • Surface blind spots in signal modeling

  • Propose structured adjustments to logic layers

  • Escalate structural flaws early

Cross-Functional Collaboration
  • Partner with Product to align quality with roadmap goals

  • Collaborate with R&D on advanced reasoning improvements

  • Provide structured feedback to Engineering when system behavior deviates

Role Impact

Strong performance in this role results in:

  • Higher confidence in decision outputs

  • Reduced reasoning inconsistencies

  • Improved explainability

  • Faster detection of system drift

  • Stronger enterprise trust

This role protects the intellectual credibility of the platform.

What This Role Is Not
  • This is not general QA

  • This is not surface-level data validation

  • This is not simple output review

This role evaluates reasoning quality, not formatting correctness.

Qualifications and Profile

We are looking for individuals who demonstrate:

  • Strong analytical and logical reasoning ability

  • Experience evaluating AI systems, decision frameworks, or complex models

  • Comfort dissecting multi-step reasoning chains

  • Ability to formalize judgment criteria

  • Strong written clarity and structured thinking

  • Comfort working with ambiguity and edge cases

Candidates may come from applied AI evaluation, consulting, operations research, economics, philosophy of logic, or technically rigorous analytical fields.

Cultural Fit

We value analysts who:

  • Obsess over reasoning integrity

  • Question outputs rather than accept them

  • Care about intellectual rigor

  • Prefer structured evaluation over intuition

  • Are comfortable holding high standards

How Candidates Are Evaluated

Candidates are evaluated based on:

  • Their ability to critique and improve structured reasoning

  • Clarity of their evaluation frameworks

  • Depth of logical analysis

  • Ability to identify hidden failure modes

  • Their rigor in defining measurable quality standards

We prioritize demonstrated reasoning discipline over titles alone.

Summary

The Decision Intelligence Analyst safeguards the quality and integrity of Rwazi’s decision engine.

This role ensures that as AI capabilities expand, decision outputs remain structured, defensible, and enterprise-grade.

Skills Required

  • Strong analytical and logical reasoning ability
  • Experience evaluating AI systems, decision frameworks, or complex models
  • Comfort dissecting multi-step reasoning chains
  • Ability to formalize judgment criteria and define evaluation rubrics
  • Strong written clarity and structured thinking
  • Comfort working with ambiguity and edge cases
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Year Founded: 2021

What We Do

Rwazi is a market intelligence platform that provides companies with actionable data from developing markets on who is buying what, for how much, from where, when, and why, to help them drive revenue and expand. Rwazi utilizes a network of local consumers (called mappers) spread across 50 countries in Africa, Asia, and South America to collect data from their localities, empowering leading multinational companies around the world to better understand their consumers and grow their businesses in developing markets.

Why Work With Us

Join us on an exciting mission to bring offline data online, with lots of room for growth, and a positive team.

Similar Jobs

Pfizer Logo Pfizer

Product Owner

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
In-Office or Remote
6 Locations
121990 Employees
112K-207K Annually

PwC Logo PwC

Oracle Fusion Field Service Implementation Senior Manager

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Remote or Hybrid
64 Locations
370000 Employees
124K-280K Annually

PwC Logo PwC

Product Manager

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Remote or Hybrid
62 Locations
370000 Employees
91K-322K Annually

PwC Logo PwC

US Tech - AI Product Senior Associate

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Remote or Hybrid
62 Locations
370000 Employees
151K-187K Annually

Similar Companies Hiring

Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
Scotch Thumbnail
Artificial Intelligence • eCommerce • Fintech • Payments • Retail • Software • Analytics
US
35 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account