arqmetrica
Dimension 06 · arqmetrica AI Maturity Index

ROI & measurement

The value tracking, ROI scorecard discipline, kill-switch culture, and outcome attribution rigour.

Weighted at 17% of the overall score

What we ask

The four questions in this dimension, with the four ordinal options and their fixed scores. Identical wording to what you will see in the assessment.

ROI-01

1. Do you have a documented scorecard for AI investments — and is it reviewed by the executive team?

Without a scorecard, every AI investment debate restarts from zero. The strongest organisations review 5–7 KPIs at every quarterly business review.

OptionResponseScore
a
Yes — board-level AI scorecard reviewed quarterly
100
b
Departmental scorecards exist, no consolidated executive view
67
c
Tracked informally in slide decks
33
d
Not tracked
0
ROI-02

2. For AI initiatives that did not deliver ROI, what is your kill-switch discipline?

Healthy organisations kill ~30% of pilots within 6 months. Zero kills usually means zero rigour, not perfect picks.

OptionResponseScore
a
Documented kill criteria; pilots are sunset when they miss them
100
b
We do kill pilots, but the criteria are subjective
67
c
Pilots tend to drift on without resolution
33
d
We do not formally track or kill pilots
0
ROI-03

3. How do you attribute revenue or cost-savings outcomes specifically to your AI investments?

Attribution is the hardest part of AI ROI. Without it, finance and the board lose confidence over time.

OptionResponseScore
a
Causal attribution method (A/B, holdout, synthetic control) per use case
100
b
Before/after comparison with controls for known confounders
67
c
Anecdotal — based on stakeholder reports
33
d
We don't measure outcomes
0
ROI-04

4. What proportion of AI use cases that reach pilot make it to production with measurable business outcomes?

Industry research (MIT Sloan/BCG 2024) puts the median around 22% for European mid-market — "AI pilot purgatory". Higher is better; over 50% is excellent.

OptionResponseScore
a
Over 50% of pilots make it to production with outcomes
100
b
20–50% — about industry average
67
c
Under 20% — most pilots stall
33
d
We rarely get past pilot stage
0

Ready to see your full score?

Take the full assessment to see your score across all six dimensions, your peer benchmark, and your three highest-leverage moves.

Take the assessment

Dimensions