Metrics Scoring

As I develop metrics for FUSE, it is important to have a method rating a metric for effectiveness. Here’s the rubric I’ll be using.

RelevanceMeasurabilityPrecisionActionabilityPresence of Baseline
Rating ScaleHow strongly does this metric connect to business objectives?How much effort would it take to track this metric?How often and by what margin does the metric change?Can we clearly articulate actions we would take in response to this metric?Does internal or external baseline data exist to indicate good/poor performance for this metric?
5Empirically Direct – Data proves the metric directly supports at least one business objectiveAlmost None – Data already collected and visualized in a centralized systemHighly Predictable -– Metric fluctuates narrowly and infrequentlyClear consensus on action, and capability currently exists to take actionBaseline can be based on both internal and external data
4Logically Direct – Clear logic shows how the metric directly supports at least one business objectiveLow – Data collected and measured consistently, but not aggregated in central system.Somewhat Predictable – Metric fluxtuates either narrowly or infrequentlySome consensus on action, and capability currently exists to take actionBaseline can be based on either internal or external data
3Empirically Indirect – Data proves the metric indirectly supports at least one business objectiveMedium – Data exists but in local systems, minor collection or measurement challenges may exist.Neither Volatile or PredictableSome consensus on action, and capability to take action expected in the futureBaseline must be based on incomplete or directional data
2Logically Indirect – Clear logic shows how the metric indirectly supports at least one business objectiveHigh – Inconsistent measurements across sites, data not being collected regularly.Somewhat Volatile – Metric fluctuates either widely or frequentlySome consensus on action, but no current or expected future capability to take actionNo data exists to establish baseline, but data can be generated within six months
1Unclear – Connection to business objective is unclearPotentially Prohibitive – No defined measurement or collection method in place.Highly Volatile – Metric fluctuates widely and frequentlyNo consensus on actionNo data exists to establish baseline, and data needed will take more than a year to generate
Weights25%20%20%25%10%

One thought on “Metrics Scoring

Leave a comment

This site uses Akismet to reduce spam. Learn how your comment data is processed.