Data Core · KPI management · Module

Definitions

What each measure means precisely enough that two people calculating it independently get the same answer.

The idea

How it works

A measure without a written definition is defined differently by each team using it, and the difference surfaces as a discrepancy every reporting period.

The test is reproducibility: give the definition and the raw data to two people and compare their answers. Disagreement means the definition is incomplete, not that one of them is careless.

Working with it

In practice

  1. 01

    Write inclusions and exclusions

    What counts and what does not. The exclusions are where the disagreements live.

  2. 02

    Specify the timing

    When something is counted — on order, on delivery, on payment — changes the number substantially.

  3. 03

    Test on two people

    Same definition, same data, independently calculated. Any difference is a definition problem.

  4. 04

    Version the definition

    When a definition changes the trend breaks, and a reader needs to know where.

One level in

The components of definitions

A component is something that exists afterwards which did not exist before — a deliverable or a mechanism, not an intention.

  1. The calculation

    How the measure is computed, including what is included and excluded.

    Learn
  2. The reproducibility test

    Evidence that two people get the same answer from the same definition.

    Learn
  3. The version record

    How the definition has changed, and where the trend breaks as a result.

    Learn

Give the definition and the data to two people. Any difference in their answers is a definition problem.