There is no true value of anything: data has meaning based on the operational definition used to calculate the data.

Walter Shewhart’s Statistical Method from the Viewpoint of Quality Control, forward by W. Edwards Deming:

There is no true value of anything. There is instead a figure that is produced by application of a master or ideal method of counting or measurement… no true value of the number of inhabitants within the boundaries of (e.g.) Detroit. A count of the number of inhabitants of Detroit is dependent upon the application of arbitrary rules for carrying out the count. Repetition of an experiment or of a count will exhibit variation.

Dr. Deming’s ideas on the theory of knowledge are the least understood and least seen in other management systems. The importance of understanding what data does, and does not tell you, is at least somewhat acknowledged in other management system but is often not found much in the actual practice of management. The execution often glosses over the importance of actually understanding statistics versus using formulas. Just using formulas is dangerous. It may be inconvenient but learning about the traps we can fall into in using data is important.

How often do you see the operational definition used to calculate the data you see with the data you are provided?

via: Shewhart, Deming and Data by Malcolm Chisholm

Related: How We Know What We Know – Pragmatism and Management Knowledge – Measuring and Managing Performance in Organizations – Dangers of Forgetting the Proxy Nature of Data