Wednesday, September 24, 2014

Even if you hate statistics...


Many tell me: "I hate statistics", or they tell me: "I don't know anything about statistics, so I don't use statistics in projects"

Hello!... actually you do use statistics; you're just not that aware of it.

One of the most prominent principles you apply probably unwittingly and unconsciously is the Central Limit Theorem, affectionately: CLT.

From a risk management perspective, the CLT has these two ideas embedded that are useful day to day (look: no math!):

1. Central tendency: similar to mean regression, central tendency says that regardless of the underlying distribution of random effects, whether asymmetrical or not, uniform or not, the aggregation of all the independent effects will have a bell shape with a pronounced central value.

That's handy because no matter how pessimistic or optimistic are the various WP managers about budgets and schedule, at the project level it all washes out and there will be a general bell curve to the central figure that is the sum of the durations or the sum of the budgets.

2. Regression to the mean: most natural phenomenon have random variations (the time for the paint to dry, etc) but over time they find their way back to their long term average.

If your project is to paint the fence, then there may be a few warm days, a few dry days, a few cool days, but over enough time, the time to paint the fence will wander back to its long term average. This gives you the basis for parametric estimating with relatively low risk.

This, of course, underlies the long term quality assumptions in Six Sigma and other process control paradigms. Of course, if there is tool wear, like the paint brush wearing out, then such non-random effects will bias the mean off its natural center.

Generally, biological systems, like people, regress to the mean unless there are material changes in environment, training, tools, etc. So, just because a team member performed really good (or bad) this time, such non-average performance does not predict the next time.

Malcolm Gladwell tells us it takes 10K hours to become an expert -- about 5 years in normal times -- so the drift of the mean with expertise is usually quite long.