Strategy. Innovation. Brand.

predictions gone wrong

The Structure of Predictions

The cost of my services may go down.

The cost of my services may go down.

I like to think about the future. So, in the past, I’ve written about scenario planning, prediction markets, resilience, and expert predictors. What have I learned in all this? Mainly, that experts regularly get it wrong. Also, that experts move in herds — one expert influences another and they begin to mutually reinforce each other. In the worst cases, we get manias, whether it’s tulip mania in 17th century Holland or mortgage mania in 21st century America. Paying ten times your annual income for a tulip bulb in 1637 is really not that different from Bank of America paying $4 billion for Countrywide.

I’ve also learned that you can (sometimes) make a lot of money by betting against the experts. The clearest description of “shorting” the experts is probably The Big Short by Michael Lewis.

I’m also forming the opinion that the reason we call people “experts” is because they study problems closely. They’re analysts; they study the details. Like college professors, they know a lot about a little. That may make them interesting dinner partners (or not) but does it make them better predictors of the future?

I’m thinking that the experts’ “close read” makes them worse predictors of the future, not better. Why? Because they go inside the frame of the problems. They pursue the internal logic of the story. Studying the internal logic of a situation can be useful but, as I pointed out in a recent article, it can also lead you astray. In addition to the internal logic, you need to step outside the frame and study the structure of the problem. If you stay inside the frame, you may well understand the internal dynamics of the issue. But, in many cases, the external dynamics are more important.

The case that I’ve been following is the cost of healthcare in the United States. The experts all seem to be pointing in the same direction: healthcare costs will continue to skyrocket and ultimately bankrupt the country. The experts are pointing in one direction so, as in the past, I think it’s useful to look in the other direction and predict that healthcare costs won’t climb as rapidly as in the past or may even go down.

Here are two interesting pieces of evidence that suggest that the experts may be wrong. The first is a report from the Altarum Institute which notes that 2012 represented the “…fourth consecutive year of record-low growth [in healthcare spending] compared to all previous years in the 50-plus years of official health spending data.” Granted, there’s a debate as to whether the slowing growth is caused by the recession or by structural changes but the experts (yikes!) suggest that at least some of the shift is structural.

The second piece of evidence is a report by Matthew Yglesias in Slate that documents the dramatic decline in spending for healthcare construction. Spending to construct new hospitals dropped precipitously in 2008 and has stayed low, even during the recovery. As Yglesias points out, construction spending is “the closest thing we have to a real-time forecast of what the future is going to look like.”

So, are the experts wrong? As Chou En Lai liked to say, it’s too soon to tell. But let’s keep an eye on them. Otherwise, we could be framed.

 

The Art of the Wrong View

In one of my classes at the University of Denver, I try to teach my students how to manage technologies that constantly morph and change. They’re unpredictable, they’re slippery, and managing them effectively can make the difference between success and failure.

The students, of course, want to predict the future so they can prepare for it.  I try to convince them that predicting the future is impossible. But they’re young. They can explain the past, so why can’t they predict the future?

To help them prepare for the future — though not predict it — I often teach the techniques of scenario planning. You tell structured stories about the future and then work through them logically to understand which way the world might tilt. The technique has common building blocks, often referred to as PESTLE.  Your stories need to incorporate political, economic, societal, technical, legal, and environmental frameworks. This helps ensure that you don’t overlook anything.

I’ve used scenario planning a number of times and it has always helped me think through situations in creative ways – so it seems reasonable to teach it. To prepare for a recent class, I re-read The Art of the Long View by Peter Schwartz. I found it on one of my dustier bookshelves and discovered it was the 1991 edition.  While I remembered many of the main points, I was surprised to find a long chapter titled, “The World in 2005: Three Scenarios”. Here was a chance to see how well the inventor of scenario planning could prepare us for the future.

In sum, I was quite disappointed. The main error was that each scenario vastly overestimated the importance of Japan on the world stage in 2005. In a way, it all makes sense. The author was writing in 1991, when we all believed that Japan might just surpass every other economy on earth. Of course, he would assume that Japan would still dominate in 2005. Of course, he was wrong.

So what can we learn from this?  Two things, I think:

  1. Always remember to ask the reverse question. If it’s “obvious” that a trend will continue (e.g. Japan will dominate) always remember to ask the non-obvious question: what if it doesn’t? Today, it seems obvious that health care costs will continue to rise for the foreseeable future. But what if we make a medical breakthrough and costs plummet?
  2. Remember that resilience is better than prediction. We’ll never be able to predict the future — partially because we can’t really explain the past. But we can be prepared by building flexible systems that can respond to unexpected jolts. The human immune is probably a good model. This means building systems and organizations where information flows easily, creativity is valued, and leaders can emerge from anywhere.

I’ll continue to teach scenario planning in the future. After all, it’s a good template for thinking and planning. I’ll also be able to provide a very good example of how it can all go wrong.

My Social Media

YouTube Twitter Facebook LinkedIn

Newsletter Signup
Archives