The Structure of Predictions

The cost of my services may go down.

I like to think about the future. So, in the past, I’ve written about scenario planning, prediction markets, resilience, and expert predictors. What have I learned in all this? Mainly, that experts regularly get it wrong. Also, that experts move in herds — one expert influences another and they begin to mutually reinforce each other. In the worst cases, we get manias, whether it’s tulip mania in 17th century Holland or mortgage mania in 21st century America. Paying ten times your annual income for a tulip bulb in 1637 is really not that different from Bank of America paying $4 billion for Countrywide.

I’ve also learned that you can (sometimes) make a lot of money by betting against the experts. The clearest description of “shorting” the experts is probably The Big Short by Michael Lewis.

I’m also forming the opinion that the reason we call people “experts” is because they study problems closely. They’re analysts; they study the details. Like college professors, they know a lot about a little. That may make them interesting dinner partners (or not) but does it make them better predictors of the future?

I’m thinking that the experts’ “close read” makes them worse predictors of the future, not better. Why? Because they go inside the frame of the problems. They pursue the internal logic of the story. Studying the internal logic of a situation can be useful but, as I pointed out in a recent article, it can also lead you astray. In addition to the internal logic, you need to step outside the frame and study the structure of the problem. If you stay inside the frame, you may well understand the internal dynamics of the issue. But, in many cases, the external dynamics are more important.

The case that I’ve been following is the cost of healthcare in the United States. The experts all seem to be pointing in the same direction: healthcare costs will continue to skyrocket and ultimately bankrupt the country. The experts are pointing in one direction so, as in the past, I think it’s useful to look in the other direction and predict that healthcare costs won’t climb as rapidly as in the past or may even go down.

Here are two interesting pieces of evidence that suggest that the experts may be wrong. The first is a report from the Altarum Institute which notes that 2012 represented the “…fourth consecutive year of record-low growth [in healthcare spending] compared to all previous years in the 50-plus years of official health spending data.” Granted, there’s a debate as to whether the slowing growth is caused by the recession or by structural changes but the experts (yikes!) suggest that at least some of the shift is structural.

The second piece of evidence is a report by Matthew Yglesias in Slate that documents the dramatic decline in spending for healthcare construction. Spending to construct new hospitals dropped precipitously in 2008 and has stayed low, even during the recovery. As Yglesias points out, construction spending is “the closest thing we have to a real-time forecast of what the future is going to look like.”

So, are the experts wrong? As Chou En Lai liked to say, it’s too soon to tell. But let’s keep an eye on them. Otherwise, we could be framed.