The planes that came back were the wrong data.

The planes that came back were the wrong data.

A wartime lesson about the evidence you can actually see.

In World War II, the American military had a problem. Too many bombers were not coming home.

So they studied the ones that did. They mapped every bullet hole, looking for where the planes took the most fire.

The plan was sensible. Add armor where the holes clustered. The wings. The tail. The body of the plane.

A statistician named Abraham Wald told them they had it exactly backward.

The bullet holes were not the weak spots. They were the survivable spots. A plane could be hit there and still limp home.

The data was missing its most important half.

The planes hit in the engine, the cockpit, the fuel lines, those planes did not return to be studied. They were at the bottom of the sea.

Wald's advice was the opposite of obvious. Armor the places with no holes. That is where the planes that never came back had been hit.

He was right. The insight saved countless crews, and it has a name now. Survivorship bias.

We make this mistake constantly.

We study the winners and hunt for their secrets. The founders who made it. The bestselling authors. The people on the stage.

We read their habits and try to copy them.

But we are only ever studying the planes that came back.

For every famous dropout who built an empire, there are thousands who dropped out and vanished. Nobody interviews them. They wrote no memoir.

The advice that survives is the advice that survivors give. That does not make it true. It just makes it loud.

The quiet failures, the ones who did the exact same thing and lost, are not in the room. So we never weigh them.

Next time someone shows you a pattern in the winners, ask the harder question. Where are the people who did the same thing and failed?

If you cannot find them, you cannot trust the pattern.

The most important data is often the data that is not in the room.

"The dog did nothing in the night-time." "That was the curious incident."

From Arthur Conan Doyle's Sherlock Holmes. The absence was the clue.