🪴 Vik's Notes

Search

Search IconIcon to open search

Last updated Oct 9, 2023

# Survivorship bias in airplane bullet holes

“we can make it a habit to always ask what is not in the picture, but could be relevant. This, too, does not come naturally to us.

One of the most famous figures to illustrate this skill is the mathematician Abraham Wald (Mangel and Samaniego 1984). During World War II, he was asked to help the Royal Air Force find the areas on their planes that were most often hit by bullets so they could cover them with more armour. But instead of counting the bullet holes on the returned planes, he recommended armouring the spots where none of the planes had taken any hits.”

“The RAF forgot to take into account what was not there to see: All the planes that didn’t make it back. The RAF fell for a common error in thinking called survivorship bias (Taleb 2005). The other planes didn’t make it back because they were hit where they should have had extra protection, like the fuel tank. The returning planes could only show what was less relevant.”