Survivorship Bias

Introduction

Survivorship bias is a cognitive bias that occurs when we focus on the individuals or things that "survived" a process or event while overlooking those that did not. It leads to an incomplete or skewed understanding of reality because we only consider the successful outcomes or visible examples and ignore the unsuccessful or invisible ones.

Examples

1. Financial Success: When we look at successful entrepreneurs, billionaires, or stock market winners, we tend to study their strategies and attribute their success solely to their actions and decisions. However, we neglect to consider the countless individuals who followed similar paths but did not achieve the same level of success.

2. World War II Aircraft: During World War II, the US military analyzed damaged aircraft returning from missions to identify areas that needed reinforcement. The focus was on the areas with the most bullet holes. However, statistician Abraham Wald pointed out that this analysis overlooked the planes that didn't return, as they likely sustained damage in critical areas that led to their destruction. The military needed to reinforce the areas without bullet holes—the survivorship bias was causing a flawed analysis.

3. Celebrity Endorsements: Advertisers often use celebrity endorsements to promote products. They showcase successful individuals who endorse the product and imply that using it will lead to success. However, this overlooks the fact that many other celebrities may have used the product but didn't achieve the same level of success, leading to an inflated perception of the product's effectiveness.

4. Job Market Success: When we hear stories of people who dropped out of college and became highly successful, it's tempting to believe that formal education is unnecessary for success. However, this survivorship bias fails to consider the vast number of people who dropped out but did not achieve the same level of success, leaving a skewed perception of the importance of education.

5. Historical Innovations: When studying historical breakthroughs or inventions, we often focus on the successful inventors and their creations. However, this overlooks the numerous failed attempts and inventors who didn't achieve recognition or commercial success. The survivorship bias can distort our understanding of the innovation process.

Impact

1. Distorted Perception of Success: Survivorship bias can lead us to overestimate the chances of success and underestimate the risks and challenges involved. When we only focus on the survivors, we create an illusion that success is more common and achievable than it actually is. This can lead to unrealistic expectations and poor decision-making, especially in fields such as entrepreneurship, investing, and career choices.

2. Misguided Strategies and Policies: When survivorship bias skews our understanding of what works and what doesn't, it can result in ineffective strategies and policies. For example, in the business world, if only successful companies are studied and their strategies replicated, it can lead to the adoption of flawed practices without considering the failures and lessons learned from unsuccessful companies.

3. Limited Learning Opportunities: By ignoring failed attempts and unsuccessful outcomes, survivorship bias limits our learning opportunities. We miss out on valuable insights that could help us avoid pitfalls and improve our chances of success. Whether in personal endeavors or professional settings, understanding both successes and failures is crucial for growth and improvement.

4. Unrealistic Expectations: Survivorship bias can create unrealistic expectations and perceptions of what it takes to achieve success. When we only see the end result and not the journey or the failures along the way, we may underestimate the effort, persistence, and resilience required. This can lead to frustration, disappointment, and a lack of motivation when we encounter challenges or setbacks.

5. Reinforcement of False Beliefs: Survivorship bias can reinforce false beliefs or stereotypes. For example, if we only hear stories of successful individuals from certain backgrounds or with specific characteristics, we may incorrectly assume that those attributes are the key to success. This can perpetuate biases and limit opportunities for individuals who do not fit the survivorship narrative.

Causes

1. Selective Data Collection: One major cause of survivorship bias is the selective collection of data. When only successful cases or survivors are included in the dataset, the failures or unsuccessful cases are excluded, leading to an incomplete and biased representation of reality. This can occur in various fields, such as business, investing, scientific research, and historical analysis.

2. Data Exclusion: Survivorship bias can also occur when certain data points are intentionally excluded or overlooked. This can happen when researchers or analysts focus only on readily available data or data that supports their preconceived notions or desired outcomes. Ignoring or excluding data that contradicts the desired narrative can lead to skewed conclusions and biased understanding.

3. Reporting Bias: The way data is reported or presented can contribute to survivorship bias. When success stories are highlighted and failures are ignored or downplayed in media, publications, or presentations, it creates a distorted perception of reality. This can result in an overemphasis on success and an underrepresentation of failure, leading to unrealistic expectations and flawed decision-making.

4. Lack of Long-Term Perspective: Survivorship bias often occurs when there is a lack of long-term perspective or historical context. By focusing only on the present or recent success stories, we may neglect the failures and setbacks that occurred in the past. This can lead to a skewed understanding of the challenges and risks involved in achieving success and a failure to learn from past mistakes.

5. Unobserved Variables: Survivorship bias can also be caused by unobserved variables or hidden factors that influence outcomes. For example, in analyzing successful companies, we might attribute their success solely to their strategies or leadership without considering external factors like market conditions, timing, or luck. This omission of important variables can lead to a biased understanding of success and failure.

6. Human Judgment and Perception: The way humans perceive and interpret information can also contribute to survivorship bias. Our tendency to focus on vivid or memorable events and our cognitive biases, such as confirmation bias or availability heuristic, can lead us to give disproportionate attention to successful outcomes while ignoring or discounting failures. This subjective interpretation of data can reinforce survivorship bias.

Mitigation

1. Include Complete Data: To counter survivorship bias, it is important to include both successful and unsuccessful cases in the dataset. By collecting and analyzing a comprehensive set of data that encompasses all outcomes, a more accurate and unbiased picture can be obtained. This may involve actively seeking out and including data on failures or unsuccessful cases.

2. Consider Long-Term Perspective: Taking a long-term perspective is essential in mitigating survivorship bias. It is important to look beyond the immediate success stories and examine the historical data, including both successes and failures. By understanding the full spectrum of outcomes over time, a more realistic assessment of risks and probabilities can be made.

3. Conduct Sensitivity Analysis: Conducting sensitivity analysis helps in understanding the impact of different scenarios and outcomes. By varying key variables and examining the effect on results, it becomes possible to assess the robustness of conclusions and identify potential biases. Sensitivity analysis helps in uncovering the influence of unobserved variables and understanding the range of possible outcomes.

4. Account for Selection Bias: Survivorship bias is often associated with selection bias, where certain cases are selectively included or excluded from analysis. It is important to identify and address selection bias by using appropriate sampling techniques and ensuring representative samples. Random sampling, stratified sampling, or other sampling methods can help reduce the impact of selection bias.

5. Analyze Failure Patterns: Analyzing failure patterns can provide valuable insights in mitigating survivorship bias. By studying the reasons behind failures and identifying common patterns or factors contributing to failures, it becomes possible to learn from past mistakes and avoid similar pitfalls. This knowledge can inform decision-making and improve future outcomes.

6. Challenge Assumptions and Narratives: To mitigate survivorship bias, it is essential to challenge assumptions and narratives that may be biased towards success. This involves critically examining the underlying beliefs, expectations, and narratives that shape our understanding of success and failure. By questioning prevailing wisdom and seeking diverse perspectives, a more balanced and nuanced view can be achieved.

7. Raise Awareness: Raising awareness about survivorship bias is important in mitigating its effects. Educating individuals, researchers, analysts, and decision-makers about the existence and implications of survivorship bias can help foster a more critical and discerning approach to data analysis. By being mindful of the potential for survivorship bias, people can make more informed and unbiased decisions.

Merchandise

Click on images to view the products