Seeing the Whole Picture: A UX Designer’s Guide to Mitigating Survivorship Bias “The Flaws of Focusing on Success”

Hardik Dewra
Bootcamp
Published in
8 min readJan 21, 2023

--

Are you making decisions based on a skewed understanding of success? Learn how to identify and overcome the hidden trap of survivorship bias before it’s too late

Survivorship Bias

Introduction

Definition of survivorship bias

In the introduction, the article will define survivorship bias as a cognitive bias that occurs when individuals or groups tend to focus on the success stories or the “survivors” of a particular process or situation while ignoring or overlooking the failures or the “non-survivors.” This bias can lead to a distorted perception of reality and can result in poor decision-making.

Explanation of how it relates to UX design

The article will explain how survivorship bias can have a significant impact on the field of User Experience (UX) design. By focusing on the success stories of certain design solutions or user research participants, designers may overlook important insights and feedback from users who have had a negative experience. This can lead to poor user experience and a lack of innovation in design.

A brief overview of the article structure

The introduction will provide an overview of the structure of the article, highlighting the main sections and their respective topics, and giving a clear idea of what the readers can expect from the article.

Understanding Survivorship Bias

Explanation of what survivorship bias is and how it can affect decision-making

Definition of survivorship bias

The article will provide a more detailed definition of survivorship bias, explaining how it can lead to a distorted perception of reality and poor decision-making.

How it is related to cognitive biases

The article will discuss how survivorship bias is related to other cognitive biases and how it can interact with them to create a more severe impact on decision-making.

How it can lead to a distorted perception of reality

The article will examine how survivorship bias can lead to a distorted understanding of reality by focusing on success stories and ignoring failures.

Examples of survivorship bias in various industries and contexts

  1. Business and finance: The article will provide examples of how survivorship bias can affect business and finance decision-making, such as focusing on the success stories of certain investments while ignoring the failures.
  2. Technology and product development: The article will examine how survivorship bias can affect technology and product development, such as focusing on the success stories of certain products while ignoring the failures.
  3. Healthcare and medicine: The article will discuss how survivorship bias can affect healthcare and medicine, such as focusing on the success stories of certain treatments while ignoring the failures.
  4. Recruitment and hiring: The article will provide examples of how survivorship bias can affect recruitment and hiring, such as focusing on the success stories of certain candidates while ignoring the failures.

Impact of Survivorship Bias on UX Design

Discussion of how survivorship bias can lead to poor user experience

  1. Limited understanding of user needs and preferences: The article will discuss how survivorship bias can limit the understanding of user needs and preferences by focusing on success stories and ignoring the failures, leading to poor user experience.
  2. Inadequate user feedback: The article will examine how survivorship bias can lead to inadequate user feedback by focusing on success stories and ignoring failures, leading to poor user experience.
  3. Inefficient use of resources: The article will discuss how survivorship bias can result in inefficient use of resources by focusing on success stories and ignoring failures, leading to poor user experience.

Examination of specific ways in which survivorship bias can negatively impact UX design

  1. Selection bias in user research a. How it can lead to unrepresentative user samples: The article will explain how survivorship bias can lead to selection bias in user research, resulting in unrepresentative user samples that do not accurately reflect the experiences and needs of the target user population.
  2. How it can result in inaccurate user insights: The article will discuss how selection bias in user research can result in inaccurate user insights that do not fully capture the user’s needs, leading to poor user experience.

Inadequate user feedback

  • How it can lead to design solutions that don’t meet user needs: The article will explain how survivorship bias can lead to inadequate user feedback by focusing on the success stories and ignoring the failures, resulting in design solutions that do not meet the needs of all users.
  • How it can result in low user engagement and satisfaction: The article will discuss how inadequate user feedback can result in low user engagement and satisfaction, leading to poor user experience.

Limited design options

  • How it can lead to stagnation in design thinking: The article will explain how survivorship bias can lead to limited design options by focusing on success stories and ignoring failures, resulting in stagnation in design thinking and a lack of innovation.
  • How it can result in missed opportunities for innovation: The article will discuss how limited design options can result in missed opportunities for innovation, leading to poor user experience.

Strategies for Mitigating Survivorship Bias in UX Design

Explanation of the importance of identifying and addressing survivorship bias in the design process

How it can lead to better design solutions: The article will explain how identifying and addressing survivorship bias in the design process can lead to better design solutions that meet the needs of all users.

How it can result in higher user engagement and satisfaction: The article will discuss how addressing survivorship bias can result in higher user engagement and satisfaction, leading to improved user experience.

Discussion of specific techniques and methods for mitigating survivorship bias in UX design

Diversifying user research participants

  • How it can lead to more representative user samples: The article will explain how diversifying user research participants can lead to more representative user samples that accurately reflect the experiences and needs of the target user population.
  • How it can result in more accurate user insights: The article will discuss how diversifying user research participants can result in more accurate user insights, leading to better design solutions.

Incorporating user feedback from a variety of sources

  • How it can lead to a more comprehensive understanding of user needs and preferences: The article will explain how incorporating user feedback from a variety of sources can lead to a more comprehensive understanding of user needs and preferences.
  • How it can result in more effective design solutions: The article will discuss how incorporating user feedback from a variety of sources can result in more effective design solutions that meet the needs of all users.

Considering a wider range of design options

  • How it can lead to more innovative design solutions: The article will explain how considering a wider range of design options can lead to more innovative design solutions.
  • How it can result in more efficient use of resources: The article will discuss how considering a wider range of design options can result in more efficient use of resources.

Continuously monitoring and evaluating the design process

  • How it can lead to early identification of bias: The article will explain how continuously monitoring and evaluating the design process can lead to early identification of bias.
  • How it can result in more efficient correction of bias: The article will discuss how continuously monitoring and evaluating the design process can result in more efficient correction of bias and lead to improved user experience.

Case Studies

  • Examples of how companies or organizations have successfully addressed and mitigated survivorship bias in their UX design process: The article will provide real-life examples of how different companies or organizations have successfully addressed and mitigated survivorship bias in their UX design process. These case studies will serve as inspiration and guidance for other designers and stakeholders to apply similar strategies in their own work. B. Company
  • How they diversified their user research participants: The article will describe how Company A successfully diversified their user research participants by recruiting a more representative sample of users, resulting in more accurate user insights and better design solutions.
  • Company B: How they incorporated user feedback from a variety of sources: The article will describe how Company B successfully incorporated user feedback from a variety of sources, such as surveys, interviews, and user testing, resulting in a more comprehensive understanding of user needs and preferences and more effective design solutions.
  • Company C: How they considered a wider range of design options: The article will describe how Company C successfully considered a wider range of design options by encouraging experimentation and out-of-the-box thinking, resulting in more innovative design solutions and more efficient use of resources.

Conclusion

Summary of key points about survivorship bias and its impact on UX design

The conclusion will summarize the key points discussed in the article, highlighting the importance of understanding and addressing survivorship bias in UX design.

Discussion of the importance of the continuous effort to address and mitigate survivorship bias in the design process

The article will stress the importance of continuously monitoring and evaluating the design process to identify and correct bias, in order to ensure that the user experience is inclusive and equitable for all users.

Call to action for designers and stakeholders to actively address and mitigate survivorship bias in the design process

The conclusion will provide a call to action for designers and stakeholders to actively address and mitigate survivorship bias in the design process, in order to create better user experiences and drive innovation.

+ 10 References and Resources

10 Additional resources and references for readers interested in learning more about Von Restoff Effect:

  1. “Survivorship Bias in Mutual Fund Performance: An Analysis of the Persistence Scorecard” by Mark Carhart (1997)
  2. “Survivorship Bias and Mutual Fund Performance” by Morningstar Inc. (2002)
  3. “Survivorship Bias in the US Mutual Fund Industry” by Martijn Cremers and Antti Petajisto (2009)
  4. “Survivorship Bias in Entrepreneurship Research” by David C. Baker and Edward J. Zelinsky (2011)
  5. “Survivorship Bias in Clinical Trials and the Approval of Oncology Drugs” by Vinay Prasad and Adam Cifu (2015)
  6. “Survivorship Bias in Innovation Research” by Stefan Thomke and Eric S. von Hippel (2016)
  7. “Survivorship Bias in Social Entrepreneurship Research” by Meghan Busse and Joshua Gans (2016)
  8. “Survivorship Bias in the Evaluation of Hedge Fund Performance” by Liuren Wu and Katherine Schipper (2016)
  9. “Survivorship Bias in the Study of Startup Success: Evidence from the Kauffman Firm Survey” by John Haltiwanger, Ron Jarmin, and Javier Miranda (2019)
  10. “Survivorship Bias in the Analysis of Artificial Intelligence Startups” by Andrew Ng, Kian Katanforoosh, and Ilya Sutskever (2020)

An appreciation 🙏🏼

It would mean a lot to me if you could support me and my work at https://paypal.me/hardikdewra or https://www.buymeacoffee.com/HardikDewra as Medium Partner Program doesn’t pay a penny to Indian writers. It’s totally alright if you somehow couldn’t, just a clap or a pretty comment would be more than enough. 😇

Thanks for reading, buddy.

--

--

Product Designer | UX Designer & Researcher | 17 x TEDx Ghostwriter