Usability Study, A Comprehensive Guide
Hey there! I’ve been talking about usability studies for a while now and I’m excited to share some of my personal experience and insights on the topic. Through conducting usability studies, I’ve gained valuable knowledge on how to improve design solutions for my users. Let’s dive into the world of usability studies together!
What is Usability?
Usability can be defined as the extent to which a specific user, within a particular context, is able to effectively, efficiently, and satisfactorily utilize a product or design to reach a predetermined objective.
What is Usability Study?
A user experience research method that evaluates the level of ease for users to perform essential tasks within a design.
Why Conduct a Usability Study?
- Uncover problems in the design
- Discover opportunities for improvement
- Learn about user behaviours and preferences
When to Conduct a Usability Study
Before design
A usability study can be performed during the early stages of a design/redesign project to identify and assess the feasibility of the proposed idea.
During design
A usability study can be conducted utilizing an interactive prototype of the on going design, offering valuable insights into areas that may require revision prior to its launch.
Post launch
A usability study can be conducted after the product is finalized and launched to gain understanding of how users interact with it in real-world scenarios.
Types of Usability Study
Unmoderated
Participants test out the prototypes without human guidance
Moderated
A moderator/group of moderators guides the participants through the study in real-time
Moderators: UX researchers who conduct the usability test. Each moderator will carry out duties like guiding the participant, observing the participant, tracking time and taking notes.
Participant: A user who would use the design solution in real life
Benefits and Limitations of Unmoderated Usability Study
Benefits
- Participants use the product in a real-world environment
- Participants complete tasks on their schedule and premises
- Participants may feel more comfortable giving honest feedback without others around
Limitations
- With no human guidance, the chances of participant getting confused if any issues arise
- No real-time questions and follow-ups
- No control over the environment
- Chances of lack of focus
Benefits and Limitations of Moderated Usability Study
Benefits
- Guide the participant throughout the study
- Can ask questions and follow up in real-time
- Build a rapport between participant and moderators
Limitations
- Chance of moderators influencing participants causing various biases
- Lack of flexibility
Steps to Conduct Remote Moderated Usability Study
- Build a rapport with participants- Welcome them, make them feel comfortable
- Thank the participants for their participation
- Ask for permissions- Video recording, Screen sharing etc.
- Explain the basic guidelines of the usability study
- Remind participants to give honest and open feedback
- Remind participants they are not being tested — Explain that they’re helping us improve a design solution
- Explain the focus of the study and set the context
- Do not force things on the participants
- Request them to sign an NDA, if necessary
Tips for Moderated Usability Study
- Ask open-ended questions
- Ask follow-up questions
- Sum up the participant’s answers and confirm
- Be mindful about the issues that can occur during a remote usbility study and prepare for it
- Do not assume things
- A positive attitude and a good smile
What to Capture
- The basic details of the participant- Location, Age etc. 📍
- Device/platform/environment they are using to interact with the design solution 🖥
- Task completion time ⏱
- Words the participants use while interacting with the design solution 🗣
- Actions and gestures by the participants 👍🏼
- Questions asked by the participants ❓
- Suggestions and recommendations from the participants 💡
Usability Testing Protocol
Usability testing protocol is a script which can be used by the UX Researchers during the time of a Moderated Usability Testing session. The script can vary based on the context and concept.
Make sure your script has the following details:
- Introduction — Welcome, Introduce each other, Thank the participant etc.
- Ask for the participant’s details if not known already
- Pre-requisite checks — Video, Audio, Screen share, Browser etc.
- Explain the context and provide the design solution
- Follow-up questions
- SUS, Product reaction test, A/B test (optional)
- Conclusion — Thank the participant, Explain to them how their feedback will help
Tools to Consider
System usability scale (SUS)
The System Usability Scale is a Likert Scale which includes 10 questions. You can ask your participant to fill the form to give their feedback based on the interaction they had with the design solution. Make sure to keep it anonymous so that the users feel motivated to give you honest feedback.
Read more about SUS here: shorturl.at/LMY08
Rapid product reaction test
A pool of words from which the participant needs to select 5 words that best describe their experience while performing tasks. You can either send the document to mark the words by the participants themselves or you can share your screen and mark the words they say.
A/B testing
Method of comparing two versions of a design solution against each other to determine which one performs better
Note Taking Template
You have to prepare a template to jot down all your findings during the Usability Study. You can use tools like MS Excel or Google Sheets. You cannot always jot down all points during the session but don’t worry, you can revisit the recording of the session and capture information
Common Biases to be Aware of
Implicit/Unconscious bias
Collection of attitudes or stereotypes we associate with people without conscious knowledge
Serial position effect
Remembering only the first and last of items from a list given items
Friendliness bias
The tendency of people to agree with those they like to avoid confrontational conversations
Social desirability bias
The tendency of people to give answers that are viewed favourably by others
References
- Interaction design foundation- https://www.interaction-design.org
- Google Design- https://design.google
- NN Group- https://www.nngroup.com/
Further Reads
Users will never forget how your product made them feel.
-Mario Maruffi
Please note that this covers only a tip of the iceberg when it comes to Usability Study. If you are a UX student, professional or enthusiast please read more on all the topics discussed here. These are my knowledge acquired from my research and experience. Please feel free to comment your feedback.
