How to conduct post-launch user experiments (user testing) for brand-new product features

Atik Rahman

Published in

Bootcamp

4 min readFeb 3, 2023

Before diving into the details, let's talk about what USER TESTING is.

User Testing

User testing is the process of evaluating a product, such as a website, app, or software, by having real users perform tasks and provide feedback. The purpose of user testing is to understand how users interact with the product, identify any issues or pain points, and make improvements to enhance the overall user experience.
User testing can be conducted in various forms, such as usability testing, where users are asked to perform specific tasks and provide feedback on their experience, or surveys and focus groups, where users are asked more general questions about their thoughts and opinions on the product.

User testing is important because it provides valuable insights directly from your target audience, allowing you to validate your assumptions, identify areas for improvement, and create a product that meets the needs and expectations of your users.

Types of user testing

There are several types of user testing, including:

Usability Testing
Participants are asked to perform specific tasks using the product and provide feedback on their experience. This type of testing is used to identify any usability issues and make improvements to the user interface and user experience.
A/B Testing
Two versions of a product are tested with two different groups of users to determine which version performs better. This type of testing is often used to compare the effectiveness of different design elements or features.
Surveys
Participants are asked to complete a questionnaire about their experience using the product. This type of testing is used to gather more general feedback and opinions about the product.
Focus Groups
Participants come together to discuss their experience using the product and provide feedback in a group setting. This type of testing is used to gather in-depth qualitative data about the product.
Remote User Testing:
Participants are asked to complete tasks using the product from a remote location, often using their own devices. This type of testing is used to gather data from a larger, more diverse pool of participants.
Contextual Inquiry
Participants are observed in their natural environment using the product, providing insight into the context in which the product is being used. This type of testing is used to gather qualitative data about the user’s experience and environment.
Beta Testing
Participants are given early access to a product and are asked to provide feedback before the product is released to the general public. This type of testing is used to identify and fix any remaining issues before the product is launched.

How to conduct user testing?

Conducting user testing for a new feature involves the following steps:

1. Define the goal of user testing

Clearly define what you want to test and what outcome you expect from the test.

2. Select participants
Choose participants who fit your target audience and have relevant experience with similar products.

3. Prepare test environment and materials
Set up a testing environment that mimics the real-world usage of the feature, and prepare all necessary materials such as consent forms and testing scripts.

4. Conduct the test
Ask participants to perform tasks using the new feature, observe their behavior, and ask them for feedback.

5. Analyze the data
Review the results of the tests, identify any issues or areas for improvement, and use the feedback to make necessary changes to the feature.

6. Repeat testing
If necessary, repeat the testing process until you are satisfied with the performance of the feature.

7. Implement changes
Based on the results of user testing, implement any necessary changes to the feature.

Conclusion

It is important to follow ethical guidelines while conducting user testing, such as obtaining informed consent from participants and protecting their privacy.