What’s better than a UX team doing awesome research? A whole organization backing investment in UX research. What’s that look like in practice?  Collaboration and support from stakeholders across the organization throughout the research process from set up, doing studies, sharing insights, and digesting, understanding, and actioning recommendations based on the amazing insights you generate.

UX research should be something that is known, understood, and expected across your organization. Rather than keeping all the insight goodies to yourselves, why not democratize user research by making it accessible and shareable to all stakeholders to drive understanding of its value wherever they sit in the organization?

We go into this in more detail in our ebook UX Research for Teams. By including the stakeholders throughout the process, the role of research becomes a lot more visible throughout the organization. Having the best online tools to make the whole process simple and straightforward is a great place to start.

1. Who owns the research?

Recognition that the user research undertaken in your organization benefits the whole organization is essential for setting up key resources. By ensuring that everyone is operating from the same set of tools, the insights and results are easier to manage, find and file. It also means if someone leaves,  they don’t leave with all the insights and knowledge.

2. Everyone’s a researcher

Everyone within the organization should have the opportunity to be involved with UX research and should be encouraged to have a base understanding of the process (and even try out the tools) or, at the very least, have some understanding of the results and insights. If everyone has access to the tools, they can use these no matter where they sit in the organization. 

3. Don’t get distracted by shiny things

Maintaining a single source of research, with a well-organized filing system means you can always look at what has gone before. It is a great place to start. The best UX researchers often revisit past studies to see where to go from here. Creating consistency through the process and output means comparing insights are simpler.

4. Research is better with friends

What’s better than one mind? It’s two or more. Working alongside a team opens new perspectives, thinking, problem-solving, and approaches. New ways to see a problem and how to interpret insights and results. By socializing your results with the key stakeholders, you bring them on the journey, explaining how and why UX research is important to the project and the wider team. Firming up the opportunity for future research.

5. Qualitative research insights that are simple to find

Qualitative research tools are designed to assist you with testing types, including user interviews, contextual inquiries, and usability tests. Working as a team with tags, sorting, and recording can be made simple and streamlined. 

One of the best decisions you can make as a researcher is to bring the organization along for the ride. Setting up consistent tools across the team (and beyond) will help streamline research, making it simpler for all to be involved at each step of the process. Embedding UX research into each part of the organization. 

Take a look at our ebook UX Research for Teams, where we go into more detail.

For those new to the qualitative research space, there’s one question that’s usually pretty tough to figure out, and that’s the question of how many participants to include in a study. Regardless of whether it’s research as part of the discovery phase for a new product, or perhaps an in-depth canvas of the users of an existing service, researchers can often find it difficult to agree on the numbers. So is there an easy answer? Let’s find out.

‍

Here, we’ll look into the right number of participants for qualitative research studies. If you want to know about participants for quantitative research, read Nielsen Norman Group’s article.

‍

‍

Getting the numbers right

‍

So you need to run a series of user interviews or usability tests and aren’t sure exactly how many people you should reach out to. It can be a tricky situation – especially for those without much experience. Do you test a small selection of 1 or 2 people to make the recruitment process easier? Or, do you go big and test with a series of 10 people over the course of a month? The answer lies somewhere in between.

‍

It’s often a good idea (for qualitative research methods like interviews and usability tests) to start with 5 participants and then scale up by a further 5 based on how complicated the subject matter is. You may also find it helpful to add additional participants if you’re new to user research or you’re working in a new area.

‍

What you’re actually looking for here is what’s known as saturation.

‍

‍

Understanding saturation

‍

Whether it’s qualitative research as part of a master’s thesis or as research for a new online dating app, saturation is the best metric you can use to identify when you’ve hit the right number of participants.

‍

In a nutshell, saturation is when you’ve reached the point where adding further participants doesn’t give you any further insights. It’s true that you may still pick up on the occasional interesting detail, but all of your big revelations and learnings have come and gone. A good measure is to sit down after each session with a participant and analyze the number of new insights you’ve noted down.

‍

Interestingly, in a paper titled How Many Interviews Are Enough?, authors Greg Guest, Arwen Bunce and Laura Johnson noted that saturation usually occurs with around 12 participants in homogeneous groups (meaning people in the same role at an organization, for example). However, carrying out ethnographic research on a larger domain with a diverse set of participants will almost certainly require a larger sample.

‍

‍

Ensuring you’ve hit the right number of participants

‍

How do you know when you’ve reached saturation point? You have to keep conducting interviews or usability tests until you’re no longer uncovering new insights or concepts.

‍

While this may seem to run counter to the idea of just gathering as much data from as many people as possible, there’s a strong case for focusing on a smaller group of participants. In The logic of small samples in interview-based, authors Mira Crouch and Heather McKenzie note that using fewer than 20 participants during a qualitative research study will result in better data. Why? With a smaller group, it’s easier for you (the researcher) to build strong close relationships with your participants, which in turn leads to more natural conversations and better data.

‍

There's also a school of thought that you should interview 5 or so people per persona. For example, if you're working in a company that has well-defined personas, you might want to use those as a basis for your study, and then you would interview 5 people based on each persona. This maybe worth considering or particularly important when you have a product that has very distinct user groups (e.g. students and staff, teachers and parents etc).

‍

‍

How your domain affects sample size

‍

The scope of the topic you’re researching will change the amount of information you’ll need to gather before you’ve hit the saturation point. Your topic is also commonly referred to as the domain.

‍

If you’re working in quite a confined domain, for example, a single screen of a mobile app or a very specific scenario, you’ll likely find interviews with 5 participants to be perfectly fine. Moving into more complicated domains, like the entire checkout process for an online shopping app, will push up your sample size.

‍

As Mitchel Seaman notes: “Exploring a big issue like young peoples’ opinions about healthcare coverage, a broad emotional issue like postmarital sexuality, or a poorly-understood domain for your team like mobile device use in another country can drastically increase the number of interviews you’ll want to conduct.”

‍

‍

In-person or remote

‍

Does the location of your participants change the number you need for qualitative user research? Well, not really – but there are other factors to consider.

‍

• Budget: If you choose to conduct remote interviews/usability tests, you’ll likely find you’ve got lower costs as you won’t need to travel to your participants or have them travel to you. This also affects…
• Participant access: Remote qualitative research can be a lifesaver when it comes to participant access. No longer are you confined to the people you have physical access to — instead you can reach out to anyone you’d like.
• Quality: On the other hand, remote research does have its downsides. For one, you’ll likely find you’re not able to build the same kinds of relationships over the internet or phone as those in person, which in turn means you never quite get the same level of insights.

‍

‍

Is there value in outsourcing recruitment?

‍

Recruitment is understandably an intensive logistical exercise with many moving parts. If you’ve ever had to recruit people for a study before, you’ll understand the need for long lead times (to ensure you have enough participants for the project) and the countless long email chains as you discuss suitable times.

‍

Outsourcing your participant recruitment is just one way to lighten the logistical load during your research. Instead of having to go out and look for participants, you have them essentially delivered to you in the right number and with the right attributes.

‍

We’ve got one such service at Optimal Workshop, which means it’s the perfect accompaniment if you’re also using our platform of UX tools. Read more about that here.

‍

‍

Wrap-up

‍

So that’s really most of what there is to know about participant recruitment in a qualitative research context. As we said at the start, while it can appear quite tricky to figure out exactly how many people you need to recruit, it’s actually not all that difficult in reality.

‍

Overall, the number of participants you need for your qualitative research can depend on your project among other factors. It’s important to keep saturation in mind, as well as the locale of participants. You also need to get the most you can out of what’s available to you. Remember: Some research is better than none!

Our exciting new feature, segments, saves time by allowing you to create and save groups of participant responses based on various filters. Think of it as your magic wand to effortlessly organize and scrutinize the wealth of data and insight you collect in your studies. Even more exciting is that the segments are available in all our quantitative study tools, including Optimal Sort, Treejack, Chalkmark, and Questions.

‍

What exactly are segments?

‍

In a nutshell, segments let you effortlessly create and save groups of participants' results based on various filters, saving you and the team time and ensuring you are all on the same page. 

A segment represents a demographic within the participants who completed your study. These segments can then be applied to your study results, allowing you to easily view and analyze the results of that specific demographic and spot the hidden trends.

‍

What filters can I use?

‍

Put simply, you've got a treasure trove of participant data, and you need to be able to slice and dice it in various ways. Segmenting your data will help you dissect and explore your results for deeper and more accurate results.

‍

Question responses: Using a screener survey or pre - or post-study questions with pre-set answers (like multi-choice), you can segment your results based on their responses.

‍

URL tag: If you identify participants using a unique identifier such as a URL tag, you can select these to create segments.

‍

Tree test tasks, card sort categories created, first click test and survey responses: Depending on your study type, you can create a segment to categorize participants based on their response in the study. 

‍

Time taken: You can select the time taken filter to view data from those who completed your study in a short space of time. This may highlight some time wasters who speed through and probably haven’t provided you with high-quality responses. On the other hand, it can provide insight into A/B tests for example, it could show you if it’s taking participants of a tree test longer to find a destination in one tree or another.

‍

With this feature, you can save and apply multiple segments to your results, using a combination of AND/OR logic when creating conditions. This means you can get super granular insights from your participants and uncover those gems that might have otherwise remained hidden.

‍

When should you use segments?

‍

This feature is your go-to when you have results from two or more participant segments. For example, imagine you're running a study involving both teachers and students. You could focus on a segment that gave a specific answer to a particular task, question, or card sort. It allows you to drill down into the nitty-gritty of your data and gain more understanding of your customers.

‍

How segments help you to unlock data magic 💫

‍

Let's explore how you can harness the power of segments:

‍

Save time: Create and save segments to ensure everyone on your team is on the same page. With segments, there's no room for costly data interpretation mishaps as everyone is singing from the same hymn book.

‍

Surface hidden trends: Identifying hidden trends or patterns within your study is much easier.  With segments,  you can zoom in on specific demographics and make insightful, data-driven decisions with confidence.

‍

Organized chaos: No more data overload! With segments, you can organize participant data into meaningful groups, unleashing clarity and efficiency.

‍

How to create a segment

‍

Ready to take segments for a spin?  To create a new segment or edit an existing one, go to  Results > Participants > Segments. Select the ‘Create segment’ button and select the filters you want to use. You can add multiple conditions, and save the segment.  To select a segment to apply to your results, click on ‘All included participants’ and select your segment from the drop-down menu.  This option will apply to all your results in your study. 

‍

We can't wait to see the exciting discoveries you'll make with this powerful tool. Get segmenting, and let us know what you think! 

‍

Help articles
‍

How to add a group tag in a study URL for participants
‍
How to integrate with a participant recruitment panel

‍

Design has a problem — historical and still pressing — of only designing for users that are easily accessible, are able to participate, or who meet some pre-determined idea of a ‘target’ or an ‘average’ user.

This is bad for organisations, who are missing out on a huge segment of the people they’d like to reach, and it’s bad for users, who can feel shut out of the services they’d like to access.

Remote research allows you to address common diversity and inclusion challenges of in-person research, and create a better product or service as a result.

Occupational diversity

While you’re probably already making considered attempts to include a diverse range of participants, the reality is that many people are simply not able to participate in research.

Some people cannot make it in to your research facilities for an hour on a weekday for an in-person interview — not now and not pre-pandemic either. That list includes single parents and other full-time carers, who are overwhelmingly women. (It’s also likely to exclude people with mobility challenges and certain chronic illnesses.)

One of the greatest strengths of remote research is that it enables asynchronous responses, which means people can fit it in whenever it makes the most sense for them. This makes it easier to research with shift workers, night owls, and people in precarious contract work, who may not be able request time off.

Geographic and cultural diversity

Research is mostly good at including people that are nearby, with spare time, and with the means to come and go as you require them to; they’ve got to fit with your schedule and your project plan. 

Planning your research to be remote by default allows you to work with and around these constraints in ways that will improve the validity and richness of your data and insights.

As an example, Paper Giant recently worked with Atlassian to conduct research with knowledge workers. Using remote research methods, we were able to speak to people in workplaces from multiple countries in North America, Europe and Australasia. This is far more representative of Atlassian’s user base than if we had only interviewed participants local to us, and helped us avoid treating Australia’s workplace culture as universal.

Neurodiversity 

Remote research also allows you to speak to people who might be uncomfortable with the intensity of a one-on-one interview in unfamiliar surroundings.

For example, autistic people commonly report finding eye contact overwhelming, but no one quite makes direct eye contact on video calls anyway, so this is one less thing they have to manage.

Body language is harder to interpret over a video call, which means remote research works best when it doesn’t rely on non-verbal cues. This equalises the process for everyone.

Research shows that non-native speakers, people with auditory processing disorders and people with high anxiety “often prefer text channels so they can have more time to process messages and craft responses.”

Inclusion challenges

Inclusion is a challenge as well as an opportunity when you’re using digital tools for research — such tools rely on digital literacy and digital infrastructure that people might not have. It’s worth remembering here that remote research doesn’t have to be digital. It can mean a phone call; it can mean sending something through the post.

This means you need to know who your users are and take into account any kind of access or inclusion issues they may have. For example, when Paper Giant has worked with participants with low literacy, we’ve designed comics as a way of getting people’s feedback on stuff rather than relying on words — those can be sent through the post. We’ve also used Easy English principles in documents for people with acquired brain injury.

Many people are only turning to remote research now, as a response to COVID-19. But it would be a mistake to view it as the fallback option. Remote research allows you to engage a much broader diversity of participants, leading to richer and better validated insights.

Paper Giant writes about research, design, innovation and ethics in our fortnightly newsletter – subscribe here.