August 8, 2022
1 min read

Tips for recruiting quality research participants

If there’s one universal truth in user research, it’s that at some point you’re going to need to find people to actually take part in your studies. Be it a large number of participants for quantitative research or a select number for in-depth, in-person user interviews. Finding the right people (and number) of people can be a hurdle.

With the right strategy, you can source exactly the right participants for your next research project.

We share a practical step-by-step guide on how to find participants for user experience research.

The difficulties/challenges of user research recruiting 🏋️

It has to be acknowledged that there are challenges when recruiting research participants. You may recognize some of these:

  • There are so many channels and methods you can use to find participants, different channels will work better for different projects.
  • Repeatedly using the same channels and methods will result in diminishing returns (i.e. burning out participants).
  • It’s a lengthy and complex process, and some projects don’t have the luxury of time.
  • Offering the right incentives and distributing them is time-consuming.
  • It’s hard to manage participants during long-term or recurring studies, such as customer research projects.

We’ll simplify the process, talk about who the right participants are, and unpack some of the best ways to find them. Removing these blocks can be the easiest way to move forward.

Who are the right participants for different types of research? 🤔

1. The first step to a successful participant recruitment strategy is clarifying the goals of your user research and which methods you intend to use. Ask yourself:

  • What is the purpose of our research?
  • How do we plan to understand that?

2. Define who your ideal research participant is. Who is going to have the answers to your questions?

3. Work out your research recruitment strategy. That starts by understanding the differences between recruiting for qualitative and quantitative research.

Recruiting for qualitative vs. quantitative research 🙋🏻

Quantitative research recruiting is a numbers game. For your data analysis to be meaningful and statistically significant, you need a lot of data. This means you need to do a lot of research with a lot of people. When recruiting for quantitative research, you first have to define the population (the entire group you want to study). From there, you choose a sampling method that allows you to create a sample—a randomly selected subset of the population who will participate in your study.

Qualitative recruiting involves far fewer participants, but you do need to find a selection of ‘perfect’ participants. Those that fit neatly into your specific demographic, geographic, psychographic, and behavioral criteria relevant to your study. Recruiting quality participants for qualitative studies involves non-random sampling, screening, and plenty of communication.

How many participants do you need? 👱🏻👩👩🏻👧🏽👧🏾

How many participants to include in a qualitative research study is one of the most heavily discussed topics in user research circles. In most cases, you can get away with 5 people – that’s the short answer. With 5 people, you’ll uncover most of the main issues with the thing you’re testing. Depending on your research project there could be as many as 50 participants, but with each additional person, there is an additional cost (money and time).

Quantitative research is obviously quite different. With studies like card sorts and tree tests, you need higher participant numbers to get statistically meaningful results. Anywhere from 20 - 500 participants, again coming back to the purpose of your test and your research budget. These are usually easier and quicker to implement therefore the additional cost is lower.

User research recruitment - step by step 👟

Let’s get into your research recruitment strategy to find the best participants for your research project. There are 5 clear steps to get you through to the research stage:

1. Identify your ideal participants

Who are they? What do they do? How old are they? Do they already use your product? Where do they live? These are all great questions to get you thinking about who exactly you need to answer your research questions. The demographic and geographic detail of your participants are important to the quality of your research results.

2. Screen participants

Screening participants will weed out those that may not be suitable for your specific project. This can be as simple as asking if the participants have used a product similar to yours. Or coming back to your key identified demographic requirements and removing anyone that doesn’t fit these criteria.

3. Find prospective participants

This is important and can be time-consuming. For qualitative research projects, you can look within your organization or ask over social media for willing participants. Or if you’re short on time look at a participant recruitment service, which takes your requirements and has a catalog of available persons to call on. There’s a cost involved, but the time saving can negate this. For qualitative surveys, a great option can be a live intercept on your website or app that interrupts users and asks them to complete a short questionnaire.

4. Research incentives

In some cases you will need to provide incentives. This could be offering a prize or discount for those who complete online qualitative surveys. Or a fixed sum for those that take part in longer format quantitative studies.

5. Scheduling with participants

Once you have waded through the emails, options, and communication from your inquiries make a list of appropriate participants. Schedule time to do the research, either in person or remotely. Be clear about expectations and how long it will take. And what the incentive to take part is.

Tips to avoid participant burnout 📛

You’ve got your participants sorted and have a great pool of people to call on. If you keep hitting the same group of people time and time again, you will experience the law of diminishing returns. Constantly returning to the same pool of participants will eventually lead to fatigue. And this will impact the quality of your research because it’s based on interviewing the same people with the same views.

There are 2 ways to avoid this problem:

  1. Use a huge database of potential participant targets.
  2. Use a mixture of different recruitment strategies and channels.

Of course, it might be unavoidable to hit the same audience repeatedly when you’re testing your product development among your customer base.

Wrap up 🌯

Understanding your UX research recruitment strategy is crucial to recruiting quality participants. A clear idea of your purpose, who your ideal participants are, and how to find them takes time and experience. 

And to make life easier you can always leave your participant recruitment with us. With a huge catalog of quality participants all at your fingertips on our app, we can recruit the right people quickly.

Check out more here.

Share this article
Author
Optimal
Workshop

Related articles

View all blog articles
Learn more
1 min read

Moderated vs unmoderated research: which approach is best?

Knowing and understanding why and how your users use your product is invaluable for getting to the nitty gritty of usability. Delving deep with probing questions into motivation or skimming over looking for issues can equally be informative. 

Put super simply, usability testing literally is testing how usable your product is for your users. If your product isn’t usable users often won’t complete their task, let alone come back for more. No one wants to lose users before they even get started. Usability testing gets under their skin and really into the how, why and what they want (and equally what they don’t).

As we have been getting used to video calling regularly and using the internet for interactions, usability testing has followed suit. Being able to access participants remotely has allowed us to diversify the participant pool by not being restricted to those that are close enough to be in-person. This has also allowed an increase in the number of participants per test, as it becomes more cost-effective to perform remote usability testing.

But if we’re remote, does this mean it can’t be moderated? No - remote testing, along with modern technology, can mean that remote testing can be facilitated and moderated. But what is the best method - moderated or unmoderated?

What is moderated remote research testing? 🙋🏻

In traditional usability testing, moderated research is done in person. With the moderator and the participant in the same physical space. This, of course, allows for conversation and observational behavioral monitoring. Meaning the moderator can note not only what the participant answers but how and even make note of the body language, surroundings, and other influencing factors. 

This has also meant that traditionally, the participant pool has been limited to those that can be available (and close enough) to make it into a facility for testing. And being in person has meant it takes time (and money) to perform these tests.

As technology has moved along and the speed of internet connections and video calling has increased, this has opened up a world of opportunities for usability testing. Allowing usability testing to be done remotely. Moderators can now set up testing remotely and ‘dial in’ to observe participants anywhere they are. And potentially even running focus groups or other testing in a group format across the internet. 

Pros:

- In-depth gathering of insights through a back-and-forth conversation and observing of the participants.

- Follow-up questions don’t underestimate the value of being available to ask questions throughout the testing. And following up in the moment.

- Observational monitoring noticing and noting the environment and how the participants are behaving, can give more insight into how or why they choose to make a decision.

- Quick remote testing can be quicker to start, find participants, and complete than in-person. This is because you only need to set up a time to connect via the internet, rather than coordinating travel times, etc.

- Location (local and/or international) Testing online removes reliance on participants being physically present for the testing. This broadens your ability to broaden the pool, and participants can be either within your country or global. 

Cons:

- Time-consuming having to be present at each test takes time. As does analyzing the data and insights generated. But remember, this is quality data.

- Limited interactions with any remote testing there is only so much you can observe or understand across the window of a computer screen. It can be difficult to have a grasp on all the factors that might be influencing your participants.

What is unmoderated remote research testing? 😵💫

In its most simple sense, unmoderated user testing removes the ‘moderated’ part of the equation. Instead of having a facilitator guide participants through the test, participants are left to complete the testing by themselves and in their own time. For the most part, everything else stays the same. 

Removing the moderator, means that there isn’t anyone to respond to queries or issues in the moment. This can either delay, influence, or even potentially force participants to not complete or maybe not be as engaged as you may like. Unmoderated research testing suits a very simple and direct type of test. With clear instructions and no room for inference. 

Pros:

- Speed and turnaround,  as there is no need to schedule meetings with each and every participant. Unmoderated usability testing is usually much faster to initiate and complete.

- Size of study (participant numbers) unmoderated usability testing allows you to collect feedback from dozens or even hundreds of users at the same time. 


- Location (local and/or international) Testing online removes reliance on participants being physically present for the testing, which broadens your participant pool.  And unmoderated testing means that it literally can be anywhere while participants complete the test in their own time.

Cons:

- Follow-up questions as your participants are working on their own and in their own time, you can’t facilitate and ask questions in the moment. You may be able to ask limited follow-up questions.

- Products need to be simple to use unmoderated testing does not allow for prototypes or any product or site that needs guidance. 

- Low participant support without the moderator any issues with the test or the product can’t be picked up immediately and could influence the output of the test.

When should you do which? 🤔

Each moderated and unmoderated remote usability testing have its use and place in user research. It really depends on the question you are asking and what you are wanting to know.

Moderated testing allows you to gather in-depth insights, follow up with questions, and engage the participants in the moment. The facilitator has the ability to guide participants to what they want to know, to dig deeper, or even ask why at certain points. This method doesn’t need as much careful setup as the participants aren’t on their own. While this is all done online, it does still allow connection and conversation. This method allows for more investigative research. Looking at why users might prefer one prototype to another. Or possibly tree testing a new website navigation to understand where they might get lost and querying why the participant made certain choices.

Unmoderated testing, on the other hand, is literally leaving the participants to it. This method needs very careful planning and explaining upfront. The test needs to be able to be set and run without a moderator. This lends itself more to wanting to know a direct answer to a query. Such as a card sort on a website to understand how your users might sort information. Or a first click to see how/where users will click on a new website.

Wrap Up 🌯

With the ability to expand our pool of participants across the globe with all of the advances (and acceptance of) technology and video calling etc, the ability to expand our understanding of users’ experiences is growing. Remote usability testing is a great option when you want to gather information from users in the real world. Depending on your query, moderated or unmoderated usability testing will suit your study. As with all user testing, being prepared and planning ahead will allow you to make the most of your test.

Learn more
1 min read

Lunch n' Learn: Holistic Design - A Framework For Collective Sense-making

Every month we have fun and informative “bite sized” presentations to add some inspiration to your lunch break.  These virtual events allow us to partner with amazing speakers, community groups and organizations to share their insights and hot takes on a variety of topics impacting our industry. 

Join us at the end of every month for Lunch n' Learn.

Susanna Carman

Leading design processes amidst a world in transition requires all practitioners to continuously invest in their own development. One aspect worth investing in, is an ability to integrate holistic thinking into our design leadership practice. This includes re-evaluating our own biases and how that bias is reflected in the tools we choose to work with when understanding and designing for/within complex systems.

Recently our guest Susanna Carman, Strategic Designer and founder of Transition Leadership LAB, introduced us to a holistic approach to qualitative design research using Ken Wilber’s 4 Quadrant Model. Susanna explained the fundamental principles underpinning the framework, and showed how it can be used to ensure a multi-perspectival harvest of critical qualitative and quantitative data on any design project.  

Speaker bio

Susanna Carman is a Strategic Designer and research-practitioner who helps people solve complex problems, the types of problems that have to do with services, systems and human interactions. Specialising in design, leadership and learning, Susanna brings a high value toolkit and herself as Thinking Partner to design, leadership and change practitioners who are tasked with delivering sustainable solutions amidst disruptive conditions. 

Susanna holds a Masters of Design Futures degree from RMIT University, and has over a decade of combined experience delivering business performance, cultural alignment and leadership development outcomes to the education, health, community development and financial services sectors. She is also the founder and host of Transition Leadership Lab, a 9-week learning lab for design, leadership and change practitioners who already have a sophisticated set of tools and mindsets, but still feel these are insufficient to meet the challenge of leading change in a rapidly transforming world.

Grab your lunch, invite your colleagues and we hope to see you at our next Lunch n' Learn 🌯🍱🍜🍲

Learn more
1 min read

The other side of the conversation: 3 reasons why UX researchers should take a turn as a participant

Lately, I’ve found myself sitting in the participant’s chair at the UX research table more and more and it’s been an eye-opening collection of experiences. As UX researchers, we’re definitely not our users, but we are someone else’s. We use products, services and tools too! I’ve recently discovered that participating in user research not only helps out a fellow UXer with their qualitative research, but has also helped me grow my skills.

Here are 3 reasons why you should try being a participant for yourself.

1. Build empathy for the participant experience 🫶

Having facilitated hundreds of UX research sessions over the years, I didn’t think I would be as nervous as I was going in as a participant! When we design our research sessions we don’t often give our participants a heads up on what we’re going to talk about because we don’t want to influence them for one, but truly not knowing what to expect made me feel slightly jittery. Before and at the beginning of these experiences, I felt quite unprepared. I wasn’t expecting to feel that way.

During these sessions I often found myself wondering things like: Were my answers detailed enough? Will my responses be kept confidential? (I could never seem to remember if that had been covered in the introduction!). I worried that I wasn’t giving helpful responses or if I was talking too much. When misunderstandings arose in the conversation, I felt responsible and I was kicking myself for not communicating clearly enough!

As a participant, I completely lost track of time during the session and developed an entirely new appreciation for timekeeping as a facilitator! I could have talked well beyond the scope of the interview timeframe and needed to be kept on track.

I also very quickly discovered that thinking aloud is a lot harder to do than it sounds. It’s not a simple matter of verbalizing your thoughts as they happen. You have to think them, process them, decide how to verbalize them and then talk – all while someone (often a complete stranger) is looking at you expectantly and eagerly. It’s awkward and it feels weird. And look, it is widely acknowledged that it’s challenging and unnatural, but I didn’t fully appreciate or understand that until I was required to do it myself in a research environment.

Did I experience some of these thoughts and feelings because I’m a UX researcher and I know what the other side looks and feels like? Maybe. It’s certainly possible and I’d be remiss if I didn’t call out this potential bias, but I do feel that having done this I now have a greater capacity to empathize with the participant experience. I’ve now been on the receiving end of the introductory spiel (and tuned out during it!), I’ve now got first-hand experience with the on-the-spot answering of those questions we carefully craft and I’ve scrambled for words when I’ve been asked to explain why I said what I said.

These experiences have taught me that there’s a good chance the participant is just as nervous as I am and that a little reassurance or confirmation of usefulness goes a very long way. I’ve learned that regardless of the skill or experience of the researcher, interview questions can be super confusing and hard to answer. Having questions rephrased and being told that what I shared was helpful made me feel significantly more comfortable and able to think clearly and open up more - therefore providing more value to the researcher.

I’ve also been itching to find out what happened next after the sessions ended. Was I helpful and in what way? Where did the insight I provided lead? I’ve learned that while we walk away with more questions, so might our participants and what can we do about that? We’re so busy, but stopping for a moment further down the track if/where possible to reach out and say ‘Hey, I just thought you might like to see what we did with all that great information you shared with us’ might be nice. It’s not always practical or possible and sometimes we have to wait until the thing goes live, but it’s food for thought.

2. Learn from other researcher’s styles 📚

Every UX researcher is different and we all have our own approaches and styles. As a notetaker for other researchers, I’ve always enjoyed having the opportunity to observe them in action, but somehow experiencing it as a participant felt different in the best possible way. It felt more immersive. Perhaps it was because I didn’t have to think about anything else or observe the participant’s reactions and was able to absorb every second of that experience as it was happening to me rather than in front of me.

I participated in a usability testing session with two researchers - one facilitating and one taking notes - and the notetaker was so unobtrusive and quiet that I completely forgot they were there! They said a quick hello at the beginning of the session and then sat back behind me and blended in with the furniture and didn’t make a sound until they piped up with a question at the very end. Note taking is such a grossly underrated UX research skill. There’s a lot to think about, a lot to avoid thinking about (e.g., jumping into solution right there in the session) and of course we have to be mindful of the potential impact of our behavior on the participant, but this went beyond stifling disappointment or resisting the urge to speak. This was a dignified and seamlessly elegant note taker existence unlike anything I have ever seen.

In other sessions as a user interview participant I was delighted when researchers injected multiple moments of humor into those previously mentioned introductory spiel snooze fests. It did more than just make me feel comfortable - humor helped me focus better on what was being said and remember important details during and well after the session had ended.

I also learned a thing or two about comfortable silences when I participated in a contextual session with two researchers. One researcher kept prodding and repeatedly asking questions while the other exuded a quiet and calm demeanor and simply patiently waited for me to complete my task and talk about it in my own time (and way). It won’t work in all situations or with all participants, but it made me feel relaxed and comfortable enough to talk through what I was thinking and seeing. This approach also made thinking aloud easier for me.

It’s important to remember that it doesn’t matter if you’re an experienced UX researcher or if you’re just starting out, everyone can learn something new from another researcher and stepping up into a session as an actual participant is a great way to do that.

3. Give back and grow our industry 🌱

One of my favourite things about the UX industry has always been its sense of community. We’re a group of people who care. We care about our users, we care about each other and we care about our capability as an industry and where we’re headed. Agreeing to be a participant in another researcher’s study is a great way to give back.

As I mentioned earlier, we use products and services too and in addition to this, there’s a whole heap of them out there designed just for us! It makes sense that in the same way that we as researchers ask our own customers and users to help us design better products, we should be open to doing the same for the people who design for us.

The cool thing about being a participant who is also a researcher is that we pick up issues other people might not. We might be a little tougher and less likely to let a usability issue slide. We might be the person that provides the external and fresh-eyed validation a researcher needs to convince a stakeholder that a design needs to be changed or worked on some more. A researcher in the participant’s chair is a powerful hybrid - it’s a participant and expert reviewer in one.

As a general rule of thumb, if you’re invited to participate in another researcher’s study, I do think it’s best to always be upfront with them about who you are and what you do so that they can determine if you are potentially too biased to be included. It’s their study and informed consent matters. Think about what you would want as a researcher. And if they’re specifically asking you to participate because you’re a researcher - that’s awesome!

So those are just some of the reasons why you should take a spin in the participant’s chair. Professional development is a lifelong learning process for us all. I’m looking forward to implementing what I’ve learned from these experiences and continuing to plonk myself in that participant chair to keep growing my perspective and helping out other researchers along the way.

Happy researching (and participating)!

Seeing is believing

Explore our tools and see how Optimal makes gathering insights simple, powerful, and impactful.