July 3, 2019
3 min

The other side of the conversation: 3 reasons why UX researchers should take a turn as a participant

Optimal Workshop

Lately, I’ve found myself sitting in the participant’s chair at the UX research table more and more and it’s been an eye-opening collection of experiences. As UX researchers, we’re definitely not our users, but we are someone else’s. We use products, services and tools too! I’ve recently discovered that participating in user research not only helps out a fellow UXer with their qualitative research, but has also helped me grow my skills.

Here are 3 reasons why you should try being a participant for yourself.

1. Build empathy for the participant experience 🫶

Having facilitated hundreds of UX research sessions over the years, I didn’t think I would be as nervous as I was going in as a participant! When we design our research sessions we don’t often give our participants a heads up on what we’re going to talk about because we don’t want to influence them for one, but truly not knowing what to expect made me feel slightly jittery. Before and at the beginning of these experiences, I felt quite unprepared. I wasn’t expecting to feel that way.

During these sessions I often found myself wondering things like: Were my answers detailed enough? Will my responses be kept confidential? (I could never seem to remember if that had been covered in the introduction!). I worried that I wasn’t giving helpful responses or if I was talking too much. When misunderstandings arose in the conversation, I felt responsible and I was kicking myself for not communicating clearly enough!

As a participant, I completely lost track of time during the session and developed an entirely new appreciation for timekeeping as a facilitator! I could have talked well beyond the scope of the interview timeframe and needed to be kept on track.

I also very quickly discovered that thinking aloud is a lot harder to do than it sounds. It’s not a simple matter of verbalizing your thoughts as they happen. You have to think them, process them, decide how to verbalize them and then talk – all while someone (often a complete stranger) is looking at you expectantly and eagerly. It’s awkward and it feels weird. And look, it is widely acknowledged that it’s challenging and unnatural, but I didn’t fully appreciate or understand that until I was required to do it myself in a research environment.

Did I experience some of these thoughts and feelings because I’m a UX researcher and I know what the other side looks and feels like? Maybe. It’s certainly possible and I’d be remiss if I didn’t call out this potential bias, but I do feel that having done this I now have a greater capacity to empathize with the participant experience. I’ve now been on the receiving end of the introductory spiel (and tuned out during it!), I’ve now got first-hand experience with the on-the-spot answering of those questions we carefully craft and I’ve scrambled for words when I’ve been asked to explain why I said what I said.

These experiences have taught me that there’s a good chance the participant is just as nervous as I am and that a little reassurance or confirmation of usefulness goes a very long way. I’ve learned that regardless of the skill or experience of the researcher, interview questions can be super confusing and hard to answer. Having questions rephrased and being told that what I shared was helpful made me feel significantly more comfortable and able to think clearly and open up more - therefore providing more value to the researcher.

I’ve also been itching to find out what happened next after the sessions ended. Was I helpful and in what way? Where did the insight I provided lead? I’ve learned that while we walk away with more questions, so might our participants and what can we do about that? We’re so busy, but stopping for a moment further down the track if/where possible to reach out and say ‘Hey, I just thought you might like to see what we did with all that great information you shared with us’ might be nice. It’s not always practical or possible and sometimes we have to wait until the thing goes live, but it’s food for thought.

2. Learn from other researcher’s styles 📚

Every UX researcher is different and we all have our own approaches and styles. As a notetaker for other researchers, I’ve always enjoyed having the opportunity to observe them in action, but somehow experiencing it as a participant felt different in the best possible way. It felt more immersive. Perhaps it was because I didn’t have to think about anything else or observe the participant’s reactions and was able to absorb every second of that experience as it was happening to me rather than in front of me.

I participated in a usability testing session with two researchers - one facilitating and one taking notes - and the notetaker was so unobtrusive and quiet that I completely forgot they were there! They said a quick hello at the beginning of the session and then sat back behind me and blended in with the furniture and didn’t make a sound until they piped up with a question at the very end. Note taking is such a grossly underrated UX research skill. There’s a lot to think about, a lot to avoid thinking about (e.g., jumping into solution right there in the session) and of course we have to be mindful of the potential impact of our behavior on the participant, but this went beyond stifling disappointment or resisting the urge to speak. This was a dignified and seamlessly elegant note taker existence unlike anything I have ever seen.

In other sessions as a user interview participant I was delighted when researchers injected multiple moments of humor into those previously mentioned introductory spiel snooze fests. It did more than just make me feel comfortable - humor helped me focus better on what was being said and remember important details during and well after the session had ended.

I also learned a thing or two about comfortable silences when I participated in a contextual session with two researchers. One researcher kept prodding and repeatedly asking questions while the other exuded a quiet and calm demeanor and simply patiently waited for me to complete my task and talk about it in my own time (and way). It won’t work in all situations or with all participants, but it made me feel relaxed and comfortable enough to talk through what I was thinking and seeing. This approach also made thinking aloud easier for me.

It’s important to remember that it doesn’t matter if you’re an experienced UX researcher or if you’re just starting out, everyone can learn something new from another researcher and stepping up into a session as an actual participant is a great way to do that.

3. Give back and grow our industry 🌱

One of my favourite things about the UX industry has always been its sense of community. We’re a group of people who care. We care about our users, we care about each other and we care about our capability as an industry and where we’re headed. Agreeing to be a participant in another researcher’s study is a great way to give back.

As I mentioned earlier, we use products and services too and in addition to this, there’s a whole heap of them out there designed just for us! It makes sense that in the same way that we as researchers ask our own customers and users to help us design better products, we should be open to doing the same for the people who design for us.

The cool thing about being a participant who is also a researcher is that we pick up issues other people might not. We might be a little tougher and less likely to let a usability issue slide. We might be the person that provides the external and fresh-eyed validation a researcher needs to convince a stakeholder that a design needs to be changed or worked on some more. A researcher in the participant’s chair is a powerful hybrid - it’s a participant and expert reviewer in one.

As a general rule of thumb, if you’re invited to participate in another researcher’s study, I do think it’s best to always be upfront with them about who you are and what you do so that they can determine if you are potentially too biased to be included. It’s their study and informed consent matters. Think about what you would want as a researcher. And if they’re specifically asking you to participate because you’re a researcher - that’s awesome!

So those are just some of the reasons why you should take a spin in the participant’s chair. Professional development is a lifelong learning process for us all. I’m looking forward to implementing what I’ve learned from these experiences and continuing to plonk myself in that participant chair to keep growing my perspective and helping out other researchers along the way.

Happy researching (and participating)!

Publishing date
July 3, 2019
Share this article

Related articles

min read
Tips for recruiting quality research participants

If there’s one universal truth in user research, it’s that at some point you’re going to need to find people to actually take part in your studies. Be it a large number of participants for quantitative research or a select number for in-depth, in-person user interviews. Finding the right people (and number) of people can be a hurdle.

With the right strategy, you can source exactly the right participants for your next research project.

We share a practical step-by-step guide on how to find participants for user experience research.

The difficulties/challenges of user research recruiting 🏋️

It has to be acknowledged that there are challenges when recruiting research participants. You may recognize some of these:

  • There are so many channels and methods you can use to find participants, different channels will work better for different projects.
  • Repeatedly using the same channels and methods will result in diminishing returns (i.e. burning out participants).
  • It’s a lengthy and complex process, and some projects don’t have the luxury of time.
  • Offering the right incentives and distributing them is time-consuming.
  • It’s hard to manage participants during long-term or recurring studies, such as customer research projects.

We’ll simplify the process, talk about who the right participants are, and unpack some of the best ways to find them. Removing these blocks can be the easiest way to move forward.

Who are the right participants for different types of research? 🤔

1. The first step to a successful participant recruitment strategy is clarifying the goals of your user research and which methods you intend to use. Ask yourself:

  • What is the purpose of our research?
  • How do we plan to understand that?

2. Define who your ideal research participant is. Who is going to have the answers to your questions?

3. Work out your research recruitment strategy. That starts by understanding the differences between recruiting for qualitative and quantitative research.

Recruiting for qualitative vs. quantitative research 🙋🏻

Quantitative research recruiting is a numbers game. For your data analysis to be meaningful and statistically significant, you need a lot of data. This means you need to do a lot of research with a lot of people. When recruiting for quantitative research, you first have to define the population (the entire group you want to study). From there, you choose a sampling method that allows you to create a sample—a randomly selected subset of the population who will participate in your study.

Qualitative recruiting involves far fewer participants, but you do need to find a selection of ‘perfect’ participants. Those that fit neatly into your specific demographic, geographic, psychographic, and behavioral criteria relevant to your study. Recruiting quality participants for qualitative studies involves non-random sampling, screening, and plenty of communication.

How many participants do you need? 👱🏻👩👩🏻👧🏽👧🏾

How many participants to include in a qualitative research study is one of the most heavily discussed topics in user research circles. In most cases, you can get away with 5 people – that’s the short answer. With 5 people, you’ll uncover most of the main issues with the thing you’re testing. Depending on your research project there could be as many as 50 participants, but with each additional person, there is an additional cost (money and time).

Quantitative research is obviously quite different. With studies like card sorts and tree tests, you need higher participant numbers to get statistically meaningful results. Anywhere from 20 - 500 participants, again coming back to the purpose of your test and your research budget. These are usually easier and quicker to implement therefore the additional cost is lower.

User research recruitment - step by step 👟

Let’s get into your research recruitment strategy to find the best participants for your research project. There are 5 clear steps to get you through to the research stage:

1. Identify your ideal participants

Who are they? What do they do? How old are they? Do they already use your product? Where do they live? These are all great questions to get you thinking about who exactly you need to answer your research questions. The demographic and geographic detail of your participants are important to the quality of your research results.

2. Screen participants

Screening participants will weed out those that may not be suitable for your specific project. This can be as simple as asking if the participants have used a product similar to yours. Or coming back to your key identified demographic requirements and removing anyone that doesn’t fit these criteria.

3. Find prospective participants

This is important and can be time-consuming. For qualitative research projects, you can look within your organization or ask over social media for willing participants. Or if you’re short on time look at a participant recruitment service, which takes your requirements and has a catalog of available persons to call on. There’s a cost involved, but the time saving can negate this. For qualitative surveys, a great option can be a live intercept on your website or app that interrupts users and asks them to complete a short questionnaire.

4. Research incentives

In some cases you will need to provide incentives. This could be offering a prize or discount for those who complete online qualitative surveys. Or a fixed sum for those that take part in longer format quantitative studies.

5. Scheduling with participants

Once you have waded through the emails, options, and communication from your inquiries make a list of appropriate participants. Schedule time to do the research, either in person or remotely. Be clear about expectations and how long it will take. And what the incentive to take part is.

Tips to avoid participant burnout 📛

You’ve got your participants sorted and have a great pool of people to call on. If you keep hitting the same group of people time and time again, you will experience the law of diminishing returns. Constantly returning to the same pool of participants will eventually lead to fatigue. And this will impact the quality of your research because it’s based on interviewing the same people with the same views.

There are 2 ways to avoid this problem:

  1. Use a huge database of potential participant targets.
  2. Use a mixture of different recruitment strategies and channels.

Of course, it might be unavoidable to hit the same audience repeatedly when you’re testing your product development among your customer base.

Wrap up 🌯

Understanding your UX research recruitment strategy is crucial to recruiting quality participants. A clear idea of your purpose, who your ideal participants are, and how to find them takes time and experience. 

And to make life easier you can always leave your participant recruitment with us. With a huge catalog of quality participants all at your fingertips on our app, we can recruit the right people quickly.

Check out more here.

min read
Remote research allows you to reach a more diverse range of participants

Design has a problem — historical and still pressing — of only designing for users that are easily accessible, are able to participate, or who meet some pre-determined idea of a ‘target’ or an ‘average’ user.

This is bad for organisations, who are missing out on a huge segment of the people they’d like to reach, and it’s bad for users, who can feel shut out of the services they’d like to access.

Remote research allows you to address common diversity and inclusion challenges of in-person research, and create a better product or service as a result.

Occupational diversity

While you’re probably already making considered attempts to include a diverse range of participants, the reality is that many people are simply not able to participate in research.

Some people cannot make it in to your research facilities for an hour on a weekday for an in-person interview — not now and not pre-pandemic either. That list includes single parents and other full-time carers, who are overwhelmingly women. (It’s also likely to exclude people with mobility challenges and certain chronic illnesses.)

One of the greatest strengths of remote research is that it enables asynchronous responses, which means people can fit it in whenever it makes the most sense for them. This makes it easier to research with shift workers, night owls, and people in precarious contract work, who may not be able request time off.

Geographic and cultural diversity

Research is mostly good at including people that are nearby, with spare time, and with the means to come and go as you require them to; they’ve got to fit with your schedule and your project plan. 

Planning your research to be remote by default allows you to work with and around these constraints in ways that will improve the validity and richness of your data and insights.

As an example, Paper Giant recently worked with Atlassian to conduct research with knowledge workers. Using remote research methods, we were able to speak to people in workplaces from multiple countries in North America, Europe and Australasia. This is far more representative of Atlassian’s user base than if we had only interviewed participants local to us, and helped us avoid treating Australia’s workplace culture as universal.

Neurodiversity 

Remote research also allows you to speak to people who might be uncomfortable with the intensity of a one-on-one interview in unfamiliar surroundings.

For example, autistic people commonly report finding eye contact overwhelming, but no one quite makes direct eye contact on video calls anyway, so this is one less thing they have to manage.

Body language is harder to interpret over a video call, which means remote research works best when it doesn’t rely on non-verbal cues. This equalises the process for everyone.

Research shows that non-native speakers, people with auditory processing disorders and people with high anxiety “often prefer text channels so they can have more time to process messages and craft responses.”

Inclusion challenges

Inclusion is a challenge as well as an opportunity when you’re using digital tools for research — such tools rely on digital literacy and digital infrastructure that people might not have. It’s worth remembering here that remote research doesn’t have to be digital. It can mean a phone call; it can mean sending something through the post.

This means you need to know who your users are and take into account any kind of access or inclusion issues they may have. For example, when Paper Giant has worked with participants with low literacy, we’ve designed comics as a way of getting people’s feedback on stuff rather than relying on words — those can be sent through the post. We’ve also used Easy English principles in documents for people with acquired brain injury.

Many people are only turning to remote research now, as a response to COVID-19. But it would be a mistake to view it as the fallback option. Remote research allows you to engage a much broader diversity of participants, leading to richer and better validated insights.

Paper Giant writes about research, design, innovation and ethics in our fortnightly newsletter – subscribe here.

Seeing is believing

Dive into our platform, explore our tools, and discover how easy it can be to conduct effective UX research.