We take a look at three qualitative research methods which can be started quickly with a bit of planning, and minimal participants while delivering great data insights.

‍

What is qualitative research? 🤔

‍

The term ‘qualitative’ refers to things that cannot be measured numerically and qualitative research is no exception. Qualitative research is primarily an exploratory research method that is typically done early in the design process. It's useful for uncovering insights into people’s thoughts, opinions, and motivations. It allows us to gain a deeper understanding of problems and provides answers to questions we didn’t know we needed to ask. 

‍

Qualitative research can be viewed as the 'why' versus quantitative user research which uncovers the 'how' or the 'what' users want. Qualitative user research helps us uncover why people make decisions (and potentially much more).

‍

Here's three qualitative research exercises you can start today:

‍

1. Usability testing 👨🏼💻

‍

Usability testing is a research method designed to evaluate how easy something is to use by testing it with representative users. In most cases, this ‘something’ is a prototype of a website or interface. Or it could just as easily be an existing website or product that requires more understanding of how it is currently used to identify faults or issues.

‍

These tests typically involve observing a participant as they work through a series of tasks involving the product being tested. It’s a good idea to bring a notetaker along, so you can focus on asking questions. After you’ve conducted several usability tests, you can analyze your observations to identify the most common issues.

‍

This can be a very practical start to the user research process. Observing, questioning and noting how a user interacts with your product in a very real environment can offer up some fantastic insights. 

‍

How many participants do I need to get started?

‍

Usability testing is done in a real world environment which means you need your participant to complete tasks on a laptop or mobile phone. Ideally this is in a controlled environment, an office or space that can be managed. Usability testing relies on the facilitator being present. So, to start you only need five participants which helps as it isn't too many people to find and set up.

‍

What to note: Usability testing is a great way to get an understanding of how exactly the participant interacts with the product. Note how they complete tasks, where their frustrations may be. Also look beyond what they are saying and observing what they are doing.  This is invaluable to get the full picture of how they feel and analyzing the user experience.

‍

2. Contextual inquiry 👀

‍

Contextual inquiry is the observation of behaviours and reactions when users undertake specific tasks. By observing and paying attention to unspoken communication, you can uncover insights into behaviour and even expectations.

‍

Giving the participant a set of tasks and observing how they complete these can be quite enlightening. Often what we do can be quite different to what we say we are doing. 

‍

By noting all of this during the testing session, and keeping our notes factual, they can provide context for why the participant may have changed their decision in a task or even abandoned it entirely.  Ensuring that you don’t try and infer why they are feeling a certain way, and how that may influence their decisions is important to gaining insights.

‍

How many participants do I need to get started?

‍

Like usability testing this method only needs a minimal one-on-one environment to get started.  A facilitator sets the test and observes the participant interacting with the product. You can start with as few as five participants, which means getting started with qualitative testing can be very quick to implement.

‍

What to note: How they move or act while they complete tasks.   Do they cross their arms, scratch their head or  even sigh?  Little things like trouble using the keyboard, can be implicit in how well they interpret the website.

‍

3. User interviews 👩🏻💻📓✍🏻💡

‍

User interviews are one-on-one facilitated conversations that are used to gain in-depth understanding of behaviours, opinions, and attitudes towards a product.

‍

Building a relationship with the participant can be valuable, allowing the conversation to flow, and remove barriers. Interviews are an excellent opportunity to ask questions as well as dig deeper into the detail.   They allow for follow up if further clarification be needed. Interviews are usually semi-structured with a list of open questions that are flexible enough to allow the interviewer to cover the required topics but also go wherever the conversation leads. 

‍

Interviews are also quite flexible because they don’t necessarily have to be conducted face to face. If time and resources are tight, they work just as well over the phone or via skype. Sessions can be recorded through note taking audio or video recording.

‍

If you want to find out more about how to do a phone interview, have a read here. 

‍

There can be a flow over of observational insights. This can be as simple as noting throughout the session, how they react to certain set tasks. Are there moments that they are frustrated? Do they turn back and look for another way? Or do they seem irritated by the hardware, the laptop, mouse or even the reflection on the screen? All valuable (unspoken) information on how and why the participant makes decisions.

‍

How many participants do I need to get started?

‍

As with our three qualitative research methods you need a minimal number of participants to really get started with user interviews. They rely on a facilitator that does one-on-one interviews with a set of predetermined questions. You can start with as few as five participants, and depending on the research they can be from inside or outside your company. But they should be as relaxed, and natural as possible, to allow for real responses and observations.

‍

What to note: User interviews are far more conversational than the previous two methods. You should have a script to work from, which will intend to uncover why your participant will want to work with your product a certain way. However, the interview allows some flexibility, with the facilitator able to dig deeper if needed, or change tack. Note the flow of conversation, and the various responses, as well as observed behaviours in a factual way.

‍

Reviewing your research 🕵🏼

‍

After completing your session it is just as important to review it. Spend the time while it’s still fresh in your mind filling in any gaps in information by reviewing the audio and/or video. Great note taking is vital and using a digital note taking software (like our very own Reframer) can make the whole process much simpler and easier, to record, review, analyze and share your data.  If you want more tips on how to take great notes in qualitative user research have a look at this.

‍

Delivering your data 🎁

‍

So, you’ve gone ahead and researched your product and you’ve got some amazing insights and data. What now? You need to pull it all together in a cohesive manner that breaks down what you’ve discovered and what it means. If you use our digital note taking software, Reframer, this can be fairly straight forward and streamlined. Having all of your notes, audio and video recordings, timestamping and observations in one place will allow the data to be generated and reviewed (and shared) swiftly. Pull together a report that can be shared among key shareholders and product managers. Present it in a way that allows your insights to clearly show where changes are needed, or improvements to the user experience can be made. It’s hard to argue with well researched data!

‍

Wrap Up 🌯

‍

If you always thought that qualitative research was too hard, or took too long, think again. Take a look at the Optimal Workshop platform and we can help you through the whole process, taking the pain out, and putting the insights in. 

‍

Ready to get started finding out how your users really interact with your product? Get started now, and lots of our products mean you can start today!

Design has a problem — historical and still pressing — of only designing for users that are easily accessible, are able to participate, or who meet some pre-determined idea of a ‘target’ or an ‘average’ user.

This is bad for organisations, who are missing out on a huge segment of the people they’d like to reach, and it’s bad for users, who can feel shut out of the services they’d like to access.

Remote research allows you to address common diversity and inclusion challenges of in-person research, and create a better product or service as a result.

Occupational diversity

While you’re probably already making considered attempts to include a diverse range of participants, the reality is that many people are simply not able to participate in research.

Some people cannot make it in to your research facilities for an hour on a weekday for an in-person interview — not now and not pre-pandemic either. That list includes single parents and other full-time carers, who are overwhelmingly women. (It’s also likely to exclude people with mobility challenges and certain chronic illnesses.)

One of the greatest strengths of remote research is that it enables asynchronous responses, which means people can fit it in whenever it makes the most sense for them. This makes it easier to research with shift workers, night owls, and people in precarious contract work, who may not be able request time off.

Geographic and cultural diversity

Research is mostly good at including people that are nearby, with spare time, and with the means to come and go as you require them to; they’ve got to fit with your schedule and your project plan. 

Planning your research to be remote by default allows you to work with and around these constraints in ways that will improve the validity and richness of your data and insights.

As an example, Paper Giant recently worked with Atlassian to conduct research with knowledge workers. Using remote research methods, we were able to speak to people in workplaces from multiple countries in North America, Europe and Australasia. This is far more representative of Atlassian’s user base than if we had only interviewed participants local to us, and helped us avoid treating Australia’s workplace culture as universal.

Neurodiversity 

Remote research also allows you to speak to people who might be uncomfortable with the intensity of a one-on-one interview in unfamiliar surroundings.

For example, autistic people commonly report finding eye contact overwhelming, but no one quite makes direct eye contact on video calls anyway, so this is one less thing they have to manage.

Body language is harder to interpret over a video call, which means remote research works best when it doesn’t rely on non-verbal cues. This equalises the process for everyone.

Research shows that non-native speakers, people with auditory processing disorders and people with high anxiety “often prefer text channels so they can have more time to process messages and craft responses.”

Inclusion challenges

Inclusion is a challenge as well as an opportunity when you’re using digital tools for research — such tools rely on digital literacy and digital infrastructure that people might not have. It’s worth remembering here that remote research doesn’t have to be digital. It can mean a phone call; it can mean sending something through the post.

This means you need to know who your users are and take into account any kind of access or inclusion issues they may have. For example, when Paper Giant has worked with participants with low literacy, we’ve designed comics as a way of getting people’s feedback on stuff rather than relying on words — those can be sent through the post. We’ve also used Easy English principles in documents for people with acquired brain injury.

Many people are only turning to remote research now, as a response to COVID-19. But it would be a mistake to view it as the fallback option. Remote research allows you to engage a much broader diversity of participants, leading to richer and better validated insights.

Paper Giant writes about research, design, innovation and ethics in our fortnightly newsletter – subscribe here.

For those new to the qualitative research space, there’s one question that’s usually pretty tough to figure out, and that’s the question of how many participants to include in a study. Regardless of whether it’s research as part of the discovery phase for a new product, or perhaps an in-depth canvas of the users of an existing service, researchers can often find it difficult to agree on the numbers. So is there an easy answer? Let’s find out.

‍

Here, we’ll look into the right number of participants for qualitative research studies. If you want to know about participants for quantitative research, read Nielsen Norman Group’s article.

‍

‍

Getting the numbers right

‍

So you need to run a series of user interviews or usability tests and aren’t sure exactly how many people you should reach out to. It can be a tricky situation – especially for those without much experience. Do you test a small selection of 1 or 2 people to make the recruitment process easier? Or, do you go big and test with a series of 10 people over the course of a month? The answer lies somewhere in between.

‍

It’s often a good idea (for qualitative research methods like interviews and usability tests) to start with 5 participants and then scale up by a further 5 based on how complicated the subject matter is. You may also find it helpful to add additional participants if you’re new to user research or you’re working in a new area.

‍

What you’re actually looking for here is what’s known as saturation.

‍

‍

Understanding saturation

‍

Whether it’s qualitative research as part of a master’s thesis or as research for a new online dating app, saturation is the best metric you can use to identify when you’ve hit the right number of participants.

‍

In a nutshell, saturation is when you’ve reached the point where adding further participants doesn’t give you any further insights. It’s true that you may still pick up on the occasional interesting detail, but all of your big revelations and learnings have come and gone. A good measure is to sit down after each session with a participant and analyze the number of new insights you’ve noted down.

‍

Interestingly, in a paper titled How Many Interviews Are Enough?, authors Greg Guest, Arwen Bunce and Laura Johnson noted that saturation usually occurs with around 12 participants in homogeneous groups (meaning people in the same role at an organization, for example). However, carrying out ethnographic research on a larger domain with a diverse set of participants will almost certainly require a larger sample.

‍

‍

Ensuring you’ve hit the right number of participants

‍

How do you know when you’ve reached saturation point? You have to keep conducting interviews or usability tests until you’re no longer uncovering new insights or concepts.

‍

While this may seem to run counter to the idea of just gathering as much data from as many people as possible, there’s a strong case for focusing on a smaller group of participants. In The logic of small samples in interview-based, authors Mira Crouch and Heather McKenzie note that using fewer than 20 participants during a qualitative research study will result in better data. Why? With a smaller group, it’s easier for you (the researcher) to build strong close relationships with your participants, which in turn leads to more natural conversations and better data.

‍

There's also a school of thought that you should interview 5 or so people per persona. For example, if you're working in a company that has well-defined personas, you might want to use those as a basis for your study, and then you would interview 5 people based on each persona. This maybe worth considering or particularly important when you have a product that has very distinct user groups (e.g. students and staff, teachers and parents etc).

‍

‍

How your domain affects sample size

‍

The scope of the topic you’re researching will change the amount of information you’ll need to gather before you’ve hit the saturation point. Your topic is also commonly referred to as the domain.

‍

If you’re working in quite a confined domain, for example, a single screen of a mobile app or a very specific scenario, you’ll likely find interviews with 5 participants to be perfectly fine. Moving into more complicated domains, like the entire checkout process for an online shopping app, will push up your sample size.

‍

As Mitchel Seaman notes: “Exploring a big issue like young peoples’ opinions about healthcare coverage, a broad emotional issue like postmarital sexuality, or a poorly-understood domain for your team like mobile device use in another country can drastically increase the number of interviews you’ll want to conduct.”

‍

‍

In-person or remote

‍

Does the location of your participants change the number you need for qualitative user research? Well, not really – but there are other factors to consider.

‍

• Budget: If you choose to conduct remote interviews/usability tests, you’ll likely find you’ve got lower costs as you won’t need to travel to your participants or have them travel to you. This also affects…
• Participant access: Remote qualitative research can be a lifesaver when it comes to participant access. No longer are you confined to the people you have physical access to, instead you can reach out to anyone you’d like.
• Quality: On the other hand, remote research does have its downsides. For one, you’ll likely find you’re not able to build the same kinds of relationships over the internet or phone as those in person, which in turn means you never quite get the same level of insights.

‍

‍

Is there value in outsourcing recruitment?

‍

Recruitment is understandably an intensive logistical exercise with many moving parts. If you’ve ever had to recruit people for a study before, you’ll understand the need for long lead times (to ensure you have enough participants for the project) and the countless long email chains as you discuss suitable times.

‍

Outsourcing your participant recruitment is just one way to lighten the logistical load during your research. Instead of having to go out and look for participants, you have them essentially delivered to you in the right number and with the right attributes.

‍

We’ve got one such service at Optimal, which means it’s the perfect accompaniment if you’re also using our platform of UX tools. Read more about that here.

‍

‍

Wrap-up

‍

So that’s really most of what there is to know about participant recruitment in a qualitative research context. As we said at the start, while it can appear quite tricky to figure out exactly how many people you need to recruit, it’s actually not all that difficult in reality.

‍

Overall, the number of participants you need for your qualitative research can depend on your project among other factors. It’s important to keep saturation in mind, as well as the locale of participants. You also need to get the most you can out of what’s available to you. Remember: Some research is better than none!

User interviews are a great research method you can use to gain qualitative data about your users, and understand what they think and feel. But they can be quite time consuming, which can sometimes put people off doing them altogether.They can be a bit of a logistical nightmare to organize. You need to recruit participants, nail down a time and place, bring your gear, and come up with a Plan B if people don’t show up. All of this can take up a fair bit of back and forthing between your research team and other people, and it’s a real headache when you have a deadline to work to.So, how can you reap the great rewards and insights that user interviews provide, while spending less time planning and organizing them? Here are 15 tips and tools to help get you started.

Preparation

1) Come up with a checklist

Checklists can be lifesavers, especially when your brain is running 100 miles an hour and you’re wondering if you’ve forgotten to even introduce yourself to your participant.Whether you’re doing your research remotely or in person, it always helps to have a list of all the tasks you need to do so you can check them off one by one.A great checklist should include:

• the items you need to bring to your sessions (notebooks, laptop, pens, water, and do NOT forget your laptop charger!)
• any links you need to send to your interviewee if speaking to them remotely (Google Hangouts, webex etc.)
• a reminder to get consent to record your interview session
• a reminder to hit the record button

Scripts are also useful for cutting down time. Instead of “umm-ing” and “ahh-ing” your way through your interview, you can have a general idea of what you’ll talk about. Scripts will likely change between each project, but having a loose template that you can chop and change pretty easily will help you save time in the future.Some basic things you’ll want to include in your script:

• an introduction of yourself, and some ice-breaker questions to build a rapport with your participant
• your research goals and objectives — what/who you’re doing this research for and why
• how your research will be used
• the questions you’re going to ask
• tying up loose ends — answering questions from your participant and thanking them very much for their time.

2) Build up a network of participants to choose from

This is another tip that requires a bit of legwork at the start, but saves lots of hassle later on. If you build up a great network of people willing to take part in your research, recruiting can become much easier.Perhaps you can set up a research panel that people can opt into through your website (something we’ve done here at Optimal Workshop that has been a huge help). If you’re working internally and need to interview users at your own company, you can do a similar thing. Reach out to managers or team leaders to get employees on board, get creative with incentives, reward people with thanks or cakes in public — there are loads of ideas.

3) Do your interviews remotely

Remote user research is great. It allows you to talk to all types of people anywhere in the world, without having to spend time and money for travel to get to them.There are many different tools you can use to conduct your user interview remotely.Some easy to use and free ones are Google Hangouts and Skype. As a bonus, it’s likely your participants will already have one of these installed, saving them time and hassle — just don’t forget to record your session.Here are a couple of recording tools you can use:

• QuickTime
• iShowU HD
• Pamela for Skype

4) Rehearse, rehearse, rehearse

Make sure you’re not wasting any precious research time and rehearse your interview with a colleague or friend. This will help you figure out anything you’ve missed, or what could potentially go wrong that could cause you time delays and headaches on the day.

• Do your questions make sense, and are they the right kinds of questions?
• Test your responses — are you making sure you stay neutral so you don’t lead your participants along?
• Does your script flow naturally? Or does it sound too scripty?
• Are there any areas that technology could become a hindrance, and how can you make sure you avoid this?

5) Use scheduling tools to book sessions for you

Setting up meetings with colleagues can be difficult, but when you’re reaching out to participants who are volunteering their precious time it can be a nightmare.Make it easier for all involved and use an easy scheduling tool to get rid of most of the hard work.Simply enter in a few times that you’re free to host sessions, and your participants can select which ones work for them.Here are a couple of tools to get you started:

• Calendly
• NeedtoMeet
• Boomerang Calendar
• ScheduleOnce

Don’t forget to automate the reminder emails to save yourself some time. Some of the above tools can sort that out for you!

In-session

6) Avoid talking about yourself — stick to your script!

When you’re trying to build a rapport with your participant, it’s easy to go overboard, get off track and waste precious research time. Avoid talking about yourself too much, and focus on asking about your participant, how they feel, and what they think. Make sure you keep your script handy so you know if you’re heading in the wrong direction.

7) Record interviews, transcribe later

In many user interview scenarios, you’ll have a notetaker to jot down key observations as your session goes on. But if you don’t have the luxury of a notetaker, you’ll likely be relying on yourself to take notes. This can be really distracting when you’re interviewing someone, and will also take up precious research time. Instead, record your interview and only note down timestamps when you come across a key observation.

8) Don’t interrupt

Ever had something to say and started to explain it to someone, only to get interrupted then lose your train of thought? This can happen to your participants if you’re not careful, which can mean delays with getting the information you need. Stay quiet, and give your participant a few seconds before asking what they’re thinking.

9) Don’t get interrupted

If you’re hosting your interview at your office, let your coworkers know so they don’t interrupt you. Hang a sign up on the door of your meeting room and make sure you close the door. If you’re going out of your office, pick a location that’s quiet and secluded like a meeting room at a library, or a quiet corner in a cafe.

10) Take photos of the environment

If you’re interviewing users in their own environment, there are many little details that can help you with your research. But you could spend ages taking note of all these details in your session. You can get a good idea of what your participant’s day is like by snapping some images of their workstations, tech they use, and the office as a whole. Use your phone and pop these into Evernote or Dropbox to analyze later.

Analysis

11) Use Reframer to analyze your data

Qualitative research produces very powerful data, but it also produces a lot of it. It can take you and your team hours, even days, to go through it all.Use a qualitative research tool such as Reframer to tag your observations so you can easily build themes and find patterns in your data while saving hours of analysis. Tags might be related to a particular subject you’re discussing with a participant, a really valuable quote, or even certain problems your participants have encountered — it all depends on your project.

12) Make collaboration simple

Instead of spending hours writing up some of your findings on Post-it notes and sticking them up on a wall to discuss with your teammates, you can quickly and easily do this online with Trello or MURAL. This is definitely a big timesaver if you’ve got some team members who work remotely.

13) Make your findings easy to read

Presenting your findings to stakeholders can be difficult, and extremely time consuming if you need to explain it all in easy-to-understand terms. Save time and make it easier for your stakeholders by compiling your findings into an infographic, engaging data visualization, or slideshow presentation. Just make sure you bring all the stats you need to answer any questions from stakeholders.For more actionable tips and tricks from UX professionals all over the world, check out our latest ebook. Download and print out templates and checklists, and become a pro for your next user interview.Get our new ebook

Related reading

• "Individual interviews" - An article from Usability.gov explaining how, when, and why you should conduct user interviews with individuals.
• "Interviewing users" - A guide from Nielsen Norman Group showing us the situations in which user interviews are best suited, and the kind of information they can provide us.
• "Open-ended versus close-ended questions in user research" - Another article from Nielsen Norman Group explaining the differences in question types.