May 1, 2019
4 min

A beginner’s guide to qualitative and quantitative research

Optimal Workshop

In the field of user research, every method is either qualitative, quantitative – or both. Understandably, there’s some confusion around these 2 approaches and where the different methods are applicable.This article provides a handy breakdown of the different terms and where and why you’d want to use qualitative or quantitative research methods.

Qualitative research

Let’s start with qualitative research, an approach that’s all about the ‘why’. It’s exploratory and not about numbers, instead focusing on reasons, motivations, behaviors and opinions – it’s best at helping you gain insight and delve deep into a particular problem. This type of data typically comes from conversations, interviews and responses to open questions.The real value of qualitative research is in its ability to give you a human perspective on a research question. Unlike quantitative research, this approach will help you understand some of the more intangible factors – things like behaviors, habits and past experiences – whose effects may not always be readily apparent when you’re conducting quantitative research.A qualitative research question could be investigating why people switch between different banks, for example.

When to use qualitative research

Qualitative research is best suited to identifying how people think about problems, how they interact with products and services, and what encourages them to behave a certain way. For example, you could run a study to better understand how people feel about a product they use, or why people have trouble filling out your sign up form. Qualitative research can be very exploratory (e.g., user interviews) as well as more closely tied to evaluating designs (e.g., usability testing).Good qualitative research questions to ask include:

  • Why do customers never add items to their wishlist on our website?
  • How do new customers find out about our services?
  • What are the main reasons people don’t sign up for our newsletter?

How to gather qualitative data

There’s no shortage of methods to gather qualitative data, which commonly takes the form of interview transcripts, notes and audio and video recordings.Here are some of the most widely-used qualitative research methods:

  • Usability test – Test a product with people by observing them as they attempt to complete various tasks.
  • User interview Sit down with a user to learn more about their background, motivations and pain points.
  • Contextual inquiry – Learn more about your users in their own environment by asking them questions before moving onto an observation activity.
  • Focus group – Gather 6 to 10 people for a forum-like session to get feedback on a product.

How many participants will you need?

You don’t often need large numbers of participants for qualitative research, with the average range usually somewhere between 5 to 10 people. You’ll likely require more if you're focusing your work on specific personas, for example, in which case you may need to study 5-10 people for each persona.While this may seem quite low, consider the research methods you’ll be using. Carrying out large numbers of in-person research sessions requires a significant time investment in terms of planning, actually hosting the sessions and analyzing your findings.

Quantitative research

On the other side of the coin you’ve got quantitative research. This type of research is focused on numbers and measurement, gathering data and being able to transform this information into statistics.Given that quantitative research is all about generating data that can be expressed in numbers, there multiple ways you make use of it. Statistical analysis means you can pull useful facts from your quantitative data, for example trends, demographic information and differences between groups. It’s an excellent way to understand a snapshot of your users.A quantitative research question could involve investigating the number of people that upgrade from a free plan to a paid plan.

When to use quantitative research

Quantitative research is ideal for understanding behaviors and usage. In many cases it's a lot less resource-heavy than qualitative research because you don't need to pay incentives or spend time scheduling sessions etc). With that in mind, you might do some quantitative research early on to better understand the problem space, for example by running a survey on your users.Here are some examples of good quantitative research questions to ask:

  • How many customers view our pricing page before making a purchase decision?
  • How many customers search versus navigate to find products on our website?
  • How often do visitors on our website change their password?

How to gather quantitative data

Commonly, quantitative data takes the form of numbers and statistics.

Here are some of the most popular quantitative research methods:

  • Card sorts – Find out how people categorize and sort information on your website.
  • First-click tests – See where people click first when tasked with completing an action.
  • A/B tests – Compare 2 versions of a design in order to work out which is more effective.
  • Clickstream analysis – Analyze aggregate data about website visits.

How many participants will you need?

While you only need a small number of participants for qualitative research, you need significantly more for quantitative research. Quantitative research is all about quantity. With more participants, you can generate more useful and reliable data you can analyze. In turn, you’ll have a clearer understanding of your research problem.This means that quantitative research can often involve gathering data from thousands of participants through an A/B test, or with 30 through a card sort. Read more about the right number of participants to gather for your research.

Mixed methods research

While there are certainly times when you’d only want to focus on qualitative or quantitative data to get answers, there’s significant value in utilizing both methods on the same research projects.Interestingly, there are a number of research methods that will generate both quantitative and qualitative data. Take surveys as an example. A survey could include questions that require written answers from participants as well as questions that require participants to select from multiple choices.

Looking back at the earlier example of how people move from a free plan to a paid plan, applying both research approaches to the question will yield a more robust or holistic answer. You’ll know why people upgrade to the paid plan in addition to how many. You can read more about mixed methods research in this article:

Where to from here?

With an understanding of qualitative and quantitative user research, the next best step would be to start learning more about the various methods that fall under each of these research approaches and how to actually conduct research effectively.

Here are some of the best articles to read next:

Publishing date
May 1, 2019
Share this article

Related articles

min read
What gear do I need for qualitative user testing?

Summary: The equipment and tools you use to run your user testing sessions can make your life a lot easier. Here’s a quick guide.

It’s that time again. You’ve done the initial scoping, development and internal testing, and now you need to take the prototype of your new design and get some qualitative data on how it works and what needs to be improved before release. It’s time for the user testing to begin.

But the prospect of user testing raises an important question, and it’s one that many new user researchers often deliberate over: What gear or equipment should I take with me? Well, never fear. We’re going to break down everything you need to consider in terms of equipment, from video recording through to qualitative note-taking.

Recording: Audio, screens and video

The ability to easily record usability tests and user interviews means that even if you miss something important during a session, you can go back later and see what you’ve missed. There are 3 types of recording to keep in mind when it comes to user research: audio, video and screen recording. Below, we’ve put together a list of how you can capture each. You shouldn’t have to buy any expensive gear – free alternatives and software you can run on your phone and laptop should suffice.

  • Audio – Forget dedicated sound recorders; recording apps for smartphones (iOS and Android) allow you to record user interviews and usability tests with ease and upload the recordings to Google Drive or your computer. Good options include Sony’s recording app for Android and the built-in Apple recording app on iOS.
  • Transcription – Once you’ve created a recording, you’ll no doubt want a text copy to work with. For this, you’ll need transcription software to take the audio and turn it into text. There are companies that will make transcriptions for you, but software like Transcribe means you can carry out the process yourself.
  • Screen recording – Very useful during remote usability tests, screen recording software can show you exactly how participants react to the tasks you set out for them, even if you’re not in the room. OBS Studio is a good option for both Mac and Windows users. You can also use Quicktime (free) if you’re running the test in person.
  • Video – Recording your participants as they make their way through the various tasks in a usability test can provide useful reference material at the end of your testing sessions. You can refer back to specific points in a video to capture any detail you may have missed, and you can share video with stakeholders to demonstrate a point. If you don’t have access to a dedicated camera, consider mounting your smartphone on a tripod and recording that way.

Taking (and making use of) notes

Notetaking and qualitative user testing go hand in hand. For most user researchers, notetaking during a research session means busting out the Post-it notes and Sharpie pens, rushing to take down every observation and insight and then having to arduously transcribe these notes after the session – or spend hours in workshops trying to identify themes and patterns. This approach still has merit, as it’s often one of the best ways to get people who aren’t too familiar with user research involved in the process. With physical notes, you can gather people around a whiteboard and discuss what you’re looking at. What’s more, you can get them to engage with the material directly.

But there are digital alternatives. Qualitative notetaking software (like our very own Reframer) means you can bring a laptop into a user interview and take down observations directly in a secure environment. Even better, you can ask someone else to sit in as your notetaker, freeing you up to focus on running the session. Then, once you’ve run your tests, you can use the software for theme and pattern analysis, instead of having to schedule yet another full day workshop.

Scheduling your user tests

Ah, participant scheduling. Perhaps one of the most time-consuming parts of the user testing process. Thankfully, software can drastically reduce the logistical burden.

Here are some useful pieces of software:

Dedicated scheduling tool Calendly is one of the most popular options for participant scheduling in the UX community. It’s really hands-off, in that you basically let the tool know when you’re available, share the Calendly link with your prospective participants, and then they select a time (from your available slots) that works for them. There are also a host of other useful features that make it a popular option for researchers, like integrations and smart timezones.

If you’re already using the Optimal Workshop platform, you can use our  survey tool Questions as a fairly robust scheduling tool. Simply set up a study and add in prospective time slots. You can then use the multi-choice field option to have people select when they’re available to attend. You can also capture other data and avoid the usual email back and forth.

Storing your findings

One of the biggest challenges for user researchers is effectively storing and cataloging all of the research data that they start to build up. Whether it’s video recordings of usability tests, audio recordings or even transcripts of user interviews, you need to ensure that your data is A) easily accessible after the fact, and B) stored securely to ensure you’re protecting your participants.

Here are some things to ask yourself when you store any piece of customer or user data:

  • Who will have access to this data?
  • How long do I plan to keep this data?
  • Will this data be anonymized?
  • If I’m keeping physical data on hand, where will it be stored?

Don’t make the mistake of thinking user data is ‘secure enough’, whether that’s on a company server that anyone can access, or even in an unlocked filing cabinet beneath your desk. Data privacy and security should always be at the top of your list of considerations. We won’t dive into best practices for participant data protection in this article, but instead, just mention that you need to be vigilant. Wherever you end up storing information, make sure you understand who has access.

Wrap up

Hopefully, this guide has given you an overview of some of the tools and software you can use before you start your next user test. We’ve also got a number of other interesting articles that you can read right here on our blog.

min read
Quantifying the value of User Research in 2024 

Think your company is truly user-centric? Think again. Our groundbreaking report on UX Research (UXR) in 2024 shatters common assumptions about our industry.

We've uncovered a startling gap between what companies say about user-centricity and what they actually do. Prepare to have your perceptions challenged as we reveal the true state of UXR integration and its untapped potential in today's business landscape.

The startling statistics 😅

Here's a striking finding: only 16% of organizations have fully embedded UXR into their processes and culture. This disconnect between intention and implementation underscores the challenges in demonstrating and maximizing the true value of user research.

What's inside the white paper 👀

In this comprehensive white paper, we explore:

  • How companies use and value UX research
  • Why it's hard to show how UX research helps businesses
  • Why having UX champions in the company matters
  • New ways to measure and show the worth of UX research
  • How to share UX findings with different people in the company
  • New trends changing how people see and use UX research

Stats sneak peek 🤖

- Only 16% of organizations have fully embedded UX Research (UXR) into their processes and culture. This highlights a significant gap between the perceived importance of user-centricity and its actual implementation in businesses.

- 56% of organizations aren't measuring the impact of UXR at all. This lack of measurement makes it difficult for UX researchers to demonstrate the value of their work to stakeholders.

- 68% of respondents believe that AI will have the greatest impact on the analysis and synthesis phase of UX research projects. This suggests that while AI is expected to play a significant role in UXR, it's seen more as a tool to augment human skills rather than replace researchers entirely.

The UX research crossroads 🛣️

As our field evolves with AI, automation, and democratized research, we face a critical juncture: how do we articulate and amplify the value of UXR in this rapidly changing landscape? We’d love to know what you think! So DM us in socials and let us know what you’re doing to bridge the gap.

Are you ready to unlock the full potential of UXR in your organization? 🔐

Download our white paper for invaluable insights and actionable strategies that will help you showcase and maximize the value of user research. In an era of digital transformation, understanding and leveraging UXR's true worth has never been more crucial.

Download the white paper

What's next?🔮

Keep an eye out for our upcoming blog series, where we'll delve deeper into key findings and strategies from the report. Together, we'll navigate the evolving UX landscape and elevate the value of user insights in driving business success and exceptional user experiences.

min read
Get started with 3 qualitative research techniques

We take a look at three qualitative research methods which can be started quickly with a bit of planning, and minimal participants while delivering great data insights.

What is qualitative research? 🤔

The term ‘qualitative’ refers to things that cannot be measured numerically and qualitative research is no exception. Qualitative research is primarily an exploratory research method that is typically done early in the design process. It's useful for uncovering insights into people’s thoughts, opinions, and motivations. It allows us to gain a deeper understanding of problems and provides answers to questions we didn’t know we needed to ask. 

Qualitative research can be viewed as the 'why' versus quantitative user research which uncovers the 'how' or the 'what' users want. Qualitative user research helps us uncover why people make decisions (and potentially much more).

Here's three qualitative research exercises you can start today:

1. Usability testing 👨🏼💻

Usability testing is a research method designed to evaluate how easy something is to use by testing it with representative users. In most cases, this ‘something’ is a prototype of a website or interface. Or it could just as easily be an existing website or product that requires more understanding of how it is currently used to identify faults or issues.

These tests typically involve observing a participant as they work through a series of tasks involving the product being tested. It’s a good idea to bring a notetaker along, so you can focus on asking questions. After you’ve conducted several usability tests, you can analyze your observations to identify the most common issues.

This can be a very practical start to the user research process. Observing, questioning and noting how a user interacts with your product in a very real environment can offer up some fantastic insights. 

How many participants do I need to get started?

Usability testing is done in a real world environment which means you need your participant to complete tasks on a laptop or mobile phone. Ideally this is in a controlled environment, an office or space that can be managed. Usability testing relies on the facilitator being present. So, to start you only need five participants which helps as it isn't too many people to find and set up.

What to note: Usability testing is a great way to get an understanding of how exactly the participant interacts with the product. Note how they complete tasks, where their frustrations may be. Also look beyond what they are saying and observing what they are doing.  This is invaluable to get the full picture of how they feel and analyzing the user experience.

2. Contextual inquiry 👀

Contextual inquiry is the observation of behaviours and reactions when users undertake specific tasks. By observing and paying attention to unspoken communication, you can uncover insights into behaviour and even expectations.

Giving the participant a set of tasks and observing how they complete these can be quite enlightening. Often what we do can be quite different to what we say we are doing. 

By noting all of this during the testing session, and keeping our notes factual, they can provide context for why the participant may have changed their decision in a task or even abandoned it entirely.  Ensuring that you don’t try and infer why they are feeling a certain way, and how that may influence their decisions is important to gaining insights.

How many participants do I need to get started?

Like usability testing this method only needs a minimal one-on-one environment to get started.  A facilitator sets the test and observes the participant interacting with the product. You can start with as few as five participants, which means getting started with qualitative testing can be very quick to implement.

What to note: How they move or act while they complete tasks.   Do they cross their arms, scratch their head or  even sigh?  Little things like trouble using the keyboard, can be implicit in how well they interpret the website.

3. User interviews 👩🏻💻📓✍🏻💡

User interviews are one-on-one facilitated conversations that are used to gain in-depth understanding of behaviours, opinions, and attitudes towards a product.

Building a relationship with the participant can be valuable, allowing the conversation to flow, and remove barriers. Interviews are an excellent opportunity to ask questions as well as dig deeper into the detail.   They allow for follow up if further clarification be needed. Interviews are usually semi-structured with a list of open questions that are flexible enough to allow the interviewer to cover the required topics but also go wherever the conversation leads. 

Interviews are also quite flexible because they don’t necessarily have to be conducted face to face. If time and resources are tight, they work just as well over the phone or via skype. Sessions can be recorded through note taking audio or video recording.

If you want to find out more about how to do a phone interview, have a read here. 

There can be a flow over of observational insights. This can be as simple as noting throughout the session, how they react to certain set tasks. Are there moments that they are frustrated? Do they turn back and look for another way? Or do they seem irritated by the hardware, the laptop, mouse or even the reflection on the screen? All valuable (unspoken) information on how and why the participant makes decisions.

How many participants do I need to get started?

As with our three qualitative research methods you need a minimal number of participants to really get started with user interviews. They rely on a facilitator that does one-on-one interviews with a set of predetermined questions. You can start with as few as five participants, and depending on the research they can be from inside or outside your company. But they should be as relaxed, and natural as possible, to allow for real responses and observations.

What to note: User interviews are far more conversational than the previous two methods. You should have a script to work from, which will intend to uncover why your participant will want to work with your product a certain way. However, the interview allows some flexibility, with the facilitator able to dig deeper if needed, or change tack. Note the flow of conversation, and the various responses, as well as observed behaviours in a factual way.

Reviewing your research 🕵🏼

After completing your session it is just as important to review it. Spend the time while it’s still fresh in your mind filling in any gaps in information by reviewing the audio and/or video. Great note taking is vital and using a digital note taking software (like our very own Reframer) can make the whole process much simpler and easier, to record, review, analyze and share your data.  If you want more tips on how to take great notes in qualitative user research have a look at this.

Delivering your data 🎁

So, you’ve gone ahead and researched your product and you’ve got some amazing insights and data. What now? You need to pull it all together in a cohesive manner that breaks down what you’ve discovered and what it means. If you use our digital note taking software, Reframer, this can be fairly straight forward and streamlined. Having all of your notes, audio and video recordings, timestamping and observations in one place will allow the data to be generated and reviewed (and shared) swiftly. Pull together a report that can be shared among key shareholders and product managers. Present it in a way that allows your insights to clearly show where changes are needed, or improvements to the user experience can be made. It’s hard to argue with well researched data!

Wrap Up 🌯

If you always thought that qualitative research was too hard, or took too long, think again. Take a look at the Optimal Workshop platform and we can help you through the whole process, taking the pain out, and putting the insights in. 

Ready to get started finding out how your users really interact with your product? Get started now, and lots of our products mean you can start today!

Seeing is believing

Dive into our platform, explore our tools, and discover how easy it can be to conduct effective UX research.