Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.

Research

Header graphic for the article 'Understanding the UX research workflow'
Learn more
1 min read

Understanding the UX research workflow

For many people, UX research is seen as a chore: they know that it’s useful and important, but are liable to just keep putting it off. Then, there are others who carry out discovery research at the start of a new project, but then quickly forget about it as they lose themselves in the design and development process. Lastly, we’ve got people who carry out research on a regular basis, both at the start of a project as discovery work and throughout to test assumptions and work through design or development problems.

Regardless of where you sit on the above scale, the insights that only user-focused research can deliver are key to building successful products, and if you don’t build products that address real user needs, then your competitors certainly will. 

Paula Makuck sums it quite well: “User research helps us to understand how people go about performing tasks and achieving goals that are important to them. It gives us context and perspective and puts us in a position to respond with useful, simplified, and productive design solutions.”

An image showing the UX workflow, sourced from Manuel Lask.
Source: Manuel Lask

Of course, there’s a big jump from understanding the value of user research to actually successfully executing the entire research workflow. What’s more, the internet is filled with thousands of articles, guides and books that attempt to either explain the ‘how’ of the entire process or focus in on one small aspect. This article is designed to shine a high-level light on the key stages of the research workflow, and then point you off to more useful resources where appropriate. This article is for everyone who’s ever said: “Ok, I get the value of user research, but where do I actually start?”.

With that in mind, let’s dive into the first section of our guide, stakeholder interviews.

Run stakeholder interviews

A stakeholder is anyone who has a stake in your research, and more specifically the output. Working with stakeholders is especially important for anyone carrying out user research as you need to know both what they already know about a particular problem and what they need to find out. Understandably, strong communication throughout the research process is key.

While the way in which you communicate with stakeholders during a project may vary, interviews are the best way to identify what they know and need to know at the beginning. As with user interviews, it’s hard to beat sitting down face to face with someone to discuss their needs and problems. Digital.gov has an excellent article on the why of stakeholder interviews, as well as how to actually go about the process of setting them up. You can find that article here.

We’re not done with our stakeholders just yet, either. They’ll play an integral role in the entire user research workflow as we move through the various stages of our project.

Identify your known data

With our stakeholder interviews wrapped up, it’s time to turn our attention to another critical part of the early-stage user research process; identifying our known data. It’s certainly not always easy (and one of the reasons why a good research repository is so key), but the work is important. 

Why? Well, in addition to helping you avoid duplicate research work, taking the time to assess all of the existing data related to your research problem may help you to identify further avenues of research.

So what does this stage of the research workflow look like? It depends on your organization. For those with an established research function, it may be as easy as accessing the company Airtable or Google Drive and pulling up any existing findings. For those without such an operation, things may be a little trickier. Research will have almost certainly been carried out at some point or another, but your mileage may vary when it comes to actually locating it.

Here are just a few of the functions within an organization where you’re likely to find existing data:

  • Product teams: Any product-focused organization is likely to have at least some insight into customer data. And while it may not be in the form of a tidy written report or a collated spreadsheet, product teams should be able to deliver data in the form of how users are actually using a product.
  • Marketing teams: A potential treasure-trove of user data lies with marketing teams. These are the people within an organization that base much of their work on user behavior, and so are likely to have information like personas on hand.
  • Sales team: In much the same way, sales teams will also likely have user data sitting around.

Wherever you end up locating existing research data, taking the time to collate it will certainly serve you well as you begin your own research project.

Develop an approach

Your approach is the mechanism by which you’ll gather more information about your research problem. In simple terms, the research questions and the methodologies you’ll use to answer them.

Research questions are essentially your research objectives. The ‘why’ of your research project. These should be informed by the existing data you’ve uncovered as well as discussions with your stakeholders. As for what research questions should look like, here are some examples: 

  • “How do people currently use the cart feature on our mobile app?”
  • “How do our existing users go about tracking their purchases?”
  • “How do potential customers of ours decide between us and one of our competitors?”

When formulating your research questions, keep in mind that these are not the same questions you should be asking your users. Basically, they should be broad enough that you can use them to then generate tasks or questions for your users, the outputs of which should hopefully shed a little more light on the problem you’re working on.

As for the methods you’ll use to actually attempt to answer these questions, we’ll get to those further down.

Put together a plan or brief

Putting together a detailed research plan is really a process that overlaps many of the steps we’ve outlined above. You’ll want to feed in things like who your stakeholders are, research methodologies, any budget estimates and the participants or participant groups you’re likely to bring on board.

For these reasons, a research plan is something that you should develop throughout the early stages of your research project and then refer back to throughout to ensure you’re still focusing on what you set out to answer. It’s fine to pivot a project if the problem leads you in a more useful direction, but always compare refer to your plan and stakeholders when doing so. Scope creep and rabbit holes are all too common in the field of user research.

Most of what we’ve talked about above will end up constituting your research plan, but a formal document is still an extremely useful tool to have. Don’t fall into the trap of simply dumping everything into a folder on your computer. Such an approach may be fine for you during the project (and possibly even when you need to come back in the future), but it’ll be a nightmare for anyone else needing to pick up where you left off.

Collect the data

Now we come to the data gathering stage of the research process, requiring the use of various research methods to answer our questions. As we covered in our Intro to UX research guide, there’s really no shortage of user research methods available. From card sorting to usability testing, each method – when used correctly – can be a powerful way to get the answers you need.

The methods you end up using should be informed by your research questions. While some questions are best answered using qualitative methods (like user interviews or usability tests), others are better suited to quantitative testing methods. Alternatively, you could even use a combination by mixing methods.

A chart showing the various user research methods available, sourced from Nielsen Norman Group.
Source: Nielsen Norman Group

Determining which method to use requires careful consideration of your research question. If we take a look at the question: “How do our existing users go about tracking their purchases?”, we’d want to look at how they navigate through the website, meaning tree testing would be a suitable option. Alternatively, the question: “How do potential customers of ours decide between us and one of our competitors?”, would be better suited to a qualitative research method like a user interview where we can sit down with a user and ask them questions directly.

Of course, to even execute any of these research methodologies, you’re going to need participants.

Source your participants

You’ve got a research plan, key stakeholders, the questions you need to answer and an understanding of the methods you’d like to use to answer those questions. Now, it’s time to turn our attention to participant recruitment.

There’s a common misconception that finding participants is one of the hardest parts of the user research process, being time consuming, costly and annoying – but this isn’t actually the case. With just a little digging, you’ll likely be able to uncover a pool of people without ever leaving your desk.

Here are just a few of the potential participant sources that researchers, designers and marketers use on a regular basis. This list is by no means exhaustive, but should serve as a good starting point. You’ll also want to consider payment. Your participants are giving up some of their time to help you, so think about a small monetary reward or even a discount for your products or services. The amount and how you broach this depends on the channel.

  • Product teams: Even if your organization doesn’t employ any researchers, chances are your product teams will be a good link to your users. Reach out to product managers, designers and developers to see whether they have any regular contact with users. You may find they work with users directly on a regular basis.
  • Sales, customer support and marketing teams: Similarly, sales and marketing teams also serve as a solid link to your users. Marketing and customer support teams will often manage lists of your existing users, whereas sales teams will have a good understanding of active or engaged users as well as prospective users.
  • Social channels: This one is quite simple. Consider recruiting directly through your social channels.
  • Recruitment services: There are a number of dedicated participant recruitment services available (you can check out our one here) that essentially handle the entire recruitment process for you. All you need to do is specify the type of people you need and they’ll handle the rest.
  • Intercepts: Running a live pop-up message on your website is another great way to recruit participants. If you’re using a messaging app like Intercom, you can easily set up a participant recruitment message to pop up on the screens of people that match the criteria you set.
  • Meetups: Heading to a local meetup group of the people you’re interested in testing can provide you with a good source of participants. This approach is quite useful if you’re looking for people outside of your organization’s users.

Understand the data

We’ve now recruited our participants, chosen our testing methods and run the tests. With the results starting to roll in, it’s time to analyze the data and make sense of it all. No small task. The insights you draw out of your data will obviously depend on the user research methods you’ve used, with methods like card sorting and tree testing giving you more quantitative data to analyze, and usability tests and user interviews providing you with qualitative insights. In any case, the key thing to focus on with this part of the UX research workflow is drawing out useful insights that help you to address your research questions and how you’re going to present this information back to your stakeholders. 

Connect to stakeholders

We’re now at the penultimate step in the research process; taking what we’ve learned and communicating it back to our stakeholders. Consider the following before you sit down in a room with them.

Aim to have detailed answers to your research questions as well as actionable next steps for your stakeholders. You’ve just put in significant time running the research process and as such are best suited to actually making suggestions based on the outputs of that research. It’s also important to understand not only your stakeholders, but the groups likely to be making use of the research further down the track. The easier you can make the process for them (of utilizing your research), the more value they’ll see in the process. Consider using tools that utilize visualizations as one way of making it easy for people to make sense of your research.

Lastly, it’s often a good idea to actually sit down with your stakeholders in a room again instead of simply sending your research results over in an email. Being able to sit down with your stakeholders one-on-one and explain your findings and recommendations will put you in good stead for future research projects.

An image showing a diagram of lean optimisation.
Source: https://twitter.com/OptimiseOrDie

Store learnings

Let’s recap on what we’ve covered. We’ve gone through:

  • The stakeholder interview process
  • How to uncover any data that already exists within the organization
  • Putting together an approach, as well as a plan or brief
  • The data collection phase
  • Participant recruitment
  • Data analysis
  • Connecting your results back to your stakeholders.

There’s a final step that can be easy to overlook, but it’s a critical one in order to ensure that your research (and the insights you’ve managed to uncover) remain accessible. One of the most common failings of the user research process is storing the data in a sustainable way. All too often, the people conducting the studies run their tests, pull out the information they need, and then simply leave the data in the tool they used to run the research or in nested folders on the organization’s server. 

The solution is quite simple in theory, although a little harder in practice – especially when you’re working within a larger team. We’ve talked about building research repositories in this article (point 4), but the key takeaway is that while you should certainly use the right tool to store your findings, you also need to ensure you create a sustainable process. There’s no sense going to the trouble of setting up a new tool if you don’t have a system in place for others to feed in their own research or access historical research in the future.

You don’t need much to create a research repository – you’ll often find many researchers are able to put together one using a tool like Airtable or Excel. Whatever you end up using, just make sure it’s easy to update and access.

Wrap up + summary

Hopefully, by breaking down each stage of the research workflow into actionable steps, we’ve shown that it’s actually quite a simple undertaking – albeit one with quite a few steps. Let us know if you’ve got any questions or thoughts of your own.

Header graphic for the article 'How to create a UX research plan'
Learn more
1 min read

How to create a UX research plan

Summary: A detailed UX research plan helps you keep your overarching research goals in mind as you work through the logistics of a research project.

‍

There’s nothing quite like the feeling of sitting down to interview one of your users, steering the conversation in interesting directions and taking note of valuable comments and insights. But, as every researcher knows, it’s also easy to get carried away. Sometimes, the very process of user research can be so engrossing that you forget the reason you’re there in the first place, or unexpected things that come up that can force you to change course or focus.

‍

This is where a UX research plan comes into play. Taking the time to set up a detailed overview of your high-level research goals, team, budget and timeframe will give your research the best chance of succeeding. It's also a good tool for fostering alignment - it can make sure everyone working on the project is clear on the objectives and timeframes. Over the course of your project, you can refer back to your plan – a single source of truth. After all, as Benjamin Franklin famously said: “By failing to prepare, you are preparing to fail”.

‍

In this article, we’re going to take a look at the best way to put together a research plan.

‍

‍

‍

Your research recipe for success

‍

Any project needs a plan to be successful, and user research is no different. As we pointed out above, a solid plan will help to keep you focused and on track during your research – something that can understandably become quite tricky as you dive further down the research rabbit hole, pursuing interesting conversations during user interviews and running usability tests. Thought of another way, it’s really about accountability. Even if your initial goal is something quite broad like “find out what’s wrong with our website”, it’s important to have a plan that will help you to identify when you’ve actually discovered what’s wrong.

‍

So what does a UX research plan look like? It’s basically a document that outlines the where, why, who, how and what of your research project.

‍

It’s time to create your research plan! Here’s everything you need to consider when putting this plan together.

‍

‍

‍

Make a list of your stakeholders

‍

The first thing you need to do is work out who the stakeholders are on your project. These are the people who have a stake in your research and stand to benefit from the results. In those instances where you’ve been directed to carry out a piece of research you’ll likely know who these people are, but sometimes it can be a little tricky. Stakeholders could be C-level executives, your customer support team, sales people or product teams. If you’re working in an agency or you’re freelancing, these could be your clients.

‍

Make a list of everyone you think needs to be consulted and then start setting up catch-up sessions to get their input. Having a list of stakeholders also makes it easy to deliver insights back to these people at the end of your research project, as well as identify any possible avenues for further research. This also helps you identify who to involve in your research (not just report findings back to).

‍

Action: Make a list of all of your stakeholders.

‍

‍

‍

Write your research questions

‍

Before we get into timeframes and budgets you first need to determine your research questions, also known as your research objectives. These are the ‘why’ of your research. Why are you carrying out this research? What do you hope to achieve by doing all of this work? Your objectives should be informed by discussions with your stakeholders, as well as any other previous learnings you can uncover. Think of past customer support discussions and sales conversations with potential customers.

‍

Here are a few examples of basic research questions to get you thinking. These questions should be actionable and specific, like the examples we’ve listed here:

  • “How do people currently use the wishlist feature on our website?”
  • “How do our current customers go about tracking their orders?”
  • “How do people make a decision on which power company to use?”
  • “What actions do our customers take when they’re thinking about buying a new TV?”

‍

A good research question should be actionable in the sense that you can identify a clear way to attempt to answer it, and specific in that you’ll know when you’ve found the answer you’re looking for. It's also important to keep in mind that your research questions are not the questions you ask during your research sessions - they should be broad enough that they allow you to formulate a list of tasks or questions to help understand the problem space.

‍

Action: Create a list of possible research questions, then prioritize them after speaking with stakeholders.

‍

‍

‍

What is your budget?

‍

Your budget will play a role in how you conduct your research, and possibly the amount of data you're able to gather.

‍

Having a large budget will give you flexibility. You’ll be able to attract large numbers of participants, either by running paid recruitment campaigns on social media or using a dedicated participant recruitment service. A larger budget helps you target more people, but also target more specific people through dedicated participant services as well as recruitment agencies.

‍

Note that more money doesn't always equal better access to tools - e.g. if I work for a company that is super strict on security, I might not be able to use any tools at all. But it does make it easier to choose appropriate methods and that allow you to deliver quality insights. E.g. a big budget might allow you to travel, or do more in-person research which is otherwise quite expensive.

‍

With a small budget, you’ll have to think carefully about how you’ll reward participants, as well as the number of participants you can test. You may also find that your budget limits the tools you can use for your testing. That said, you shouldn’t let your budget dictate your research. You just have to get creative!

‍

Action: Work out what the budget is for your research project. It’s also good to map out several cheaper alternatives that you can pursue if required.

‍

‍

‍

How long will your project take?

‍

How long do you think your user research project will take? This is a necessary consideration, especially if you’ve got people who are expecting to see the results of your research. For example, your organization’s marketing team may be waiting for some of your exploratory research in order to build customer personas. Or, a product team may be waiting to see the results of your first-click test before developing a new signup page on your website.

‍

It’s true that qualitative research often doesn’t have a clear end in the way that quantitative research does, for example as you identify new things to test and research. In this case, you may want to break up your research into different sub-projects and attach deadlines to each of them.

‍

Action: Figure out how long your research project is likely to take. If you’re mixing qualitative and quantitative research, split your project timeframe into sub-projects to make assigning deadlines easier.

‍

‍

‍

Understanding participant recruitment

‍

Who you recruit for your research comes from your research questions. Who can best give you the answers you need? While you can often find participants by working with your customer support, sales and marketing teams, certain research questions may require you to look further afield.

‍

The methods you use to carry out your research will also have a part to play in your participants, specifically in terms of the numbers required. For qualitative research methods like interviews and usability tests, you may find you’re able to gather enough useful data after speaking with 5 people. For quantitative methods like card sorts and tree tests, it’s best to have at least 30 participants. You can read more about participant numbers in this Nielsen Norman article.

‍

At this stage of the research plan process, you’ll also want to write some screening questions. These are what you’ll use to identify potential participants by asking about their characteristics and experience.

‍

Action: Define the participants you’ll need to include in your research project, and where you plan to source them. This may require going outside of your existing user base.

‍

‍

‍

Which research methods will you use?

‍

The research methods you use should be informed by your research questions. Some questions are best answered by quantitative research methods like surveys or A/B tests, with others by qualitative methods like contextual inquiries, user interviews and usability tests. You’ll also find that some questions are best answered by multiple methods, in what’s known as mixed methods research.

‍

If you’re not sure which method to use, carefully consider your question. If we go back to one of our earlier research question examples: “How do our current customers go about tracking their orders?”, we’d want to test the navigation pathways.

‍

If you’re not sure which method to use, it helps to carefully consider your research question. Let’s use one of our earlier examples: “Is it easy for users to check their order history in our iPhone app?” as en example. In this case, because we want to see how users move through our app, we need a method that’s suited to testing navigation pathways – like tree testing.

‍

For the question: “What actions do our customers take when they’re thinking about buying a new TV?”, we’d want to take a different approach. Because this is more of an exploratory question, we’re probably best to carry out a round of user interviews and ask questions about their process for buying a TV.

‍

Action: Before diving in and setting up a card sort, consider which method is best suited to answer your research question.

‍

‍

‍

Develop your research protocol

‍

A protocol is essentially a script for your user research. For the most part, it’s a list of the tasks and questions you want to cover in your in-person sessions. But, it doesn’t apply to all research types. For example, for a tree test, you might write your tasks, but this isn't really a script or protocol.

‍

Writing your protocol should start with actually thinking about what these questions will be and getting feedback on them, as well as:

  • The tasks you want your participants to do (usability testing)
  • How much time you’ve set aside for the session
  • A script or description that you can use for every session
  • Your process for recording the interviews, including how you’ll look after participant data.

‍

Action: This is essentially a research plan within a research plan – it’s what you’d take to every session.

‍

Happy researching!

‍

‍

Related UX plan reading

‍

Header graphic for the article 'What is ResearchOps?'
Learn more
1 min read

What is ResearchOps?

Back in early 2018, user researchers from around the globe got together to try and define an emerging practice – ResearchOps. The project eventually grew into a significant research effort called #WhatisResearchOps, involving 34 workshops, a survey that garnered over 300 responses and reams of analysis.

‍

The goal was quite simple. Generate conversation around the work that researchers do in order to support them as research grows, with an eye toward standardizing common research practices. It’s an important undertaking: a report back carried out in 2017 found that 81 percent of executives agreed that user research made their organization more efficient. Further, 86 percent believed user research improved the quality of their products.

‍

It’s clear that many organizations are starting to understand the value that user researchers bring to the table, it’s now up to the researchers to operationalize their practice. 

‍

But for the uninitiated, what exactly is ResearchOps? And why should you care?

‍

‍

‍

What is ResearchOps?

‍

‍

To start off, there’s not a lot of literature about ResearchOps as of early 2020. Right now, it’s a practice that can certainly be classed as ‘emerging’. This is partly why we’re writing about it. We want to add our own kindling to the ResearchOps conversation fire.

‍

ResearchOps as a practice has 2 main goals:

  • Socialize research: Make it easier for the people in an organization to access the insights generated by user research, and allow them to actively take part in research activities.
  • Operationalize research: Standardize templates, processes and plans to reduce research costs and the time required to get research projects off the ground.

‍

Or, as Vidhya Sriram explains in the post we linked above, ResearchOps “democratizes customer insights, takes down barriers to understand customers, and makes everyone take responsibility for creating remarkable customer experiences.”

‍

ResearchOps certainly hasn’t achieved anything close to ‘mainstream’ understanding yet, so in order to give ResearchOps the best chance of succeeding, it’s quite helpful to look at another ‘Ops’ practice – DesignOps.

‍

As 2 ‘operations’ focused initiatives, DesignOps and ResearchOps share a lot of the same DNA. According to Nielsen Norman’s DesignOps 101 article, DesignOps “refers to the orchestration and optimization of people, processes, and craft in order to amplify design’s value and impact at scale”. Author Kate Kaplan goes on to flesh out this description, noting that it’s a term for addressing such issues as growing or evolving design teams, onboarding people with the right design skills, creating efficient workflows and improving design outputs. Sound familiar?

‍

The world of DesignOps is a veritable smorgasbord of useful learnings for researchers looking to grow the practice of ResearchOps. One particularly useful element is the idea of selecting only the components of DesignOps that are relevant for the organization at that point in time. This is quite important. DesignOps is a broad topic, and there’s little sense in every organization trying to take on every aspect of it. The takeaway, DesignOps (and ResearchOps) should look very different depending on the organization.

‍

Kate Kaplan also touches on another useful point in her Nielsen Norman Group article; the idea of the DesignOps menu:

‍

An image of the DesignOps Menu, by Nielsen Norman Group.
Source: Nielsen Norman Group | Caption: The DesignOps Menu.

‍

This menu essentially outlines all of the elements that organizations could focus on when adopting practices to support designers. The DesignOps Menu is a useful framework for those trying to create a similar list of elements for ResearchOps.

‍

‍

‍

Why does ResearchOps matter now?

‍

‍

It’s always been difficult to definitively say “this is the state of user research”. While some organizations intimately understand the value that a focus on customer centricity brings (and have teams devoted to the cause), others are years behind. In these lagging organizations, the researchers (or the people doing research), have to fight to prove the value of their work. This is one of the main reasons why ResearchOps as an initiative matters so much right now.

‍

The other driver for ResearchOps is that the way researchers work together and with other disciplines is changing fast. In general, a growing awareness of the importance of the research is pushing the field together with data science, sales, customer support and marketing. All this to say, researchers are having to spend more and more time both proving the value of their work and operating at a more strategic level. This isn’t likely to slow, either. The coming years will see researchers spending less time doing actual research. With this in mind, ResearchOps becomes all the more valuable. By standardizing common research practices and working out ownership, the research itself doesn’t have to suffer.

‍

‍

‍

What are the different components of ResearchOps?

‍

‍

As we touched on earlier, ResearchOps – like DesignOps – is quite a broad topic. This is necessary. As most practicing researchers know, there are a number of elements that go into ensuring thorough, consistent research.

‍

A useful analogy for ResearchOps is a pizza. There are many different components (toppings) that can go on the pizza, which is reflected in how research exists in different organizations. The real point here is that no 2 research operations should look the same. Research at Facebook will look markedly different to research at a small local government agency in Europe.

‍

We looked at the DesignOps Menu earlier as a model for ResearchOps, but there’s another, more specific map created as part of the #WhatisResearchOps project.

‍

An image of the ResearchOps components map by MURAL.
Source: Medium/Mural |  Caption: The ResearchOps components map.

‍

Like the DesignOps Menu, this map functions as a framework for what ResearchOps is. It’s the output of a series of workshops run by researchers across the globe as well as a large survey.

‍

‍

‍

Who practices ResearchOps?

‍

‍

By now you should have a clear idea of the scale and scope of ResearchOps, given that we’ve covered the various components and why the practice matters so much. There are still 2 important topics left to cover, however: Who practices ResearchOps and (perhaps most interestingly) where it’s heading.

‍

As the saying goes, “everyone’s a researcher”, and this certainly holds true when talking about ResearchOps, but here are some of the more specific roles that should be responsible for executing ResearchOps components.

‍

  • User researchers – Self-explanatory. The key drivers of research standardization and socialization.
  • UX designers – Customer advocates to the core, UX designers follow user researchers quite closely when it comes to execution.
  • Designers – Add to that, designers in general. As designers increasingly become involved in the research activities of their organizations, expect to see them having a growing stake in ResearchOps activities.
  • Customer experience (CX) and marketing – Though they’re often not the foremost consideration when it comes to research conversations, marketing and CX certainly have a stake in research operations. 

‍

There’s also another approach that is worth considering: Research as a way of thinking. This can essentially be taken up by anyone, and it boils down to understanding the importance of a healthy research function, with processes, systems and tools in place to carry out research.

‍

‍

‍

What’s next for ResearchOps?

‍

‍

As Kate Kaplan said in DesignOps 101, “DesignOps is the glue that holds the design organization together, and the bridge that enables collaboration among cross-disciplinary team members”. The same is true of ResearchOps – and it’s only going to become more important.

 

We’re going to echo the same call made by numerous other people helping to grow ResearchOps and say that if you’ve got some learnings to share, share them back with the community! We’re also always looking to share great UX and research content, so get in touch with us if you’ve got something to share on our blog.

Learn more
1 min read

5 ways to increase user research in your organization

Co-authored by Brandon Dorn, UX designer at Viget.As user experience designers, making sure that websites and tools are usable is a critical component of our work, and conducting user research enables us to assess whether we’re achieving that goal or not. Even if we want to incorporate research, however, certain constraints may stand in our way.

‍

A few years ago, we realized that we were facing this issue at Viget, a digital design agency, and we decided to make an effort to prioritize user research. Almost two years ago, we shared initial thoughts on our progress in this blog post. We’ve continued to learn and grow as researchers since then and hope that what we’ve learned along the way can help your clients and coworkers understand the value of research and become better practitioners. Below are some of those lessons.

‍

Make research a priority for your organization

‍

Before you can do more research, it needs to be prioritized across your entire organization — not just within your design team. To that end, you should:

‍

  • Know what you’re trying to achieve. By defining specific goals, you can share a clear message with the broader organization about what you’re after, how you can achieve those goals, and how you will measure success. At Viget, we shared our research goals with everyone at the company. In addition, we talked to the business development and project management teams in more depth about specific ways that they could help us achieve our goals, since they have the greatest impact on our ability to do more research.
  • Track your progress. Once you’ve made research a priority, make sure to review your goals on an ongoing basis to ensure that you’re making progress and share your findings with the organization. Six months after the research group at Viget started working on our goals, we held a retrospective to figure out what was working — and what wasn’t.
  • Adjust your approach as needed. You won’t achieve your goals overnight. As you put different tactics into action, adjust your approach if something isn’t helping you achieve your goals. Be willing to experiment and don’t feel bad if a specific tactic isn’t successful.

‍

Educate your colleagues and clients

‍

If you want people within your organization to get excited about doing more research, they need to understand what research means. To educate your colleagues and clients, you should:

  • Explain the fundamentals of research. If someone has not conducted research before, they may not be familiar or feel comfortable with the vernacular. Provide an overview of the fundamental terminology to establish a basic level of understanding. In a blog post, Speaking the Same Language About Research, we outline how we established a common vocabulary at Viget.
  • Help others understand the landscape of research methods. As designers, we feel comfortable talking about different methodologies and forget that that information will be new to many people. Look for opportunities to increase understanding by sharing your knowledge. At Viget, we make this happen in several ways. Internally, we give presentations to the company, organize group viewing sessions for webinars about user research, and lead focused workshops to help people put new skills into practice. Externally, we talk about our services and share knowledge through our blog posts. We are even hosting a webinar about conducting user interviews in November and we'd love for you to join us.
  • Incorporate others into the research process. Don't just tell people what research is and why it's important — show them. Look for opportunities to bring more people into the research process. Invite people to observe sessions so they can experience research firsthand or have them take on the role of the notetaker. Another simple way to make people feel involved is to share findings on an ongoing basis rather than providing a report at the end of the process.

‍

Broaden your perspective while refining your skill set

‍

Our commitment to testing assumptions led us to challenge ourselves to do research on every project. While we're dogmatic about this goal, we're decidedly un-dogmatic about the form our research takes from one project to another. To pursue this goal, we seek to:

  • Expand our understanding. To instill a culture of research at Viget, we've found it necessary to question our assumptions about what research looks like. Books like Erika Hall’s Just Enough Research teach us the range of possible approaches for getting useful user input at any stage of a project, and at any scale. Reflect on any methodological biases that have become well-worn paths in your approach to research. Maybe your organization is meticulous about metrics and quantitative data, and could benefit from a series of qualitative studies. Maybe you have plenty of anecdotal and qualitative evidence about your product that could be better grounded in objective analysis. Aim to establish a balanced perspective on your product through a diverse set of research lenses, filling in gaps as you learn about new approaches.
  • Adjust our approach to project constraints. We've found that the only way to consistently incorporate research in our work is to adjust our approach to the context and constraints of any given project. Client expectations, project type, business goals, timelines, budget, and access to participants all influence the type, frequency, and output of our research. Iterative prototype testing of an email editor, for example, looks very different than post-launch qualitative studies for an editorial website. While some projects are research-intensive, short studies can also be worthwhile.
  • Reflect on successes and shortcomings. We have a longstanding practice of holding post-project team retrospectives to reflect on and document lessons for future work. Research has naturally come up in these conversations, and many of the things we've discussed you're reading right now. As an agency with a diverse set of clients, it's been important for us to understand what types of research work for what types of clients, and when. Make sure to take time to ask these questions after projects. Mid-project retrospectives can be beneficial, especially on long engagements, yet it's hard to see the forest when you're in the weeds.

‍

Streamline qualitative research processes 🚄

‍

Learning to be more efficient at planning, conducting, and analyzing research has helped us overturn the idea that some projects merit research while others don't. Remote moderated usability tests are one of our preferred methods, yet, in our experience, the biggest obstacle to incorporating these tests isn't the actual moderating or analyzing, but the overhead of acquiring and scheduling participants. While some agencies contract out the work of recruiting, we've found it less expensive and more reliable to collaborate with our clients to find the right people for our tests. That said, here are some recommendations for holding efficient qualitative tests:

  • Know your tools ahead of time. We use a number of tools to plan, schedule, annotate, and analyze qualitative tests (we're inveterate spreadsheet users). Learn your tools beforehand, especially if you're trying something new. Tools should fade into the background during tests, which Reframer does nicely.
  • Establish a recruiting process. When working with clients to find participants, we'll often provide an email template tailored to the project for them to send to existing or potential users of their product. This introductory email will contain a screener that asks a few project-related demographic or usage questions, and provides us with participant email addresses which we use to follow-up with a link to a scheduling tool. Once this process is established, the project manager will ensure that the UX designer on the team has a regular flow of participants. The recruiting process doesn't take care of itself – participants cancel, or reschedule, or sometimes don't respond at all – yet establishing an approach ahead of time allows you, the researcher, to focus on the research in the midst of the project.
  • Start recruiting early. Don't wait until you've finished writing a testing script to begin recruiting participants. Once you determine the aim and focal points of your study, recruit accordingly. Scripts can be revised and approved in the meantime.

‍

Be proactive about making research happen 🤸

‍

As a generalist design agency, we work with clients whose industries and products vary significantly. While some clients come to us with clear research priorities in mind, others treat it as an afterthought. Rare, however, is the client who is actively opposed to researching their product. More often than not, budget and timelines are the limiting factors. So we try not to make research an ordeal, but instead treat it as part of our normal process even if a client hasn't explicitly asked for it. Common-sense perspectives like Jakob Nielsen’s classic “Discount Usability for the Web” remind us that some research is always better than none, and that some can still be meaningfully pursued. We aren’t pushy about research, of course, but instead try to find a way to make it happen when it isn't a definite priority.

‍

‍World Usability Day is coming up on November 9, so now is a great time to stop and reflect on how you approach research and to brainstorm ways to improve your process. The tips above reflect some of the lessons we’ve learned at Viget as we’ve tried to improve our own process. We’d love to hear about approaches you’ve used as well.

Header graphic for the article 'Optimal vs. UserTesting: A Modern, Streamlined Platform or a Complex...'
Learn more
1 min read

Optimal vs. UserTesting: A Modern, Streamlined Platform or a Complex Enterprise Suite

‍

The user research landscape has evolved significantly in recent years, but not all platforms have adapted at the same pace. UserTesting for example, despite being one of the largest players in the market, still operates on legacy infrastructure with outdated pricing models that no longer meet the evolving needs of mature UX, design and product teams. More and more we see enterprises choosing platforms like Optimal, because we represent the next generation of user research and insight platforms: ones that are purpose-built for modern teams that are prioritizing agility, insight quality, and value.

‍

What are the biggest differences between Optimal and UserTesting?

‍

Cost

‍

Optimal has Transparent Pricing: Optimal offers flat-rate pricing without per-seat fees or session units, enabling teams to scale research sustainably. Our transparent pricing eliminates budget surprises and enables predictable research ops planning.

‍

UserTesting is Expensive: In contrast, UserTesting has very high per user fees annually plus additional session-based fees, creating unpredictable costs that escalate the more research your team does. This means that teams often face budget surprises when conducting longer studies or more frequent research.

‍

Return on Investment

‍

The Best Value in the Market: Optimal's straightforward pricing and comprehensive feature set deliver measurable ROI. We offer 90% of the features that UserTesting provides at 10% of the price.

‍

Justifying the Cost of UserTesting: UserTesting's high costs and complex pricing structure make it hard to prove the ROI, particularly for teams conducting frequent research or extended studies that trigger additional session fees.

‍

Technology Evolution

‍‍

Optimal is Purpose-Built for Modern Research: Optimal has invested heavily over the last few years in features for contemporary research needs, including AI-powered analysis and automation capabilities. Our new Interviews tool exemplifies this innovation, transforming hours of manual video analysis into automated, AI-powered insights that surface key themes, generate highlight reels, and produce timestamped transcripts in a fraction of the time.

‍

UserTesting is Struggling to Modernize: UserTesting's platform shows signs of aging infrastructure, with slower performance and difficulty integrating modern research methodologies. Their technology advancement has lagged behind industry innovation.

‍

Platform Integration

‍

Built by Researchers for Researchers: Optimal has built from the ground up a single, cohesive platform without the complexity of merged acquisitions, ensuring consistent user experience and seamless workflow integration.

‍

UserZoom Integration Challenges: UserTesting's acquisition of UserZoom has created platform challenges that continue to impact user experience. UserTesting customers report confusion navigating between legacy systems and inconsistent feature availability and quality.

‍

Participant Panel Quality

‍

Flexibility = Quality: Optimal prioritizes flexibility for our users, allowing our customers to bring their own participants for free or use our high-quality panels, with over 100+ million verified participants across 150+ countries who meet strict quality standards.

‍

Poor Quality, In-House Panel: UserTesting's massive scale has led to participant quality issues, with researchers reporting difficulty finding high-quality participants for specialized research needs and inconsistent participant engagement.

‍

Customer Support Experience

‍

Agile, Personal Support: At Optimal we pride ourselves on our fast, human support with dedicated account management and direct access to product teams, ensuring fast and personalized support.

‍

Impersonal, Enterprise Support: In contrast, users report that UserTesting's large organizational structure creates slower support cycles, outsourced customer service, and reduced responsiveness to individual customer needs.

‍

The Future of User Research Platforms

‍

The future of user research platforms is here, and smart teams are re-evaluating their platform needs to reflect that future state. What was once a fragmented landscape of basic testing tools and legacy systems has evolved into one where comprehensive user insight platforms are now the preferred solution. Today's UX, product and design teams need platforms that have evolved to include:

‍

  • Advanced Analytics: AI-powered analysis that transforms data into actionable insights
  • Flexible Recruitment: Options for both BYO, panel and custom participant recruitment
  • Transparent Pricing: Predictable costs that scale with your needs
  • Responsive Development: Platforms that evolve based on user feedback and industry trends

‍

Platforms Need to Evolve for Modern Research Needs

‍

When selecting a vendor, teams need to choose a platform with the functionality that their teams need now but also one that will also grow with the needs of your team in the future. Scalable, adaptable platforms enable research teams to:

‍

  • Scale Efficiently: Grow research activities without exponential cost increaeses
  • Embrace Innovation: Integrate new research methodologies and analysis techniques as well as emerging tools like AI 
  • Maintain Standards: Ensure consistent participant, data and tool quality as the platform evolves
  • Stay Responsive: Adapt to changing business needs and market conditions

‍

The key is choosing a platform that continues to evolve rather than one constrained by outdated infrastructure and complex, legacy pricing models.

‍

Ready to see how leading brands including Lego, Netflix and Nike achieve better research outcomes? Experience how Optimal's platform delivers user insights that adapt to your team's growing needs.

‍

‍

‍

No results found.

Please try different keywords.

Subscribe to OW blog for an instantly better inbox

Thanks for subscribing!
Oops! Something went wrong while submitting the form.

Seeing is believing

Explore our tools and see how Optimal makes gathering insights simple, powerful, and impactful.