User experience research is super important to developing a product that truly engages, compels and energises people. We all want a website that is easy to navigate, simple to follow and compels our users to finish their tasks. Or an app that supports and drives engagement.
We’ve talked a lot about the various types of research tools that help improve these outcomes.
There is a rising research trend in 2021.
Mixed method research - what is more compelling than these user research quantitative tools? Combining these with awesome qualitative research! Asking the same questions in various ways can provide deeper insights into how our users think and operate. Empowering you to develop products that truly talk to your users, answer their queries or even address their frustrations.
Though it isn’t enough to simply ‘do research’, as with anything you need to approach it with strategy, focus and direction. This will funnel your time, money and energy into areas that will generate the best results.
Mixed Method UX research is the research trend of 2021
With the likes of Facebook, Amazon, Etsy, eBay, Ford and many more big organizations offering newly formed job openings for mixed methods researchers it becomes very obvious where the research trend is heading.
It’s not only good to have, but now becoming imperative, to gather data, dive deeper and generate insights that provide more information on our users than ever before. And you don't need to be Facebook to reap the benefits. Mixed method research can be implemented across the board and can be as narrow as finding out how your homepage is performing through to analysing in depth the entirety of your product design.
And with all of these massive organizations making the move to increase their data collection and research teams. Why wouldn’t you?
The value in mixed method research is profound. Imagine understanding what, where, how and why your customers would want to use your service. And catering directly for them. The more we understand our customers, the deeper the relationship and the more likely we are to keep them engaged.
Although of course by diving deep into the reasons our users like (or don’t like) how our products operate can drive your organization to target and operate better at a higher level. Gearing your energies to attracting and keeping the right type of customer, providing the right level of service and after care. Potentially reducing overheads, by not delivering to expected levels.
What is mixed method research?
Mixed methods research isn’t overly complicated, and doesn’t take years for you to master. It simply is a term used to refer to using a combination of quantitative and qualitative data. This may mean using a research tool such as card sorting alongside interviews with users.
Qualitative research is research around users’ behaviour and experiences. This can be through usability tests, interviews or surveys.
For instance you may be asking ‘how should I order the products on my site?’. With card sorting you can get the data insights that will inform how a user would like to see the products sorted. Coupled with interviews you will get the why.
Understanding the thinking behind the order, and why one user likes to see gym shorts stored under shorts and another would like to see them under active wear. With a deeper understanding of how and why users decide how content should be sorted are made will create a highly intuitive website.
Another great reason for mixed method research would be to back up data insights for stakeholders. With a depth and breadth of qualitative and quantitative research informing decisions, it becomes clearer why changes may need to be made, or product designs need to be challenged.
How to do mixed method research
Take a look at our article for more examples of the uses of mixed method research.
Simply put mixed method research means coupling quantitative research, such as tree testing, card sorting or first click testing, with qualitative research such as surveys, interviews or diary entry.
Say, for instance, the product manager has identified that there is an issue with keeping users engaged on the homepage of your website. We would start with asking where they get stuck, and when they are leaving.
This can be done using a first-click tool, such as Chalkmark, which will map where users head when they land on your homepage and beyond.
This will give you the initial qualitative data. However, it may only give you some of the picture. Coupled with qualitative data, such as watching (and reporting on) body language. Or conducting interviews with users directly after their experience so we can understand why they found the process confusing or misleading.
A fuller picture, means a better understanding.
Key is to identify what your question is and honing in on this through both methods. Ultimately, we are answering your question from both sides of the coin.
Upcoming research trends to watch
Keeping an eye on the progression of the mixed method research trend, will mean keeping an eye on these:
1. Integrated Surveys
Rather than thinking of user surveys as being a one time, in person event, we’re seeing more and more often surveys being implemented through social media, on websites and through email. This means that data can be gathered frequently and across the board. This longitude data allows organizations to continuously analyse, interpret and improve products without really ever stopping.
Rather than relying on users' memories for events and experiences data can be gathered in the moment. At the time of purchase or interaction. Increasing the reliability and quality of the data collected.
2. Return to the social research
Customer research is rooted in the focus group. The collection of participants in one space, that allows them to voice their opinions and reach insights collectively. This did used to be an overwhelming task with days or even weeks to analyse unstructured forums and group discussions.
However, now with the advent of online research tools this can also be a way to round out mixed method research.
3. Co-creation
The ability to use your customers input to build better products. This has long been thought a way to increase innovative development. Until recently it too has been cumbersome and difficult to wrangle more than a few participants. But, there are a number of resources in development that will make co-creation the buzzword of the decade.
4. Owned Panels & Community
Beyond community engagement in the social sphere. There is a massive opportunity to utilise these engaged users in product development. Through a trusted forum, users are far more likely to actively and willingly participate in research. Providing insights into the community that will drive stronger product outcomes.
What does this all mean for me
So, there is a lot to keep in mind when conducting any effective user research. And there are a lot of very compelling reasons to do mixed method research and do it regularly.
To remain innovative, and ahead of the ball it remains very important to be engaged with your users and their needs. Using qualitative and qualitative research to inform product decisions means you can operate knowing a fuller picture.
One of the biggest challenges with user research can be the coordination and participant recruitment. That’s where we come in.
Taking the pain out of the process and streamlining your research. Take a look at our Qualitative Research option, Reframer. Giving you an insight into how we can help make your mixed method research easier and analyse your data efficiently and in a format that is easy to understand.
User research doesn’t need to take weeks or months. With our participant recruitment we can provide reliable and quality participants across the board that will provide data you can rely on.
Why not get in deeper with mixed method research today!
Simply put, ResearchOps is about making sure your research operations are robust, thought through and managed.
Having systems and processes around your UX research and your team keep everyone (and everything) organized. Making user research projects quicker to get started and more streamlined to run. And robust sharing, socializing, and knowledge storage means that everyone can understand the research insights and findings and put these to use - across the organization. And even better, find these when they need them.
Using the same tools across the team allows the research team to learn from each other, and previous research projects and be able to compare apples with apples, with everyone included. Bringing the team together across tools, research and results.
We go into more detail in our ebook ResearchOps Checklist about exactly what you can do to make sure your research team is running at its best. Let’s take a quick look at 5 way to ensure you have the grounding for a successful ResearchOps team.
1. Knowledge management 📚
What do you do with all of the insights and findings of a user research project? How do you store them, how do you manage the insights, and how do you share and socialize?
Having processes in place that manage this knowledge is important to the longevity of your research. From filing to sharing across platforms, it all needs to be standardized so everyone can search, find and share.
2. Guidelines and process templates 📝
Providing a framework for how to run research projects is are important. Building on the knowledge base from previous research can improve research efficiencies and cut down on groundwork and administration. Making research projects quicker and more streamlined to get underway.
3. Governance 🏛
User research is all about people, real people. It is incredibly important that any research be legal, safe, and ethical. Having effective governance covered is vital.
4. Tool stack 🛠
Every research team needs a ‘toolbox’ that they can use whenever they need to run card sorts, tree tests, usability tests, user interviews, and more. But which software and tools to use?
Making sure that the team is using the same tools also helps with future research projects, learning from previous projects, and ensuring that the information is owned and run by the organization (rather than whichever individuals prefer). Reduce logins and password shares, and improve security with organization-wide tools and platforms.
5. Recruitment 👱🏻👩👩🏻👧🏽👧🏾
Key to great UX research is the ability to recruit quality participants - fast! Having strong processes in place for screening, scheduling, sampling, incentivizing, and managing participants needs to be top of the list when organizing the team.
Wrap Up 💥
Each of these ResearchOps processes are not independent of the other. And neither do they flow from one to the other. They are part of a total wrap around for the research team, creating processes, systems and tools that are built to serve the team. Allowing them to focus on the job of doing great research and generating insights and findings that develop the very best user experience.
Afterall, we are creating user experiences that keep our users engaged and coming back. Why not look at the teams user experience and make the most of that. Freeing time and space to socialize and share the findings with the organization.
The Age of the Customer is well and truly here. In every industry and vertical across the globe, UX professionals now dictate the terms, placing customers at the heart of every design decision. Or at least, this is the new reality that’s unfolding in the organizations and businesses that don’t want to be left behind.
Make no mistake; simply claiming to be the best is no longer enough. To survive and thrive, people need to be placed at the heart. The golden key that will allow organizations to pivot to this new reality lies with that of the user researcher.
But it’s not enough to simply “do user research”. Sure, some customer insight is obviously better than none at all, but to really be useful it needs to be effective research. That’s what this article is all about.
Get comfortable, because this is going to be a long one – for good reason.
Why (effective) user research is so important
You are not your user. As much as you may like to think that you are, you’re not. It can be a tricky proposition to get your head around, especially when we regularly assume that everyone thinks like us. There are 8 billion people out there who have a vastly different set of experiences and perspectives than you. With that in mind, when we start to generalize based on our own personal experiences, this is what’s known as availability bias.
Unfortunately, solving this is issue not as easy as getting into a room with customers and having a chat. People don’t always tell the truth! This isn’t to say that the participant in your last user interview was flat out lying to you, but the things that people say are different from the things that people do. It;’s your job (as a user researcher) to intuit the actual behaviors and actions, and identify their needs based on this data.
When you’re doing your job correctly, you’ve given your organization the best possible chance of success. Everything – and I mean everything – starts with a solid understanding of your users. Doors will open, paths will reveal themselves – you get the idea.
The qualities of an effective user researcher
Let me preface this section by saying that you don’t have to have all of these qualities in spades, the list below is really just a way for you to better understand some of the traits of an effective user researcher, to get you thinking and on the right path.
Curious: User research can be quite repetitive, especially when you get to the 6th user interview and need to ask the same questions. A genuine curiosity about people, the challenges they face and their behaviors will go a long way in helping you to push through.
Pragmatic: Being an idealist has its uses, but it’s also important to be pragmatic. As a researcher, you need to operate on a fine line and balance your capacity to do research with business goals, finances and the desires of your stakeholders. Do the most with what you’ve got.
Organized: It takes a lot to plan a research project, from scheduling testing sessions to assembling large slide decks for presentations. You’ve got to manage a large number of complex components, so it’s important that you can organize and prioritize.
Collaborative: User research is most effective when it’s carried out collaboratively. This means working with your team, with the organization and with other disciplines. Think outside the box: Who stands to benefit from your research and how can you involve them?
Empathetic: Real, natural empathy is a rare trait, but adopting an empathetic mindset is something everyone can (and should) learn. Beyond just uncovering insights from your participants, consider what these insights mean and how they all connect. This will truly enable you to understand your users.
Sociable: You don’t have to suddenly adopt an extroverted persona, but being actively interested in other people will help you build relationships both inside your organization and with customers.
Perceptive: User research means listening and observing. During a user interview or usability test, you need to be able to filter all of the data entering your mind and extract the most relevant insights.
Analytical: In a similar vein to perceptiveness, being analytical is also key if you want to understand all of the data that your research will produce. Filter, examine, extract and move on.
How to run user research effectively (and at a low cost)
There are innumerable methods for user research, but many are resource- and time-intensive. What’s more, certain research methods come attached with significant costs.
But, research doesn’t have to be the time and money sink that it can often first appear to be. Certain actions before you ever step into the room with a participant can make a world of difference.
Conduct research at the start
User research is obviously valuable whenever you do it, but you’ll see the biggest impact when you carry it out right the start of a project. Conduct research to get the lay of the land; to learn how and why customers make certain decisions, and where the biggest opportunities lie.
Note: Don’t research in a silo, involve your team, stakeholders and other interested parties.
Have clear goals – and a plan
Every research project needs a clear objective, and that comes from a detailed UX research plan, which includes well-formulated research questions. Every project will have a different question, but they’re the best starting point to ensure research success.
Choose the right methods
There’s no shortage of research methods to choose from, but being an effective user researcher is all about being able to pick the right methods for each project, and use them correctly. Nearly every research project will benefit from using a combination of qualitative and quantitative methods in order to generate the most useful insights.
To understand which method to use, it’s a good idea to view them using the following framework:
Involve stakeholders
Bring stakeholders into your research project as early as possible. These are the people that will end up utilizing the results of your work, and chances are they’re the ones who’ll have the most questions at the end. Involve them through consultation, regular updates, the all-too-important presentation at the end of the project and by letting them take notes for you during research sessions.
Wrap up
It’s not enough to simply run a card sort now (although that’s still a very useful exercise). You need to think cohesively about the role of your research in your organization and make sure that you’re as aware of your bias as you are of the various methods and tools available to you. Happy researching!
For many people, UX research is seen as a chore: they know that it’s useful and important, but are liable to just keep putting it off. Then, there are others who carry out discovery research at the start of a new project, but then quickly forget about it as they lose themselves in the design and development process. Lastly, we’ve got people who carry out research on a regular basis, both at the start of a project as discovery work and throughout to test assumptions and work through design or development problems.
Regardless of where you sit on the above scale, the insights that only user-focused research can deliver are key to building successful products, and if you don’t build products that address real user needs, then your competitors certainly will.
Paula Makuck sums it quite well: “User research helps us to understand how people go about performing tasks and achieving goals that are important to them. It gives us context and perspective and puts us in a position to respond with useful, simplified, and productive design solutions.”
Of course, there’s a big jump from understanding the value of user research to actually successfully executing the entire research workflow. What’s more, the internet is filled with thousands of articles, guides and books that attempt to either explain the ‘how’ of the entire process or focus in on one small aspect. This article is designed to shine a high-level light on the key stages of the research workflow, and then point you off to more useful resources where appropriate. This article is for everyone who’s ever said: “Ok, I get the value of user research, but where do I actually start?”.
With that in mind, let’s dive into the first section of our guide, stakeholder interviews.
Run stakeholder interviews
A stakeholder is anyone who has a stake in your research, and more specifically the output. Working with stakeholders is especially important for anyone carrying out user research as you need to know both what they already know about a particular problem and what they need to find out. Understandably, strong communication throughout the research process is key.
While the way in which you communicate with stakeholders during a project may vary, interviews are the best way to identify what they know and need to know at the beginning. As with user interviews, it’s hard to beat sitting down face to face with someone to discuss their needs and problems. Digital.gov has an excellent article on the why of stakeholder interviews, as well as how to actually go about the process of setting them up. You can find that article here.
We’re not done with our stakeholders just yet, either. They’ll play an integral role in the entire user research workflow as we move through the various stages of our project.
Identify your known data
With our stakeholder interviews wrapped up, it’s time to turn our attention to another critical part of the early-stage user research process; identifying our known data. It’s certainly not always easy (and one of the reasons why a good research repository is so key), but the work is important.
Why? Well, in addition to helping you avoid duplicate research work, taking the time to assess all of the existing data related to your research problem may help you to identify further avenues of research.
So what does this stage of the research workflow look like? It depends on your organization. For those with an established research function, it may be as easy as accessing the company Airtable or Google Drive and pulling up any existing findings. For those without such an operation, things may be a little trickier. Research will have almost certainly been carried out at some point or another, but your mileage may vary when it comes to actually locating it.
Here are just a few of the functions within an organization where you’re likely to find existing data:
Product teams: Any product-focused organization is likely to have at least some insight into customer data. And while it may not be in the form of a tidy written report or a collated spreadsheet, product teams should be able to deliver data in the form of how users are actually using a product.
Marketing teams: A potential treasure-trove of user data lies with marketing teams. These are the people within an organization that base much of their work on user behavior, and so are likely to have information like personas on hand.
Sales team: In much the same way, sales teams will also likely have user data sitting around.
Wherever you end up locating existing research data, taking the time to collate it will certainly serve you well as you begin your own research project.
Develop an approach
Your approach is the mechanism by which you’ll gather more information about your research problem. In simple terms, the research questions and the methodologies you’ll use to answer them.
Research questions are essentially your research objectives. The ‘why’ of your research project. These should be informed by the existing data you’ve uncovered as well as discussions with your stakeholders. As for what research questions should look like, here are some examples:
“How do people currently use the cart feature on our mobile app?”
“How do our existing users go about tracking their purchases?”
“How do potential customers of ours decide between us and one of our competitors?”
When formulating your research questions, keep in mind that these are not the same questions you should be asking your users. Basically, they should be broad enough that you can use them to then generate tasks or questions for your users, the outputs of which should hopefully shed a little more light on the problem you’re working on.
As for the methods you’ll use to actually attempt to answer these questions, we’ll get to those further down.
Put together a plan or brief
Putting together a detailed research plan is really a process that overlaps many of the steps we’ve outlined above. You’ll want to feed in things like who your stakeholders are, research methodologies, any budget estimates and the participants or participant groups you’re likely to bring on board.
For these reasons, a research plan is something that you should develop throughout the early stages of your research project and then refer back to throughout to ensure you’re still focusing on what you set out to answer. It’s fine to pivot a project if the problem leads you in a more useful direction, but always compare refer to your plan and stakeholders when doing so. Scope creep and rabbit holes are all too common in the field of user research.
Most of what we’ve talked about above will end up constituting your research plan, but a formal document is still an extremely useful tool to have. Don’t fall into the trap of simply dumping everything into a folder on your computer. Such an approach may be fine for you during the project (and possibly even when you need to come back in the future), but it’ll be a nightmare for anyone else needing to pick up where you left off.
Collect the data
Now we come to the data gathering stage of the research process, requiring the use of various research methods to answer our questions. As we covered in our Intro to UX research guide, there’s really no shortage of user research methods available. From card sorting to usability testing, each method – when used correctly – can be a powerful way to get the answers you need.
The methods you end up using should be informed by your research questions. While some questions are best answered using qualitative methods (like user interviews or usability tests), others are better suited to quantitative testing methods. Alternatively, you could even use a combination by mixing methods.
Determining which method to use requires careful consideration of your research question. If we take a look at the question: “How do our existing users go about tracking their purchases?”, we’d want to look at how they navigate through the website, meaning tree testing would be a suitable option. Alternatively, the question: “How do potential customers of ours decide between us and one of our competitors?”, would be better suited to a qualitative research method like a user interview where we can sit down with a user and ask them questions directly.
Of course, to even execute any of these research methodologies, you’re going to need participants.
Source your participants
You’ve got a research plan, key stakeholders, the questions you need to answer and an understanding of the methods you’d like to use to answer those questions. Now, it’s time to turn our attention to participant recruitment.
There’s a common misconception that finding participants is one of the hardest parts of the user research process, being time consuming, costly and annoying – but this isn’t actually the case. With just a little digging, you’ll likely be able to uncover a pool of people without ever leaving your desk.
Here are just a few of the potential participant sources that researchers, designers and marketers use on a regular basis. This list is by no means exhaustive, but should serve as a good starting point. You’ll also want to consider payment. Your participants are giving up some of their time to help you, so think about a small monetary reward or even a discount for your products or services. The amount and how you broach this depends on the channel.
Product teams: Even if your organization doesn’t employ any researchers, chances are your product teams will be a good link to your users. Reach out to product managers, designers and developers to see whether they have any regular contact with users. You may find they work with users directly on a regular basis.
Sales, customer support and marketing teams: Similarly, sales and marketing teams also serve as a solid link to your users. Marketing and customer support teams will often manage lists of your existing users, whereas sales teams will have a good understanding of active or engaged users as well as prospective users.
Social channels: This one is quite simple. Consider recruiting directly through your social channels.
Recruitment services: There are a number of dedicated participant recruitment services available (you can check out our one here) that essentially handle the entire recruitment process for you. All you need to do is specify the type of people you need and they’ll handle the rest.
Intercepts: Running a live pop-up message on your website is another great way to recruit participants. If you’re using a messaging app like Intercom, you can easily set up a participant recruitment message to pop up on the screens of people that match the criteria you set.
Meetups: Heading to a local meetup group of the people you’re interested in testing can provide you with a good source of participants. This approach is quite useful if you’re looking for people outside of your organization’s users.
Understand the data
We’ve now recruited our participants, chosen our testing methods and run the tests. With the results starting to roll in, it’s time to analyze the data and make sense of it all. No small task. The insights you draw out of your data will obviously depend on the user research methods you’ve used, with methods like card sorting and tree testing giving you more quantitative data to analyze, and usability tests and user interviews providing you with qualitative insights. In any case, the key thing to focus on with this part of the UX research workflow is drawing out useful insights that help you to address your research questions and how you’re going to present this information back to your stakeholders.
Connect to stakeholders
We’re now at the penultimate step in the research process; taking what we’ve learned and communicating it back to our stakeholders. Consider the following before you sit down in a room with them.
Aim to have detailed answers to your research questions as well as actionable next steps for your stakeholders. You’ve just put in significant time running the research process and as such are best suited to actually making suggestions based on the outputs of that research. It’s also important to understand not only your stakeholders, but the groups likely to be making use of the research further down the track. The easier you can make the process for them (of utilizing your research), the more value they’ll see in the process. Consider using tools that utilize visualizations as one way of making it easy for people to make sense of your research.
Lastly, it’s often a good idea to actually sit down with your stakeholders in a room again instead of simply sending your research results over in an email. Being able to sit down with your stakeholders one-on-one and explain your findings and recommendations will put you in good stead for future research projects.
Store learnings
Let’s recap on what we’ve covered. We’ve gone through:
The stakeholder interview process
How to uncover any data that already exists within the organization
Putting together an approach, as well as a plan or brief
The data collection phase
Participant recruitment
Data analysis
Connecting your results back to your stakeholders.
There’s a final step that can be easy to overlook, but it’s a critical one in order to ensure that your research (and the insights you’ve managed to uncover) remain accessible. One of the most common failings of the user research process is storing the data in a sustainable way. All too often, the people conducting the studies run their tests, pull out the information they need, and then simply leave the data in the tool they used to run the research or in nested folders on the organization’s server.
The solution is quite simple in theory, although a little harder in practice – especially when you’re working within a larger team. We’ve talked about building research repositories in this article (point 4), but the key takeaway is that while you should certainly use the right tool to store your findings, you also need to ensure you create a sustainable process. There’s no sense going to the trouble of setting up a new tool if you don’t have a system in place for others to feed in their own research or access historical research in the future.
You don’t need much to create a research repository – you’ll often find many researchers are able to put together one using a tool like Airtable or Excel. Whatever you end up using, just make sure it’s easy to update and access.
Wrap up + summary
Hopefully, by breaking down each stage of the research workflow into actionable steps, we’ve shown that it’s actually quite a simple undertaking – albeit one with quite a few steps. Let us know if you’ve got any questions or thoughts of your own.
What’s better than a UX team doing awesome research? A whole organization backing investment in UX research. What’s that look like in practice? Collaboration and support from stakeholders across the organization throughout the research process from set up, doing studies, sharing insights, and digesting, understanding, and actioning recommendations based on the amazing insights you generate.
UX research should be something that is known, understood, and expected across your organization. Rather than keeping all the insight goodies to yourselves, why not democratize user research by making it accessible and shareable to all stakeholders to drive understanding of its value wherever they sit in the organization?
We go into this in more detail in our ebook UX Research for Teams. By including the stakeholders throughout the process, the role of research becomes a lot more visible throughout the organization. Having the best online tools to make the whole process simple and straightforward is a great place to start.
1. Who owns the research?
Recognition that the user research undertaken in your organization benefits the whole organization is essential for setting up key resources. By ensuring that everyone is operating from the same set of tools, the insights and results are easier to manage, find and file. It also means if someone leaves, they don’t leave with all the insights and knowledge.
2. Everyone’s a researcher
Everyone within the organization should have the opportunity to be involved with UX research and should be encouraged to have a base understanding of the process (and even try out the tools) or, at the very least, have some understanding of the results and insights. If everyone has access to the tools, they can use these no matter where they sit in the organization.
3. Don’t get distracted by shiny things
Maintaining a single source of research, with a well-organized filing system means you can always look at what has gone before. It is a great place to start. The best UX researchers often revisit past studies to see where to go from here. Creating consistency through the process and output means comparing insights are simpler.
4. Research is better with friends
What’s better than one mind? It’s two or more. Working alongside a team opens new perspectives, thinking, problem-solving, and approaches. New ways to see a problem and how to interpret insights and results. By socializing your results with the key stakeholders, you bring them on the journey, explaining how and why UX research is important to the project and the wider team. Firming up the opportunity for future research.
5. Qualitative research insights that are simple to find
Qualitative research tools are designed to assist you with testing types, including user interviews, contextual inquiries, and usability tests. Working as a team with tags, sorting, and recording can be made simple and streamlined.
One of the best decisions you can make as a researcher is to bring the organization along for the ride. Setting up consistent tools across the team (and beyond) will help streamline research, making it simpler for all to be involved at each step of the process. Embedding UX research into each part of the organization.