Knowing and understanding why and how your users use your product is invaluable for getting to the nitty gritty of usability. Delving deep with probing questions into motivation or skimming over looking for issues can equally be informative. 

‍

Put super simply, usability testing literally is testing how usable your product is for your users. If your product isn’t usable users often won’t complete their task, let alone come back for more. No one wants to lose users before they even get started. Usability testing gets under their skin and really into the how, why and what they want (and equally what they don’t).

‍

As we have been getting used to video calling regularly and using the internet for interactions, usability testing has followed suit. Being able to access participants remotely has allowed us to diversify the participant pool by not being restricted to those that are close enough to be in-person. This has also allowed an increase in the number of participants per test, as it becomes more cost-effective to perform remote usability testing.

‍

But if we’re remote, does this mean it can’t be moderated? No - remote testing, along with modern technology, can mean that remote testing can be facilitated and moderated. But what is the best method - moderated or unmoderated?

‍

What is moderated remote research testing? 🙋🏻

‍

In traditional usability testing, moderated research is done in person. With the moderator and the participant in the same physical space. This, of course, allows for conversation and observational behavioral monitoring. Meaning the moderator can note not only what the participant answers but how and even make note of the body language, surroundings, and other influencing factors. 

‍

This has also meant that traditionally, the participant pool has been limited to those that can be available (and close enough) to make it into a facility for testing. And being in person has meant it takes time (and money) to perform these tests.

‍

As technology has moved along and the speed of internet connections and video calling has increased, this has opened up a world of opportunities for usability testing. Allowing usability testing to be done remotely. Moderators can now set up testing remotely and ‘dial in’ to observe participants anywhere they are. And potentially even running focus groups or other testing in a group format across the internet. 

‍

Pros:

‍

- In-depth gathering of insights through a back-and-forth conversation and observing of the participants.

‍

- Follow-up questions don’t underestimate the value of being available to ask questions throughout the testing. And following up in the moment.

‍

- Observational monitoring noticing and noting the environment and how the participants are behaving, can give more insight into how or why they choose to make a decision.

‍

- Quick remote testing can be quicker to start, find participants, and complete than in-person. This is because you only need to set up a time to connect via the internet, rather than coordinating travel times, etc.

‍

- Location (local and/or international) Testing online removes reliance on participants being physically present for the testing. This broadens your ability to broaden the pool, and participants can be either within your country or global. 

‍

Cons:

‍

- Time-consuming having to be present at each test takes time. As does analyzing the data and insights generated. But remember, this is quality data.

‍

- Limited interactions with any remote testing there is only so much you can observe or understand across the window of a computer screen. It can be difficult to have a grasp on all the factors that might be influencing your participants.

‍

What is unmoderated remote research testing? 😵💫

‍

In its most simple sense, unmoderated user testing removes the ‘moderated’ part of the equation. Instead of having a facilitator guide participants through the test, participants are left to complete the testing by themselves and in their own time. For the most part, everything else stays the same. 

‍

Removing the moderator, means that there isn’t anyone to respond to queries or issues in the moment. This can either delay, influence, or even potentially force participants to not complete or maybe not be as engaged as you may like. Unmoderated research testing suits a very simple and direct type of test. With clear instructions and no room for inference. 

‍

Pros:

‍

- Speed and turnaround,  as there is no need to schedule meetings with each and every participant. Unmoderated usability testing is usually much faster to initiate and complete.

‍

- Size of study (participant numbers) unmoderated usability testing allows you to collect feedback from dozens or even hundreds of users at the same time. 

- Location (local and/or international) Testing online removes reliance on participants being physically present for the testing, which broadens your participant pool.  And unmoderated testing means that it literally can be anywhere while participants complete the test in their own time.

‍

Cons:

‍

- Follow-up questions as your participants are working on their own and in their own time, you can’t facilitate and ask questions in the moment. You may be able to ask limited follow-up questions.

‍

- Products need to be simple to use unmoderated testing does not allow for prototypes or any product or site that needs guidance. 

‍

- Low participant support without the moderator any issues with the test or the product can’t be picked up immediately and could influence the output of the test.

‍

When should you do which? 🤔

‍

Each moderated and unmoderated remote usability testing have its use and place in user research. It really depends on the question you are asking and what you are wanting to know.

‍

Moderated testing allows you to gather in-depth insights, follow up with questions, and engage the participants in the moment. The facilitator has the ability to guide participants to what they want to know, to dig deeper, or even ask why at certain points. This method doesn’t need as much careful setup as the participants aren’t on their own. While this is all done online, it does still allow connection and conversation. This method allows for more investigative research. Looking at why users might prefer one prototype to another. Or possibly tree testing a new website navigation to understand where they might get lost and querying why the participant made certain choices.

‍

Unmoderated testing, on the other hand, is literally leaving the participants to it. This method needs very careful planning and explaining upfront. The test needs to be able to be set and run without a moderator. This lends itself more to wanting to know a direct answer to a query. Such as a card sort on a website to understand how your users might sort information. Or a first click to see how/where users will click on a new website.

‍

Wrap Up 🌯

‍

With the ability to expand our pool of participants across the globe with all of the advances (and acceptance of) technology and video calling etc, the ability to expand our understanding of users’ experiences is growing. Remote usability testing is a great option when you want to gather information from users in the real world. Depending on your query, moderated or unmoderated usability testing will suit your study. As with all user testing, being prepared and planning ahead will allow you to make the most of your test.

In-person user testing is an important part of any research project, helping you to see first-hand how your users interact with your prototypes and products – but what are you supposed to do when it’s not a viable option?

The recent outbreak of coronavirus is forcing user researchers and designers to rethink traditional testing approaches, especially in-person testing. So what’s the solution? Enter unmoderated user testing. This approach circumvents the need to meet your participants face-to-face as it’s done entirely over the internet. As you can probably guess, this also means there are a few considerable benefits.

Here, we'll take a look at 5 reasons to consider this testing approach. But first, let's explore what unmoderated user testing is.

What is unmoderated user testing?

In the most basic sense, unmoderated user testing removes the ‘moderated’ part of the equation. Instead of having a facilitator guide participants through the test, participants complete the testing activity by themselves and in their own time. For the most part, everything else stays the same.

The key differences are that:

• You’re unable to ask follow-up questions
• You can’t use low-fidelity prototypes
• You can’t support participants (beyond the initial instructions you send them).

However, there are a number of upsides to unmoderated user testing, which we’ll cover below.

1. You can access participants from all over the globe

There’s a good chance that your organization’s customers don’t exist solely in your city, or even just in your country, so why limit yourself to testing local individuals? Moderated user testing requires you to either bring in people who can visit your office or for you to actually travel to another physical location and host testing sessions there.

With unmoderated user testing, you can use a variety of participant recruitment services to access large groups of participants from all over the globe. Making these services even more useful is the fact many allow you to recruit the exact participants you need. For example, drivers of Toyota hybrid vehicles who live in Calgary.

2. Unmoderated user testing is cheaper

Have a think for a moment about all of the typical costs that go along with a hosted user testing session. There’s the cost of a location if you’re traveling to another city, the remuneration for the people you’re testing and the cost of equipment (that you may not typically have access to). Sure, moderated testing can be made much more affordable if you’re hosting a session in your own office and you have all of the required gear, but that’s not the case for everyone doing research.

Unmoderated user testing really only requires you to choose the tool with which you want to run your user test (variable cost), set up your study and then send out the link to your participants.

3. It’s easier to manage

Unmoderated user testing means you can set aside the difficult task of managing participants in person, from scheduling through to finding notetakers and people to help you with the recording equipment. As we noted in the above section about cost, all you have to do is select the tool and then set up and run your study.

4. Automatic analysis

Running in-person, qualitative usability testing sessions can deliver some truly useful insights. There’s really nothing like sitting down in front of a participant and seeing how they interact with the product you’re working on, hearing their frustrations and learning about how they work. But any insights you gain from these sessions you’ll have to derive yourself. There’s no magic button that can generate useful qualitative analysis for you.

With unmoderated user testing, and especially with the right set of tools, you can run your tests and then have analysis generated automatically from your data. Take our IA tool Treejack as just one example. The functionality built into the tool means you can send out text-based versions of your website structure and then see how people make their way through the website to find what they’re looking for. At the end of your test, Treejack will present you with an array of useful, detailed visualizations like this one:

5. There’s less chance of bias

Ever heard of the observer effect? It’s a theory that basically states that the observation of a phenomenon will inevitably change that phenomenon, commonly due to the instruments used in the measurement. The observer effect and other biases often come into play during moderated research sessions specifically as a result of having a moderator in the room – typically with their own biases. Removing the moderator from the equation means you’ll get more reliable data from your study.

And the best place to get started?

Unmoderated user research requires unmoderated testing tools. With health concerns like coronavirus and influenza leading to reduced travel and in turn making in-person testing more difficult, there’s never been a better time to start using unmoderated testing tools. If you haven’t already, take our full set of 5 tools for a spin for free (no credit card required).

In many ways, Information architecture (IA) is the backbone of a digital product or service. It is a conceptual structure for information, designed in a way that allows users to navigate and interact with it in a meaningful way. This is done by organizing, structuring, and labeling content that is intuitive for users. IA considers user needs and goals, as well as the relationships between different types of content, in order to create a user-centric design.

‍

An effective IA design approach leads to better user experiences as it ensures that information is presented in a logical and intuitive way. Essentially, good IA attempts to reduce the chance of a clunky, frustrating user experience by organizing information in a way that makes sense for the target user. 

‍

In this article, we’ll discuss the history of information architecture and how user research impacts its effectiveness. We’ll also discuss the roles of conceptual and structural design in user experience. And along the way, we’ll introduce Optimal Workshop’s IA tools, and how they can help you design exceptional IA.

‍

The Beginning of Information Architecture

‍

The world is full of information and humans have always had a knack for structuring and organizing it. Take libraries, for example. In ancient Egypt, workers in the Library of Alexandria created a catalog of 120 scrolls to order and describe the inventory. They needed to - estimates of the number of scrolls the library contained range between 40,000 and 400,000! Fast-forward to 1873, and Melvil Dewey came up with the Dewey Decimal System to further categorize and universalize much larger collections of books. Why come up with these solutions? To efficiently comb through, and navigate, masses of information.

‍

As computer technology started to rise more prominently in the 1950s and 1960s, we started organizing computer programs and system designs in a way that made them easier to navigate too. In fact, IBM first mentioned the term architecture in a computational context in 1959 [ref]. When the wonderful ‘worldwide web’ was born in the 1990s, digital information began to be displayed and interacted with on a much larger scale. And, like our librarians, the world decided that online order was desperately needed. This is where the foundations of information architecture as we know it today really started to take shape.

‍

In 1998, Peter Morville and Louis Rosenfeld wrote the book ‘Information Architecture for the World Wide Web’, which became Amazon’s best internet book that year. The authors integrated the ‘librarian’ approach to IA, where the main goal is to design a system where information is labeled for easy navigation and search. This focus on user-centric, logical design has become the backbone of user experience (UX) design today, and why Optimal Workshop’s Treejack tool, among other, exist for researching and designing great IA.

‍

Organizational Structures

‍

Information architecture is like the blueprint of your digital product - it’s a conceptual structure of how content is organized and arranged to create seamless interactions. But, no matter how much experience you have, or how much you trust your instincts, you will never truly get inside your end users' minds without performing user research. They will be the ones to tell you what information is relevant to them, how to structure it, and even how to label and categorize it.

‍

There are some best practices for organizing information. Start by ordering your content from most critical to least. Think like a web page. What will immediately engage a user, and what subsequent content will keep them engaged? This exercise helps to prioritize and order content. Next, think about how your information should be grouped or categorized. Content that is grouped intuitively helps users consume and navigate information on your website or digital product. Another useful exercise is to consider how different users might access your content. Mapping user journeys (often with entirely different users in mind), challenges how you design your organizational structures in a way that meets multiple users' needs.

‍

But, while those principles can get you started, user research is where designing modern, user-centric products really begins. In terms of information architecture and organizing content, card sorting is one of the most effective ways of designing conceptual structures. Card sorting, executed by Optimal Workshop’s OptimalSort tool, for example, involves asking people to arrange things like labels, articles, and products in a way that makes sense to them. People are different, and the benefit of this technique is that you can identify how information is most commonly organized. It also highlights potential ambiguity that you may need to address early on in the design of your IA.

‍

Conceptual and Structural Design

‍

The roles of conceptual and structural design in user experience are crucial in the development of effective information architecture and user experience (UX) design. Conceptual design involves the creation of a high-level, abstract representation of the overall structure of the information architecture, which helps designers to understand the content, functionality, and overall user experience. Generally, there are limited or no restrictions as to what shape the design can take. Structural design, on the other hand, involves the development of the actual information architecture, including the organization of content, navigation systems, and interaction design.

‍

Effective conceptual and structural design can significantly improve user experience by creating a clear and consistent design language. This allows your target users to easily understand and navigate through content, leading to better engagement and satisfaction. Essentially, well-structured IA can increase the accessibility of content, making it easier for users to find the information they are looking for, regardless of their level of experience with the website or digital product.

‍

Tools such as Optimal Workshop's Chalkmark tool can help designers to test and validate their conceptual and structural design decisions by enabling them to create and analyze user interactions with information architecture. This helps designers identify areas of the structure that are confusing or difficult to navigate, which can then be streamlined to create a more intuitive user experience.

‍

The Evolution of Information Architecture

‍

As we discussed earlier, modern information architecture is no longer limited to physical implementation, like libraries, but instead extends to digital platforms and software applications. With the rise of the internet and mobile devices, IA has become a critical aspect of UX design. The focus has shifted from organizing information in a static, hierarchical manner to creating dynamic and interactive information environments that adapt to the needs of individual users.

‍

One of the key changes in IA has been the shift towards a more user-centered design approach. This involves creating IA that is tailored to the needs and preferences of specific user groups, such as individuals with disabilities or users with different levels of technical expertise. This approach requires a deep understanding of user needs and behaviors, which is achieved through research and user testing. This research is increasingly done remotely and online using a suite of tools, like those provided by Optimal Workshop.

‍

Optimal Workshop's Reframer tool, for example, allows designers to collaborate and capture user insights and translate them into design solutions. This tool helps designers to identify patterns in user behavior and preferences, enabling them to create IA that is intuitive and easy to use.

‍

As technology continues to evolve, IA is likely to become even more integral to UX design. With the emergence of new technologies such as artificial intelligence, virtual and augmented reality, designers will need to create IA that is capable of adapting to these new interfaces and provide solid structures that lead to seamless user experiences.

‍

Conclusion

‍

Information architecture is an essential aspect of user experience design that involves organizing, structuring, and labeling digital content in a way that makes it easy for users to find and understand. Great IA leads to better user experiences by presenting information in intuitive and logical designs. This is why information architecture is crucial for website design.

‍

The history of IA as we know it today dates back to the 1950s and evolved with the rise of the internet. Now, we think of modern IA design as being user-centric, which involves in-depth research to understand users' needs and goals. Optimal Workshop's IA tools, such as Treejack, OptimalSort, and Chalkmark, can help designers create exceptional IA by testing and validating conceptual and structural designs. 

‍

Well-structured information architecture can significantly improve the accessibility of content, which leads to better engagement and user satisfaction. This will become increasingly important as users interact with technology through new mediums, like virtual and augmented reality. So, remember to set solid foundations by investing in IA design when you start your next project!