Measuring the impact of UXR: beyond CSAT and NPS

Our exciting new feature, segments, saves time by allowing you to create and save groups of participant responses based on various filters. Think of it as your magic wand to effortlessly organize and scrutinize the wealth of data and insight you collect in your studies. Even more exciting is that the segments are available in all our quantitative study tools, including Optimal Sort, Treejack, Chalkmark, and Questions.

‍

What exactly are segments?

‍

In a nutshell, segments let you effortlessly create and save groups of participants' results based on various filters, saving you and the team time and ensuring you are all on the same page. 

A segment represents a demographic within the participants who completed your study. These segments can then be applied to your study results, allowing you to easily view and analyze the results of that specific demographic and spot the hidden trends.

‍

What filters can I use?

‍

Put simply, you've got a treasure trove of participant data, and you need to be able to slice and dice it in various ways. Segmenting your data will help you dissect and explore your results for deeper and more accurate results.

‍

Question responses: Using a screener survey or pre - or post-study questions with pre-set answers (like multi-choice), you can segment your results based on their responses.

‍

URL tag: If you identify participants using a unique identifier such as a URL tag, you can select these to create segments.

‍

Tree test tasks, card sort categories created, first click test and survey responses: Depending on your study type, you can create a segment to categorize participants based on their response in the study. 

‍

Time taken: You can select the time taken filter to view data from those who completed your study in a short space of time. This may highlight some time wasters who speed through and probably haven’t provided you with high-quality responses. On the other hand, it can provide insight into A/B tests for example, it could show you if it’s taking participants of a tree test longer to find a destination in one tree or another.

‍

With this feature, you can save and apply multiple segments to your results, using a combination of AND/OR logic when creating conditions. This means you can get super granular insights from your participants and uncover those gems that might have otherwise remained hidden.

‍

When should you use segments?

‍

This feature is your go-to when you have results from two or more participant segments. For example, imagine you're running a study involving both teachers and students. You could focus on a segment that gave a specific answer to a particular task, question, or card sort. It allows you to drill down into the nitty-gritty of your data and gain more understanding of your customers.

‍

How segments help you to unlock data magic 💫

‍

Let's explore how you can harness the power of segments:

‍

Save time: Create and save segments to ensure everyone on your team is on the same page. With segments, there's no room for costly data interpretation mishaps as everyone is singing from the same hymn book.

‍

Surface hidden trends: Identifying hidden trends or patterns within your study is much easier.  With segments,  you can zoom in on specific demographics and make insightful, data-driven decisions with confidence.

‍

Organized chaos: No more data overload! With segments, you can organize participant data into meaningful groups, unleashing clarity and efficiency.

‍

How to create a segment

‍

Ready to take segments for a spin?  To create a new segment or edit an existing one, go to  Results > Participants > Segments. Select the ‘Create segment’ button and select the filters you want to use. You can add multiple conditions, and save the segment.  To select a segment to apply to your results, click on ‘All included participants’ and select your segment from the drop-down menu.  This option will apply to all your results in your study. 

‍

We can't wait to see the exciting discoveries you'll make with this powerful tool. Get segmenting, and let us know what you think! 

‍

Help articles
‍

How to add a group tag in a study URL for participants
‍
How to integrate with a participant recruitment panel

‍

In the realm of financial services, complexity isn't just a challenge, it's the default state. From intricate investment products to multi-layered insurance policies to complex fee structures, financial services are inherently complicated. But your users don't want complexity; they want confidence, clarity, and control over their financial lives.

‍

‍

How to keep things simple with good UX research 

‍

Understanding how users perceive and navigate complexity requires systematic research. Optimal's platform offers specialized tools to identify complexity pain points and validate simplification strategies:

‍

Uncover Navigation Challenges with Tree Testing

‍

Complex financial products often create equally complex navigation structures:

‍

How can you solve this? 

‍

• Test how easily users can find key information within your financial platform
• Identify terminology and organizational structures that confuse users
• Compare different information architectures to find the most intuitive organization

‍

‍

Identify Confusion Points with First-Click Testing

‍

Understanding where users instinctively look for information reveals valuable insights about mental models:

‍

How can you solve this? 

‍

• Test where users click when trying to accomplish common financial tasks
• Compare multiple interface designs for complex financial tools
• Identify misalignments between expected and actual user behavior

‍

‍

Understand User Mental Models with Card Sorting

‍

Financial terminology and categorization often don't align with how customers think:

‍

How can you solve this? 

• Use open card sorts to understand how users naturally group financial concepts
• Test comprehension of financial terminology
• Identify intuitive labels for complex financial products

‍

‍

‍

‍

Practical Strategies for Simplifying Financial UX

‍

1. Progressive Information Disclosure

‍

Rather than bombarding users with all information at once, layer information from essential to detailed:

‍

• Start with core concepts and benefits
• Provide expandable sections for those who want deeper dives
• Use tooltips and contextual help for terminology
• Create information hierarchies that guide users from basic to advanced understanding

‍

‍

2. Visual Representation of Numerical Concepts

‍

Financial services are inherently numerical, but humans don't naturally think in numbers—we think in pictures and comparisons.

‍

What could this look like? 

‍

• Use visual scales and comparisons instead of just presenting raw numbers
• Implement interactive calculators that show real-time impact of choices
• Create visual hierarchies that guide attention to most relevant figures
• Design comparative visualizations that put numbers in context

‍

‍

3. Contextual Decision Support

‍

Users don't just need information; they need guidance relevant to their specific situation.

‍

How do you solve for this? 

‍

• Design contextual recommendations based on user data
• Provide comparison tools that highlight differences relevant to the user
• Offer scenario modeling that shows outcomes of different choices
• Implement guided decision flows for complex choices

‍

‍

4. Language Simplification and Standardization

‍

Financial jargon is perhaps the most visible form of unnecessary complexity. So, what can you do? 

‍

• Develop and enforce a simplified language style guide
• Create a financial glossary integrated contextually into the experience
• Test copy with actual users, measuring comprehension, not just preference
• Replace industry terms with everyday language when possible

‍

‍

‍

‍

Measuring Simplification Success

‍

To determine whether your simplification efforts are working, establish a continuous measurement program:

‍

1. Establish Complexity Baselines

‍

Use Optimal's tools to create baseline measurements:

‍

• Success rates for completing complex tasks
• Time required to find critical information
• Comprehension scores for key financial concepts
• User confidence ratings for financial decisions

‍

‍

2. Implement Iterative Testing

‍

Before launching major simplification initiatives, validate improvements through:

‍

• A/B testing of alternative explanations and designs
• Comparative testing of current vs. simplified interfaces
• Comprehension testing of revised terminology and content

‍

‍

3. Track Simplification Metrics Over Time

‍

Create a dashboard of key simplification indicators:

‍

• Task success rates for complex financial activities
• Support call volume related to confusion
• Feature adoption rates for previously underutilized tools
• User-reported confidence in financial decisions

‍

‍

‍

‍

Where rubber hits the road: Organizational Commitment to Clarity

‍

True simplification goes beyond interface design. It requires organizational commitment at the most foundational level:

‍

• Product development: Are we creating inherently understandable products?
• Legal and compliance: Can we satisfy requirements while maintaining clarity?
• Marketing: Are we setting appropriate expectations about complexity?
• Customer service: Are we gathering intelligence about confusion points?

‍

When there is a deep commitment from the entire organization to simplification, it becomes part of a businesses’ UX DNA. 

‍

‍

‍

‍

‍

Conclusion: The Future Belongs to the Clear

‍

As financial services become increasingly digital and self-directed, clarity bcomes essential for business success. The financial brands that will thrive in the coming decade won't necessarily be those with the most features or the lowest fees, but those that make the complex world of finance genuinely understandable to everyday users.

‍

By embracing clarity as a core design principle and supporting it with systematic user research, you're not just improving user experience, you're democratizing financial success itself.

‍

"Hi Optimal Work,I was wondering if there are some best practices you stick to when creating or sending out different UX research studies (i.e. Card sorts, Prototyye Test studies, etc)? Thank you! Mary"

‍

Indeed I do! Over the years I’ve learned a lot about creating remote research studies and engaging participants. That experience has taught me a lot about what works, what doesn’t and what leaves me refreshing my results screen eagerly anticipating participant responses and getting absolute zip. Here are my top tips for remote research study creation and launch success!

‍

‍

Creating remote research studies

‍

‍

Use screener questions and post-study questions wisely

‍

Screener questions are really useful for eliminating participants who may not fit the criteria you’re looking for but you can’t exactly stop them from being less than truthful in their responses. Now, I’m not saying all participants lie on the screener so they can get to the activity (and potentially claim an incentive) but I am saying it’s something you can’t control. To help manage this, I like to use the post-study questions to provide additional context and structure to the research.

‍

Depending on the study, I might ask questions to which the answers might confirm or exclude specific participants from a specific group. For example, if I’m doing research on people who live in a specific town or area, I’ll include a location based question after the study. Any participant who says they live somewhere else is getting excluded via that handy toggle option in the results section. Post-study questions are also great for capturing additional ideas and feedback after participants complete the activity as remote research limits your capacity to get those — you’re not there with them so you can’t just ask. Post-study questions can really help bridge this gap. Use no more than five post-study questions at a time and consider not making them compulsory.

‍

‍

Do a practice run

‍

No matter how careful I am, I always miss something! A typo, a card with a label in the wrong case, forgetting to update a new version of an information architecture after a change was made — stupid mistakes that we all make. By launching a practice version of your study and sharing it with your team or client, you can stop those errors dead in their tracks. It’s also a great way to get feedback from the team on your work before the real deal goes live. If you find an error, all you have to do is duplicate the study, fix the error and then launch. Just keep an eye on the naming conventions used for your studies to prevent the practice version and the final version from getting mixed up!

‍

Sending out remote research studies

‍

‍

Manage expectations about how long the study will be open for

‍

Something that has come back to bite me more than once is failing to clearly explain when the study will close. Understandably, participants can be left feeling pretty annoyed when they mentally commit to complete a study only to find it’s no longer available. There does come a point when you need to shut the study down to accurately report on quantitative data and you’re not going to be able to prevent every instance of this, but providing that information upfront will go a long way.

‍

‍

Provide contact details and be open to questions

‍

You may think you’re setting yourself up to be bombarded with emails, but I’ve found that isn’t necessarily the case. I’ve noticed I get around 1-3 participants contacting me per study. Sometimes they just want to tell me they completed it and potentially provide additional information and sometimes they have a question about the project itself. I’ve also found that sometimes they have something even more interesting to share such as the contact details of someone I may benefit from connecting with — or something else entirely! You never know what surprises they have up their sleeves and it’s important to be open to it. Providing an email address or social media contact details could open up a world of possibilities.

‍

‍

Don’t forget to include the link!

‍

It might seem really obvious, but I can’t tell you how many emails I received (and have been guilty of sending out) that are missing the damn link to the study. It happens! You’re so focused on getting that delivery right and it becomes really easy to miss that final yet crucial piece of information.

‍

To avoid this irritating mishap, I always complete a checklist before hitting send:

‍

• Have I checked my spelling and grammar?
• Have I replaced all the template placeholder content with the correct information?
• Have I mentioned when the study will close?
• Have I included contact details?
• Have I launched my study and received confirmation that it is live?
• Have I included the link to the study in my communications to participants?
• Does the link work? (yep, I’ve broken it before)

‍

‍

‍

General tips for both creating and sending out remote research studies

‍

‍

Know your audience

‍

First and foremost, before you create or disseminate a remote research study, you need to understand who it’s going to and how they best receive this type of content. Posting it out when none of your followers are in your user group may not be the best approach. Do a quick brainstorm about the best way to reach them. For example if your users are internal staff, there might be an internal communications channel such as an all-staff newsletter, intranet or social media site that you can share the link and approach content to.

‍

‍

Keep it brief

‍

And by that I’m talking about both the engagement mechanism and the study itself. I learned this one the hard way. Time is everything and no matter your intentions, no one wants to spend more time than they have to. Even more so in situations where you’re unable to provide incentives (yep, I’ve been there). As a rule, I always stick to no more than 10 questions in a remote research study and for card sorts, I’ll never include more than 60 cards. Anything more than that will see a spike in abandonment rates and of course only serve to annoy and frustrate your participants. You need to ensure that you’re balancing your need to gain insights with their time constraints.

‍

As for the accompanying approach content, short and snappy equals happy! In the case of an email, website, other social media post, newsletter, carrier pigeon etc, keep your approach spiel to no more than a paragraph. Use an audience appropriate tone and stick to the basics such as: a high level sentence on what you’re doing, roughly how long the study will take participants to complete, details of any incentives on offer and of course don’t forget to thank them.

‍

‍

Set clear instructions

‍

The default instructions in Optimal Workshop’s suite of tools are really well designed and I’ve learned to borrow from them for my approach content when sending the link out. There’s no need for wheel reinvention and it usually just needs a slight tweak to suit the specific study. This also helps provide participants with a consistent experience and minimizes confusion allowing them to focus on sharing those valuable insights!

‍

‍

Create a template

‍

When you’re on to something that works — turn it into a template! Every time I create a study or send one out, I save it for future use. It still needs minor tweaks each time, but I use them to iterate my template.What are your top tips for creating and sending out remote user research studies? Comment below!