June 6, 2024
4 min

Event Recap: Measuring the Value of UX Research at UXDX

Amberlie Denny
Chief Marketing Officer

Last week Optimal Workshop was delighted to sponsor UXDX USA 2024 in New York. The User Experience event brings together Product, Design, UX, CX, and Engineering professionals and our team had an amazing time meeting with customers, industry experts, and colleagues throughout the conference. This year, we also had the privilege of sharing some of our industry expertise by running an interactive forum on “Measuring the Value of UX Research” - a topic very close to our hearts.

Our forum, hosted by Optimal Workshop CEO Alex Burke and Product Lead Ella Fielding, was focused on exploring the value of User Experience Research (UXR) from both an industry-wide perspective and within the diverse ecosystem of individual companies and teams conducting this type of research today.

The session brought together a global mix of UX professionals for a rich discussion on measuring and demonstrating the effectiveness of and the challenges facing organizations who are trying to tie UXR to tangible business value today.

The main topics for the discuss were: 

  • Metrics that Matter: How do you measure UXR's impact on sales, customer satisfaction, and design influence?
  • Challenges & Strategies: What are the roadblocks to measuring UXR impact, and how can we overcome them?
  • Beyond ROI:  UXR's value beyond just financial metrics

Some of the key takeaways from our discussions during the session were: 

  1. The current state of UX maturity and value
    • Many UX teams don’t measure the impact of UXR on core business metrics and there were more attendees who are not measuring the impact of their work than those that are measuring it. 
    • Alex & Ella discussed with the attendees the current state of UX research maturity and the ability to prove value across different organizations represented in the room. Most organizations were still early in their UX research maturity with only 5% considering themselves advanced in having research culturally embedded.
  1. Defining and proving the value of UX research
    • The industry doesn’t have clear alignment or understanding of what good measurement looks like. Many teams don’t know how to accurately measure UXR impact or don’t have the tools or platforms to measure it, which serve as core roadblocks for measuring UXRs’ impact. 
    • Alex and Ella discussed challenges in defining and proving the value of UX research, with common values being getting closer to customers, innovating faster, de-risking product decisions, and saving time and money. However, the value of research is hard to quantify compared to other product metrics like lines of code or features shipped.
  1. Measuring and advocating for UX research
    • When teams are measuring UXR today there is a strong bias for customer feedback, but little ability or understanding about how to measure impact on business metrics like revenue. 
    • The most commonly used metrics for measuring UXR are quantitative and qualitative feedback from customers as opposed to internal metrics like stakeholder involvement or tieing UXR to business performance metrics (including financial performance). 
    • Attendees felt that in organizations where research is more embedded, researchers spend significant time advocating for research and proving its value to stakeholders rather than just conducting studies. This included tactics like research repositories and pointing to past study impacts as well as ongoing battles to shape decision making processes. 
    • One of our attendees highlighted that engaging stakeholders in the process of defining key research metrics prior to running research was a key for them in proving value internally. 
  1. Relating user research to financial impact
    • Alex and Ella asked the audience if anyone had examples of demonstrating financial impact of research to justify investment in the team and we got some excellent examples from the audience proving that there are tangible ways to tie research outcomes to core business metrics including:
    • Calculating time savings for employees from internal tools as a financial impact metric. 
    • Measuring a reduction in calls to service desks as a way to quantify financial savings from research.
  1. Most attendees recognise the value in embedding UXR more deeply in all levels of their organization - but feel like they’re not succeeding at this today. 
    • Most attendees feel that UXR is not fully embedded in their orgnaization or culture, but that if it was - they would be more successful in proving its overall value.
    • Stakeholder buy-in and engagement with UXR, particularly from senior leadership varied enormously across organizations, and wasn’t regularly measured as an indicator of UXR value 
    • In organizations where research was more successfully embedded, researchers had to spend significant time and effort building relationships with internal stakeholders before and after running studies. This took time and effort away from actual research, but ended up making the research more valuable to the business in the long run. 

With the large range of UX maturity and the democratization of research across teams, we know there’s a lot of opportunity for our customers to improve their ability to tie their user research to tangible business outcomes and embed UX more deeply in all levels of their organizations. To help fill this gap, Optimal Workshop is currently running a large research project on Measuring the Value of UX which will be released in a few weeks.

Keep up to date with the latest news and events by following us on LinkedIn.

Publishing date
June 6, 2024
Share this article

Related articles

min read
Invested in UX: the story behind Optimal Workshop's NZ$10m investment

It’s going to be a big year for Optimal Workshop, with the recent announcement of a NZ$10m investment by New Zealand private equity firm, Pioneer Capital.  We caught up with Andrew Mayfield, Optimal Workshop’s CEO, to find out the story behind the investment, why now, and what it means for the future.

The Tech start-up route isn’t for everyone but you’ve been part of Optimal Workshop’s success story from early on when it was ‘just 4 people in a windowless room’! What appealed to you back then?

“I worked on the initial prototype for Optimal Workshop with our founder, Sam Ng, in 2007 and eventually joined the team myself to take over from Sam two years later. When I was handed the reins the brief was simple: create ‘kick-ass tools that make life easier.

With this focus on tools to make life easier, life online especially, we settled on a suite focussed on user experience research. It’s turned out to be a field that’s grown an average of 40% year on year so there’s no reason to leave that field. In fact, I’d say Optimal Workshop has been a strong part of enabling the UX field, and user research especially, to grow as it has.”

So, that early focus on user experience was a good call, ahead of the curve even?

“It was timely I guess.  People were just starting to appreciate user experience as a key differentiator.  I’ve always thought of it as a necessary shift in the way people think about design. That you’d consider your users and you might follow specific methodologies so you can do that consistently and inclusively. Ideally, much of what we call user experience would eventually be considered a natural part of any good design process. It’s just good practice as a designer to consider the real, diverse, and evolving needs and context of the people who actually use what you make.” 

When you put it that way it feels pretty compelling, even common sense. Fast forward 14 years, what’s the attitude towards UX now?  

“What’s interesting now is there are so many people practicing user experience.  When we started there was no UX-specific education, no university courses.  Everybody in the field had come from some other field and they were all bringing their influences from somewhere else and I found that very interesting. 

Every person I spoke to provided a different lens. It seemed to me that everyone had entered the field, even if it meant dropping some other illustrious career, because they cared about trying to make things, digital things primarily, substantially better than what was available at the time. And by and large they did this by listening to real people doing real things, in real contexts..  Simple, but almost unheard of at the time.

The field of UX has matured a lot over time but there’s still a long, long way to go. If anything, good information is getting harder to find so we still have a lot more work to do."

Andrew Mayfield, CEO at Optimal Workshop

Clearly, you have big plans for the future. You’ve just announced pretty exciting news - getting an investor, Pioneer Capital, on board.  Why now?

“We are in a big market and from the start our users have almost pulled the product out of us. It has never felt like we've needed to push anything uphill. We've grown organically to a point where we now feel comfortable that we have all the foundations in place for a truly great company. The team is hungry to have a greater impact and to grow fast — so it’s time to put some more fuel in the tank and get on with it.

Pioneer Capital is a great fit for us as they want to help us build a great company that’s fit to endure, and they’d already had us on their radar for some time.”

Sounds like good timing all-around.  What kind of growth are you hoping to achieve with Pioneer Capital’s support?

“There’s been a real elegance in growing organically because you only do what is necessary and what customers absolutely appreciate. We've been growing our team at the speed of revenue growth. This means we've only really been able to hire for roles when we really need them. Now with funding, we can look ahead and hire for what we expect to need tomorrow, instead of what we needed yesterday."

Exciting times.  What’s the key to keeping Optimal Workshop ahead of the game?

“Keeping our customers at heart. Many companies say it, and it’s addictive once you start doing it. Once you start listening to people and give them what they need - which isn’t necessarily what they asked for - it’s very gratifying. That's what we’re going to continue doing."

You can find out more about the NZ$10 million investment by New Zealand private equity firm, Pioneer Capital in our media release.

min read
Product Roadmap Update 2024 🛣️ 🎉

We’re excited to announce the latest updates to our platform to help teams test, validate and gain insights early in the design process. Looking ahead to the rest of 2024, stay tuned as we expand Optimal’s research capabilities with new tools and features, including Prototype Testing, Qualitative Insights, and upgraded Surveys along with enhanced admin management and user roles!

What’s new at Optimal? 🤩

Advanced Recruitment 🙋🙋🏾


We’re thrilled to share the launch of our new Advanced Recruitment offering with high quality and expanded profiling capabilities for hard-to-reach audiences. Advanced Recruitment leverages our in-house recruitment team and a new powerful, award-winning panel — PureSpectrum — to give you access to millions of participants across 100+ countries. Optimal handles recruitment logistics from start to finish, guaranteeing quality responses and replacing low-quality participants at no extra cost.

Early access is now available. To get started, submit your criteria via the request form. Starting in early August, you’ll be able to access Advanced Recruitment via the Optimal Recruit tab. Recruitment is available for all Optimal tools except for Qualitative Insights (Reframer).

What’s coming next? 🔮🧙

Test your designs early and often with our latest tool:  Prototype Testing ⚙️

The newest edition to the Optimal toolkit is just around the corner.  Prototype testing will allow you to quickly  test designs with users throughout the design process, to help inform decisions so you can build on with confidence.


You’ll have the option to easily import low or high-fidelity prototypes directly from Figma or build your own prototypes from scratch  by uploading images or screenshots and creating clickable areas. Prototype testing allows you to Identify usability issues and areas for improvement throughout the design process to iterate and improve your designs quickly with your users.

Video Recording 🎬📽️🎞️

Soon after we launch Prototype testing, we’ll be adding Video Recording to allow you to record a participant completing a prototype test. You can capture nonverbal cues like eye rolls and frustration, screens and voices to better understand user experiences, and gain deeper insights for Prototype Testing. Video recording is browser-based, with no plug in required eliminating setup complexities. Consent to record is captured upfront in the testing process and can be tailored to meet your organization’s policies.

Qualitative Insights & AI 🤖✨

You’ll be able to capture meaningful insights faster and more efficiently with the new Insights feature under our Qualitative Insights (Reframer) tool. Create Insights — takeaways or key findings from a study — and keep them organized under the new Insights tab. Create a new Insight from observations or use AI to generate Insights. Each Insight will contain a title, description, and associated observations.

Note that you and your organization will always maintain complete control over any AI engagement. All AI-generated results are editable. Leverage AI as needed for your studies or decide to turn off access completely for your organization.

Admin Management and User Roles 👨🏻💻

For Enterprise customers, we’ll be introducing enhanced admin management capabilities. Create and manage multiple workspaces tailored to your team’s needs, with improved reporting and user role flexibility. The new admin role ensures robust control without consuming additional licenses.

Surveys Upgrade 📋

We’ll be transforming surveys with enhanced usability, advanced survey logic, and AI integration, empowering you to create, launch, and analyze surveys with ease. Our focus on improving usability will make creating, editing, and launching surveys easier than ever, including new question types, question cloning, question grouping, and AI assistance to streamline survey creation.

Help us build a better Optimal Workshop 🧰

We’re looking for customers to join our research and beta panel to help influence product development. From time to time, you’ll be invited to join us for interviews or surveys, and you’ll be rewarded for your time with a thank-you gift.  


If you’d like to join the team, email product@optimalworkshop.com.

min read
The Ultimate UX Research Repository: Empowering Your Entire Product Team with Specialized Tools

User research is vital to the product development process as it helps product teams understand their users' needs, behaviors, preferences, and pain points. By gathering insights from various research methods, such as user interviews, surveys, usability testing, and analytics data, product teams can make informed decisions based on evidence, rather than assumptions or personal opinions.

A UX research repository is a centralized database that stores all user research conducted by a product team, making it easily accessible and shareable across the entire team. There are many benefits to having a UX research repository, such as saving time and resources, enabling data-driven decision-making, and keeping everyone on the product team informed about user needs and preferences.

Specialized tools, like the Treejack tool, can make UX research easier, quicker, and more collaborative. In this article, we’ll discuss a bunch of tools and how they can (and should!) contribute to a centralized UX research repository.

Why a UX Research Repository is Necessary for Product Teams

A centralized UX research repository is a valuable asset for product teams to store and access research data related to user experience. It enables product managers and development teams to better understand their user's behavior, preferences, and expectations, which in turn enables them to make informed design and development decisions.

One of the key benefits of UX research repositories, like the Reframer tool, is that it saves time and resources. By storing user research data in one central location, teams can easily access and reuse existing research data. This saves them from having to conduct the same research repeatedly, which can be a waste of precious time and resources. Additionally, a centralized UX research repository can help teams to identify gaps in their research and prioritize areas for future research.

Another advantage of a UX research repository is that it facilitates collaboration across the entire team. With a central repository, research findings can be shared and discussed, enabling cross-functional collaboration. This promotes transparency and helps to ensure that everyone is working towards the same goals. It also helps to avoid duplication of effort, as team members can easily see what others have done, and what is still required.

Additionally, a UX research repository helps to ensure consistency in research practices. By defining research methodology, protocols, and use of prescribed specialized tools, product teams can collect data systematically and compare findings across different studies. This helps to ensure that the insights gained from user research are reliable and accurate, which in turn can be used to guide design decisions.

The Benefits of a UX Research Repository for Product Managers

A UX research repository helps product managers in several ways, including supporting informed product decisions, enhancing the user experience, and providing stakeholders with evidence-based research.

One of the significant advantages of a UX research repository is that it provides product managers with a wealth of data to make informed product decisions. Through usability testing, user interviews, and first-click testing (check out the Chalkmark tool), product managers can gain insights into how users interact with their products, what they like and dislike, and how they use them. By storing all this data in a central repository, product managers can quickly access all research data, not just their own, to inform their decisions about product development and design.

Another advantage of a UX research repository is that it helps to enhance user experience. Using video clips and other multimedia, product managers can share research findings with their team members and stakeholders, making it easier to understand user needs and preferences. This helps ensure that the product design is aligned with user needs, resulting in a better user experience.

Finally, a UX research repository provides stakeholders with evidence-based research to support product decisions. By presenting research findings to stakeholders, product managers can confidently stand behind future recommendations and iterations. This evidence-based approach helps to demonstrate that decisions are grounded in data and not just intuition or opinion.

The Role of Specialized Tools in UX Research

Specialized tools are essential for conducting high-quality UX research as they provide User Researchers with powerful data collection, analysis, and visualization features. These tools are particularly useful for conducting usability testing, user interviews, and surveys, as they help researchers to gather reliable and accurate data from users. Integrating these specialized tools into a UX research repository can help product teams to streamline their research process and facilitate collaboration within the team.

One such specialized tool is Treejack, which helps researchers to test the information architecture of a product or website. By using Treejack, researchers can review how users interact with navigation, site structure, and content, to ensure users can quickly and easily find the information they need. The results can then be stored in a UX research repository, allowing the team to access and analyze the data at any time.

Chalkmark is another tool that can enhance the quality of research by providing heatmaps and click-density grids of user interactions. These interactions can be tested on mockups and wireframes. Chalkmark helps researchers to identify where users are clicking and which areas are receiving the most attention, providing valuable insights for product design. By integrating Chalkmark into a UX research repository, product teams can store and access the data, making it easier to share insights and collaborate on product development.

Another useful tool is Reframer, which helps researchers to capture insights from user interviews and user testing sessions. Reframer enables researchers to record and transcribe interviews, tag key insights, and share findings with the team - acting as a functional research repository.

The Role of User Interviews and Usability Testing in UX Research

User interviews and usability testing are used in UX research to gather insights into user behavior, needs, and preferences. User interviews involve a one-on-one conversation between a User Researcher and a participant, where the researcher asks open-ended questions to understand the user's perspective. Usability testing, on the other hand, involves observing users as they interact with a product to identify usability issues.

Specialized tools play a crucial role in conducting user interviews and usability testing efficiently and effectively. These tools can help with data collection, organization, and analysis, making the research process more streamlined and insightful.

OptimalSort is a specialized tool that aids in conducting card sorting activities for usability testing. Card sorting involves asking users to organize concepts or items into categories to understand how they think about and categorize information. The OptimalSort tool enables researchers to conduct card sorting activities remotely and collect data on how participants group and label items. The tool also generates data visualizations and reports that can be added to the UX research repository for further analysis.

Optimal Workshop’s Reframer tool, mentioned earlier, has been designed specifically to enable researchers to capture and organize interview data in real-time. Researchers can tag and categorize interview data, making it easier to analyze and identify patterns across participants. It then stores this information in a centralized location for all research insights.  Reframer also generates reports and data visualizations, making data efficient to share and analyze across teams.

Conclusion

A UX research repository empowers entire teams to make informed product decisions, enhance user experiences, and provide stakeholders with evidence-based research. They can also support awareness and participation in UX among senior leaders, encouraging further research. 

Teams are increasingly using specialized tools like Treejack, Chalkmark, OptimalSort, and Reframer to conduct high-quality UX research as they provide powerful data collection, analysis, and visualization features. By using these tools together, product teams can streamline their research process and facilitate improved collaboration within the team. 

Are you interested in the benefits of a UX research repository? Check out how Optimal Workshop’s specialized research tools can add value to not only the quality of your data, but how your team collects, analyzes, and shares the results!

Seeing is believing

Dive into our platform, explore our tools, and discover how easy it can be to conduct effective UX research.