June 6, 2024
4 min

Event Recap: Measuring the Value of UX Research at UXDX

Last week Optimal Workshop was delighted to sponsor UXDX USA 2024 in New York. The User Experience event brings together Product, Design, UX, CX, and Engineering professionals and our team had an amazing time meeting with customers, industry experts, and colleagues throughout the conference. This year, we also had the privilege of sharing some of our industry expertise by running an interactive forum on “Measuring the Value of UX Research” - a topic very close to our hearts.

Our forum, hosted by Optimal Workshop CEO Alex Burke and Product Lead Ella Fielding, was focused on exploring the value of User Experience Research (UXR) from both an industry-wide perspective and within the diverse ecosystem of individual companies and teams conducting this type of research today.

The session brought together a global mix of UX professionals for a rich discussion on measuring and demonstrating the effectiveness of and the challenges facing organizations who are trying to tie UXR to tangible business value today.

The main topics for the discuss were: 

  • Metrics that Matter: How do you measure UXR's impact on sales, customer satisfaction, and design influence?
  • Challenges & Strategies: What are the roadblocks to measuring UXR impact, and how can we overcome them?
  • Beyond ROI:  UXR's value beyond just financial metrics

Some of the key takeaways from our discussions during the session were: 

  1. The current state of UX maturity and value
    • Many UX teams don’t measure the impact of UXR on core business metrics and there were more attendees who are not measuring the impact of their work than those that are measuring it. 
    • Alex & Ella discussed with the attendees the current state of UX research maturity and the ability to prove value across different organizations represented in the room. Most organizations were still early in their UX research maturity with only 5% considering themselves advanced in having research culturally embedded.
  1. Defining and proving the value of UX research
    • The industry doesn’t have clear alignment or understanding of what good measurement looks like. Many teams don’t know how to accurately measure UXR impact or don’t have the tools or platforms to measure it, which serve as core roadblocks for measuring UXRs’ impact. 
    • Alex and Ella discussed challenges in defining and proving the value of UX research, with common values being getting closer to customers, innovating faster, de-risking product decisions, and saving time and money. However, the value of research is hard to quantify compared to other product metrics like lines of code or features shipped.
  1. Measuring and advocating for UX research
    • When teams are measuring UXR today there is a strong bias for customer feedback, but little ability or understanding about how to measure impact on business metrics like revenue. 
    • The most commonly used metrics for measuring UXR are quantitative and qualitative feedback from customers as opposed to internal metrics like stakeholder involvement or tieing UXR to business performance metrics (including financial performance). 
    • Attendees felt that in organizations where research is more embedded, researchers spend significant time advocating for research and proving its value to stakeholders rather than just conducting studies. This included tactics like research repositories and pointing to past study impacts as well as ongoing battles to shape decision making processes. 
    • One of our attendees highlighted that engaging stakeholders in the process of defining key research metrics prior to running research was a key for them in proving value internally. 
  1. Relating user research to financial impact
    • Alex and Ella asked the audience if anyone had examples of demonstrating financial impact of research to justify investment in the team and we got some excellent examples from the audience proving that there are tangible ways to tie research outcomes to core business metrics including:
    • Calculating time savings for employees from internal tools as a financial impact metric. 
    • Measuring a reduction in calls to service desks as a way to quantify financial savings from research.
  1. Most attendees recognise the value in embedding UXR more deeply in all levels of their organization - but feel like they’re not succeeding at this today. 
    • Most attendees feel that UXR is not fully embedded in their orgnaization or culture, but that if it was - they would be more successful in proving its overall value.
    • Stakeholder buy-in and engagement with UXR, particularly from senior leadership varied enormously across organizations, and wasn’t regularly measured as an indicator of UXR value 
    • In organizations where research was more successfully embedded, researchers had to spend significant time and effort building relationships with internal stakeholders before and after running studies. This took time and effort away from actual research, but ended up making the research more valuable to the business in the long run. 

With the large range of UX maturity and the democratization of research across teams, we know there’s a lot of opportunity for our customers to improve their ability to tie their user research to tangible business outcomes and embed UX more deeply in all levels of their organizations. To help fill this gap, Optimal Workshop is currently running a large research project on Measuring the Value of UX which will be released in a few weeks.

Keep up to date with the latest news and events by following us on LinkedIn.

Share this article
Author
Amberlie
Denny

Related articles

View all blog articles
Learn more
1 min read

Bear Liu: How visual thinking can improve communications in design workplaces

When Bear Liu was teaching himself design, he struggled remembering concepts since English wasn’t his first language. To help, he started doodling. By drawing pictures that related to what he was learning, he found he could not only remember them better, he could understand and communicate more effectively too. Ever since, he’s used the power of drawings and pictures to relay information in ways people can use.

Bear gives examples of how visual communication can help design workplaces to relay information in a more memorable and usable way. It may only seem like a minor change, but the difference can be significant.

Bear’s background 🎤

Bear Liu is a Product Designer at Xero, an online accounting platform that’s used all over the world. He’s also a Design Mentor at Springboard and CareerFoundry, and an Apple Award-Winning podcast host at BearTalk.

His background is in science education. As a self-taught designer, Bear has helped a raft of large and small businesses with digital products over the last 16 years. His clients come from diverse backgrounds and industries across the globe. Bear's professional passions also carry over into his hobbies. Outside of work he enjoys reading, drawing, and producing videos & podcasts on tech and design.

Contact Details:

You can find Bear on LinkedIn, or listen to his podcast, BearTalk.

Unleash your visual superpower as a communication pro 🦸🏻

When it comes to addressing business challenges it is important to keep these three aspects in mind: 

  1. Understanding - break down complex problems and solutions so everyone can understand. 
  2. Memory - retaining information in your mind is difficult even with note taking.
  3. Communication- People relate to words differently, and the meaning of something can easily get lost in translation. This issue is more prevalent with remote work.

Bear Liu strongly believes that visual communication helps people understand, remember and communicate information more effectively. Why?

  • It helps to focus. Pictures remove distractions and draw attention to where it’s desired.
  • It’s a token. A picture is universal - a house or a smiley face means the same thing to people that speak different languages. 
  • Most people are visual thinkers. Studies have found humans are hard-wired to process visual information faster. We are better at storing information in images, rather than numbers and letters.

But what if I can’t draw? This is a common issue Bear finds when talking to people about this. It’s not about the quality of the drawing itself, it’s about what it means. By delivering a message through a picture, it becomes understandable. Many of Bear’s drawings only ever remain in draft form. Even simple doodles can have meanings that make concepts clear.

In his design work at Xero, Bear has used drawing and sketches to great effect in a range of instances:

  • The accessibility tree was a complex, abstract system, but by drawing it (on a literal tree), and adding a few notes alongside it, the terminology became much more understandable.
  • Sketching how customers work made it easier to describe how Xero could help them. It was much more memorable than writing it out in paragraphs.
  • Wrapping the year in product design. A written summary of a year’s work is long-winded. Instead, Bear drew a tree and pinned key words, quotes and achievements to communicate the highlights.
  • UX terminology explanations can be difficult for those outside the industry to comprehend. Bear challenged himself to share 1 minute videos that accompanied simple drawings to help colleagues understand them, and had rave reviews.
  • Sketching notes is a great alternative to writing notes at conferences or meetings. Presenters can draw to help audiences follow along, and people in the audience themselves can also sketch their own notes.

Why it matters  🔥

Bear has adapted visual thinking to his own product design process and has seen a noticeable improvement in communication as a result.

People are busy - their brains are packed with all sorts of information, and they’re easily distracted by other things they have on their minds. By delivering information in a way that helps them to focus on it, remember and understand it, designers can achieve their ultimate goals.

As Bear also notes, drawing is fun. It’s much more rewarding than using words, as well as much more effective.

Bear used the example of his talk at UX New Zealand 2023 as a great place to use a drawing. Rather than follow along with his message by scribbling notes the whole way through, those in the audience could capture the biggest lessons easily in one simple drawing.

  • First, Bear drew one stick figure to represent himself as a speaker. He drew three speech bubbles, where audience members could write the most notable points he said.
  • Then he drew another stick figure, which represented the audience member listening to him. They had three thought bubbles, which people could populate with their biggest takeaways from the speech.

That one simple drawing is a template that can be used in any speech or meeting to remember the key points.

Learn more
1 min read

Workspaces delivers new privacy controls and improved collaboration

Improved organization, privacy controls, and more with new Workspaces 🚀

One of our key priorities in 2024 is making Optimal Workshop easier for large organizations to manage teams and collaborate more effectively on delivering optimal digital experiences. Workspaces is going live this week, which replaces teams, and introduces projects and folders for improved organization and privacy controls. Our latest release lays the foundations to provide more control over managing users, licenses, and user roles in the app in the near future.

More control with project privacy 🔒

Private projects allow greater flexibility on who can see what in your workspace, with the ability to make projects public or private and manage who can access a project. Find out more about how to set up private projects in this help article.

What changes for Enterprise customers? 😅

  • The teams you have set up today will remain the same; they are renamed workspaces.
  • Studies will be moved to a 'Default project' within the new workspace, from here you can decide how you would like to organize your studies and access to them.

  • You can create new projects, move studies into them, and use the new privacy features to control who has access to studies or leave them as public access.

  • Optimal Workshop are here to help if you would like to review your account structure and make changes, please reach out to your Customer Success Manager.

Watch the video 🎞️

What changes for Professional and Team customers? 😨

Customers on either a Professional or Team plan will notice the studies tab will now be called Workspace. We have introduced another layer of organization called projects, and there is a new-look sidebar on the left to create projects, folders, and studies.

What's next for Workspaces? 🔮

This new release is an essential step towards improving how we manage users, licenses, and different role types in Optimal Workshop. We hope to deliver more updates, such as the ability to move studies between workspaces, in the near future. If you have any feedback or ideas you want to share on workspaces or Optimal Workshop, please email product@optimalworkshop.com; we'd love to hear from you.

Learn more
1 min read

Product Roadmap Update

At Optimal Workshop, we're dedicated to building the best user research platform to empower you with the tools to better understand your customers and create intuitive digital experiences. We're thrilled to announce some game-changing updates and new products that are on the horizon to help elevate the way you gather insights and keep customers at the heart of everything you do. 

What’s new…

Integration with Figma 🚀

Last month, we joined forces with design powerhouse Figma to launch our integration. You can import images from Figma into Chalkmark (our click-testing tool) in just a few clicks, streamlining your workflows and getting insights to make decisions based on data not hunches and opinions.  

What’s coming next…

Session Replays 🧑‍💻

With session replay you can focus on other tasks while Optimal Workshop automatically captures card sort sessions for you to watch in your own time.  Gain valuable insights into how participants engage and interpret a card sort without the hassle of running moderated sessions. The first iteration of session replays captures the study interactions, and will not include audio or face recording, but this is something we are exploring for future iterations. Session replays will be available in tree testing and click-testing later in 2024.  

Reframer Transcripts 🔍

Say goodbye to juggling note-taking and hello to more efficient ways of working with Transcripts! We're continuing to add more capability to Reframer, our qualitative research tool, to now include the importing of interview transcripts. Save time, reduce human errors and oversights by importing transcripts, tagging and analyzing observations all within Reframer. We’re committed to build on transcripts with video and audio transcription capability in the future,  we’ll keep you in the loop and when to expect those releases. 

Prototype testing 🧪

The team is fizzing to be working on a new Prototype testing product designed to expand your research methods and help test prototypes easily from the Optimal Workshop platform. Testing prototypes early and often is an important step in the design process, saving you time and money before you invest too heavily in the build. We are working with customers and on delivering the first iteration of this exciting new product. Stay tuned for Prototypes coming in the second quarter of 2024.   

Workspaces 🎉

Making Optimal Workshop easier for large organizations to manage teams and collaborate more effectively on projects is a big focus for 2024. Workspaces are the first step towards empowering organizations to better manage multiple teams with projects. Projects will allow greater flexibility on who can see what, encouraging working in the open and collaboration alongside the ability to make projects private. The privacy feature is available on Enterprise plans.

Questions upgrade❓

Our survey product Questions is in for a glow up in 2024 💅. The team are enjoying working with customers, collecting and reviewing feedback on how to improve Questions and will be sharing more on this in the coming months. 

Help us build a better Optimal Workshop

We are looking for new customers to join our research panel to help influence product development. From time to time, you’ll be invited to join us for interviews or surveys, and you’ll be rewarded for your time with a thank-you gift.  If you’d like to join the team, email product@optimalworkshop.com

Seeing is believing

Explore our tools and see how Optimal makes gathering insights simple, powerful, and impactful.