June 6, 2024
4 min

Event Recap: Measuring the Value of UX Research at UXDX

Header graphic for the article 'Event Recap: Measuring the Value of UX Research at UXDX'

Last week Optimal Workshop was delighted to sponsor UXDX USA 2024 in New York. The User Experience event brings together Product, Design, UX, CX, and Engineering professionals and our team had an amazing time meeting with customers, industry experts, and colleagues throughout the conference. This year, we also had the privilege of sharing some of our industry expertise by running an interactive forum on “Measuring the Value of UX Research” - a topic very close to our hearts.

Our forum, hosted by Optimal Workshop CEO Alex Burke and Product Lead Ella Fielding, was focused on exploring the value of User Experience Research (UXR) from both an industry-wide perspective and within the diverse ecosystem of individual companies and teams conducting this type of research today.

The session brought together a global mix of UX professionals for a rich discussion on measuring and demonstrating the effectiveness of and the challenges facing organizations who are trying to tie UXR to tangible business value today.

The main topics for the discuss were: 

  • Metrics that Matter: How do you measure UXR's impact on sales, customer satisfaction, and design influence?
  • Challenges & Strategies: What are the roadblocks to measuring UXR impact, and how can we overcome them?
  • Beyond ROI:  UXR's value beyond just financial metrics

Some of the key takeaways from our discussions during the session were: 

  1. The current state of UX maturity and value
    • Many UX teams don’t measure the impact of UXR on core business metrics and there were more attendees who are not measuring the impact of their work than those that are measuring it. 
    • Alex & Ella discussed with the attendees the current state of UX research maturity and the ability to prove value across different organizations represented in the room. Most organizations were still early in their UX research maturity with only 5% considering themselves advanced in having research culturally embedded.
  1. Defining and proving the value of UX research
    • The industry doesn’t have clear alignment or understanding of what good measurement looks like. Many teams don’t know how to accurately measure UXR impact or don’t have the tools or platforms to measure it, which serve as core roadblocks for measuring UXRs’ impact. 
    • Alex and Ella discussed challenges in defining and proving the value of UX research, with common values being getting closer to customers, innovating faster, de-risking product decisions, and saving time and money. However, the value of research is hard to quantify compared to other product metrics like lines of code or features shipped.
  1. Measuring and advocating for UX research
    • When teams are measuring UXR today there is a strong bias for customer feedback, but little ability or understanding about how to measure impact on business metrics like revenue. 
    • The most commonly used metrics for measuring UXR are quantitative and qualitative feedback from customers as opposed to internal metrics like stakeholder involvement or tieing UXR to business performance metrics (including financial performance). 
    • Attendees felt that in organizations where research is more embedded, researchers spend significant time advocating for research and proving its value to stakeholders rather than just conducting studies. This included tactics like research repositories and pointing to past study impacts as well as ongoing battles to shape decision making processes. 
    • One of our attendees highlighted that engaging stakeholders in the process of defining key research metrics prior to running research was a key for them in proving value internally. 
  1. Relating user research to financial impact
    • Alex and Ella asked the audience if anyone had examples of demonstrating financial impact of research to justify investment in the team and we got some excellent examples from the audience proving that there are tangible ways to tie research outcomes to core business metrics including:
    • Calculating time savings for employees from internal tools as a financial impact metric. 
    • Measuring a reduction in calls to service desks as a way to quantify financial savings from research.
  1. Most attendees recognise the value in embedding UXR more deeply in all levels of their organization - but feel like they’re not succeeding at this today. 
    • Most attendees feel that UXR is not fully embedded in their orgnaization or culture, but that if it was - they would be more successful in proving its overall value.
    • Stakeholder buy-in and engagement with UXR, particularly from senior leadership varied enormously across organizations, and wasn’t regularly measured as an indicator of UXR value 
    • In organizations where research was more successfully embedded, researchers had to spend significant time and effort building relationships with internal stakeholders before and after running studies. This took time and effort away from actual research, but ended up making the research more valuable to the business in the long run. 

With the large range of UX maturity and the democratization of research across teams, we know there’s a lot of opportunity for our customers to improve their ability to tie their user research to tangible business outcomes and embed UX more deeply in all levels of their organizations. To help fill this gap, Optimal Workshop is currently running a large research project on Measuring the Value of UX which will be released in a few weeks.

Keep up to date with the latest news and events by following us on LinkedIn.

Share this article
Author
Amberlie
Denny

Related articles

View all blog articles
Header graphic for the article 'Optimal Workshop’s core values: The foundation of our success 🧱🔥'
Learn more
1 min read

Optimal Workshop's core values: The foundation of our success 🧱🔥

In the fast-paced world of tech startups and scale-ups, having a strong set of core values is crucial for sustainable growth and success. As the CEO of Optimal Workshop, a best-in-class research and insights platform, I've learned firsthand the importance of establishing and nurturing the right company culture. Today, I'd like to share our journey of revisiting and refining our values, and how these principles are shaping our path forward.

The power of values in leadership 🫶

This is my third run as a CEO, following leadership roles at the digital consultancy Tigerspike and the EdTech company Education Perfect. Each time, I've faced the challenge of taking the business to a whole new level. From experience, I've learned that this transformation begins with getting all the right pieces in play for future growth.

At Optimal Workshop, we've been busy laying the groundwork for our next phase of expansion:

1. Forming a new leadership team

2. Launching a fresh brand identity

3. Developing a new strategy and product direction

4. Introducing our refined team values

These elements, particularly our values, are not just words on a wall. They underpin our future way of working and set the standard for the behaviors we expect from every team member. By doing so, we're creating a culture of high performance with solid foundations to build upon and scale globally.

Our core values: The heart of Optimal Workshop 💖

In April 2024, we embarked on a journey to revisit and refine our company values. This process was collaborative and thoughtful, involving input from team members across all levels of the organization. The result is a set of four core values that truly represent who we are and who we aspire to be:

1. Live in our customers' shoes

At Optimal Workshop, we believe that our success is intrinsically tied to the success of our customers. This value emphasizes empathy, understanding, and a customer-centric approach to everything we do. Team members who embody this value:

  • Deeply understand our products and champion user research and data-driven methodologies
  • Go above and beyond to support our customers, ensuring they derive maximum value from our products and services
  • Show a profound understanding of customer pain points and challenges, always seeking ways to enhance the customer experience
  • Prioritize customer satisfaction and strive to provide the highest level of service in all their endeavors

2. Own it

We take pride in our expertise and resilience. This value is about taking initiative, holding ourselves to high standards, and fostering an environment of trust and commitment. An "Own It" mindset means:

  • Demonstrating reliability and accountability, stepping up to challenges and delivering on promises
  • Being solution-focused, supporting others, and finding the best outcomes for all stakeholders
  • Bringing a high level of quality to daily work, advancing projects while maintaining excellent standards
  • Communicating openly and transparently, and professionally challenging the status quo when necessary

3. Game On!

In the dynamic world of tech and user research, adaptability and continuous learning are key. Our "Game On!" value encapsulates our readiness to pivot, our curiosity, and our commitment to constant improvement. Team members who exemplify this value:

  • Demonstrate the ability to change direction quickly and adapt to new circumstances
  • Actively contribute to discussions, ask insightful questions, and share information effectively
  • Continuously learn and challenge the status quo, always seeking innovative ways to improve our processes and offerings

4. In It Together

Last but certainly not least, we believe in the power of collaboration, mutual support, and compassion. This value underscores our commitment to fostering a positive, respectful work environment where everyone can thrive. "In It Together" means:

  • Creating a collaborative work environment and showing respect to all team members and individuals
  • Bringing colleagues and customers together to achieve better results and reach common goals
  • Demonstrating honesty, transparency, and integrity in team settings
  • Speaking openly but respectfully, always listening actively, and being present and ready to participate

Celebrating our values in action 🥳

To bring these values to life, we recently celebrated our inaugural Value Awards. It was inspiring to see team members being recognized for exemplifying these principles in their daily work:

These winners have set a great benchmark for all of us to follow, showing how our values translate into tangible actions and outcomes.

Looking ahead 🔭

One of the most crucial lessons I've learned as a CEO is the immense value of establishing clear core values and guidelines early in a company's journey. When these fundamental pieces are in place, scaling becomes not just easier, but significantly faster – especially when it comes to global growth. 

By setting these core values and guidelines early, we've created a strong foundation that will enable Optimal Workshop to scale more efficiently and effectively on a global level, maintaining our identity, culture, and high standards of performance, no matter how large we become or how far we expand geographically.

Here's to the journey ahead – onwards and upwards, across borders and beyond!

Alex Burke

Header graphic for the article 'Bear Liu: How visual thinking can improve communications in design...'
Learn more
1 min read

Bear Liu: How visual thinking can improve communications in design workplaces

When Bear Liu was teaching himself design, he struggled remembering concepts since English wasn’t his first language. To help, he started doodling. By drawing pictures that related to what he was learning, he found he could not only remember them better, he could understand and communicate more effectively too. Ever since, he’s used the power of drawings and pictures to relay information in ways people can use.

Bear gives examples of how visual communication can help design workplaces to relay information in a more memorable and usable way. It may only seem like a minor change, but the difference can be significant.

Bear’s background 🎤

Bear Liu is a Product Designer at Xero, an online accounting platform that’s used all over the world. He’s also a Design Mentor at Springboard and CareerFoundry, and an Apple Award-Winning podcast host at BearTalk.

His background is in science education. As a self-taught designer, Bear has helped a raft of large and small businesses with digital products over the last 16 years. His clients come from diverse backgrounds and industries across the globe. Bear's professional passions also carry over into his hobbies. Outside of work he enjoys reading, drawing, and producing videos & podcasts on tech and design.

Contact Details:

You can find Bear on LinkedIn, or listen to his podcast, BearTalk.

Unleash your visual superpower as a communication pro 🦸🏻

When it comes to addressing business challenges it is important to keep these three aspects in mind: 

  1. Understanding - break down complex problems and solutions so everyone can understand. 
  2. Memory - retaining information in your mind is difficult even with note taking.
  3. Communication- People relate to words differently, and the meaning of something can easily get lost in translation. This issue is more prevalent with remote work.

Bear Liu strongly believes that visual communication helps people understand, remember and communicate information more effectively. Why?

  • It helps to focus. Pictures remove distractions and draw attention to where it’s desired.
  • It’s a token. A picture is universal - a house or a smiley face means the same thing to people that speak different languages. 
  • Most people are visual thinkers. Studies have found humans are hard-wired to process visual information faster. We are better at storing information in images, rather than numbers and letters.

But what if I can’t draw? This is a common issue Bear finds when talking to people about this. It’s not about the quality of the drawing itself, it’s about what it means. By delivering a message through a picture, it becomes understandable. Many of Bear’s drawings only ever remain in draft form. Even simple doodles can have meanings that make concepts clear.

In his design work at Xero, Bear has used drawing and sketches to great effect in a range of instances:

  • The accessibility tree was a complex, abstract system, but by drawing it (on a literal tree), and adding a few notes alongside it, the terminology became much more understandable.
  • Sketching how customers work made it easier to describe how Xero could help them. It was much more memorable than writing it out in paragraphs.
  • Wrapping the year in product design. A written summary of a year’s work is long-winded. Instead, Bear drew a tree and pinned key words, quotes and achievements to communicate the highlights.
  • UX terminology explanations can be difficult for those outside the industry to comprehend. Bear challenged himself to share 1 minute videos that accompanied simple drawings to help colleagues understand them, and had rave reviews.
  • Sketching notes is a great alternative to writing notes at conferences or meetings. Presenters can draw to help audiences follow along, and people in the audience themselves can also sketch their own notes.

Why it matters  🔥

Bear has adapted visual thinking to his own product design process and has seen a noticeable improvement in communication as a result.

People are busy - their brains are packed with all sorts of information, and they’re easily distracted by other things they have on their minds. By delivering information in a way that helps them to focus on it, remember and understand it, designers can achieve their ultimate goals.

As Bear also notes, drawing is fun. It’s much more rewarding than using words, as well as much more effective.

Bear used the example of his talk at UX New Zealand 2023 as a great place to use a drawing. Rather than follow along with his message by scribbling notes the whole way through, those in the audience could capture the biggest lessons easily in one simple drawing.

  • First, Bear drew one stick figure to represent himself as a speaker. He drew three speech bubbles, where audience members could write the most notable points he said.
  • Then he drew another stick figure, which represented the audience member listening to him. They had three thought bubbles, which people could populate with their biggest takeaways from the speech.

That one simple drawing is a template that can be used in any speech or meeting to remember the key points.

Header graphic for the article 'Ready for take-off: Best practices for creating and launching remote...'
Learn more
1 min read

Ready for take-off: Best practices for creating and launching remote user research studies

"Hi Optimal Work,I was wondering if there are some best practices you stick to when creating or sending out different UX research studies (i.e. Card sorts, Prototyye Test studies, etc)? Thank you! Mary"

Indeed I do! Over the years I’ve learned a lot about creating remote research studies and engaging participants. That experience has taught me a lot about what works, what doesn’t and what leaves me refreshing my results screen eagerly anticipating participant responses and getting absolute zip. Here are my top tips for remote research study creation and launch success!

Creating remote research studies

Use screener questions and post-study questions wisely

Screener questions are really useful for eliminating participants who may not fit the criteria you’re looking for but you can’t exactly stop them from being less than truthful in their responses. Now, I’m not saying all participants lie on the screener so they can get to the activity (and potentially claim an incentive) but I am saying it’s something you can’t control. To help manage this, I like to use the post-study questions to provide additional context and structure to the research.

Depending on the study, I might ask questions to which the answers might confirm or exclude specific participants from a specific group. For example, if I’m doing research on people who live in a specific town or area, I’ll include a location based question after the study. Any participant who says they live somewhere else is getting excluded via that handy toggle option in the results section. Post-study questions are also great for capturing additional ideas and feedback after participants complete the activity as remote research limits your capacity to get those — you’re not there with them so you can’t just ask. Post-study questions can really help bridge this gap. Use no more than five post-study questions at a time and consider not making them compulsory.

Do a practice run

No matter how careful I am, I always miss something! A typo, a card with a label in the wrong case, forgetting to update a new version of an information architecture after a change was made — stupid mistakes that we all make. By launching a practice version of your study and sharing it with your team or client, you can stop those errors dead in their tracks. It’s also a great way to get feedback from the team on your work before the real deal goes live. If you find an error, all you have to do is duplicate the study, fix the error and then launch. Just keep an eye on the naming conventions used for your studies to prevent the practice version and the final version from getting mixed up!

Sending out remote research studies

Manage expectations about how long the study will be open for

Something that has come back to bite me more than once is failing to clearly explain when the study will close. Understandably, participants can be left feeling pretty annoyed when they mentally commit to complete a study only to find it’s no longer available. There does come a point when you need to shut the study down to accurately report on quantitative data and you’re not going to be able to prevent every instance of this, but providing that information upfront will go a long way.

Provide contact details and be open to questions

You may think you’re setting yourself up to be bombarded with emails, but I’ve found that isn’t necessarily the case. I’ve noticed I get around 1-3 participants contacting me per study. Sometimes they just want to tell me they completed it and potentially provide additional information and sometimes they have a question about the project itself. I’ve also found that sometimes they have something even more interesting to share such as the contact details of someone I may benefit from connecting with — or something else entirely! You never know what surprises they have up their sleeves and it’s important to be open to it. Providing an email address or social media contact details could open up a world of possibilities.

Don’t forget to include the link!

It might seem really obvious, but I can’t tell you how many emails I received (and have been guilty of sending out) that are missing the damn link to the study. It happens! You’re so focused on getting that delivery right and it becomes really easy to miss that final yet crucial piece of information.

To avoid this irritating mishap, I always complete a checklist before hitting send:

  • Have I checked my spelling and grammar?
  • Have I replaced all the template placeholder content with the correct information?
  • Have I mentioned when the study will close?
  • Have I included contact details?
  • Have I launched my study and received confirmation that it is live?
  • Have I included the link to the study in my communications to participants?
  • Does the link work? (yep, I’ve broken it before)

General tips for both creating and sending out remote research studies

Know your audience

First and foremost, before you create or disseminate a remote research study, you need to understand who it’s going to and how they best receive this type of content. Posting it out when none of your followers are in your user group may not be the best approach. Do a quick brainstorm about the best way to reach them. For example if your users are internal staff, there might be an internal communications channel such as an all-staff newsletter, intranet or social media site that you can share the link and approach content to.

Keep it brief

And by that I’m talking about both the engagement mechanism and the study itself. I learned this one the hard way. Time is everything and no matter your intentions, no one wants to spend more time than they have to. Even more so in situations where you’re unable to provide incentives (yep, I’ve been there). As a rule, I always stick to no more than 10 questions in a remote research study and for card sorts, I’ll never include more than 60 cards. Anything more than that will see a spike in abandonment rates and of course only serve to annoy and frustrate your participants. You need to ensure that you’re balancing your need to gain insights with their time constraints.

As for the accompanying approach content, short and snappy equals happy! In the case of an email, website, other social media post, newsletter, carrier pigeon etc, keep your approach spiel to no more than a paragraph. Use an audience appropriate tone and stick to the basics such as: a high level sentence on what you’re doing, roughly how long the study will take participants to complete, details of any incentives on offer and of course don’t forget to thank them.

Set clear instructions

The default instructions in Optimal Workshop’s suite of tools are really well designed and I’ve learned to borrow from them for my approach content when sending the link out. There’s no need for wheel reinvention and it usually just needs a slight tweak to suit the specific study. This also helps provide participants with a consistent experience and minimizes confusion allowing them to focus on sharing those valuable insights!

Create a template

When you’re on to something that works — turn it into a template! Every time I create a study or send one out, I save it for future use. It still needs minor tweaks each time, but I use them to iterate my template.What are your top tips for creating and sending out remote user research studies? Comment below!

Seeing is believing

Explore our tools and see how Optimal makes gathering insights simple, powerful, and impactful.