June 6, 2024
4 min

Event Recap: Measuring the Value of UX Research at UXDX

Header graphic for the article 'Event Recap: Measuring the Value of UX Research at UXDX'

Last week Optimal Workshop was delighted to sponsor UXDX USA 2024 in New York. The User Experience event brings together Product, Design, UX, CX, and Engineering professionals and our team had an amazing time meeting with customers, industry experts, and colleagues throughout the conference. This year, we also had the privilege of sharing some of our industry expertise by running an interactive forum on “Measuring the Value of UX Research” - a topic very close to our hearts.

Our forum, hosted by Optimal Workshop CEO Alex Burke and Product Lead Ella Fielding, was focused on exploring the value of User Experience Research (UXR) from both an industry-wide perspective and within the diverse ecosystem of individual companies and teams conducting this type of research today.

The session brought together a global mix of UX professionals for a rich discussion on measuring and demonstrating the effectiveness of and the challenges facing organizations who are trying to tie UXR to tangible business value today.

The main topics for the discuss were: 

  • Metrics that Matter: How do you measure UXR's impact on sales, customer satisfaction, and design influence?
  • Challenges & Strategies: What are the roadblocks to measuring UXR impact, and how can we overcome them?
  • Beyond ROI:  UXR's value beyond just financial metrics

Some of the key takeaways from our discussions during the session were: 

  1. The current state of UX maturity and value
    • Many UX teams don’t measure the impact of UXR on core business metrics and there were more attendees who are not measuring the impact of their work than those that are measuring it. 
    • Alex & Ella discussed with the attendees the current state of UX research maturity and the ability to prove value across different organizations represented in the room. Most organizations were still early in their UX research maturity with only 5% considering themselves advanced in having research culturally embedded.
  1. Defining and proving the value of UX research
    • The industry doesn’t have clear alignment or understanding of what good measurement looks like. Many teams don’t know how to accurately measure UXR impact or don’t have the tools or platforms to measure it, which serve as core roadblocks for measuring UXRs’ impact. 
    • Alex and Ella discussed challenges in defining and proving the value of UX research, with common values being getting closer to customers, innovating faster, de-risking product decisions, and saving time and money. However, the value of research is hard to quantify compared to other product metrics like lines of code or features shipped.
  1. Measuring and advocating for UX research
    • When teams are measuring UXR today there is a strong bias for customer feedback, but little ability or understanding about how to measure impact on business metrics like revenue. 
    • The most commonly used metrics for measuring UXR are quantitative and qualitative feedback from customers as opposed to internal metrics like stakeholder involvement or tieing UXR to business performance metrics (including financial performance). 
    • Attendees felt that in organizations where research is more embedded, researchers spend significant time advocating for research and proving its value to stakeholders rather than just conducting studies. This included tactics like research repositories and pointing to past study impacts as well as ongoing battles to shape decision making processes. 
    • One of our attendees highlighted that engaging stakeholders in the process of defining key research metrics prior to running research was a key for them in proving value internally. 
  1. Relating user research to financial impact
    • Alex and Ella asked the audience if anyone had examples of demonstrating financial impact of research to justify investment in the team and we got some excellent examples from the audience proving that there are tangible ways to tie research outcomes to core business metrics including:
    • Calculating time savings for employees from internal tools as a financial impact metric. 
    • Measuring a reduction in calls to service desks as a way to quantify financial savings from research.
  1. Most attendees recognise the value in embedding UXR more deeply in all levels of their organization - but feel like they’re not succeeding at this today. 
    • Most attendees feel that UXR is not fully embedded in their orgnaization or culture, but that if it was - they would be more successful in proving its overall value.
    • Stakeholder buy-in and engagement with UXR, particularly from senior leadership varied enormously across organizations, and wasn’t regularly measured as an indicator of UXR value 
    • In organizations where research was more successfully embedded, researchers had to spend significant time and effort building relationships with internal stakeholders before and after running studies. This took time and effort away from actual research, but ended up making the research more valuable to the business in the long run. 

With the large range of UX maturity and the democratization of research across teams, we know there’s a lot of opportunity for our customers to improve their ability to tie their user research to tangible business outcomes and embed UX more deeply in all levels of their organizations. To help fill this gap, Optimal Workshop is currently running a large research project on Measuring the Value of UX which will be released in a few weeks.

Keep up to date with the latest news and events by following us on LinkedIn.

Share this article
Author
Amberlie
Denny

Related articles

View all blog articles
The Optimal Workshop team
Learn more
1 min read

B is for belief: Optimal Workshop’s B Corp journey

There are over 5000 certified B Corporations around the world, including new recruit, New Zealand based SaaS company, Optimal Workshop.  The ‘B’ in B Corp actually stands for ‘beneficial’, to reflect the founding vision behind the movement: ‘make business a force for good’.   B Corp seeks to help companies balance purpose and profit, while also serving stakeholders by building a global community of like-minded organizations. We asked Andrew Mayfield, CEO and Julie Reddish, Head of People and Culture at Optimal Workshop about becoming a B Corp, the journey so far and why it’s so important.

Why did Optimal decide to become a B Corp?

Andrew: I’ve been interested in aligning our reporting with our purpose and values for years, so becoming a B Corp felt like a huge and natural step in this direction. Our ethos of placing people at the heart of decisions extends to the way we treat our own people, not just our customers.  So I saw B Corp as a way of enshrining this thinking into the company and making sure these aspects were considered in future decision making.  

Sounds as if being a B Corp was already in line with your thinking.  What’s it mean in terms of action?  

Julie: One of the things we’ve always cared about is ‘how do we show our real commitment to people, to the environment, to sustainability, to doing ethical good work?’ Finding out B Corp existed as this global initiative, this reputable, recognized way of measuring yourself against other companies was compelling.  It was a way for us to metrify or codify ‘the optimal way’ of doing things in a way that does good as a company and does good in the world.  

Andrew: Practically it means writing up more policies to ensure the things we do for the good of our people and the planet, which we consider normal are actually written down and therefore, in effect, protected. Our Code of Ethics and Business Conduct, Whistleblower policy, Breast feeding and support policy and Environmental sustainability policy are some that spring to mind.

Tell me about the actual journey to becoming a B Corp - what’s it been like?

Julie: Oh my gosh - it’s been a big project.  Little did we know how much work it would take to get accredited!  It requires six different categories of certification which have, like 50 or 60 questions or areas you can gain points in and you need a minimum of 80 points to get certification.  A lot of the questions weren’t really applicable to us so we really had to look closely and think, ‘what is there already that we do inside Optimal that actually equates to saying yes to that question?’ We had an awful lot of thinking to do about which questions to put our time and our money into.  

Andrew:  There were a lot of things we did that weren’t fully documented, that was the hard part. We didn’t have to change much of our actual behavior to be honest.  We have been for years looking at a people-centered approach - our three values are Approachable, Bold and Curious. We had to write things down, make sure they were where people could find them.  There wasn’t a lot we had to change to get our entrance score as such. If we want to continually improve each year then we will need to make continual changes for sure, like anyone trying to self improve.

Julie:  We thought we were quite close, then there was this massive surge of interest and eight months to even see a consultant, then another six months before the verification process even started.  

That’s when the rubber really hit the road.  We were working away on different bits of the B Corp certification like there’s one for having an office set up for breastfeeding.  Do you have a lockable door? Do you have a place that is private? Does everyone know? Is it communicated? Do you have a policy on breastfeeding? You had to look at each of those things and make sure that you could back it up with evidence.  And that might be worth 0.2 points.  

Sounds like a detailed and rigorous journey - but also quite meaningful and actionable?

Julie: We already had thoughts on what we could do to make our organization great like sourcing local produce and local suppliers but the process of becoming a B Corp really flushed it out for us.  Some of the suggestions and categories were things we were already looking at within the bigger picture of being a good employer and being a good contributor to our communities. Going through the assessment helped us identify a whole other layer of things that we could and should be doing.

Beyond measuring female representation, what else could we be doing for diversity?  What about our indigenous representation? What could we be doing for people with disabilities?  It got us into deeper thinking about what diversity actually means. It’s pretty amazing.

What does being a B Corp mean for your employees?

Julie:  As an employer it’s reaffirming a commitment to treating people well and human-centered work practices.  So the real nuts and bolts come down to individuals thinking how might I get involved with this:  If I see something I don’t feel is right I call it out.  I can also advocate for what is right.

Andrew:  More and more I think people are interested in working for companies that care for more than simply enriching their shareholders, that care about taking care of their team and of their environment and of their impact more broadly, of the change they seek to make on society, knowledge-sharing and all this sort of thing.  People are more aware of considering this on choice of where to work, where to stay and just generally where to spend their time.  We all have scarce time these days and strong choices to make and it does play into where people choose to work.

Does this extend to customers?  What impact, if any, does being a B Corp mean for them?

Andrew:  B Corp certainly takes into consideration who you choose to use as suppliers so it becomes a bit recursive in that way. If our customers value the fact we’re a B Corp then they need to be thinking about choosing suppliers who are also B Corps - so it would gradually happen over time I’d imagine. 

Julie: It’s about thoughtful practices.  Not just following trends. It’s about what works, not what’s popular. 

What’s it feel like to be part of this global community called B Corp?

Julie:  I think it's a really cool company to be in.  To share our thinking, to share policies and resources with somebody who’s traveled that road before us, with its dragons and potholes, to actually follow in someone’s footsteps, but also make it our own ‘Optimal’ way.  

Andrew: Being part of a community of B Corps supporting each other with new ways to manage these obligations we choose to put on ourselves to be better corporate citizens as such is valuable.  While there’s no desire to make it hard, sometimes it is hard to make sure you’re doing the right thing.  It requires extra research and extra conscientiousness when making decisions so sharing ideas and experiences.  Feeling like you’re not the only one who’s been there can help.

Becoming a B Corp is quite an achievement however the work doesn’t stop there does it?

Andrew: My understanding is the requirements get harder and that’s a good thing.  We can all get better.  The biggest areas for us to improve are things like sharing information in decision-making, we’re already pretty transparent but haven’t formalized that so there are things we can do there.  

The next checkpoint is in three years and we’re expected to improve plus the requirements get more onerous - so we’d better improve!

Header graphic for the article 'Best UX Research Methods for Every Phase of Product Development'
Learn more
1 min read

Best UX Research Methods for Every Phase of Product Development

What is UX research?

User experience (UX) research, or user research as it’s commonly referred to, is an important part of the product design process. Primarily, UX research involves using different research methods to gather information about how your users interact with your product. It is an essential part of developing, building and launching a product that truly meets the requirements of your users. 

UX research is essential at all stages of a products' life cycle:

  1. Planning
  2. Building
  3. Introduction
  4. Growth & Maturity

While there is no one single time to conduct UX research it is best-practice to continuously gather information throughout the lifetime of your product. The good news is many of the UX research methods do not fit just one phase either, and can (and should) be used repeatedly. After all, there are always new pieces of functionality to test and new insights to discover. We introduce you to best-practice UX research methods for each lifecycle phase of your product.

1. Product planning phase

While the planning phase it is about creating a product that fits your organization, your organization’s needs and meeting a gap in the market it’s also about meeting the needs, desires and requirements of your users. Through UX research you’ll learn which features are necessary to be aligned with your users. And of course, user research lets you test your UX design before you build, saving you time and money.

Qualitative Research Methods

Usability Testing - Observational

One of the best ways to learn about your users and how they interact with your product is to observe them in their own environment. Watch how they accomplish tasks, the order they do things, what frustrates them, and what makes the task easier and/or more enjoyable for your subject. The data can be collated to inform the usability of your product, improving intuitive design, and what resonates with users.

Competitive Analysis

Reviewing products already in the market can be a great start to the planning process. Why are your competitors’ products successful and how well do they behave for users. Learn from their successes, and even better build on where they may not be performing the best and find your niche in the market.

Quantitative Research Methods

Surveys and Questionnaires

Surveys are useful for collecting feedback or understanding attitudes. You can use the learnings from your survey of a subset of users to draw conclusions about a larger population of users.

There are two types of survey questions:

Closed questions are designed to capture quantitative information. Instead of asking users to write out answers, these questions often use multi-choice answers.

Open questions are designed to capture qualitative information such as motivations and context.  Typically, these questions require users to write out an answer in a text field.

2. Product building phase

Once you've completed your product planning research, you’re ready to begin the build phase for your product. User research studies undertaken during the build phase enable you to validate the UX team’s deliverables before investing in the technical development.

Qualitative Research Methods

Focus groups

Generally involve 5-10 participants and include demographically similar individuals. The study is set up so that members of the group can interact with one another and can be carried out in person or remotely.


Besides learning about the participants’ impressions and perceptions of your product, focus group findings also include what users believe to be a product’s most important features, problems they might encounter while using the product, as well as their experiences with other products, both good and bad.

Quantitative Research Methods

Card sorting gives insight into how users think. Tools like card sorting reveal where your users expect to find certain information or complete specific tasks. This is especially useful for products with complex or multiple navigations and contributes to the creation of an intuitive information architecture and user experience.

Tree testing gives insight into where users expect to find things and where they’re getting lost within your product. Tools like tree testing help you test your information architecture.
Card sorting and tree testing are often used together. Depending on the purpose of your research and where you are at with your product, they can provide a fully rounded view of your information architecture.

3. Product introduction phase

You’ve launched your product, wahoo! And you’re ready for your first real life, real time users. Now it’s time to optimize your product experience. To do this, you’ll need to understand how your new users actually use your product.

Qualitative Research Methods

Usability testing involves testing a product with users. Typically it involves observing users as they try to follow and complete a series of tasks. As a result you can evaluate if the design is intuitive and if there are any usability problems.

User Interviews - A user interview is designed to get a deeper understanding of a particular topic. Unlike a usability test, where you’re more likely to be focused on how people use your product, a user interview is a guided conversation aimed at better understanding your users. This means you’ll be capturing details like their background, pain points, goals and motivations.

Quantitative Research Methods

A/B Testing is a way to compare two versions of a design in order to work out which is more effective. It’s typically used to test two versions of the same webpage, for example, using a different headline, image or call to action to see which one converts more effectively. This method offers a way to validate smaller design choices where you might not have the data to make an informed decision, like the color of a button or the layout of a particular image.

Flick-click testing shows you where people click first when trying to complete a task on a website. In most cases, first-click testing is performed on a very simple wireframe of a website, but it can also be carried out on a live website using a tool like first-time clicking.

4. Growth and maturity phase

If you’ve reached the growth stage, fantastic news! You’ve built a great product that’s been embraced by your users. Next on your to-do list is growing your product by increasing your user base and then eventually reaching maturity and making a profit on your hard work.

Growing your product involves building new or advanced features to satisfy specific customer segments. As you plan and build these enhancements, go through the same research and testing process you used to create the first release. The same holds true for enhancements as well as a new product build — user research ensures you’re building the right thing in the best way for your customers.

Qualitative research methods

User interviews will focus on how your product is working or if it’s missing any features, enriching your knowledge about your product and users.

It allows you to test your current features, discover new possibilities for additional features and think about discarding  existing ones. If your customers aren’t using certain features, it might be time to stop supporting them to reduce costs and help you grow your profits during the maturity stage.

Quantitative research methods

Surveys and questionnaires can help gather information around which features will work best for your product, enhancing and improving the user experience. 

A/B testing during growth and maturity occurs within your sales and onboarding processes. Making sure you have a smooth onboarding process increases your conversion rate and reduces wasted spend — improving your bottom line.

Final Thoughts: Why Continuous UX Research Matters

UX research testing throughout the lifecycle of your product helps you continuously evolve and develop a product that responds to what really matters - your users.

Talking to, testing, and knowing your users will allow you to push your product in ways that make sense with the data to back up decisions. Go forth and create the product that meets your organizations needs by delivering the very best user experience for your users.

Header graphic for the article 'Event Recap: Measuring the Value of UX Research at UXDX'
Learn more
1 min read

Event Recap: Measuring the Value of UX Research at UXDX

Last week Optimal Workshop was delighted to sponsor UXDX USA 2024 in New York. The User Experience event brings together Product, Design, UX, CX, and Engineering professionals and our team had an amazing time meeting with customers, industry experts, and colleagues throughout the conference. This year, we also had the privilege of sharing some of our industry expertise by running an interactive forum on “Measuring the Value of UX Research” - a topic very close to our hearts.

Our forum, hosted by Optimal Workshop CEO Alex Burke and Product Lead Ella Fielding, was focused on exploring the value of User Experience Research (UXR) from both an industry-wide perspective and within the diverse ecosystem of individual companies and teams conducting this type of research today.

The session brought together a global mix of UX professionals for a rich discussion on measuring and demonstrating the effectiveness of and the challenges facing organizations who are trying to tie UXR to tangible business value today.

The main topics for the discuss were: 

  • Metrics that Matter: How do you measure UXR's impact on sales, customer satisfaction, and design influence?
  • Challenges & Strategies: What are the roadblocks to measuring UXR impact, and how can we overcome them?
  • Beyond ROI:  UXR's value beyond just financial metrics

Some of the key takeaways from our discussions during the session were: 

  1. The current state of UX maturity and value
    • Many UX teams don’t measure the impact of UXR on core business metrics and there were more attendees who are not measuring the impact of their work than those that are measuring it. 
    • Alex & Ella discussed with the attendees the current state of UX research maturity and the ability to prove value across different organizations represented in the room. Most organizations were still early in their UX research maturity with only 5% considering themselves advanced in having research culturally embedded.
  1. Defining and proving the value of UX research
    • The industry doesn’t have clear alignment or understanding of what good measurement looks like. Many teams don’t know how to accurately measure UXR impact or don’t have the tools or platforms to measure it, which serve as core roadblocks for measuring UXRs’ impact. 
    • Alex and Ella discussed challenges in defining and proving the value of UX research, with common values being getting closer to customers, innovating faster, de-risking product decisions, and saving time and money. However, the value of research is hard to quantify compared to other product metrics like lines of code or features shipped.
  1. Measuring and advocating for UX research
    • When teams are measuring UXR today there is a strong bias for customer feedback, but little ability or understanding about how to measure impact on business metrics like revenue. 
    • The most commonly used metrics for measuring UXR are quantitative and qualitative feedback from customers as opposed to internal metrics like stakeholder involvement or tieing UXR to business performance metrics (including financial performance). 
    • Attendees felt that in organizations where research is more embedded, researchers spend significant time advocating for research and proving its value to stakeholders rather than just conducting studies. This included tactics like research repositories and pointing to past study impacts as well as ongoing battles to shape decision making processes. 
    • One of our attendees highlighted that engaging stakeholders in the process of defining key research metrics prior to running research was a key for them in proving value internally. 
  1. Relating user research to financial impact
    • Alex and Ella asked the audience if anyone had examples of demonstrating financial impact of research to justify investment in the team and we got some excellent examples from the audience proving that there are tangible ways to tie research outcomes to core business metrics including:
    • Calculating time savings for employees from internal tools as a financial impact metric. 
    • Measuring a reduction in calls to service desks as a way to quantify financial savings from research.
  1. Most attendees recognise the value in embedding UXR more deeply in all levels of their organization - but feel like they’re not succeeding at this today. 
    • Most attendees feel that UXR is not fully embedded in their orgnaization or culture, but that if it was - they would be more successful in proving its overall value.
    • Stakeholder buy-in and engagement with UXR, particularly from senior leadership varied enormously across organizations, and wasn’t regularly measured as an indicator of UXR value 
    • In organizations where research was more successfully embedded, researchers had to spend significant time and effort building relationships with internal stakeholders before and after running studies. This took time and effort away from actual research, but ended up making the research more valuable to the business in the long run. 

With the large range of UX maturity and the democratization of research across teams, we know there’s a lot of opportunity for our customers to improve their ability to tie their user research to tangible business outcomes and embed UX more deeply in all levels of their organizations. To help fill this gap, Optimal Workshop is currently running a large research project on Measuring the Value of UX which will be released in a few weeks.

Keep up to date with the latest news and events by following us on LinkedIn.

Seeing is believing

Explore our tools and see how Optimal makes gathering insights simple, powerful, and impactful.