June 6, 2024
4 min

Event Recap: Measuring the Value of UX Research at UXDX

Last week Optimal Workshop was delighted to sponsor UXDX USA 2024 in New York. The User Experience event brings together Product, Design, UX, CX, and Engineering professionals and our team had an amazing time meeting with customers, industry experts, and colleagues throughout the conference. This year, we also had the privilege of sharing some of our industry expertise by running an interactive forum on “Measuring the Value of UX Research” - a topic very close to our hearts.

Our forum, hosted by Optimal Workshop CEO Alex Burke and Product Lead Ella Fielding, was focused on exploring the value of User Experience Research (UXR) from both an industry-wide perspective and within the diverse ecosystem of individual companies and teams conducting this type of research today.

The session brought together a global mix of UX professionals for a rich discussion on measuring and demonstrating the effectiveness of and the challenges facing organizations who are trying to tie UXR to tangible business value today.

The main topics for the discuss were: 

  • Metrics that Matter: How do you measure UXR's impact on sales, customer satisfaction, and design influence?
  • Challenges & Strategies: What are the roadblocks to measuring UXR impact, and how can we overcome them?
  • Beyond ROI:  UXR's value beyond just financial metrics

Some of the key takeaways from our discussions during the session were: 

  1. The current state of UX maturity and value
    • Many UX teams don’t measure the impact of UXR on core business metrics and there were more attendees who are not measuring the impact of their work than those that are measuring it. 
    • Alex & Ella discussed with the attendees the current state of UX research maturity and the ability to prove value across different organizations represented in the room. Most organizations were still early in their UX research maturity with only 5% considering themselves advanced in having research culturally embedded.
  1. Defining and proving the value of UX research
    • The industry doesn’t have clear alignment or understanding of what good measurement looks like. Many teams don’t know how to accurately measure UXR impact or don’t have the tools or platforms to measure it, which serve as core roadblocks for measuring UXRs’ impact. 
    • Alex and Ella discussed challenges in defining and proving the value of UX research, with common values being getting closer to customers, innovating faster, de-risking product decisions, and saving time and money. However, the value of research is hard to quantify compared to other product metrics like lines of code or features shipped.
  1. Measuring and advocating for UX research
    • When teams are measuring UXR today there is a strong bias for customer feedback, but little ability or understanding about how to measure impact on business metrics like revenue. 
    • The most commonly used metrics for measuring UXR are quantitative and qualitative feedback from customers as opposed to internal metrics like stakeholder involvement or tieing UXR to business performance metrics (including financial performance). 
    • Attendees felt that in organizations where research is more embedded, researchers spend significant time advocating for research and proving its value to stakeholders rather than just conducting studies. This included tactics like research repositories and pointing to past study impacts as well as ongoing battles to shape decision making processes. 
    • One of our attendees highlighted that engaging stakeholders in the process of defining key research metrics prior to running research was a key for them in proving value internally. 
  1. Relating user research to financial impact
    • Alex and Ella asked the audience if anyone had examples of demonstrating financial impact of research to justify investment in the team and we got some excellent examples from the audience proving that there are tangible ways to tie research outcomes to core business metrics including:
    • Calculating time savings for employees from internal tools as a financial impact metric. 
    • Measuring a reduction in calls to service desks as a way to quantify financial savings from research.
  1. Most attendees recognise the value in embedding UXR more deeply in all levels of their organization - but feel like they’re not succeeding at this today. 
    • Most attendees feel that UXR is not fully embedded in their orgnaization or culture, but that if it was - they would be more successful in proving its overall value.
    • Stakeholder buy-in and engagement with UXR, particularly from senior leadership varied enormously across organizations, and wasn’t regularly measured as an indicator of UXR value 
    • In organizations where research was more successfully embedded, researchers had to spend significant time and effort building relationships with internal stakeholders before and after running studies. This took time and effort away from actual research, but ended up making the research more valuable to the business in the long run. 

With the large range of UX maturity and the democratization of research across teams, we know there’s a lot of opportunity for our customers to improve their ability to tie their user research to tangible business outcomes and embed UX more deeply in all levels of their organizations. To help fill this gap, Optimal Workshop is currently running a large research project on Measuring the Value of UX which will be released in a few weeks.

Keep up to date with the latest news and events by following us on LinkedIn.

Share this article
Author
Amberlie
Denny

Related articles

View all blog articles
Learn more
1 min read

B is for belief: Optimal Workshop’s B Corp journey

There are over 5000 certified B Corporations around the world, including new recruit, New Zealand based SaaS company, Optimal Workshop.  The ‘B’ in B Corp actually stands for ‘beneficial’, to reflect the founding vision behind the movement: ‘make business a force for good’.   B Corp seeks to help companies balance purpose and profit, while also serving stakeholders by building a global community of like-minded organizations. We asked Andrew Mayfield, CEO and Julie Reddish, Head of People and Culture at Optimal Workshop about becoming a B Corp, the journey so far and why it’s so important.

Why did Optimal decide to become a B Corp?

Andrew: I’ve been interested in aligning our reporting with our purpose and values for years, so becoming a B Corp felt like a huge and natural step in this direction. Our ethos of placing people at the heart of decisions extends to the way we treat our own people, not just our customers.  So I saw B Corp as a way of enshrining this thinking into the company and making sure these aspects were considered in future decision making.  

Sounds as if being a B Corp was already in line with your thinking.  What’s it mean in terms of action?  

Julie: One of the things we’ve always cared about is ‘how do we show our real commitment to people, to the environment, to sustainability, to doing ethical good work?’ Finding out B Corp existed as this global initiative, this reputable, recognized way of measuring yourself against other companies was compelling.  It was a way for us to metrify or codify ‘the optimal way’ of doing things in a way that does good as a company and does good in the world.  

Andrew: Practically it means writing up more policies to ensure the things we do for the good of our people and the planet, which we consider normal are actually written down and therefore, in effect, protected. Our Code of Ethics and Business Conduct, Whistleblower policy, Breast feeding and support policy and Environmental sustainability policy are some that spring to mind.

Tell me about the actual journey to becoming a B Corp - what’s it been like?

Julie: Oh my gosh - it’s been a big project.  Little did we know how much work it would take to get accredited!  It requires six different categories of certification which have, like 50 or 60 questions or areas you can gain points in and you need a minimum of 80 points to get certification.  A lot of the questions weren’t really applicable to us so we really had to look closely and think, ‘what is there already that we do inside Optimal that actually equates to saying yes to that question?’ We had an awful lot of thinking to do about which questions to put our time and our money into.  

Andrew:  There were a lot of things we did that weren’t fully documented, that was the hard part. We didn’t have to change much of our actual behavior to be honest.  We have been for years looking at a people-centered approach - our three values are Approachable, Bold and Curious. We had to write things down, make sure they were where people could find them.  There wasn’t a lot we had to change to get our entrance score as such. If we want to continually improve each year then we will need to make continual changes for sure, like anyone trying to self improve.

Julie:  We thought we were quite close, then there was this massive surge of interest and eight months to even see a consultant, then another six months before the verification process even started.  

That’s when the rubber really hit the road.  We were working away on different bits of the B Corp certification like there’s one for having an office set up for breastfeeding.  Do you have a lockable door? Do you have a place that is private? Does everyone know? Is it communicated? Do you have a policy on breastfeeding? You had to look at each of those things and make sure that you could back it up with evidence.  And that might be worth 0.2 points.  

Sounds like a detailed and rigorous journey - but also quite meaningful and actionable?

Julie: We already had thoughts on what we could do to make our organization great like sourcing local produce and local suppliers but the process of becoming a B Corp really flushed it out for us.  Some of the suggestions and categories were things we were already looking at within the bigger picture of being a good employer and being a good contributor to our communities. Going through the assessment helped us identify a whole other layer of things that we could and should be doing.

Beyond measuring female representation, what else could we be doing for diversity?  What about our indigenous representation? What could we be doing for people with disabilities?  It got us into deeper thinking about what diversity actually means. It’s pretty amazing.

What does being a B Corp mean for your employees?

Julie:  As an employer it’s reaffirming a commitment to treating people well and human-centered work practices.  So the real nuts and bolts come down to individuals thinking how might I get involved with this:  If I see something I don’t feel is right I call it out.  I can also advocate for what is right.

Andrew:  More and more I think people are interested in working for companies that care for more than simply enriching their shareholders, that care about taking care of their team and of their environment and of their impact more broadly, of the change they seek to make on society, knowledge-sharing and all this sort of thing.  People are more aware of considering this on choice of where to work, where to stay and just generally where to spend their time.  We all have scarce time these days and strong choices to make and it does play into where people choose to work.

Does this extend to customers?  What impact, if any, does being a B Corp mean for them?

Andrew:  B Corp certainly takes into consideration who you choose to use as suppliers so it becomes a bit recursive in that way. If our customers value the fact we’re a B Corp then they need to be thinking about choosing suppliers who are also B Corps - so it would gradually happen over time I’d imagine. 

Julie: It’s about thoughtful practices.  Not just following trends. It’s about what works, not what’s popular. 

What’s it feel like to be part of this global community called B Corp?

Julie:  I think it's a really cool company to be in.  To share our thinking, to share policies and resources with somebody who’s traveled that road before us, with its dragons and potholes, to actually follow in someone’s footsteps, but also make it our own ‘Optimal’ way.  

Andrew: Being part of a community of B Corps supporting each other with new ways to manage these obligations we choose to put on ourselves to be better corporate citizens as such is valuable.  While there’s no desire to make it hard, sometimes it is hard to make sure you’re doing the right thing.  It requires extra research and extra conscientiousness when making decisions so sharing ideas and experiences.  Feeling like you’re not the only one who’s been there can help.

Becoming a B Corp is quite an achievement however the work doesn’t stop there does it?

Andrew: My understanding is the requirements get harder and that’s a good thing.  We can all get better.  The biggest areas for us to improve are things like sharing information in decision-making, we’re already pretty transparent but haven’t formalized that so there are things we can do there.  

The next checkpoint is in three years and we’re expected to improve plus the requirements get more onerous - so we’d better improve!

Learn more
1 min read

Transforming digital experiences: Optimal Workshop's radical refresh

At Optimal Workshop, we've always prided ourselves on being pioneers in the field of UX research tools. Since our inception, we've been the go-to platform for UX researchers and designers looking to conduct card sorting, tree testing, and other critical user research activities. Our tools have helped shape the digital experiences of some of the world's leading companies.

The digital landscape is ever-changing, and with it, the needs of the professionals who create and optimize digital experiences. As we've grown and evolved alongside the industry, we've recognized the need to expand our reach and refine our value proposition to better serve not just UX researchers, but all professionals involved in delivering exceptional digital experiences.

That's why we're excited to announce a significant brand refresh and value pivot for Optimal Workshop. This evolution isn't just about a new coat of paint – it's a fundamental shift in how we position ourselves and the value we provide to our users and the broader digital experience community.

Why fix it if it ain’t broke? 💔🔨

Expanding Our User Base

While we've built a strong reputation among UX researchers, we've recognized that there's a broader audience of professionals who benefit from our tools and expertise. Product managers, marketers, customer experience specialists, and others involved in shaping digital experiences often lack access to professional-grade user research tools or the knowledge to effectively implement them.

Our brand refresh aims to make Optimal Workshop more accessible and relevant to this wider circle of professionals, without losing the deep respect we've earned from UX experts.

Adapting to market changes

The UX research landscape has evolved significantly since we first entered the market. With the proliferation of prototyping tools and the increasing speed of digital product development, there's been a shift away from extensive upfront research. However, we firmly believe that incorporating the voice of the customer throughout the development process is more critical than ever.

Our pivot allows us to emphasize the importance of integrating user research and insights at various stages of the digital experience lifecycle, not just during initial design phases.

Leveraging our expertise

As pioneers in the field, we have accumulated a wealth of knowledge about best practices in UX research and digital experience optimization. Our brand refresh positions us not just as a tool provider, but as a trusted partner and thought leader in the industry. We're doubling down on our commitment to sharing knowledge, standardizing best practices, and elevating the work of exceptional practitioners in the field.

Meeting evolving business needs through effective UX

The UX industry is evolving rapidly, with increasing investment and a diverse range of roles getting involved. From junior designers leveraging AI to seasoned researchers with deep expertise, the landscape is rich with talent and tools. However, the true value lies in how effectively these resources translate into business outcomes.

Optimal Workshop recognizes that exceptional digital experiences are no longer just nice-to-have – they're critical for engagement, conversion, and overall business success. Our tools bridge the gap between UX insights and tangible ROI by:

  • Democratizing research: Enabling teams across experience levels to gather valuable user data quickly and efficiently.
  • Accelerating decision-making: Providing fast, actionable insights that reduce design iterations and time-to-market.
  • Enhancing team effectiveness: Facilitating collaboration and knowledge sharing between junior and senior team members.
  • Driving business value: Directly linking UX improvements to key performance indicators and bottom-line results.

In a landscape where basic UX practices are becoming table stakes, Optimal Workshop empowers organizations to go beyond the basics. We help teams leverage the full spectrum of UX expertise – from AI-assisted analysis to seasoned human insight – to create digital experiences that truly set businesses apart and deliver measurable returns on UX investment.

What's changing at Optimal Workshop 🐛🦋

1. Best-in-class research & insights platform

While our core tools remain a critical part of our offering, we're broadening our focus to position Optimal Workshop as a best-in-class research & insights platform for digital experience professionals. This means developing new tools, workflows, and integrations that cater to a wider range of use cases and user types.

2. Accessibility without compromise

We're committed to making our professional-grade tools more accessible to a broader audience without sacrificing the depth and rigor that our expert users expect. This means developing new onboarding experiences, creating more intuitive interfaces, and providing educational resources to help users at all levels get the most out of our platform.

3. Championing best practices

As part of our evolution, we're placing a greater emphasis on identifying, sharing, and standardizing best practices in digital experience research and optimization. Through case studies, partnerships with industry leaders, and our own thought leadership content, we aim to elevate the entire field of digital experience design.

4. Fostering a community of excellence

We're doubling down on our commitment to building and nurturing a community of digital experience professionals. This includes expanding our educational offerings, hosting more events and webinars, and creating opportunities for our users to connect and learn from each other. 

5. Emphasizing outcomes and ROI

We're aligning our messaging and product development with the real-world impact our users are seeking. That’s why the new names for our tools emphasize what each tool helps you achieve, rather than the technical methodology behind it. This outcome-focused approach helps users quickly identify which tool is right for their specific needs.

How our evolution benefits you 🚀

For our long-time users, rest assured that the tools and features you know and love aren't going anywhere, but their names are changing to plain English terms to be more approachable for professionals who may not have a background in UX research. In fact, our UXR platform is only going to get better as we invest in improvements and new capabilities. You'll also benefit from an expanded community of practitioners and a wealth of new resources to help you continue to grow and excel in your field.

For professionals who may be new to Optimal Workshop or to formalized user research in general, our refresh means it's easier than ever to get started with professional-grade tools and methodologies. We're here to support you at every step, from your first card sort to building a comprehensive, data-driven approach to optimizing digital experiences.

Join us in shaping tomorrow's digital experiences 🌟

This brand refresh and value pivot mark an exciting new chapter for Optimal Workshop. We're committed to continuing our tradition of excellence while expanding our reach and impact in the world of digital experiences.

As we move forward, we'll be rolling out new features, resources, and initiatives that align with our refreshed brand and value proposition. We're excited to partner with our users – both new and long-standing – to push the boundaries of what's possible in creating truly exceptional digital experiences.

Thank you for being part of the Optimal Workshop community. Whether you're a UX research veteran or just starting your journey in optimizing digital experiences, we're here to support you with the best tools, knowledge, and community in the industry. Together, we can shape the future of digital experiences and make the online world more intuitive, efficient, and enjoyable for everyone.

Onwards and upwards,

Alex Burke, CEO Optimal Workshop

Learn more
1 min read

Meera Pankhania: From funding to delivery - Ensuring alignment from start to finish

It’s a chicken and egg situation when it comes to securing funding for a large transformation program in government. On one hand, you need to submit a business case and, as part of that, you need to make early decisions about how you might approach and deliver the program of work. On the other hand, you need to know enough about the problem you are going to solve to ensure you have sufficient funding to understand the problem better, hire the right people, design the right service, and build it the right way. 

Now imagine securing hundreds of millions of dollars to design and build a service, but not feeling confident about what the user needs are. What if you had the opportunity to change this common predicament and influence your leadership team to carry out alignment activities, all while successfully delivering within the committed time frames?

Meera Pankhania, Design Director and Co-founder of Propel Design, recently spoke at UX New Zealand, the leading UX and IA conference in New Zealand hosted by Optimal Workshop, on traceability and her learnings from delivering a $300 million Government program.

In her talk, Meera helps us understand how to use service traceability techniques in our work and apply them to any environment - ensuring we design and build the best service possible, no matter the funding model.

Background on Meera Pankhania

As a design leader, Meera is all about working on complex, purpose-driven challenges. She helps organizations take a human-centric approach to service transformation and helps deliver impactful, pragmatic outcomes while building capability and leading teams through growth and change.

Meera co-founded Propel Design, a strategic research, design, and delivery consultancy in late 2020. She has 15 years of experience in service design, inclusive design, and product management across the private, non-profit, and public sectors in both the UK and Australia. 

Meera is particularly interested in policy and social design. After a stint in the Australian Public Service, Meera was appointed as a senior policy adviser to the NSW Minister for Customer Service, Hon. Victor Dominello MP. In this role, she played a part in NSW’s response to the COVID pandemic, flexing her design leadership skills in a new, challenging, and important context.

Contact Details:

Email address: meera@propeldesign.com.au

Find Meera on LinkedIn  

From funding to delivery: ensuring alignment from start to finish 🏁🎉👏

Meera’s talk explores a fascinating case study within the Department of Employment Services (Australia) where a substantial funding investment of around $300 million set the stage for a transformative journey. This funding supported the delivery of a revamped Employment Services Model, which had the goal of delivering better services to job seekers and employers, and a better system for providers within this system. The project had a focus on aligning teams prior to delivery, which resulted in a huge amount of groundwork for Meera.

Her journey involved engaging various stakeholders within the department, including executives, to understand the program as a whole and what exactly needed to be delivered. “Traceability” became the watchword for this project, which is laid out in three phases.

  • Phase 1: Aligning key deliverables
  • Phase 2: Ensuring delivery readiness
  • Phase 3: Building sustainable work practices

Phase 1: Aligning key deliverables 🧮

Research and discovery (pre-delivery)

Meera’s work initially meant conducting extensive research and engagement with executives, product managers, researchers, designers, and policymakers. Through this process, a common theme was identified – the urgent (and perhaps misguided) need to start delivering! Often, organizations focus on obtaining funding without adequately understanding the complexities involved in delivering the right services to the right users, leading to half-baked delivery.

After this initial research, some general themes started to emerge:

  1. Assumptions were made that still needed validation
  2. Teams weren’t entirely sure that they understood the user’s needs
  3. A lack of holistic understanding of how much research and design was needed

The conclusion of this phase was that “what” needed to be delivered wasn’t clearly defined. The same was true for “how” it would be delivered.

Traceability

Meera’s journey heavily revolved around the concept of "traceability” and sought to ensure that every step taken within the department was aligned with the ultimate goal of improving employment services. Traceability meant having a clear origin and development path for every decision and action taken. This is particularly important when spending taxpayer dollars!

So, over the course of eight weeks (which turned out to be much longer), the team went through a process of combing through documents in an effort to bring everything together to make sense of the program as a whole. This involved some planning, user journey mapping, and testing and refinement. 

Documenting Key Artifacts

Numerous artifacts and documents played a crucial role in shaping decisions. Meera and her team gathered and organized these artifacts, including policy requirements, legislation, business cases, product and program roadmaps, service maps, and blueprints. The team also included prior research insights and vision documents which helped to shape a holistic view of the required output.

After an effort of combing through the program documents and laying everything out, it became clear that there were a lot of gaps and a LOT to do.

Prioritising tasks

As a result of these gaps, a process of task prioritization was necessary. Tasks were categorized based on a series of factors and then mapped out based on things like user touch points, pain points, features, business policy, and technical capabilities.

This then enabled Meera and the team to create Product Summary Tiles. These tiles meant that each product team had its own summary ahead of a series of planning sessions. It gave them as much context (provided by the traceability exercise) as possible to help with planning. Essentially, these tiles provided teams with a comprehensive overview of their projects i.e. what their user needs, what certain policies require them to deliver, etc.  

Phase 2: Ensuring delivery readiness 🙌🏻

Meera wanted every team to feel confident that we weren’t doing too much or too little in order to design and build the right service, the right way.

Standard design and research check-ins were well adopted, which was a great start, but Meera and the team also built a Delivery Readiness Tool. It was used to assess a team's readiness to move forward with a project. This tool includes questions related to the development phase, user research, alignment with the business case, consideration of policy requirements, and more. Ultimately, it ensures that teams have considered all necessary factors before progressing further. 

Phase 3: Building sustainable work practices 🍃

As the program progressed, several sustainable work practices emerged which Government executives were keen to retain going forward.

Some of these included:

  • ResearchOps Practice: The team established a research operations practice, streamlining research efforts and ensuring that ongoing research was conducted efficiently and effectively.
  • Consistent Design Artifacts: Templates and consistent design artifacts were created, reducing friction and ensuring that teams going forward started from a common baseline.
  • Design Authority and Ways of Working: A design authority was established to elevate and share best practices across the program.
  • Centralized and Decentralized Team Models: The program showcased the effectiveness of a combination of centralized and decentralized team models. A central design team provided guidance and support, while service design leads within specific service lines ensured alignment and consistency.

Why it matters 🔥

Meera's journey serves as a valuable resource for those working on complex design programs, emphasizing the significance of aligning diverse stakeholders and maintaining traceability. Alignment and traceability are critical to ensuring that programs never lose sight of the problem they’re trying to solve, both from the user and organization’s perspective. They’re also critical to delivering on time and within budget!

Traceability key takeaways 🥡

  • Early Alignment Matters: While early alignment is ideal, it's never too late to embark on a traceability journey. It can uncover gaps, increase confidence in decision-making, and ensure that the right services are delivered.
  • Identify and audit: You never know what artifacts will shape your journey. Identify everything early, and don’t be afraid to get clarity on things you’re not sure about.
  • Conducting traceability is always worthwhile: Even if you don’t find many gaps in your program, you will at least gain a high level of confidence that your delivery is focused on the right things.

Delivery readiness key takeaways 🥡

  • Skills Mix is Vital: Assess and adapt team member roles to match their skills and experiences, ensuring they are positioned optimally.
  • Not Everyone Shares the Same Passion: Recognize that not everyone will share the same level of passion for design and research. Make the relevance of these practices clear to all team members.

Sustainability key takeaways 🥡

  • One Size Doesn't Fit All: Tailor methodologies, templates, and practices to the specific needs of your organization.
  • Collaboration is Key: Foster a sense of community and collective responsibility within teams, encouraging shared ownership of project outcomes.

Seeing is believing

Explore our tools and see how Optimal makes gathering insights simple, powerful, and impactful.