Optimal vs. Maze: Deep User Insights or Surface-Level Design Feedback

Return on investment (ROI) is often the term on everyone’s lips when starting a big project or even when reviewing a website. It’s especially popular with those that hold the purse strings.  As UX researchers it is important to consider the ROI of the work we do and understand how to measure this. 

‍

We’ve lined up 5 key ways to measure ROI for UX research to help you get the conversation underway with stakeholders so you can show real and tangible benefits to your organization. 

‍

‍

1. Meet and exceed user expectations

‍

Put simply, a product that meets and exceeds user expectations leads to increased revenue. When potential buyers are able to find and purchase what they’re looking for, easily, they’ll complete their purchase, and are far more likely to come back. The simple fact that users can finish their task will increase sales and improve overall customer satisfaction which has an influence on their loyalty. Repeat business means repeat sales. Means increased revenue.

‍

Creating, developing and maintaining a usable website is more important than you might think. And this is measurable! Tracking and analyzing website performance prior to the UX research and after can be insightful and directly influenced by changes made based on UX research.

‍

Measurable: review the website (product) performance prior to UX research and after changes have been made. The increase in clicks, completed tasks and/or baskets will tell the story.

‍

‍

2. Reduce development time

‍

UX research done at the initial stages of a project can lead to a reduction in development time of by 33% to 50%! And reduced time developing, means reduced costs (people and overheads) and a speedier to market date. What’s not to love? 

‍

Measurable: This one is a little more tricky as you have saved time (and cost) up front. Aiding in speed to market and performance prior to execution. Internal stakeholder research may be of value post the live date to understand how the project went.

‍

‍

3. Ongoing development costs

‍

And the double hitter? Creating a product that has the user in mind up front, reduces the need to rehash or revisit as quickly. Reducing ongoing costs. Early UX research can help with the detection of errors early on in the development process. Fixing errors after development costs a company up to 100 times more than dealing with the same error before development.

‍

Measureable: Again, as UX research has saved time and money up front this one can be difficult to track. Though depending on your organization and previous projects you could conduct internal research to understand how the project compares and the time and cost savings.

‍

‍

4. Meeting user requirements

‍

Did you know that 70% of projects fail due to the lack of user acceptance? This is often because project managers fail to understand the user requirements properly. Thanks to UX research early on, gaining insights into users and only spending time developing the functions users actually want, saving time and reducing development costs. Make sure you get confirmation on those requirements by iterative testing. As always, fail early, fail often. Robust testing up front means that in the end, you’ll have a product that will meet the needs of the user.

‍

Measurable: Where is the product currently? How does it perform? Set a benchmark up front and review post UX research. The deliverables should make the ROI obvious.

‍

‍

5. Investing in UX research leads to an essential competitive advantage.

‍

Thanks to UX research you can find out exactly what your customers want, need and expect from you. This gives you a competitive advantage over other companies in your market. But you should be aware that more and more companies are investing in UX while customers are ever more demanding, their expectations continue to grow and they don’t tolerate bad experiences. And going elsewhere is an easy decision to make.

‍

Measurable: Murky this one, but no less important. Knowing, understanding and responding to competitors can help keep you in the lead, and developing products that meet and exceed those user expectations.

‍

‍

Wrap up

‍

Showing the ROI on the work we do is an essential part of getting key stakeholders on board with our research. It can be challenging to talk the same language, ultimately we all want the same outcome…a product that works well for our users, and delivers additional revenue.

‍

For some continued reading (or watching in this case), Anna Bek, Product and Delivery Manager at Xplor explored the same concept of "How to measure experience" during her UX New Zealand 2020 – watch it here as she shares a perspective on UX ROI.

Product, design and research teams today are drowning in user data while starving for user understanding. Never before have teams had such access to user information, analytics dashboards, heatmaps, session recordings, survey responses, social media sentiment, support tickets, and endless behavioral data points. Yet despite this volume of data, teams consistently build features users don't want and miss needs hiding in plain sight.

‍

It’s a true paradox for product, design and research teams: more information has made genuine understanding more elusive. 

‍

Because with  all this data, teams feel informed. They can say with confidence: "Users spend 3.2 minutes on this page," "42% abandon at this step," "Power users click here." But what this data doesn't tell you is Why. 

‍

The Difference between Data and Insight

‍

Data tells you what happened. Understanding tells you why it matters.

‍

Here’s a good example of this: Your analytics show that 60% of users abandon a new feature after first use. You know they're leaving. You can see where they click before they go. You have their demographic data and behavioral patterns.

‍

But you don't know:

‍

• Were they confused or simply uninterested?
• Did it solve their problem too slowly or not at all?
• Would they return if one thing changed, or is the entire approach wrong?
• Are they your target users or the wrong segment entirely?

‍

One team sees "60% abandonment" and adds onboarding tooltips. Another talks to users and discovers the feature solves the wrong problem entirely. Same data, completely different understanding.

‍

Modern tools make it dangerously easy to mistake observation for comprehension, but some aspects of user experience exist beyond measurement:

‍

• Emotional context, like the frustration of trying to complete a task while handling a crying baby, or the anxiety of making a financial decision without confidence.
• The unspoken needs of users which can only be demonstrated through real interactions. Users develop workarounds without reporting bugs. They live with friction because they don't know better solutions exist.
• Cultural nuances that numbers don't capture, like how language choice resonates differently across cultures, or how trust signals vary by context.
• Data shows what users do within your current product. It doesn't reveal what they'd do if you solved their problems differently to help you identify new opportunities. 

‍

Why Human Empathy is More Important than Ever 

‍

The teams building truly user-centered products haven't abandoned data but they've learned to combine quantitative and qualitative insights. 

‍

• Combine analytics (what happens), user interviews (why it happens), and observation (context in which it happens).
• Understanding builds over time. A single study provides a snapshot; continuous engagement reveals the movie.
• Use data to form theories, research to validate them, and real-world live testing to confirm understanding.
• Different team members see different aspects. Engineers notice system issues, designers spot usability gaps, PMs identify market fit, researchers uncover needs.

‍

Adding AI into the mix also emphasizes the need for human validation. While AI can help significantly speed up workflows and can augment human expertise, it still requires oversight and review from real people. 

‍

AI can spot trends humans miss, processing millions of data points instantly but it can't understand human emotion, cultural context, or unspoken needs. It can summarize what users say but humans must interpret what they mean.

‍

Understanding users has never been easier from a data perspective. We have tools our predecessors could only dream of.  But understanding users has never been harder from an empathy perspective. The sheer volume of data available to us creates an illusion of knowledge that's more dangerous than ignorance.

‍

The teams succeeding aren't choosing between data and empathy, they're investing equally in both. They use analytics to spot patterns and conversations to understand meaning. They measure behavior and observe context. They quantify outcomes and qualify experiences.

‍

Because at the end of the day, you can track every click, measure every metric, and analyze every behavior, but until you understand why, you're just collecting data, not creating understanding.

‍

‍

The choice between comprehensive research platforms and tools designed for smaller teams becomes increasingly critical as research and product teams work to scale their user insight capabilities. This decision impacts not only immediate research outcomes but also long-term strategic planning and organizational growth. While platforms like Lyssna focus on rapid feedback collection and quick turnaround times which are valuable for teams needing fast validation, Optimal delivers the depth, reliability, and enterprise features that the world's biggest brands require to make strategic product decisions.

‍

Why do teams choose Optimal instead of Lyssna?

‍

Comprehensive Insights vs. Speed-Only Focus

‍

Optimal's Comprehensive Approach: Optimal combines speed with depth, delivering rapid study launch alongside AI-powered analysis, detailed reporting, and enterprise-grade insights that transform user feedback into actionable business intelligence. This includes live site testing capabilities that let you test actual websites and web apps without code, enabling continuous optimization post-launch.

‍

Lyssna's Speed Focus: In contrast, Lyssna optimizes for quick feedback collection with simple testing workflows, but lacks AI-powered analysis, advanced reporting, and the sophisticated insights enterprise research programs require for strategic decision-making.

‍

Trusted by Global Brands: Optimal serves enterprise clients including Lego, Nike, and Amazon with SOC 2 compliance, global security protocols, and dedicated enterprise support that meets Fortune 500 requirements.

‍

Limited Enterprise Features: Lyssna operates as a testing tool rather than an enterprise platform, lacking the compliance, security, and support infrastructure global brands require for mission-critical research programs.

‍

Participant Quality and Global Reach

‍

Global Participant Network: Optimal's 10+ million verified participants across 150+ countries enable sophisticated audience targeting, global market research, and reliable recruitment for any demographic or geographic requirement.

‍

Limited Panel Reach: Lyssna's small participant panel restricts targeting options and geographic coverage, particularly for niche audiences or international research requirements.

‍

Verified Participant Quality: Optimal implements comprehensive fraud prevention, advanced screening protocols, and quality assurance processes that ensure participant authenticity and criteria matching for reliable research results.

‍

Quality Control Issues: Users report that Lyssna participants often don't match requested criteria, compromising study validity and requiring additional screening overhead.

‍

Advanced Features and Platform Capabilities

‍

AI-Powered Insights: Optimal includes sophisticated AI analysis tools that automatically generate insights, identify patterns, and create actionable recommendations from research data. Our new Interviews tool exemplifies this innovation, upload interview videos and let AI automatically surface key themes, generate smart highlight reels with timestamped evidence, and produce actionable insights in hours instead of weeks.

‍

Manual Analysis Required: Lyssna provides basic reporting without integrated AI tools, requiring teams to manually analyze results and generate insights from raw data.

‍

Full-Service Flexibility: Optimal provides both self-service and white-glove managed recruitment services, accommodating varying team resources and research complexity with dedicated support for challenging recruitment scenarios.

‍

Self-Service Only: Lyssna operates exclusively as a self-service platform without managed recruitment options for teams requiring specialized audience targeting or complex demographic requirements.

‍

Sophisticated Yet Accessible: Optimal balances powerful functionality with intuitive design, providing guided templates and automation features that enable complex research without overwhelming users.

‍

Simple but Limited: While Lyssna offers a straightforward interface, this simplicity comes with functional limitations that restrict test design flexibility and advanced research capabilities.

‍

When to Choose Lyssna

‍

Lyssna may suffice for teams with:

‍

• Basic testing needs without strategic implications
• Limited budgets prioritizing low cost over comprehensive features
• Simple research requirements without compliance needs
• Acceptance of limited participant quality and geographic reach

‍

When to Choose Optimal

‍

Optimal becomes essential for:

‍

• Strategic Research Programs: When user insights drive business strategy
• Global Organizations: Requiring international research capabilities
• Quality-Critical Studies: Where participant verification and data integrity matter
• Enterprise Compliance: Organizations with security and compliance requirements
• Advanced Analysis Needs: Teams requiring AI-powered insights and sophisticated reporting
• Scalable Research Operations: Growing programs needing comprehensive platform capabilities

‍

Why Enterprises Need to Prioritize Enterprise Research Excellence

‍

While Lyssna serves basic testing needs, enterprise research requires the depth, reliability, and global reach that only comprehensive platforms provide. Optimal delivers speed without sacrificing the sophisticated capabilities enterprise teams need for strategic decision-making. Don't compromise research quality for simple, quick tools.

‍

Ready to see how leading brands including Lego, Netflix and Nike achieve better research outcomes? Experience how Optimal's platform delivers user insights that adapt to your team's growing needs.

‍