Product Roadmap Update

Today, we’re thrilled to announce the arrival of the latest member of the Optimal family:  Prototype Testing! This exciting and much-requested new tool allows you to test designs early and often with users to gather fast insights, and make confident design decisions to create more intuitive and user-friendly digital experiences. 

‍

Optimal gives you tools you need to easily build a prototype to test using images and screens and creating clickable areas, or you can import a prototype from Figma and get testing. The first iteration of prototype testing is an open beta, and we’ll be working closely with our customers and community to gather feedback and ideas for further improvements in the months to come.

‍

‍

When to use prototype testing 

‍

Prototype testing is a great way to validate design ideas, identify usability issues, and gather feedback from users before investing too heavily in the development of products, websites, and apps. To further inform your insights, it’s a good idea to include sentiment questions or rating scales alongside your tasks.

‍

Early in the design process: Test initial ideas and concepts to gauge user reactions and feelings about your conceptual solutions. 

‍

Iterative design phases: Continuously test and refine prototypes as you make changes and improvements to the designs. 

‍

Before major milestones: Validate designs before key project stages, such as stakeholder reviews or final approvals.

‍

Usability Testing: Conduct summative research to assess a design's overall performance and gauge real user feedback to guide future design decisions and enhancements.

‍

‍

How it works 🧑🏽‍💻

‍

No existing prototype? No problem. We've made it easy to create one right within Optimal. Here's how:

‍

1. Import your visuals

Start by uploading a series of screenshots or images that represent your design flow. These will form the backbone of your prototype.

‍

2. Create interactive elements

Once your visuals are in place, it's time to bring them to life. Use our intuitive interface to designate clickable areas on each screen. These will act as navigation points for your test participants.

‍

3. Set up the flow

Connect your screens in a logical sequence, mirroring the user journey you want to test. This creates a seamless, interactive experience for your participants.

‍

4. Preview and refine

Before launching your study, take a moment to walk through your prototype. Ensure all clickable areas work as intended and the flow feels natural.

‍

The result? A fully functional prototype that looks and feels like a real digital product. Your test participants will be able to navigate through it just as they would a live website or app, providing you with authentic, actionable insights.

‍

By empowering you to build prototypes from scratch, we're removing barriers to early-stage testing. This means you can validate ideas faster, iterate with confidence, and ultimately deliver better digital experiences.

‍

‍

Or…import your prototypes directly from Figma 

‍

There’s a bit of housekeeping you’ll need to do in Figma in order to provide your participants with the best testing experience and not impact loading times of the prototype. You can import a link to your Figma prototype into your study,  and it will carry across all the interactions you have set up. You’ll need to make sure your Figma presentation mode is made public in order to share the file with participants. If you make any updates to your Figma file, you can sync the changes in just one click. 

‍

Help Article: Find out more about how to set up your Figma file for testing

‍

‍

How to create tasks 🧰

‍

When you set up your study, you’ll create tasks for participants to complete. 

‍

There are two different ways to build tasks in your prototype tests. You can set a correct destination by adding a start screen and a correct destination screen. That way, you can watch how participants navigate your design to find their way to the correct destination. Another option is to set a correct pathway and evaluate how participants navigate a product, app, or website based on the pathway sequence you set. You can add as many pathways or destinations as you like. 

‍

Adding post-task questions is a great way to help gather qualitative feedback on the user's experience, capturing their thoughts, feelings, and perceptions.

‍

Help Article: Find out how to analyze your results

‍

‍

Prototype testing analysis and metrics 📊

‍

Prototype testing offers a variety of analysis options and metrics to evaluate the effectiveness and usability of your design.  By using these analysis options and metrics, you can get comprehensive insights into your prototype's performance, identify areas for improvement, and make informed design decisions:

‍

Task results 

The task results provide a deep analysis at a task level, including the success score, directness score, time taken, misclicks, and the breakdown of the task's success and failure. They provide great insight into the usability of your design to achieve a task. 

‍

• Success score tells you the total percentage of participants who reached the correct destination or pathway that you defined for this task. It’s a good indicator of a prototype's usability. 
• Directness score is the total completed results minus the ‘indirect’ results.
• A path is ‘indirect’ when a participant backtracks, viewing the same page multiple times, or if they nominate the correct destination but don’t follow the correct pathway
• Time taken is how long it took a participant to complete your task and can be a good indicator of how easy or difficult it was to complete. 
• ‍Misclicks measure the total number of clicks made on areas of your prototype that weren’t clickable, clicks that didn’t result in a page change.

‍

‍

Clickmaps

‍

Clickmaps provide an aggregate view of user interactions with prototypes, visualizing click patterns to reveal how users navigate and locate information. They display hits and misses on designated clickable areas, average task completion times, and heatmaps showing where users believed the next steps to be. Filters for first, second, and third page visits allow analysis of user behavior over time, including how they adapt when backtracking. This comprehensive data helps designers understand user navigation patterns and improve prototype usability.

‍

‍

‍

Participant paths 

‍

The Paths tab in Optimal provides a powerful visualization to understand and identify common navigation patterns and potential obstacles participants encounter while completing tasks. You can include thumbnails of your screens to enhance your analysis, making it easier to pinpoint where users may face difficulties or where common paths occured.

‍

‍

‍

Coming soon to prototyping 🔮

‍

Later this year, we’re running a closed beta for video recording with prototype testing. This feature captures behaviors and insights not evident in click data alone. The browser-based recording requires no plugins, simplifying setup. Consent for recording is obtained at the start of the testing process and can be customized to align with your organization's policies. This new feature will provide deeper insights into user experience and prototype usability.

‍

These enhancements to prototype testing offer a comprehensive toolkit for user experience analysis. By combining quantitative click data with qualitative video insights, designers and researchers can gain a more nuanced understanding of user behavior, leading to more informed decisions and improved product designs.

‍

Start prototype testing today

"Hi Optimal Work,I was wondering if there are some best practices you stick to when creating or sending out different UX research studies (i.e. Card sorts, Prototyye Test studies, etc)? Thank you! Mary"

‍

Indeed I do! Over the years I’ve learned a lot about creating remote research studies and engaging participants. That experience has taught me a lot about what works, what doesn’t and what leaves me refreshing my results screen eagerly anticipating participant responses and getting absolute zip. Here are my top tips for remote research study creation and launch success!

‍

‍

Creating remote research studies

‍

‍

Use screener questions and post-study questions wisely

‍

Screener questions are really useful for eliminating participants who may not fit the criteria you’re looking for but you can’t exactly stop them from being less than truthful in their responses. Now, I’m not saying all participants lie on the screener so they can get to the activity (and potentially claim an incentive) but I am saying it’s something you can’t control. To help manage this, I like to use the post-study questions to provide additional context and structure to the research.

‍

Depending on the study, I might ask questions to which the answers might confirm or exclude specific participants from a specific group. For example, if I’m doing research on people who live in a specific town or area, I’ll include a location based question after the study. Any participant who says they live somewhere else is getting excluded via that handy toggle option in the results section. Post-study questions are also great for capturing additional ideas and feedback after participants complete the activity as remote research limits your capacity to get those — you’re not there with them so you can’t just ask. Post-study questions can really help bridge this gap. Use no more than five post-study questions at a time and consider not making them compulsory.

‍

‍

Do a practice run

‍

No matter how careful I am, I always miss something! A typo, a card with a label in the wrong case, forgetting to update a new version of an information architecture after a change was made — stupid mistakes that we all make. By launching a practice version of your study and sharing it with your team or client, you can stop those errors dead in their tracks. It’s also a great way to get feedback from the team on your work before the real deal goes live. If you find an error, all you have to do is duplicate the study, fix the error and then launch. Just keep an eye on the naming conventions used for your studies to prevent the practice version and the final version from getting mixed up!

‍

Sending out remote research studies

‍

‍

Manage expectations about how long the study will be open for

‍

Something that has come back to bite me more than once is failing to clearly explain when the study will close. Understandably, participants can be left feeling pretty annoyed when they mentally commit to complete a study only to find it’s no longer available. There does come a point when you need to shut the study down to accurately report on quantitative data and you’re not going to be able to prevent every instance of this, but providing that information upfront will go a long way.

‍

‍

Provide contact details and be open to questions

‍

You may think you’re setting yourself up to be bombarded with emails, but I’ve found that isn’t necessarily the case. I’ve noticed I get around 1-3 participants contacting me per study. Sometimes they just want to tell me they completed it and potentially provide additional information and sometimes they have a question about the project itself. I’ve also found that sometimes they have something even more interesting to share such as the contact details of someone I may benefit from connecting with — or something else entirely! You never know what surprises they have up their sleeves and it’s important to be open to it. Providing an email address or social media contact details could open up a world of possibilities.

‍

‍

Don’t forget to include the link!

‍

It might seem really obvious, but I can’t tell you how many emails I received (and have been guilty of sending out) that are missing the damn link to the study. It happens! You’re so focused on getting that delivery right and it becomes really easy to miss that final yet crucial piece of information.

‍

To avoid this irritating mishap, I always complete a checklist before hitting send:

‍

• Have I checked my spelling and grammar?
• Have I replaced all the template placeholder content with the correct information?
• Have I mentioned when the study will close?
• Have I included contact details?
• Have I launched my study and received confirmation that it is live?
• Have I included the link to the study in my communications to participants?
• Does the link work? (yep, I’ve broken it before)

‍

‍

‍

General tips for both creating and sending out remote research studies

‍

‍

Know your audience

‍

First and foremost, before you create or disseminate a remote research study, you need to understand who it’s going to and how they best receive this type of content. Posting it out when none of your followers are in your user group may not be the best approach. Do a quick brainstorm about the best way to reach them. For example if your users are internal staff, there might be an internal communications channel such as an all-staff newsletter, intranet or social media site that you can share the link and approach content to.

‍

‍

Keep it brief

‍

And by that I’m talking about both the engagement mechanism and the study itself. I learned this one the hard way. Time is everything and no matter your intentions, no one wants to spend more time than they have to. Even more so in situations where you’re unable to provide incentives (yep, I’ve been there). As a rule, I always stick to no more than 10 questions in a remote research study and for card sorts, I’ll never include more than 60 cards. Anything more than that will see a spike in abandonment rates and of course only serve to annoy and frustrate your participants. You need to ensure that you’re balancing your need to gain insights with their time constraints.

‍

As for the accompanying approach content, short and snappy equals happy! In the case of an email, website, other social media post, newsletter, carrier pigeon etc, keep your approach spiel to no more than a paragraph. Use an audience appropriate tone and stick to the basics such as: a high level sentence on what you’re doing, roughly how long the study will take participants to complete, details of any incentives on offer and of course don’t forget to thank them.

‍

‍

Set clear instructions

‍

The default instructions in Optimal Workshop’s suite of tools are really well designed and I’ve learned to borrow from them for my approach content when sending the link out. There’s no need for wheel reinvention and it usually just needs a slight tweak to suit the specific study. This also helps provide participants with a consistent experience and minimizes confusion allowing them to focus on sharing those valuable insights!

‍

‍

Create a template

‍

When you’re on to something that works — turn it into a template! Every time I create a study or send one out, I save it for future use. It still needs minor tweaks each time, but I use them to iterate my template.What are your top tips for creating and sending out remote user research studies? Comment below!

It’s no secret - New Zealand has a diversity problem in design and technology. 

‍

Throughout her career, Sachi often felt like the odd one out - the only woman, the only Pasifika person, the one who laughed too loud, the one who looked different and sounded different. But as a leader, Sachi has been able to create change.

‍

Sachi Taulelei, Head of Design, ANZ, recently spoke at UX New Zealand, the leading UX and IA conference in New Zealand hosted by Optimal Workshop, on how she is building a diverse team of designers at New Zealand’s largest bank.

‍

In her talk, Sachi shares the challenges she’s faced as a Pasifika woman in design and technology; and how this has shaped her approach to leadership and her drive to create inclusive environments where individuals and teams thrive.

‍

Background on Sachi Taulelei

‍

Sachi is a creative strategist, a design leader, and a recovering people pleaser. She has worked in digital and design for over 25 years, spending most of her career creating and designing digital experiences centered on people.

‍

As a proud Pasifika woman, she has a particular interest in diversity, equity, and inclusion. She has spoken out about the need for more diversity within design and technology and the impact it can have on the technology we create.

‍

Sachi is passionate about giving back - when she's not running after her two kids, you'll find her mentoring Pasifika youth, cheering on young leaders through the Young Enterprise Scheme, judging awards for Women in AI, or volunteering at the local hospice.

‍

Contact Details:

‍

Email: sachi.taulelei@anz.com

‍

LinkedIn: https://www.linkedin.com/in/sachi-taulelei/

‍

Odd one out: embracing diversity in design and technology ✨

‍

Looking and sounding different from her peers, Sachi always felt like she was trying to find her place in the office. She always felt like she didn’t belong. 

‍

Sachi has experienced all forms of racism and discrimination as a result of her heritage. These experiences aren’t spoken about and often go unnoticed by the majority. She has held equivalent jobs to male counterparts but received lower pay, and was advised to change her name from Sachi to Sacha on her job applications to improve her chances.  

‍

Sachi’s response was to work hard and become great at what she does, which was recognized over time. Slowly, she began to rise through the ranks. However, having reached leadership roles, she struggled to be heard and participate, without knowing why. The advice was given freely by managers to “stick at it”, to “grow thicker skin”, and to grow through the “school of hard knocks”. Although this advice worked at face value and she flourished, Sachi began to feel like a fraud and constantly second-guessing herself. She began to “edit” herself to fit into an acceptable mold and, in doing so, felt like she lost part of who she was.

‍

What is success? 🏆🎯💎

‍

Success often comes in the form of our leaders who have already climbed the mountains of achievement. When you see success in this way, as someone who doesn’t fit the mold, there is pressure to conform to get ahead. Using the same tools and advice given to these leaders, she realized, would actually hold her back. 

‍

Realizing true value through our uniqueness 🪐🦋

‍

Sachi recounts the treatment of Japanese-American citizens in the U.S. in the years following Pearl Harbour, where Japanese-American citizens were moved to concentration camps. This happened despite an official report finding conclusively that there was no threat from this population. Even though Germany and Italy were also at war with the U.S., for example, citizens with Italian and German heritage were not treated this way. This caused immeasurable pain, shame, and fear for the victims, and fostered a head-down, work-hard mentality in order to try and forget the treatment they received. This attitude, Sachi believes, was passed down to her from her ancestors who experienced that reality. Sachi explains that while there are many things that can hold someone back in life, creating meaningful change starts with introspection. Often, that requires us to work through fear and shame.

‍

Reflecting on her heritage, which is part Samoan and part Japanese, Sachi started to embrace her unique traits. In her case, she embraced the deep empathy and human compassion from her Japanese side and the deep sense of community and connection from her Samoan side. Her uniqueness is something to celebrate, not to hide behind. 

‍

Becoming a leader and realizing this, Sachi wanted to create a team culture based on equity, openness, and a sense of belonging – all things that Sachi wished for herself on her journey.

‍

Why it matters 💫

‍

Once she understood herself and what she wanted for her team, Sachi set to work on building a new team culture. Sachi breaks down key learnings from how she turned this vision into reality.

‍

Define

‍

Define what diversity means for your team. You need to clearly understand what it is you want to achieve before you can achieve it. For Sachi’s team, they knew that they wanted to create a team that was representative of New Zealand. Sachi knew, for example, that she had a lack of Māori and Pacific representation within the team. Māori and Pasifika represent 25% of the population. So, an effort was made to increase ranks by hiring talent from these cultures. 

‍

Additionally, Sachi focused on creating new role levels - from intern right through to graduates, juniors, and intermediate-level positions. This helped to acknowledge age differences within her team and also helped to manage career progression opportunities.

‍

Effort 

‍

It can be difficult to achieve diversity and inclusion and it requires a lot of work. For example, Sachi learned that posting an ad on job boards and expecting to receive hundreds of Māori and Pasifika applicants wasn’t realistic. Instead, partnerships were built with local design schools, and networking events were consistently attended. Job referrals from within the team were also leveraged, as well as establishing a strong direction for recruitment specialists within the organization.

‍

Sachi also recognized that, as a leader, she needed to be more visible and more vocal about sharing her views of the world and what she was trying to achieve. It was important to be clear about the type of culture she was building within her team so that she could promote it.

‍

In less than a year her team grew (from 11 to 40!) which meant a focus on building an inclusive team culture was required. The central theme throughout this time was, “You have to connect to yourself and your strengths first and foremost, before you can connect with others and as a team”. This meant that the team used tools like the Clifton Strength Finder, in order to learn about themselves and each other. Each designer was then encouraged to delve into their own natural working styles and were taught how to amplify their own strengths through various workshops. This approach also becomes handy when recruiting and strengthening potential weak spots.

‍

Integrity

‍

It’s important to have leaders who care - you can’t do it on your own. There can be pain points on the journey to creating diversity and inclusion, so it’s necessary to have leaders who listen, support, and work through some of the challenges that can arise.

‍

Benefits of diversity and inclusion in design teams 👩🏼🤝👨🏿

‍

Why push for diversity and inclusion? Sachi argues that the benefits are evident in the way that her team designs. 

‍

For example, her team:

‍

• Insist that research is done with diverse customer groups
• Advocates for accessibility when no one else will
• Understand problems from different perspectives before diving into a project

‍

Most importantly, the benefits show up in the way that each other is treated, and the relationships that are built with key stakeholders. Diversity and inclusion are wins for everyone - the team, the organization, and the customer.

‍

‍