The Participants list displays useful information about every participant who started your prototype test, and can be used to clean and filter your data. At a glance you can see time taken, question responses, tasks completed, tasks skipped and tasks successful at a participant level. It’s a good idea to take some time to review the participant list before you dive into your analysis. Working through the list will give you a better understanding of which participants you want to include in your results.
You can sort the list according to ‘time taken’, and exclude participants that you think finished the prototype test too quickly – this could mean these participants may not have read the tasks properly and just clicked around the prototype without thinking, which will skew your data.
You might also want to sort the table by ‘tasks successful’ to see which (and how many) participants have a success rate of 50% or less in completing the tasks. This will give you insight into patterns of unsuccessful tasks, meaning they may not have been unclear to the participant or identifying that you prototype needs to be iterated.
Participants who complete the prototype test are automatically placed in the ‘included in results’ table. Those who don’t complete all tasks (or are rejected by our recruitment panel if you've used it) are placed in the ‘excluded from results’ table.
Participants are automatically marked as 'abandoned' when they don't complete the prototype test - this happens if they've exited the test or the test has timed out. By default, these participants are not included in your results. The same goes for participants who complete 8 tasks in only 4 seconds; you can be quite sure they haven't taken the study seriously. This can skew your data and is usually an indicator that a participant is not fully engaged in the study.
Participants are also considered to have 'abandoned' a study if they don't complete any tasks and if they don't reach the final page (your Thank You page or redirect URL). These participants are automatically excluded from your results.
We place these participants in the "excluded from results" table so that you can choose to include them if you want to. For example, you might see that a participant marked as 'abandoned' has completed 60% of tasks, which will still give you some valid data as prototype test tasks are scored individually.
To exclude participants, check the box next to their names and click “Exclude Selected Participants.” This moves them to the “Excluded from Results” table. We recommend reviewing this tab when analyzing your results to remove any participants as needed, ensuring cleaner data.
You can view metrics like time taken, task success rates, and skipped tasks. If you’re using our in-app recruitment service, flagged participants in the “Included” table indicate potential issues with how they completed the study.