You’ll have access to the 5 second test results as soon as it’s published and participants start taking part. Analysing the results involves looking at the responses you’ve been given and figuring out whether there are any patterns in what people think or noticed about the design.
Here’s a step-by-step guide on how to analyse your 5 second test results.
.
Step 1: find the test you want to analyse
From your personal dashboard, click on the settings menu of the test you want to analyse.
Select ‘View results’.
Step 2: examine the test overview
Under the ‘Overview’ tab, you’ll find a general summary of your test results, including information such as:
the total number of participants
the total number of participants from UserQ/shared link
a timeline results graph
a short summary of test details (number of tasks, introduction questions, conclusion questions).
Step 3. Examine participant data
If you’ve used the UserQ panel, under the ‘Participants’ tab, you’ll find information on who took part in your 5 second test test, including information such as:
gender
age
nationality and residency
current employment status (and industry, department)
household status and income
and more.
If you’ve used a shared link only, this section will be empty.
Step 4: review the responses
nder the ‘ 5 seconds test’ tab, you’ll find the answers and responses that were given to each follow-up question you asked.
The way you can examine and review the answers all depends on the type(s) of questions you’ve asked, including Free text, Single choice, Multiple-choice, Likert scale, Ranking scale, and Rating scale.
Here’s what data you’ll see for each type of question:
a. Free text
the total number of answers
the exact written answer that each individual participant input
the time spent answering the question, and the answer completion date.
b. Single-choice
the total number of answers (just beware that the number of answers given for a single question may vary from the total number of participants: some might skip a question or the use of logics can take them elsewhere)
a pie chart illustrating what proportion of participants answered with each answer choice (hover over each pie segment to see the exact number of participants)
aggregated data, including the total number of responses for each choice, % total, number of participants sourced from the UserQ panel, and number of unknown participants (from shared link)
by each individual user, including their unique answer, time spent answering the question, and the answer completion date.
Tip: you can hide an individual participant from your data. Click on the settings menu of the participant you want to hide and select ‘Hide participant’ then ‘Confirm’.
Just beware that hidden users are only invisible from a single question input. The single entry doesn’t get deleted.
Alternatively, you can report the participant by selecting ‘Report participant’. Let us know the reason (ie. use of offensive or vulgar language) and select ‘Report issue’. Once our support team reviews the report request, they will either issue a refund or contact you for further information.
c. Multi-choice
the total number of answers
a horizontal bar chart illustrating what proportion of participants selected each option (hover over each bar to see the exact number of votes)
aggregated data, including the total number of responses for each choice, % total, number of participants sourced from the UserQ panel, and number of unknown participants (from shared link)
by each individual user, including the answer(s) they selected, time spent answering the question, and the answer completion date.
d. Likert scale
the total number of answers
a chart illustrating the proportion of participants that voted for each rating (hover over each bar to see the exact number of participant – this applies for each statement which is shown in its own individual chart)
aggregated data, presented as a visual comparison between the different statements, including the % voted rating for each statement.
by each individual user, including the answer (s) they selected, time spent answering the statement, and the answer competition date.
e. Rating scale
the total number of answers
a chart illustrating the proportion of participants that voted for each rating (hover over each bar to see the exact number of participants)
f. Ranking scale
the total number of answers
overview of which answer(s) were ranked highest
a chart illustrating the scores each option received and the percentage it was ranked at each specified rank (#1, #2, and so on)
Think of the scores as weighted averages which represent the average ranking of each option. The option that’s ranked #1 the most will have the largest weighted score.
Build your 5 second test today
Are you ready to build your 5 second test? Join as a researcher and you’ll get the feedback you need in just minutes.