Skip to content

User Testing Results

gisellepastulero edited this page Oct 22, 2016 · 7 revisions

About

An initial user testing session was conducted with the team's first working prototype of the concept. There was a total of 5 users who were tested from the age range of under 18 to 25-year-olds. The results and findings from this user testing session will be outlined below: https://goo.gl/forms/mag3RY0BUSxE2Bnz2

Procedure

The testing was a physical testing session where the facilitator observes the user while they did the required tasks. The test had 2 phases, the user scenarios and the usability testing. The user scenarios had 5 tasks to be completed. The facilitator was not allowed to assist the user while they did the tasks as much a possible. After the user completed the tasks, the facilitator gave the users a short usability testing questionnaire where it was answered using a 5 point scale (strongly disagree -- strongly agree)

Section 1: User Scenarios

Source: https://www.nngroup.com/articles/task-scenarios-usability-testing/
Participants are to be observed by the facilitator. Facilitators should take note of the difficulties encountered by the users throughout the tasks

Scenario 1
User goal: Create a new playlist
Task: Create a new account and start a new session with breaking news, sports and science

Scenario 2
User goal: Add user stories into your playlist
Task: Edit the playlist that you made and add user stories into your playlist

Scenario 3
User goal: Explore the play and favourite buttons
Task: Play and favourite one of the videos in the playlist

Scenario 4
User goal: Get familiarised with the user profile page
Task: Restart the application, log on to your account and view your saved playlists

Scenario 5
User goal: Explore the user settings page
Task: Edit what news categories you prefer to see and sign out afterwards.

Section 2: Usability Testing

(Answered through a five-point response items (strongly disagree -- strongly agree)
Source: http://edutechwiki.unige.ch/en/Usability_and_user_experience_surveys

Please spend a few minutes browsing through the app before answering the following questions

  1. I think that I would like to use this system frequently
  2. I found the system unnecessarily complex
  3. I thought the system was easy to use
  4. I think that I would need the support of a technical person to be able to use this system
  5. I found the various functions in this system were well integrated
  6. I thought there was too much inconsistency in this system
  7. I would imagine that most people would learn to use this system very quickly
  8. I found the system very cumbersome to use
  9. I felt very confident using the system
  10. I needed to learn a lot of things before I could get going with this system

Purpose

Findings

User Scenarios

Task 1

  • Most users did not have any issues on completing this task. However, one user was unsure whether there was an option to create an account as the screen was slightly smaller when testing on the phone, meaning the register button was cut off.

Task 2

  • Extra instructions had to be given to the users as some of them did not realise that the 'View Playlist' lead to a page where you could edit the playlist.

Task 3

  • The participants easily completed this task

Task 4

  • A user was slightly confused at the wording of the button 'Your List', but clicked it anyway and found that they were in the right place
  • Some users was able to log in again easily and navigate to saved playlists

Task 5

  • The users could not edit the news categories in the current prototype as the prototype does not permit this but successfully logged out

Usability Testing

  1. I think that I would like to use this system frequently
  2. I found the system unnecessarily complex
  3. I thought the system was easy to use
  4. I think that I would need the support of a technical person to be able to use this system
  5. I found the various functions in this system were well integrated
  6. I thought there was too much inconsistency in this system
  7. I would imagine that most people would learn to use this system very quickly
  8. I found the system very cumbersome to use
  9. I felt very confident using the system
  10. I needed to learn a lot of things before I could get going with this system