...
- ease of learning
- retention
- efficiency
- reliability
- interaction (between usr and the system)
- user satisfaction
- user convenience
- necessity for proficiency
- importance of accuracy
These criteria are good move them also to the task 1 - thats where they derived from right
MB (19.11.2009) Good you moved them, now you have to select the main ones, you cannot test all of them, there is too much to test. So some of these are more relevant for users than the others.
• Where and when will the test take place?
...
- Subscribe to Usability testing-workspace in Tuubi. (User has the workspace on his/her General-workpsaces)
- Go to workspace Usability testing and read the description about the usability testing from the frontpage of workspace. (User finds and can open the description)
- Find and download file named Usability_document.doc and open it on the test computer. (user is reading the content of the file on the computer)
- Open assignment "Usability testing 1" and do as you have been told in the assigment (in the assignment test person will be asked to upload a file from the desktop as submitting an assignment) (user has given his/her answer by submitting a file)
- Open assignment "Usability testing 2" and do as you have been told in the assigment (in the assignment test person will be asked to give feedback about the assignment as a text) (user has given his/her answer by submitting text)
- Read feedback for the assigment (user sees the grade and comment on his/her assignment)
- Look up the date for the final assignment from calendar (can see the final assignment on the calendar)
- Show how to see the people who are described to the same workspace (can see other members of this worspace)
- Reply to a message on the discussion board. (There is a reply from user to Test-message)
- Subscribe to Random-workspace in Tuubi. (User has the workspace on his/her General-workpsaces)This is to test the retention.
You need to open these tasks, i.e., how will you prezsent them to the user. And you need some kind of scenario why the user is performing those taks so that it comes meaningful.
• What criteria will be used to determine when the users have finished each of the test tasks correctly?
Criteria can be found within the tasks.
Yes, but what is succesful? In login it is getting into the Tuubi and seeing the "front page" of Tuubi, so the sucess criteria is needed here.
• What user aids will be made available to the test users (manuals, online help, etc)?
We will explain that we are not interested in the user manual/documentation.
Help document of Tuubi (in Finnish). Are you sure you want totake this? Is it probabale that the yoru user segment would use the help document? of not do n ot allow it to be used in the test. If you allow you need to take into account the effect of using the manual in the test when you evaluate the results.
• To what extend will the experimenter be allowed to help the users during the test?
Translation help, help to set up the computer.
• What data is going to be collected and how will it be analysed?
Notes with timing.
Its about finished, just some finetuning and you are ready for the pilot test!