Planning Report
• The goal of the test: what do you want to achieve?
Study the following:
- ease of learning
- retention
- efficiency
- reliability
- interaction (between usr and the system)
- user satisfaction
- user convenience
- necessity for proficiency
- importance of accuracy
These criteria are good move them also to the task 1 - thats where they derived from right
MB (19.11.2009) Good you moved them, now you have to select the main ones, you cannot test all of them, there is too much to test. So some of these are more relevant for users than the others.
• Where and when will the test take place?
Test will be take place at lab-room some time there is no class in session.
• How long is each test session expected to take?
60 minutes?
• What computer support will be needed for the test?
No computer support will be need. If test is conducted on a OS that is not familiar with the test person, a briefing of the common features will be given and necessary programs will be started.
• What software needs to be ready for the test?
Web browser, word processor, text editor, program to open PDF-files.
• What should the state of the system be at the start of the test?
We will make a workspace in Tuubi to simulate a real course. User will start with Tuubi-login page.
• What should the system/network load and What should the system/network load and response times be? (not too fast or too slow);
• Who will serve as experimenters for the test?
• Who are the users going to be and how are we going to get hold of them?
• How many users are needed?
More than one person. Maybe several users together so they woud interact with each other.
• What test tasks will the users be asked to perform?
- Subscribe to a Usability testing-workspace in Tuubi.
- Go to workspace Usability testing and read the description about the usability testing from the frontpage of workspace.
- Find and download file named Usability_document.doc and open it on the test computer.
- Open assignment "Usability testing 1" and do as you have been told in the assigment (in the assignment test person will be asked to upload a file from the desktop as submitting an assignment)
- Open assignment "Usability testing 2" and do as you have been told in the assigment (in the assignment test person will be asked to give feedback about the assignment as a text)
- Read feedback for the assigment
- Look up the date for the final assignment from calendar
- Show how to see the people who are described to the same workspace
- Reply to a message on the discussion board.
You need to open these tasks, i.e., how will you prezsent them to the user. And you need some kind of scenario why the user is performing those taks so that it comes meaningful.
• What criteria will be used to determine when the users have finished each of the test tasks correctly?
Succesfull, fail, succesfull but user needs help, succesfull but addition from user
Yes, but what is succesful? In login it is getting into the Tuubi and seeing the "front page" of Tuubi, so the sucess criteria is needed here.
• What user aids will be made available to the test users (manuals, online help, etc)?
Help document of Tuubi (in Finnish). Are you sure you want totake this? Is it probabale that the yoru user segment would use the help document? of not do n ot allow it to be used in the test. If you allow you need to take into account the effect of using the manual in the test when you evaluate the results.
• To what extend will the experimenter be allowed to help the users during the test?
Translation help, help to set up the computer
• What data is going to be collected and how will it be analysed?
Notes
Its about finished, just some finetuning and you are ready for the pilot test!