Planning Report
• The goal of the test: what do you want to achieve?
Study the following:
- ease of learning
- retention
- efficiency
- reliability
- interaction (between usr and the system)
- user satisfaction
- user convenience
- necessity for proficiency
- importance of accuracy
These criteria are good move them also to the task 1 - thats where they derived from right
• Where and when will the test take place?
Test will be take place at lab-room some time there is no class in session.
• How long is each test session expected to take?
20 minutes. This seems a bit under estimated usually the test take more time, consider that you have to wellcome the user, you might need to ask questions before the test and interview the user after the test......
• What computer support will be needed for the test?
No computer support will be need. If test is conducted on a OS that is not familiar with the test person, a briefing of the common features will be given and necessary programs will be started.
• What software needs to be ready for the test?
Web browser, word processor, text editor, program to open PDF-files.
• What should the state of the system be at the start of the test?
We will make a workspace in Tuubi to simulate a real course. User will start with Tuubi-login page.
• What should the system/network load and What should the system/network load and response times be? (not too fast or too slow);
• Who will serve as experimenters for the test?
• Who are the users going to be and how are we going to get hold of them?
• How many users are needed?
More than one person. Maybe several users together so they woudl interacti with each other.
• What test tasks will the users be asked to perform?
- Sees the courses
- Look for course description and open it if necessary.
- Can download documents (slides, tasks, materials) and open external links
- Open the lecture.doc file in Word.
- Can submit an assignment
- Receive feedback
- See events in the calendar
- Browse the members of group (like classmates)
- Have a discussion on the discussion board
You need to open these tasks, i.e., how will you prezsent them to the user. And you need some kind of scenario why the user is performing those taks so that it comes meaningful.
• What criteria will be used to determine when the users have finished each of the test tasks correctly?
Succesfull, fail, succesfull but user needs help, succesfull but addition from user
Yes, but what is succesful? In login it is getting into the Tuubi and seeing the "front page" of Tuubi, so the sucess criteria is needed here.
• What user aids will be made available to the test users (manuals, online help, etc)?
Help document of Tuubi (in Finnish). Are you sure you want totake this? Is it probabale that the yoru user segment would use the help document? of not do n ot allow it to be used in the test. If you allow you need to take into account the effect of using the manual in the test when you evaluate the results.
• To what extend will the experimenter be allowed to help the users during the test?
Translation help, help to set up the computer
• What data is going to be collected and how will it be analysed?
Notes
Its about finished, just some finetuning and you are ready for the pilot test!