Lilia:Bella and Recep, i have wrote below some ideas for Planning Report, suggestions are more than welcome.
TASK 2
Planning Report:
• The goal of the test
...
The main goal is to know how Winhaville is used and if it is efficient for each users.•
: to research usability aspects of WinhaWille student page,dentify problems and benefits: Since WihnaWille is strictly educational assistance tool, we will not be covering attractiveness and visualization of the application, we will concentrate on the following tasks:
- to define if the structure of the menu is clear and the titles are understandable
- do the users able to successfully complete the task
- to detect if information represented is clear and understandable
- to detect if data is reliable and accurant
- to identify the most relevant/important parts of application, as well as missing and unnecessary ones, usefull and not
- to reveal general lareas for improvement
• Where and when will the test take place
...
The test would be take place in the same courses with own lesson's mate.•
:
Metropolia University, Leppävaara unit
• How long is each test session expected to take
...
The test would be take approximately 5 mn for each session•
: 30-40 min per each user
• What
...
computer support will be needed for the test
...
We can used all the computer which have : computer with active internet connection
• What software needs to be ready for the test
...
We need an internet browser,like internet explorer,mozilla,or safari...•
: none
• What should the state of the system be at the start of the test
...
the login page have to poster•
...
: computer is on, browser is pointed to a home page, such as google, or metropolia
We need a correct connection, not so important, but enough for not lose patience.•
• What should the system/network load and response times be? (not too fast or too slow);
...
good internet connection, response time less than 1 sec.
• Who will serve as experimenters for the test
...
We think speacially student•
: Bella, Lilia and Recep
• Who are the users going to be and how are we going to get hold of them
...
: users are Metropolia students, we will ask to participate in the experiment.
•
course mate, with not worries, just asking, they do the same,and we could help them after•
How many users are needed: 10 ---?
I think maximum 5,it's enough• What test tasks will the users be asked to perform
...
:
- to find link/to go to WinhaWille (to understand if user knows it by heart, or needs to first log in to metropolia/tuubi page)
- to give an explaination of each submenu, what does each title means without browsing through it (to understand depth of knowledge of the application, to identify comprehension of submenu titles)
- to enroll to a study year
- to find and enroll to courses
- to check study progress
- to show the most common area of usage
- to show the less common area of usage
- to give a feedback on improvement
• What criteria will be used to determine when the users have finished each of the test tasks correctly
...
:mistake absence, quick actions, correct answers
• What user aids will be made available to the test users (manuals, online help, etc)
...
: no help
• To what extend will the experimenter be allowed to help the users during the test
...
: at a very minimum level
• What data is going to be collected and how will it be analysed:
DATA:
- Talk alowd records: to gather immediate feedback on interacting with the system
- Interview or questionnaire results
- Observation: to collect verbal and nonverbal reactions (interjections, gestures, facial expression and etc) will be used as an addition to main research
METHODS:
analyzing quatitive data:
- calculation of frequency of successful performance
- time to complete the task
analyzing qualititive data:
- interview interpretation
- questionnare analysis
- heuretical analysis
Task 3 - Pilot Test
- When and where the test was executed
The pilot test took place on 3.12.2009 in Metropolia UAS, Leppävaara unit on the lab hour of "Usability and Interface Design" lesson. Therefore, other students were also present in the same classroom, but they were all doing their own tasks and the pilot tested user seemed to be fine with the surrounding environment. Pilot test team included an interviewer who interacted with the tested user, asked questions and took some notes, and a note-taker, who recorded mostly everything that the user and the interviewer were saying.
- What you have to correct in your testing plan. e.g., your task descriptions were not clear, your time estimation of how long the test takes was not correct, you did not have the right debriefing questions, you did not get the information that you thought you would from the test.
We came to conclusion that we have to modify our questions, in a way that they would be more understandable to the tested users, because the interviewer usually needed to explain in further details what the question was about.
The time of pilot test was the same that we expected.
We did get the information that we assumed on receiving when designing the pilot test.
- Then correct your plan (state what colour you will use for the corrections so that i find them)
Find below the pilot test notes with the corrections highlighted in red
- State when and where will the actual testing take place.
We have scheduled to start with the actual testing on Monday (13.30 to 15 o'clock), in the same building of Metropolia UAS, Leppävaara. We are planning to choose our test users in a random order, but we need to ask them first if they belong to the representative group of the users we have chosen.
User Code:_ ___
WinhaWille Usability Test
User details:
Program Degree: _________________________
How many academic terms you have been present at school_______________
Have you been on Orientation days_________
How well are you familiar with Study Plan?
Perfect
Very Good
Good
Satisfactory
Poor
We have found out that the multiple question options were not enough, and as a result decided to add one more option "Good" to it.
Additional question: Have you had previous experience of working with Winha Wille in other schools, institutions of higher education, etc?
Please access WinhaWille page
It became clear that all the questions needed further explanation, because the interviewer usually asked a longer question than it was written (studying the pilot user's reactions)
What do the links represent?
Please give an explanation of each submenu, what does each title means without clicking on it.
Browse through the following and give explanation of each option
had to explain question more
ISP:
ISP contents:
Additional question: Do you know what all these parts mean?
study time- date
Pgrm resposible
choose language
study method
by name, by date
Implementation:
Exam:
- to check study progress
Would you show the most common area of usage?
Would you show the less common area of usage?
User code:_____
Questionnaire:
Suggestion on the questionnaire was to make lines longer, leave more space for the tested user to write on.
How often do you use WinhaWille? for example, once a week, a month, etc. _________________________________________________
In the beginning was it easy to learn how to use the system? ______________________________________________________________________________
Did anyone teach you how to use the system? ______________If yes, who ________________
Do you find it is easy to use? ______________________________________________________________________________
If no, why _____________________________________________________________________
What kind of problems previously did you have while using WinhaWille? ______________________________________________________________________________
______________________________________________________________________________
______________________________________________________________________________
Is the layout of the system is clear and understandable? If not, specify
Menu structure and navigation ______________________________________________________________________________
______________________________________________________________________________
Menu items and definitions: ______________________________________________________________________________
______________________________________________________________________________
Did you have problem with data accuracy: wrong credits published, wrong registration, insufficient course description: ________________________________________________________________
________________________________________________________________________________
Would you recommend any improvements, regarding problems you have mentioned or other? ________________________________________________________________________________
___________________________________________________________________________________
What kind of irritating things you find in WinhaWille? ________________________________________________________________________________
___________________________________________________________________________________
Have you ever been using Help page on WinhaWille? Any comments: ___________________________________________________________________________________