Page History

.{color}

h3.


h3. TASK 2


h2. Planning Report:


*• The goal of the test:* _to research usability aspects of WinhaWille student page,dentify problems and benefits: Since WihnaWille is strictly educational assistance tool, we will not be covering attractiveness and visualization of the application, we will concentrate on the following tasks:_

_\- to define if the structure of the menu is clear and the titles are understandable_

_\- do the users able to successfully complete the task_

_\- to detect if information represented is clear and understandable_

_\- to detect if data is reliable_ and accurant


_\- to identify the most relevant/important parts of application, as well as missing and unnecessary ones, usefull and not_


_\- to reveal general lareas for improvement_

*• Where and when will the test take place:*

_Metropolia University, Leppävaara unit_

*• How long is each test session expected to take:* _30-40 min per each user_

*• What computer support will be needed for the test:* _computer with active internet connection_

*• What software needs to be ready for the test:* _none_

*• What should the state of the system be at the start of the test:* _computer is on, browser is pointed to a home page, such as google, or metropolia_

*• What should the system/network load and response times be?* (not too fast or too slow); _good internet connection, response time less than 1 sec_.
*• Who will serve as experimenters for the test:* _Bella, Lilia and Recep_

*• Who are the users going to be and how are we going to get hold of them:* _users are Metropolia students, we will ask to participate in the experiment._

*• How many users are needed*: 10 \---?
*• What test tasks will the users be asked to perform:*

_\- to find link/to go to WinhaWille (to understand if user knows it by heart, or needs to first log in to metropolia/tuubi page)_

_\- to give an explaination of each submenu, what does each title means without browsing through it (to understand depth of knowledge of the application, to identify comprehension of submenu titles)_

 _\- to enroll to a study year_

_\- to find and enroll to courses_


_\- to check study progress_

_\- to show the most common area of usage_

_\- to show the less common area of usage_

_\- to give a feedback on improvement_

*• What criteria will be used to determine when the users have finished each of the test tasks correctly:*{_}mistake absence, quick actions, correct answers_

*• What user aids will be made available to the test users (manuals, online help, etc):* _no help_

*•* *To what extend will the experimenter be allowed to help the users during the test:* _at a very minimum level_

*• What data is going to be collected and how will it be analysed:*

_DATA:_

_\- Talk alowd_ _records: to gather immediate feedback on interacting with the system_


_\- Interview or questionnaire results_

_\- Observation: to collect verbal and nonverbal reactions (interjections, gestures, facial expression and etc) will be used as an addition to main research_

METHODS:

_analyzing quatitive data:_


_\- calculation of_ _frequency of successful performance_

_\- time to complete the task_

_analyzing qualititive data:_

_\- interview interpretation_

_\- questionnare analysis_


_\- heuretical analysis_

h2. Task 3 - Pilot Test

<!--  /* Font Definitions */  @font-face 	{font-family:Wingdings; 	panose-1:5 0 0 0 0 0 0 0 0 0; 	mso-font-charset:2; 	mso-generic-font-family:auto; 	mso-font-pitch:variable; 	mso-font-signature:0 268435456 0 0 -2147483648 0;} @font-face 	{font-family:Times; 	panose-1:2 2 6 3 5 4 5 2 3 4; 	mso-font-charset:0; 	mso-generic-font-family:roman; 	mso-font-pitch:variable; 	mso-font-signature:536902279 -2147483648 8 0 511 0;}  /* Style Definitions */  p.MsoNormal, li.MsoNormal, div.MsoNormal 	{mso-style-parent:""; 	margin:0cm; 	margin-bottom:.0001pt; 	mso-pagination:widow-orphan; 	font-size:12.0pt; 	mso-bidi-font-size:10.0pt; 	font-family:Times; 	mso-fareast-font-family:Times; 	mso-bidi-font-family:"Times New Roman"; 	mso-ansi-language:EN-US;} @page Section1 	{size:612.0pt 792.0pt; 	margin:72.0pt 90.0pt 72.0pt 90.0pt; 	mso-header-margin:35.4pt; 	mso-footer-margin:35.4pt; 	mso-paper-source:0;} div.Section1 	{page:Section1;}  /* List Definitions */  @list l0 	{mso-list-id:1166238768; 	mso-list-template-ids:325346742;} @list l0:level1 	{mso-level-number-format:bullet; 	mso-level-text:; 	mso-level-tab-stop:36.0pt; 	mso-level-number-position:left; 	text-indent:-18.0pt; 	mso-ansi-font-size:10.0pt; 	font-family:Symbol;} ol 	{margin-bottom:0cm;} ul 	{margin-bottom:0cm;} -->

1. Write into your task 2, i.e. your testing plan:
* *When and      where the test was executed*

The pilot test took place on 3.12.2009 in Metropolia UAS, Leppävaara unit on the lab hour of "Usability and Interface Design" lesson. Therefore, other students were also present in the same classroom, but they were all doing their own tasks and the pilot tested user seemed to be fine with the surrounding environment. Pilot test team included an interviewer who interacted with the tested user, asked questions and took some notes, and a note-taker, who recorded mostly everything that the user and the interviewer were saying.
* *What you have      to correct in your testing plan. e.g., your task descriptions were not      clear, your time estimation of how long the test takes was not correct,      you did not have the right debriefing questions, you did not get the      information that you thought you would from the test.*

We came to conclusion that we have to modify our questions, in a way that they would be more understandable to the tested users, because the interviewer usually needed to explain in further details what the question was about.

The time of pilot test was the same that we expected.

We did get the information that we assumed on receiving when designing the pilot test.

 
* *Then correct      your plan (state what colour you will use for the corrections so that i      find them)*

Find below the pilot test notes with the corrections highlighted in red
* *State when      and where will the actual testing take place.*

We have scheduled to start with the actual testing on Monday (13.30 to 15 o'clock), in the same building of Metropolia UAS, Leppävaara. We are planning to choose our test users in a random order, but we need to ask them first if they belong to the representative group of the users we have chosen.

 

 

{color:red}{*}{+}Notes on the pilot test, should be combined with the questionnaire and interviewer's notes{+}{*}{color}

*{+}User Code:\_ \__\_+*

*{+}WinhaWille Usability Test{+}*

*User details:*

*Program Degree:*&nbsp; \________________________\_

*How many academic terms you have been present at school*\______________\_

*Have you been on Orientation days*\________\_

*How well are you familiar with Study Plan?*

*Perfect*

*Very Good*

*Satisfactory*

*Poor*

{color:red}{*}We have found out that the multiple question options were not enough, and as a result decided to add one more option "Good" to it.*{color}

 

{color:red}{*}Have you had previous experience of working with Winha Wille in other schools, institutions of higher education, etc?*{color}

 

*Please access WinhaWille page*

&nbsp;I suppose I have to log into tuubi

&nbsp;the user is fluent in getting the access, takes less than 15 seconds (starting from opening the browser window)

{color:red}{*}It became clear that all the questions needed some tailoring, because the interviewer usually asked a longer question than it was written (studying the pilot user's reactions)*{color}

 

*What do the links represent?*

*Please give an explanation of each submenu, what does each title means without clicking on it.*

*Browse through the following and give explanation of each option*

*had to explain question more*

*ISP:*

*ISP contents:*

*&nbsp;*

{color:red}{*}Do you know what all these parts mean?*{color}

{color:red}*&nbsp;*{color}

{color:red}{*}{_}study time{_}{*}{color}{color:red}*\-*{color} {color:red}{*}{_}date{_}{*}{color}

{color:red}{*}{_}Pgrm resposible{_}{*}{color}

{color:red}{*}{_}choose language{_}{*}{color}

{color:red}{*}{_}study method{_}{*}{color}

{color:red}{*}{_}by name, by date{_}{*}{color}

*&nbsp;*

*Implementation:*

*&nbsp;*{*}Exam:*

*&nbsp;**\- to check study progress*

*&nbsp;*

*Would you show the most common area of usage?*

*_&nbsp;_*

*Would you show the less common area of usage?*

_&nbsp;_

_User code:______\__

_Questionnaire:_

{color:red}{*}Suggestions on the questionnaire were to make lines longer, leave more space for the tested user to write on.*{color}

 

How often do you use WinhaWille? \________________________________________________\_

In the beginning was it easy to learn how to use the system? \_____________________________________________________________________________\_

Did anyone teach you how to use the system? \_______________If yes, who \________________\_

Do you find it is easy to use? \_____________________________________________________________________________\_

If no, why \____________________________________________________________________\_

What kind of problems previously did you have while using WinhaWille? \_____________________________________________________________________________\_

\_____________________________________________________________________________\_

\_____________________________________________________________________________\_

Is the layout of the system is clear and understandable?&nbsp; If not, specify

Menu structure and navigation \_____________________________________________________________________________\_

\_____________________________________________________________________________\_

Menu items and definitions: \_____________________________________________________________________________\_

\_____________________________________________________________________________\_

Did you have problem with data accuracy: wrong credits published, wrong registration, insufficient course description: \_______________________________________________________________\_

\_______________________________________________________________________________\_

Would you recommend any improvements, regarding problems you have mentioned or other? \_______________________________________________________________________________\_

\__________________________________________________________________________________\_

What kind of irritating things you find in WinhaWille? \_______________________________________________________________________________\_

\__________________________________________________________________________________\_

Have you ever been using Help page on WinhaWille?&nbsp; Any comments: \__________________________________________________________________________________\_

 

 

 

 

h2.