...
- Language issue. Even though I log in with English, Some data (like ISP contents) is still in Finnish. When I change the language, it logs me out automatically and only when I log in again then is a change of language. Irritating "15 minutes" logout issue. I have to find link all over agin after it
- Translation of interface is not complete. Sometimes I get stuck with Finnish
Navigation issuses (quotations from users):
- I had to cick blindly because almost all link names mean nothing to me
- the names are not self explantory, i very rarely use the system , always forget under what link i find what.
- WinhaWille should be Changed. It screwed up my ISP, because I was always lost what to do and when to click "register"
- Winha is diffcult to use and does not provide much information about courses.
Introduction
...
- Any known differences between the evaluated context and the expected context of use
- There is no big difference between our experctations and the reality, since we also feel what respondents feel.
- Tasks
- getting student data
- changing address
- check the confirmed participation
- check the completed courses
- check the study guide line
- checking the courses offered for the department
- enrolling for the courses that are offered
- changing the data language
- checking the enrollment status(season)
- Describe the task scenarios for testing
- Explain why these tasks were selected
- Because they are the basic and most common tasks to be done in the system.
- Describe the source of these tasks
- From our own experience
- Include any task data/information given to the participants
- We provided questionnaire
- Completion or performance criteria established for each task
- The respondants were expected to answer YES , NO and YES WITH DIFFICULTIES, inaddition they are provided spaces to include thier personal opinions
- Explain why these tasks were selected
...
Display Devices (report if relevant, e.g., Paper prototypes are tested or static prototypes are tested on screen)
...
Not applicable to this test, the used sustem was the system in real use.
Test Administrator Tools (report if relevant for the particular test)
...
- Define independent variables and control variables: Not applicable to this test
- Describe the measures for which data were recorded (the scale/scope of the recorded data, if relevant for the particular test, i.e., written notes, think aloud in audio recording, etc.). Analysing the written answers in qualitative manner and counting some percentages on the answers.
Procedure
- Operational definitions of measures (e.g., how is it decided that that a task is completed)** When the questionnaire is filled.
- Policies and procedures for interaction between tester(s) and subjects (e.g., is the test conductor aloud to answer questions of the user, provide help, etc.)** Just provide the questionnaire and wait for the answers(no help was provided in answering the questions).
- State used: non-disclosure agreements, form completion, warm-ups, pre-task training, and debriefing
- none of the above
- Specific steps followed to execute the test sessions and record data
- questionnaire was given and collected after finnishing.
- Number and roles of people who interacted with the participants during the test session
- 4 of us
- Specify if other individuals were present in the test environment
- No
- State whether participants were paid
- No
...
- Data Analysis
- We have Attached the xls file UserTest(results).xls, about the result analysis
- Quantitative data analysis
- We have Attached the xls fileUserTest(results).xls, about the result analysis
- Qualitative data analysis
- We have done the analysis based on the answers given by the respondents,hope it reflects the real feel of the respondents.
- Presentation of the Results
- From quantitative data analysis
- From the number of answers given by our respodents we have analysed the the users are not verymuch satisfied and the system is not logically desined, the language aspect also a bit clumsy.
- From qualitative data analysis (descriptive and clarifying presentation of the results)
- From the Users point of view the answers given are generally valuable and really acceptedand it impplies there is magor major task is to be on place for school.
- From quantitative data analysis
...