Testing plan
What color will you use for correction?
we used green color for the correction.
• The goal of the test: what do you want to achieve?
-->After >After conduction the test, we wanted to know how successful New York Times reader is in satisfying reader's need is.
We wanted to test the the effectiveness of the navigation in New York Times and overall look and feel of the site.
Is New York Times reader fulfilling the requirements of irregular users?MB: so what are these requirements?
-->The requirements of the user visiting news site is to get latest update of the news. And if he is intrested to get some news then it doesnot matters if he is a regular or irregular for that time.
• Where and when will the test take place?
...
The testing will take place on the weekends.
--When and where was the test was executed?
-->The test was executed in Metropolia UAS,Palmia Cafeteria,Leppavaara.
• How long is each test session expected to take?
-->We expect that each section takes around 10 20 minutes.
MB: how can it be so fast? you need to intriduce a story why the user is using The reader, provide the tasks for the user and most likely have an briefing discussion fater wards...?We did the testing in 10 to 15 minutes.
• What computer support will be needed for the test?
...
Computer must be ready and software must be running before starting the test.
MB: then you cannot test one of the frustration parts you mentioned i.e., the problems with downloading the software...so you are not testing that part?Also we can test the web page in users computer and show them it is not so difficult to download software and use all the services in the page.
• What should the system/network load and What should the system/network load and response times be? (not too fast or too slow);
...
then the testing process would be unsuccessful. The users as well might be annoyed. If you use wane's cafe in Helsinki close to Anttila you should be aware that the net connection there is often very bad - so you have to take this into accoiunt in your testWe should check the bandwith of connection before we are starting testing.
• Who will serve as experimenters for the test?
...
We will conduct our test using around 10 users.For the pilot test you do not need 10 users, also his will take quite a while since the 10 min that yoiu described above is not accurate timing or fi you do thge test so fast you have problems in your test5 users because it will take like 20 minutes with one user so it is not possible for testing with more users.
• What test tasks will the users be asked to perform?
-->>First we will ask the user to find news of certain topics which is not in so easy spot to find and ask them to write their exprience in it.
For that we We prepared questionnaires and we want them to explain their experiences with the New York Times while they go through it using our computer. We will let them use our computer to write it down. We also make some interview and we want them to answer some questions and observe them too.The sample questions are as follows.
1.Do you like the color of the site?
Do you like the layout of the site?
What they didnot like about the site?
2.What difficulties do you get using new york times reader?
3.Do you like the arrangement of the content in the page e.g. sports,politics,entertainment etc?
Do you like the navigation in the page?
4.How many times a week do you read the papers ?
5.In what position do you keep the new york times reader among other papers (e.g. Helsinki Sanomat, iltalehti,ilta sanomata and Lansi Uuusima)?
6. Was it easy to do the task what we have asked you to do?
7. Is the site user friendly in your point of view?
Do you like the navigation,search engine in the site?
8. Is it easy to navigate?
Are there any broken linkswhen you navigate?
9.What are the things which you like and you don't like about the site?MB: I doid not understand: you have no specific tasks the user just browse and then fill in a questionnaire or they do some tasks that you desxibe to them and then answer some questions? Please be clearer and you have to add the questions here....
• What criteria will be used to determine when the users have finished each of the test tasks correctly?
-->
We can give them some instruction before they start. With the questions, we can give them appropriate instructions and inform us when they are done like in normal examinations in schools.
Unclear what are you meaning with the above>Actually we are focused on the time required for the users to find the specified news and the users exprience on finding the news. By which we will know that what improvements can be done to make it more user friendly.
• What user aids will be made available to the test users (manuals, online help, etc)?
...
Both manual and online help would be provided to the users. We are also there to help them in case the instruction is not clear enough.
• To what extend will the experimenter be allowed to help the users during the test?
-->
When the users are stuck in some cases using the software's and if they don't get the questions, we are there to help them. But we can't give them the answers.
MB: this frequent referring to the questions is very weird, I do not get at all what you are planning to do...?Since we are testing how easy is the webpage for the user to find the news of their interest? We are not helping the user but we are focused to get feedback about the page. So we help only if some application which are required to perform the task is not working.
• What data is going to be collected and how will it be analysed?
-->
The users experiences would be collected which means that we will give limits to the answers like level to which extend they like the site. Then we analyze the collected data them.
SO you only do a questionnaire for them?
...
>We will note the time required to find the news about the topic we have told them to find.
And experiences of the user would be collected.Then we will analyse the data and we will have the idea what should be improved.
1. Write into your task 2, i.e. your testing plan:
- When and where the test was executed
- What you have to correct in your testing plan. e.g., your task descriptions were not clear, your time estimation of how long the test takes was not correct, you did not have the right briefing questions, you did not get the information that you thought you would from the test.
- Then correct your plan (state what colour you will use for the corrections so that i find them)
- State when and where will the actual testing take place.