<!-- /* Font Definitions */ @font-face
@font-face
@font-face
@font-face
@font-face
/* Style Definitions */ p.MsoNormal, li.MsoNormal, div.MsoNormal
h2
h3
p
span.Heading2Char
span.Heading3Char
@page Section1
div.Section1
/* List Definitions */ @list l0
@list l0:level1
@list l1
@list l1:level1
@list l2
@list l2:level1
@list l3
@list l3:level1
@list l3:level2
@list l4
@list l4:level1
@list l4:level2
@list l5
@list l5:level1
@list l6
@list l6:level1
@list l7
@list l7:level1
@list l7:level2
@list l8
@list l8:level1
@list l9
@list l9:level1
@list l9:level2
@list l10
@list l10:level1
@list l11
@list l11:level1
ol
ul
-->
Title Page
Usability Report. |
New York Times Reader |
Due date of Report: |
15.12.2009 |
Actual submission date: |
15.12.2009 |
Revised version: |
15.12.2009 (final) |
Product name and version: |
New York times reader |
Organisers of the test: |
Kumud Sharma |
Date of the test: |
10.12.2009 |
Date of the report: |
15.12.2009 |
Editor: |
Dinesh Sapkota |
Contact name(s): |
Kumuds@metropolia.fi |
Executive summary
Name the product:The Name of the product is New York Times Reader.
Purpose/objectives of the test:The main objective of the test is to know the easiness using the navigations in the site.
Method 1:The method is to open the site and work on it.
Number and type of participants:The numbers of participants were 10 and the participants were students.
Results in main points
The main result of the test were:
1.The site is complex and includes so many matters.
2.There is not so easy navigation for small matters.If you want to get something like music, the tabs are smaller and its hard to focus when you are using it for the first time.
3.The site includes all the elements of the society.Thus there is some problems in arrangements of items.It can diminish the great outlook of the website.
Introduction
Full Product Description
Describe what parts of the product were evaluated
In the website,we evaluated the navigation system of the website http://www.nytimes.com/.
The user population for which the product is intended
The User population cant be estimated correctly because new york times is read by people all around the world.Everyday billions of people use new york times.So the user population is over billions.
- Brief description of the environment in which it should be used The Website is used in offices,school,houses,in restaurant and all those places which wants the latest world news.
Test Objectives
- State the objectives for the test and any areas of specific interest
The objective for the test was to get the information how the users feels about the website.How the users find it to use.Do they like the color of the site etc.The main object in the website is the navigation.If you click in some links in the site,it takes to another page.This is the navigation and signifies how effective the website is.
Reason for focusing on a product subset
The main reason is that navigation of the site gives how the site works.The color of the site gives how attractive is the site.
Method
Participants
The total number of participants tested was 10.The user group was student but with different feelings and choices.
- Key characteristics and capabilities of user group
The key characteristics of this user group is that they study much and all sectors of the website.Students need the information of all sector of the society.So they are creative,investigator and they are regular reader.They can read new york times many times a day.
- How participants were selected; whether they had the essential characteristics
The participants were selected from the library.But we did not select them with some special characteristics.They are just selected because they are reader.
- Differences between the participant sample and the user population
There are some differences between the participant sample and the user population. The sample is ideal but the user group can't be. The sample is the regular reader but our user population cant be regular reader always. User population gives the rough results of the success of New York Times. They can't be always correct but we take average result from the user population.
Context of Product Use in the Test
- Any known differences between the evaluated context and the expected context of use
There is not any known difference between the evaluated context and the expected context of the use because the site using is same process.open the browser and then go through it.
- Tasks
The main task of the user is to go through the navigation system of the site.How they find it,do they get it easier or difficult?
Explain why these tasks were selected
The task was selected to know more about the site.When the site is known more,then the problems and shortcoming of the site are well known.As per the website of new york times, we asked the users to test with the navigations and how well it goes to another page.When page opens,is it easier to find what is he looking for.If so,what problems did he noticed?These were some criteria for selecting the tasks.
-
- Describe the source of these tasks
The main source of these tasks is New York Times website http://www.nytimes.com/.
-
- Include any task data/information given to the participants
The participants were not given any data.They were only given the website and to go through the task.
-
- Completion or performance criteria established for each task
When the participants complete the task,then they say to us.This is the completion criteria.
Test Facility
Describe the setting, and type of space in which the evaluation was conducted
The test was performed in the café in the school.There were enough spaces to sit.We also performed test in the smoking area with some students.
Detail any relevant features or circumstances, which could affect the results
As the testing was outside the room,there were much noise which affected our testing process.Students were in hurry,not enough time was also another circumstance which affect the result.The test was not long so that it was well organised.So it was not boring to any participants.
Participant's Computing Environment
- Computer configuration, including model, OS version, settings
We had five computers for the participants.They first go through the site and then write what they feel about the site in the questionaire we provided.Three of the computers were acer and two of them were macbook pro.
- Browser name and version;
The browser we used were safari,mozilla firefox,opera etc.
- Relevant plug-in names and versions
The plugins were accepted in the browsers.Browsers don't respond if the plugins and pop ups are not accepted.The download helper was installed in the browsers.
Display Devices(report if relevant, e.g., Paper prototypes are tested or static prototypes are tested on screen)
- If screen-based, screen size, resolution, and colour setting
The prototypes were screen based.The screen size was 13 inches.The resolution was 60 % and the color was Lcd color.
Test Administrator Tools(report if relevant for the particular test)
- If a questionnaire was used, describe or specify it here (add these to appendix)
- The questionaire was used to collect the data.The paper was used and also online ways were used.When the user go through the sites,then they just write what they feel bad or good in the site in the word document.
- Describe any hardware or software used to control the test or to record data (audio, video)
We did not used any hardware tools.
Experimental Design
- Define independent variables and control variables
- Describe the measures for which data were recorded (the scale/scope of the recorded data, if relevant for the particular test, i.e., written notes, think aloud in audio recording, etc.).
Procedure
- Operational definitions of measures (e.g., how is it decided that that a task is completed)
- Policies and procedures for interaction between tester(s) and subjects (e.g., is the test conductor aloud to answer questions of the user, provide help, etc.)
- State used: non-disclosure agreements, form completion, warm-ups, pre-task training, and debriefing
- Specific steps followed to execute the test sessions and record data
- Number and roles of people who interacted with the participants during the test session
- Specify if other individuals were present in the test environment
- State whether participants were paid
Participant General Instructions (here or in Appendix)
- Instructions given to the participants
- Task instruction summary
- Usability Metrics (if used)
- Metrics for effectiveness
- Metrics for efficiency
- Metrics for satisfaction, etc.
Results
- Data Analysis
- Quantitative data analysis
- Qualitative data analysis
- Presentation of the Results
- From quantitative data analysis
- From qualitative data analysis (descriptive and clarifying presentation of the results)
Reliability and Validity
Reliability is the question of whether one would get the same result if the test were to be repeated.
This is hard to acquire in usability tests, but it can be reasoned how significant the findings are.
(Example from expert evaluation: This review was made by one reviewer in order to give quick feedback to the development team. To get more reliable results it would have been desirable to use three, or at least two reviewers, as it is often the case that different reviewers look at different things. We do feel, however, that for the purpose of this report, and the essence of quick feedback, one reviewer has given enough feedback to enhance the usability of the system.)
Validity is the question of whether the usability test measured what was thought it would measure, i.e., provide answers to. Typical validity problems involve: using the wrong users, giving them the wrong tasks.
(Example from expert evaluation: "The reviewer is an experienced usability professional that has evaluated systems for many years. We therefore feel that the method used as well as the tasks used give an appropriate view of how ordinary users would behave in the system.")
Summary Appendices
- Custom Questionnaires, (if used, e.g., in expert evaluation there is no participants)
- Participant General Instructions
- Participant Task Instructions, if tasks were used in the testLabels parameters