Software Usability Assessment: Comparison of the Questionnaire Versus User Performance

Q: How can I download an article?

To download an article from SID, first log in to the site, search for the article title, and click on the 'Download Article' option.

Q: How can I download an ISI article?

To download an ISI article on SID, enter the keyword or article title in the search bar, view the relevant results, click on the desired article, and select the 'Download Article' option.

Q: How can I access the SID database?

To access the SID database, visit SID.ir, create an account, and log in to access scientific resources.

Q: Is downloading articles from SID free?

Some articles on SID are available for free, while others require payment. Details are specified on the article's page.

Mazani Fatemeh; Vafadar Shiva

مرکز اطلاعات علمی Scientific Information Database (SID) - Trusted Source for Research and Academic Resources

Journal Paper

Paper Information

Journal: Iranian Journal of Information Processing & Management Year:2019 | Volume:34 | Issue:4 Page(s): 1849-1878

Download Full-Text

Persian Verion

View:

450

Download:

Cites:

Information Journal Paper

Title

Software Usability Assessment: Comparison of the Questionnaire Versus User Performance

Author(s)

Mazani Fatemeh | Vafadar Shiva | Issue Writer Certificate

Keywords

Human-Computer InteractionQ1

UsabilityQ2

Empirical StudyQ1

Usage AnalysisQ2

QuestionnaireQ1

Abstract

is an important attribute for software quality that can play a significant role in improving user experience. Various methods have been proposed for evaluating the Usability of software systems. Selecting a proper method for collecting information and evaluating the Usability of a software application is a challenge due to the variety of methods, and consequently the time and cost required for their implementation. In this paper, ease of use is considered as a subset of Usability and it is defined as the user’ s effort to perform a task in the software application. We evaluate ease of use based on two methods; Questionnaire and users’ performance in an Empirical Study and compare the results of these two methods. In this way, two different versions of an online store application with similar functionalities are produced and the users are asked to perform specific operations in the application and then answer questions regarding the ease of use of various software functionalities. During the experience, the interactions between user and the software are logged and consequently the user’ s performance is measured based on the successful completion of the operation, the time of the task completion, the number of steps taken by the user, the number of errors, and the time taken to fix the error. These criteria have been selected based on observable criteria and ease of use measurement in relevant research. The results of this study is based on the data of 48 applicants except one of the functionalities which has been expanded to 70 applicants in order to achieve adequate level of confidence. Our results indicate that the evaluation of the Questionnaire does not correlate with the performance of users in the measured criteria. In some functions, the performance of the users in two versions of the application do not have a significant difference, but their views are significantly different in the Questionnaire. On the other hand, in some other functions, the performance of the users in two versions has a significant difference but the results of the Questionnaire does not show a significant difference. Verifying the performance of each user with the results of his/her Questionnaire does not indicate correlation between these two methods results. Also, according to the results of this study, the honesty of users in the Questionnaire evaluation can be questioned, since 80% of the users who have not performed a functionality rated it higher than good in the Questionnaire.

Cites

No record.

References

No record.

Cite

APA: Copy

Mazani, Fatemeh, & Vafadar, Shiva. (2019). Software Usability Assessment: Comparison of the Questionnaire Versus User Performance. IRANIAN JOURNAL OF INFORMATION PROCESSING & MANAGEMENT (INFORMATION SCIENCES AND TECHNOLOGY), 34(4 ), 1849-1878. SID. https://sid.ir/paper/131158/en

Vancouver: Copy

Mazani Fatemeh, Vafadar Shiva. Software Usability Assessment: Comparison of the Questionnaire Versus User Performance. IRANIAN JOURNAL OF INFORMATION PROCESSING & MANAGEMENT (INFORMATION SCIENCES AND TECHNOLOGY)[Internet]. 2019;34(4 ):1849-1878. Available from: https://sid.ir/paper/131158/en

IEEE: Copy

Fatemeh Mazani, and Shiva Vafadar, “Software Usability Assessment: Comparison of the Questionnaire Versus User Performance,” IRANIAN JOURNAL OF INFORMATION PROCESSING & MANAGEMENT (INFORMATION SCIENCES AND TECHNOLOGY), vol. 34, no. 4 , pp. 1849–1878, 2019, [Online]. Available: https://sid.ir/paper/131158/en

Related Journal Papers