Assessing the Usability of a Comprehensive Research Management System: A Mixed-Use Study in Iran
محورهای موضوعی : Expert Systems
Mehdi Beyramijam
1
,
Mohammad Sadegh Sohrabi
2
,
Mohammad Babamiri
3
,
Arezo Farhadi
4
1 - Department of Health in Emergency and Disaster, School of Public Health, University of Medical Sciences, Hamadan, Iran.
2 - Occupational Health and Safety Research Center, Institute of Health Sciences and Technology, Hamadan University of Medical Sciences, Hamadan, Iran.
3 - Department of Ergonomics, School of Public Health, Research Center for Health Sciences, Institute of Health Sciences and Technology, Hamadan University of Medical Sciences, Hamadan, Iran.
4 - Department of Medical Library and Information Science, School of Health Management and Information Sciences, Iran University of Medical Sciences, Tehran, Iran.
کلید واژه: Ergonomics, Research Management System, User-Computer Interface, Usability,
چکیده مقاله :
Usability is a key dimension of the quality of research information systems. This study aimed to examine the usability of the “Pazhuheshyar” research affairs management system and explore users’ experiences and challenges when interacting with it across several medical universities in Iran. A convergent parallel mixed‑methods design was employed. In the quantitative phase, 169 users (76 men and 93 women) completed a questionnaire evaluating the usability of web‑based software, and independent t‑tests were used to examine differences by gender and user role. In the qualitative phase, 16 semi‑structured interviews were conducted using purposive sampling and analyzed through content analysis. The mean Relative Usability score was 33.19%, indicating a low to moderate level of usability. The lowest subscale score was related to Ease of Use (23.82%), while the highest score was observed for Content/Output Quality (42.40%). Women reported higher usability scores than men across most domains, although no significant differences were found for System Terminology and Information and System Capabilities. Similarly, officers and managers reported higher scores than researchers on most scales, with no significant differences in System Terminology and Information, Personalization, and Error Management. Qualitative analysis identified five main categories: complex navigation pathways and similar menu options; system errors and data storage problems; insufficient training and user support; strengths related to documentation and national system integration; and suggested improvements such as simplifying processes, redesigning search and reporting functions, providing personalized dashboards, and developing a mobile version. Despite strengths in documentation and integration, limitations in ease of use and learnability appear to hinder optimal efficiency and user satisfaction. Implementing user‑centered workflow redesign, improving error handling and feedback mechanisms, providing structured training, and continuously monitoring user experience may enhance system adoption, user satisfaction, and productivity.
Usability is a key dimension of the quality of research information systems. This study aimed to examine the usability of the “Pazhuheshyar” research affairs management system and explore users’ experiences and challenges when interacting with it across several medical universities in Iran. A convergent parallel mixed‑methods design was employed. In the quantitative phase, 169 users (76 men and 93 women) completed a questionnaire evaluating the usability of web‑based software, and independent t‑tests were used to examine differences by gender and user role. In the qualitative phase, 16 semi‑structured interviews were conducted using purposive sampling and analyzed through content analysis. The mean Relative Usability score was 33.19%, indicating a low to moderate level of usability. The lowest subscale score was related to Ease of Use (23.82%), while the highest score was observed for Content/Output Quality (42.40%). Women reported higher usability scores than men across most domains, although no significant differences were found for System Terminology and Information and System Capabilities. Similarly, officers and managers reported higher scores than researchers on most scales, with no significant differences in System Terminology and Information, Personalization, and Error Management. Qualitative analysis identified five main categories: complex navigation pathways and similar menu options; system errors and data storage problems; insufficient training and user support; strengths related to documentation and national system integration; and suggested improvements such as simplifying processes, redesigning search and reporting functions, providing personalized dashboards, and developing a mobile version. Despite strengths in documentation and integration, limitations in ease of use and learnability appear to hinder optimal efficiency and user satisfaction. Implementing user‑centered workflow redesign, improving error handling and feedback mechanisms, providing structured training, and continuously monitoring user experience may enhance system adoption, user satisfaction, and productivity.
[1] ISO 9241-11:2018. Ergonomics of human-system interaction – Part 11: Usability: Definitions and concepts, International Organization for Standardization, 2018.
[2] P. W. Jordan, B. Thomas, I. L. McClelland, and B. Weerdmeester, Usability Evaluation in Industry. Taylor & Francis, 1996.
[3] M. M. Yusof, J. Kuljis, A. Papazafeiropoulou, and L. K. Stergioulas, "An evaluation framework for Health Information Systems: human, organization and technology-fit factors (HOT-fit)," (in eng), Int J Med Inform, vol. 77, no. 6, pp. 386-98, Jun 2008.
[4] P. J, I. Pendidikan, Lisnawita, and C. Loneli, "Exploring Research and Service Information System Usability by Heuristic Evaluation as a Compelement of System Usability Scale," presented at the Jurnal Penelitian Pendidikan IPA, 2023.
[5] P. Edilson, M. Érica, V. José, M. Cristiano, and T. Daniela, "Avaliação da Usabilidade do Sistema de Informação e Gestão de Projetos (SIGProj) e da Aceitação de uma Proposta na Extensão Universitária," Anais do Computer on the Beach, vol. 14, pp. 272-279, 2023.
[6] S. C et al., "Empowering Researchers to Query Medical Data and Biospecimens by Ensuring Appropriate Usability of a Feasibility Tool: Evaluation Study," JMIR Human Factors, vol. 19, no. 10, p. e43782, 2022.
[7] A. M. S. Mohd, S. Ali, N. S. A. Mohd, and H. Hasrul, "The Importance of Usability Features in Enhancing Online Communication Satisfaction," Malaysian Journal of Communication, vol. 32, no. 1, pp. 1-15, 2016.
[8] K. Qureshi, Alhajri, Hessah , El-barr, Mostafa Abd, "Design and Analysis of a Secure Intelligent Blood Management Information System," Journal of Information Systems and Telecommunication (JIST), vol. 12, no. 48, pp. 300-312, 2025.
[9] S. Etemadinezhad, E. Amouzadeh, and J. Charati, "Investigating the Usability of the Integrated Research Automation System (SYAT): A Heuristic Evaluation," Iranian Journal of Ergonomics, vol. 10, no. 1, pp. 46-55, 2023.
[10] F. Bahador, F. Salehi, E. Esmaeeli, A. Akbari, and A. Sabahi, "Evaluation the Usability of Hamava System Using Heuristic Evaluation," Frontiers in Health Informatics, vol. 9, no. 12, pp. 11045–11052, 2023.
[11] G.-P. Patricio, F.-P. Félix, and U.-U. Pilar, "Hybrid Procedure for Measuring Usability of Management Systems in Higher Education," Iberian Conference on Information Systems and Technologies, 2019.
[12] M. D. E. Fernanda, E. Leandro, and P. B. Denise, "Usability of the “Systematic Review Support” computer system: a methodological study," Revista Latino-Americana de Enfermagem, 2024.
[13] J. Nikokaran, S. A. Fatemi Aghda, H. Dehghan, M. Mirfakhraei, M. M. Poornematy, and M. Mirfakhraei, "Usability Evaluation of the Ministry of Health Exam System: Viewpoint the Users," (in eng), Journal of Health and Biomedical Informatics, Original Article vol. 11, no. 3, pp. 176-185, 2024.
[14] R. Kazemi, Z. Rasouli kahaki, and A. S. Jafari Roodbandi, "The relationship between the usability of research centers system and mental workload caused by its interaction with users of shiraz university of medical sciences," (in eng), Iran Occupational Health Journal, Research vol. 18, no. 1, pp. 274-284, 2021.
[15] J. Faradmal and J. Keshvari Kamran, "The validity and reliability of an usability assessment tool for a web-based software," (in eng), Iranian Journal of Ergonomics, Research vol. 2, no. 3, pp. 57-69, 2014.
[16] S. Etemadinezhad, E. Amouzadeh, and J. Yazdani Charati, "Investigating the Usability of the Integrated Research Automation System (SYAT): A Heuristic Evaluation," Iranian Journal of Ergonomics, vol. 10, no. 1, pp. 46-55, 2022.
[17] A. Bangor, P. T. Kortum, and J. T. Miller, "An Empirical Evaluation of the System Usability Scale," International Journal of Human–Computer Interaction, vol. 24, no. 6, pp. 574-594, 2008.
[18] I. Dianat, Z. Ghanbari, and M. AsghariJafarabadi, "Psychometric properties of the persian language version of the system usability scale,", Health Promot Perspect, vol. 4, no. 1, pp. 82-9, 2014.
[19] U. H. Graneheim and B. Lundman, "Qualitative content analysis in nursing research: concepts, procedures and measures to achieve trustworthiness," (in eng), Nurse Educ Today, vol. 24, no. 2, pp. 105-12, Feb 2004.
[20] D. dmp, Mahjur, Ali, "Concatenating Approach: Improving the Performance of Data Structure Implementation," Journal of Information Systems and Telecommunication (JIST), vol. 6, no. 21, pp. 18-24, 2018.
[21] M. Beyramijam, M. S. Sohrabi, M. Babamiri, and A. Farhadi, "Usability of Research and Educational Systems: A Policy Brief,", Iranian Journal of Ergonomics, vol. 13, no. 4, 2026.
[22] H. hamidi, "Selecting Enterprise Resource Planning System Using Fuzzy Analytic Hierarchy Process Approach," Journal of Information Systems and Telecommunication (JIST), vol. 3, no. 12, pp. 1-10, 2015.
