Uncovering User Experience Evaluation in Nursing-English Several platforms Through SUS and PSSUQ

Yeyep Natrio
Rio Andika Malik - [ https://orcid.org/0000-0003-3556-9769 ]
Rinawati Kasrin


DOI: https://doi.org/10.29100/jipi.v9i4.6780

Abstract


The demand for English-proficient nurses in global healthcare settings has led to the development of multiple Nursing-English learning platforms. However, the user experience (UX) of these platforms significantly impacts their effectiveness in language learning. This study aims to evaluate the UX of several Nursing-English platforms using two established usability measurement tools: the System Usability Scale (SUS) and the Post-Study System Usability Questionnaire (PSSUQ). The primary objective is to uncover usability strengths and weaknesses across different platforms to improve the learning experience for nursing students. The research adopts a mixed-methods design, combining quantitative and qualitative data collection. A total of 109 nursing students from various universities in Sumatra, Indonesia, participated in this study. They were asked to use the Nursing-English platforms and evaluate them based on ease of use, system functionality, and information quality. The SUS provided an overall usability score for each platform, while the PSSUQ offered a more detailed breakdown across system usefulness, information quality, and interface quality. Results revealed an average SUS score of 84.85 across platforms, indicating a high level of user satisfaction. The PSSUQ scores corroborated these findings, with system usefulness and interface quality receiving the highest evaluations. The interactive content and relevance to nursing-specific language were highlighted as strengths, while areas for improvement included navigation and personalization features. Nursing-English platforms offer a generally positive user experience, with opportunities for optimization in user interface and learning customization. This study provides practical insights for enhancing Nursing-English learning tools to support students in preparing for global nursing careers.

Keywords


Digital Learning Platform; PSSUQ; System Usability Scale (SUS); Ui/UX; Usability Evaluation.

Full Text:

PDF

Article Metrics :

References


S. H. Bae, “Comprehensive assessment of factors contributing to the actual turnover of newly licensed registered nurses working in acute care hospitals: a systematic review,” BMC Nurs., vol. 22, no. 1, pp. 1–19, 2023, doi: 10.1186/s12912-023-01190-3.

E. Mukurunge, C. N. Nyoni, and L. Hugo, “Assessment approaches in undergraduate health professions education: towards the development of feasible assessment approaches for low-resource settings,” BMC Med. Educ., vol. 24, no. 1, pp. 1–11, 2024, doi: 10.1186/s12909-024-05264-x.

J. Z. Muyselaar-Jellema and S. J. Querido, “Twelve tips for having more meaningful conversations with medical students on specialty career choice,” Med. Teach., vol. 46, no. 5, pp. 617–620, 2024, doi: 10.1080/0142159x.2023.2280114.

L. N. B. Minh, “Strategic Integration of Technology to Foster Students’ Learning Outcomes and Motivation in Legal English Lessons,” Stud. English Lang. Educ., vol. 11, no. 2, pp. 957–975, 2024, doi: 10.24815/siele.v11i2.34885.

D. E. Tyndall, E. S. Scott, L. R. Jones, and K. J. Cook, “Changing new graduate nurse profiles and retention recommendations for nurse leaders,” J. Nurs. Adm., vol. 49, no. 2, pp. 93–98, 2019, doi: 10.1097/NNA.0000000000000716.

N. N. Padmadewi, L. P. Artini, N. M. Ratminingsih, I. P. A. Suhardiana, A. Zamzam, and P. A. K. Juniarta, “Designing Project-Based Learning in Research Proposal Writing: Its Effect, Problems, and Scaffolding Utilized,” Stud. English Lang. Educ., vol. 10, no. 2, pp. 841–862, 2023, doi: 10.24815/siele.v10i2.27408.

A. Rosyada and H. Sundari, “Learning from home environment: Academic writing course for efl undergraduates through google classroom application,” Stud. English Lang. Educ., vol. 8, no. 2, pp. 710–725, 2021, doi: 10.24815/siele.v8i2.18374.

F. M. Amin and H. Sundari, “Efl students’ preferences on digital platforms during emergency remote teaching: Video conference, lms, or messenger application?,” Stud. English Lang. Educ., vol. 7, no. 2, pp. 362–378, 2020, doi: 10.24815/siele.v7i2.16929.

M. N. Santoso, “Utilizing a facebook closed group for efl e-learning environment: Students’ views,” Stud. English Lang. Educ., vol. 8, no. 3, pp. 1026–1044, 2021, doi: 10.24815/siele.v8i3.21233.

S. Fan, S. Zhou, J. Ma, W. An, H. Wang, and T. Xiao, “The role of the nursing work environment, head nurse leadership and presenteeism in job embeddedness among new nurses: a cross-sectional multicentre study,” BMC Nurs., vol. 23, no. 1, pp. 1–11, 2024, doi: 10.1186/s12912-024-01823-1.

D. N. Hidayat, Fitriah, Mahlil, and J. Mason, “Factors Impacting English Teachers’ Creativity in Teaching English as a Foreign Language in Indonesia,” Stud. English Lang. Educ., vol. 10, no. 1, pp. 155–173, 2023, doi: 10.24815/siele.v10i1.26145.

D. Mulyadi, C. K. S. Singh, A. Setiawan, and D. C. Prasetyanti, “Technology-Enhanced Task-Based Language Teaching toward Their Self-Directed Language Learning: ESP Learners’ Views,” Stud. English Lang. Educ., vol. 10, no. 3, pp. 1326–1341, 2023, doi: 10.24815/siele.v10i3.27910.

R. A. Malik, M. R. Frimadani, and D. J. Putra, “Enrichment of microscopic photographs by utilizing CNN regarding soil-transmitted helminths identification,” Int. J. Adv. Appl. Sci., vol. 13, no. 1, pp. 46–53, 2024, doi: 10.11591/ijaas.v13.i1.pp46-53.

R. A. Malik et al., “Enhancing Soil-Transmitted Helminth Detection in Microscopic Images Using the Chain Code for Object Feature Extraction,” Int. J. Adv. Data Inf. Syst., vol. 4, no. 2, pp. 181–190, 2023, doi: 10.25008/ijadis.v4i2.1305.

E. N. Rabbianty, D. N. Utami, M. F. N. Humairoh, and N. Suryati, “Exploring English Lecturers’ Self-Efficacy in the Use of Educational Technology in Post COVID-19 Pandemic,” Stud. English Lang. Educ., vol. 11, no. 1, pp. 362–383, 2024, doi: 10.24815/siele.v11i1.30978.

A. A. M. Kasim, N. A. Darus, N. A. A. Lee, A. L. B. Subramaniam, and J. Januin, “Online Collaborative Performance in Group-Based Tasks among Learners of Higher Education,” Stud. English Lang. Educ., vol. 9, no. 3, pp. 948–966, 2022, doi: 10.24815/siele.v9i3.24861.

E. Limbong and B. Wadham, “Exploring Pre-Service English Teachers’ Digital Competence in Creating Interactive Instructional Materials,” Stud. English Lang. Educ., vol. 11, no. 2, pp. 748–767, 2024, doi: 10.24815/siele.v11i2.35103.

S. Samuel and T. L. Anita, “The relationship between trends in technology use and repurchase intention,” Int. J. Data Netw. Sci., vol. 7, no. 1, pp. 449–456, 2023, doi: 10.5267/j.ijdns.2022.9.001.

A. B. Rinekso, R. S. Rodliyah, and I. Pertiwi, “Digital literacy practices in tertiary education: A case of efl postgraduate students,” Stud. English Lang. Educ., vol. 8, no. 2, pp. 622–641, 2021, doi: 10.24815/siele.v8i2.18863.

R. A. Malik and M. R. Frimadani, “LEAN UX: Pemahaman dan Penerapan Metodologi Desain UI yang Efektif,” Lean UX Pemahaman dan Penerapan Metodol. Desain UI yang Ef., 2023.

H. Sundari and R. H. Febriyanti, “Collective Scaffolding in Virtual Collaborative Writing: A Study during Emergency Remote Teaching in Indonesia,” Stud. English Lang. Educ., vol. 10, no. 1, pp. 16–40, 2023, doi: 10.24815/siele.v10i1.25039.

R. A. Malik, S. M. Octafia, and V. S. Gunawan, “Easily Determining Post-Study System Usability for Anime Community E-Commerce Analysis,” vol. 7, no. 2, pp. 39–44, 2024, doi: 10.15408/aism.v7i2.39352.

M. E. Singer and K. Martens, “Measuring travel problems: Testing a novel survey tool in a natural experiment,” Transp. Res. Part D Transp. Environ., vol. 121, no. December 2022, p. 103834, 2023, doi: 10.1016/j.trd.2023.103834.

S. Oesch et al., “User Perceptions of Security and Privacy for Group Chat,” Digit. Threat. Res. Pract., vol. 3, no. 2, 2022, doi: 10.1145/3491265.

J. Gothelf and J. Seiden, LEAN UX: Designing Great Products with Agile Teams, vol. 3. O’REILLY Media, 2021. [Online]. Available: https://www.oreilly.com/library/view/lean-ux-2nd/9781491953594/

R. A. Malik and M. R. Frimadani, “UI/UX Analysis and Design Development of Less-ON Digital Startup Prototype by Using Lean UX,” J. RESTI (Rekayasa Sist. dan Teknol. Informasi), vol. 6, no. 6, pp. 958–965, 2022, doi: 10.29207/resti.v6i6.4454.

L. A. Liikkanen, H. Kilpiö, L. Svan, and M. Hiltunen, “Lean UX - The next generation of user-centered Agile development?,” Proc. Nord. 2014 8th Nord. Conf. Human-Computer Interact. Fun, Fast, Found., pp. 1095–1100, 2014, doi: 10.1145/2639189.2670285.

M. C. Ramos-Vega, V. M. Palma-Morales, D. Pérez-Marín, and J. M. Moguerza, “Stimulating children’s engagement with an educational serious videogame using Lean UX co-design,” Entertain. Comput., vol. 38, 2021, doi: 10.1016/j.entcom.2021.100405.

R. N. Sari, A. Umamah, M. P. Anggraini, M. A. Arianto, Kurniasih, and N. Mukminatien, “Exploring Self-Regulated Writing Strategies: A Comparison between Paragraphs and Essays,” Stud. English Lang. Educ., vol. 10, no. 2, pp. 805–821, 2023, doi: 10.24815/siele.v10i2.26146.

R. A. Malik and M. R. Frimadani, “Lean UX: Applied PSSUQ to Evaluate Less-ON UI/UX Analysis and Design,” Int. J. Adv. Data Inf. Syst., vol. 4, no. 1, pp. 73–85, 2023, doi: 10.25008/ijadis.v4i1.1263.

M. Zorzetti, I. Signoretti, L. Salerno, S. Marczak, and R. Bastos, “Improving Agile Software Development using User-Centered Design and Lean Startup,” Inf. Softw. Technol., vol. 141, no. August 2021, p. 106718, 2022, doi: 10.1016/j.infsof.2021.106718.

T. W. Chang, Y. Lee, and H. Y. Huang, “Visualizing design process by using lean ux to improve interdisciplinary team’s effectiveness-a case study,” Inf. Vis. - Biomed. Vis. Vis. Built Rural Environ. Geom. Model. Imaging, IV 2018, pp. 434–437, 2018, doi: 10.1109/iV.2018.00081.

N. Harrati, I. Bouchrika, A. Tari, and A. Ladjailia, “Exploring user satisfaction for e-learning systems via usage-based metrics and system usability scale analysis,” Comput. Human Behav., vol. 61, pp. 463–471, 2016, doi: 10.1016/j.chb.2016.03.051.

A. Abdullah Albarq and R. Qureshi, “The Proposed L-Scrumban Methodology to Improve the Efficiency of Agile Software Development,” Int. J. Inf. Eng. Electron. Bus., vol. 10, no. 3, pp. 23–35, 2018, doi: 10.5815/ijieeb.2018.03.04.

M. Govaerts, C. Van der Vleuten, and S. Schut, “Implementation of Programmatic Assessment: Challenges and Lessons Learned,” Educ. Sci., vol. 12, no. 10, pp. 10–15, 2022, doi: 10.3390/educsci12100717.

T. Fatima and W. Mahmood, “Requirement Engineering in Agile,” Int. J. Educ. Manag. Eng., vol. 9, no. 4, pp. 20–33, 2019, doi: 10.5815/ijeme.2019.04.03.

M. Soegaard, “The Basics of User Experience Design BY INTERACTION DESIGN FOUNDATION,” Basics User Exp. Des., pp. 21–27, 2020, [Online]. Available: interaction-design.org

T. Oshchepkova, O. M. Tolstykh, E. V. Panasenko, N. A. Nazarova, and N. V. Petrova, “Examining Changes in Foreign Language Educators’ Attitudes towards the Use of Computer-Assisted Learning,” Stud. English Lang. Educ., vol. 11, no. 2, pp. 630–649, 2024, doi: 10.24815/siele.v11i2.36441.

J. Saad, S. Martinelli, L. S. Machado, C. R. B. de Souza, A. Alvaro, and L. Zaina, “UX work in software startups: A thematic analysis of the literature,” Inf. Softw. Technol., vol. 140, no. June, p. 106688, 2021, doi: 10.1016/j.infsof.2021.106688.

M. R. F. Rio Andika Malik, “Pemahaman dan Penerapan Metodologi Desain UI yang Efektif,” 2021, [Online]. Available: https://www.google.co.id/books/edition/Lean_UX_Pemahaman_dan_Penerapan_Metodolo/kbGzEAAAQBAJ?hl=id&gbpv=1

R. Young, K. Sage, D. Broom, A. Hext, N. Snowdon, and C. Smith, “Evaluating the usability of a co-designed power assisted exercise graphical user interface for people with stroke,” J. Neuroeng. Rehabil., vol. 20, no. 1, pp. 1–25, 2023, doi: 10.1186/s12984-023-01207-7.

W. P. Rey, S. A. S. Adalin, K. R. L. Calanog, G. Windsor, and R. Jimenez, “Mamamayan : An Android mobile Community-based Emergency Reporting and Notification System,” no. Pagasa 2020, pp. 4288–4296, 2022, [Online]. Available: https://ieomsociety.org/proceedings/2022istanbul/799.pdf

N. Pereira-Azevedo, L. Osório, A. Fraga, and M. J. Roobol, “Rotterdam prostate cancer risk calculator: Development and usability testing of the mobile phone app,” JMIR Cancer, vol. 3, no. 1, 2017, doi: 10.2196/cancer.6750.

E. Jeon, H. A. Park, and H. A. Park, “Development of a smartphone application for clinical-guideline-based obesity management,” Healthc. Inform. Res., vol. 21, no. 1, pp. 10–20, 2015, doi: 10.4258/hir.2015.21.1.10.

A. I. Martins, A. Queirós, A. G. Silva, and N. P. Rocha, “Usability evaluation of ambient assisted living systems using a multi-method approach,” ACM Int. Conf. Proceeding Ser., pp. 261–268, 2016, doi: 10.1145/3019943.3019981.