Abstract
iPusnas, a mobile library application owned by the National Library of Indonesia, allows users to borrow digital books accessible through mobile devices freely. However, the application has received unfavorable reviews on the digital marketplace. This research examines iPusnas’ user experience by assessing factors such as effectiveness, efficiency, satisfaction, and subjective user experience. The study targets end-users composed of students, workers, and housewives. A mixed-method strategy is used in this study, incorporating usability testing, the System Usability Scale (SUS), and the User Experience Questionnaire (UEQ) as data-gathering techniques. Findings suggest a minor yet significant variation in effectiveness. There are no considerable differences across groups regarding efficiency and satisfaction. However, students demonstrated low satisfaction levels, while workers and housewives rated their satisfaction as adequate. The UEQ data shows that the app scores below average in the Attractiveness and Efficiency categories, while its Perspicuity score is poor. The study concludes by discussing these findings’ implications, suggestions, and potential limitations.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Badan Pusat Statistik: Indonesian telecommunications statistics 2021 (2021). https://www.bps.go.id/publication/2022/09/07/bcc820e694c537ed3ec131b9/statistik-telekomunikasi-indonesia-2021.html
Bangor, A., Kortum, P., Miller, J.: Determining what individual SUS scores mean: adding an adjective rating scale. J. Usability Stud. 4(3), 114–123 (2009)
Berkman, A.E.: General interaction expertise: an approach for sampling in usability testing of consumer products. Hum.-Comput. Interact. Interact. Des. Usability, 397–406,(2007). https://doi.org/10.1007/978-3-540-73105-4_44
Beyene, W.M.: Realizing inclusive digital library environments: opportunities and challenges. Res. Adv. Technol. Digit. Libr., 3–14 (2016). https://doi.org/10.1007/978-3-319-43997-6_1
Brooke, J.: SUS: a retrospective. J. Usability Stud. 8(2), 29–40 (2013)
Creswell, J.W., David Creswell, J.: Research Design: Qualitative, Quantitative, and Mixed Methods Approaches, 5th edn. SAGE, Los Angeles (2018)
Febrianti, S.A., Adhy, S.: Usability evaluation of iPekalonganKota with different end-user groups using usability testing and USE questionnaire methods. In: 2021 5th International Conference on Informatics and Computational Sciences (ICICoS), 2021-Novem, pp. 104–109 (2021). https://doi.org/10.1109/ICICoS53627.2021.9651841
Garzotto, F., Sorce, F., Bolchini, D., Yang, T.: Empirical investigation of web design attributes affecting brand perception. In: Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries, pp. 188–197 (2010). https://doi.org/10.1145/1868914.1868939
Genc-Nayebi, N., Abran, A.: A measurement design for the comparison of expert usability evaluation and mobile app user reviews. In: CEUR Workshop Proceedings (2018)
Guay, S., Rudin, L., Reynolds, S.: Testing, testing: a usability case study at University of Toronto Scarborough Library. Libr. Manag. 40(1–2), 88–97 (2019). https://doi.org/10.1108/LM-10-2017-0107
Hartson, R., Pyla, P.: The UX Book: Agile UX Design for Quality User Experience, 2nd edn. Elsevier, Amsterdam (2019)
Hass, C.: A practical guide to usability testing. Consum. Inform. Digit. Health, 107–124 (2019). https://doi.org/10.1007/978-3-319-96906-0_6
Hassan, H.M., Galal-Edeen, G.H.: From usability to user experience. In: 2017 International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS), pp. 216–222 (2017). https://doi.org/10.1109/ICIIBMS.2017.8279761
Hu, X.: Usability evaluation of E-Dunhuang cultural heritage digital library. Data Inf. Manage. 2(2), 57–69 (2018). https://doi.org/10.2478/dim-2018-0008
Inal, Y.: University students’ heuristic usability inspection of the National Library of Turkey website. Aslib J. Inf. Manag. 70(1), 66–77 (2018). https://doi.org/10.1108/AJIM-09-2017-0216
International Organization for Standardization: Ergonomics of human-system interaction - Part 11: Usability: Definitions and concepts (ISO 9241-211:2018) (2018). https://www.iso.org/standard/63500.html
iPusnas: How to use (n.d.). https://ipusnas.id/en/howto.html. Accessed 27 Feb 2023
Jiang, T., Luo, G., Wang, Z., Yu, W.: Research into influencing factors in user experiences of university mobile libraries based on mobile learning mode. Library Hi Tech (2022). https://doi.org/10.1108/LHT-11-2021-0423
Kiran, K., Singh, D.: Exploring user experiences with digital library services: a focus group approach. Digit. Libr. Univ. Ubiquit. Access Inf. 5362, 285–293 (2008). https://doi.org/10.1007/978-3-540-89533-6_29
Kous, K., Pušnik, M., Heričko, M., Polančič, G.: Usability evaluation of a library website with different end-user groups. J. Librariansh. Inf. Sci. 52(1), 75–90 (2020). https://doi.org/10.1177/0961000618773133
Kuhar, M., Merčun, T.: Exploring user experience in digital libraries through questionnaire and eye-tracking data. Libr. Inf. Sci. Res. 44(3), 101175 (2022). https://doi.org/10.1016/J.LISR.2022.101175
Kushendriawan, M.A., Santoso, H.B., Putra, P.O.H., Schrepp, M.: Evaluating user experience of a mobile health application ‘Halodoc’ using user experience questionnaire and usability testing. Jurnal Sistem Informasi 17(1), 58–71 (2021). https://doi.org/10.21609/jsi.v17i1.1063
Maricar, M.A., Pramana, D., Putri, D.R.: Evaluation of the use of SLiMS in E-Library using user experience questions (EUQ). Jurnal Teknologi Informasi dan Ilmu Komputer 8(2), 319 (2021). https://doi.org/10.25126/jtiik.2021824443
Matusiak, K.K.: Perceptions of usability and usefulness of digital libraries. Int. J. Hum. Arts Comput. 6(1–2), 133–147 (2012). https://doi.org/10.3366/ijhac.2012.0044
Maulana, Y.I.: Evaluation of the level of satisfaction of users of the national digital library (iPusnas) using the PIECES framework. Bianglala Informatika 6(1) (2018). https://doi.org/10.31294/bi.v6i1.5904
Merga, M.K., Mat Roni, S.: The influence of access to e-readers, computers and mobile phones on children’s book reading frequency. Comput. Educ. 109, 187–196 (2017). https://doi.org/10.1016/J.COMPEDU.2017.02.016
Ming, J., Chen, R., Tu, R.: Factors influencing user behavior intention to use mobile library application: a theoretical and empirical research based on grounded theory. Data Inf. Manage. 5(1), 131–146 (2021). https://doi.org/10.2478/dim-2020-0037
Nassimbeni, M., Desmond, C.: Availability of books as a factor in reading, teaching and learning behaviour in twenty disadvantaged primary schools in South Africa. S. Afr. J. Libr. Inf. Sci. 77(2) (2011). https://doi.org/10.7553/77-2-52
Nielsen, J.: Why you only need to test with 5 users. Nielsen Norman Group, March 18 2000. https://www.nngroup.com/articles/why-you-only-need-to-test-with-5-users/
Nuriman, M.L., Mayesti, N.: Evaluation of the usability of Universitas Indonesia websites using a usability scale system. Baca Jurnal Dokumentasi Dan Informasi 41(2), 253 (2020). https://doi.org/10.14203/j.baca.v41i2.622
Okhovati, M., Karami, F., Khajouei, R.: Exploring the usability of the central library websites of medical sciences universities. J. Librariansh. Inf. Sci. 49(3), 246–255 (2017). https://doi.org/10.1177/0961000616650932
Prastiwi, M.A., Jumino, J.: Efektivitas aplikasi iPusnas sebagai sarana temu balik informasi elektronik Perpustakaan Nasional Republik Indonesia. Jurnal Ilmu Perpustakaan 7(4) (2018)
Rafique, H., Almagrabi, A.O., Shamim, A., Anwar, F., Bashir, A.K.: Investigating the acceptance of mobile library applications with an extended Technology Acceptance Model (TAM). Comput. Educ. 145, 103732 (2020). https://doi.org/10.1016/j.compedu.2019.103732
Rafique, H., Anwer, F., Shamim, A., Minaei-Bidgoli, B., Qureshi, M.A., Sham-shirband, S.: Factors affecting acceptance of mobile library applications: structural equation model. Libri 68(2), 99–112 (2018). https://doi.org/10.1515/libri-2017-0041
Ratnawati, S., et al.: Evaluation of digital library’s usability using the system usability scale method of (a case study). In: 2020 8th International Conference on Cyber and IT Service Management (CITSM), pp. 1–5 (2020). https://doi.org/10.1109/CITSM50537.2020.9268801
Santoso, H.B., Schrepp, M., Yugo Kartono Isal, R., Utomo, A.Y., Priyogi, B.: Measuring user experience of the student-centered e-learning environment. J. Educ. Online 13(1), 1–79 (2016)
Sauro, J., Lewis, J.R.: Quantifying the User Experience: Practical Statistics for User Research, 2nd edn. Elsevier, Amsterdam (2016)
Schrepp, M.: User Experience Questionnaire Handbook, vol. 9 (2023). www.ueq-online.org
Sharfina, Z., Santoso, H.B.: An Indonesian adaptation of the system usability scale (SUS). In: 2016 International Conference on Advanced Computer Science and Information Systems (ICACSIS), pp. 145–148 (2016). https://doi.org/10.1109/ICACSIS.2016.7872776
Sikora, J., Evans, M.D.R., Kelley, J.: Scholarly culture: how books in adolescence enhance adult literacy, numeracy and technology skills in 31 societies. Soc. Sci. Res. 77, 1–15 (2019). https://doi.org/10.1016/j.ssresearch.2018.10.003
Sunardi, Julian, I., Murad, D.F., Riva’i, R.Y.: Combining UEQ and eye-tracking method as usability evaluation for mobile apps. In: 2021 3rd International Conference on Cybernetics and Intelligent System (ICORIS), pp. 1–6 (2021). https://doi.org/10.1109/ICORIS52787.2021.9649529
Twum, K.K., Yalley, A.A., Agyapong, G.K.-Q., Ofori, D.: The influence of public university library service quality and library brand image on user loyalty. Int. Rev. Publ. Nonprofit Market. 18(2), 207–227 (2021). https://doi.org/10.1007/s12208-020-00269-w
Walper, D., Kassau, J., Methfessel, P., Pronold, T., Einhäuser, W.: Optimizing user interfaces in food Production: gaze tracking is more sensitive for A-B-testing than behavioral data alone. In: Eye Tracking Research and Applications Symposium (ETRA), 6 February 2020. https://doi.org/10.1145/3379156.3391351
Wei, Q., Chang, Z., Cheng, Q.: Usability study of the mobile library app: an example from Chongqing University. Library Hi Tech 33(3), 340–355 (2015). https://doi.org/10.1108/LHT-05-2015-0047
Ye, P., Liu, L., Gao, L., Mei, Q.: Influence of information and service quality on users’ continuous use of mobile libraries in China. J. Cases Inf. Technol. 22(1), 57–71 (2022). https://doi.org/10.4018/JCIT.2020010104
Zaphiris, P., Dellaporta, A., Mohamedally, D.: User needs analysis and evaluation of portals. Portals, 52–62 (2018). https://doi.org/10.29085/9781856049832.007
Zarour, M., Alharbi, M.: User experience framework that combines aspects, dimensions, and measurement methods. Cogent Eng. 4(1), 1421006 (2017). https://doi.org/10.1080/23311916.2017.1421006
Zhao, Y., Deng, S., Zhou, R.: Understanding mobile library apps continuance usage in China: a theoretical framework and empirical study. Libri 65(3) (2015). https://doi.org/10.1515/libri-2014-0148
Jamal, A., et al.: Usability analysis of a health sciences digital library by medical residents: cross-sectional survey. JMIR Formative Res. 5(6), e23293 (2021). https://doi.org/10.2196/23293
Prasetya, Y., Rahmi, R.: Pilot study on user experience analysis of universitas Indonesia library website. Tik Ilmeu Jurnal Ilmu Perpustakaan dan Informasi 7(1), 105–116 (2023)
Acknowledgments
The authors are grateful to the anonymous reviewers for their constructive feedback, which significantly improved the manuscript. This work was generously supported by a grant from the Universitas Indonesia, grant number NKB-1202/UN2.RST/HKP.05.00/2022. Any opinions, findings, and conclusions described here are the authors and do not necessarily reflect those of the sponsors.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Aditia, Rahmi, Susianto, H. (2023). Understanding iPusnas User Experience Among Students, Workers, and Housewives. In: Goh, D.H., Chen, SJ., Tuarob, S. (eds) Leveraging Generative Intelligence in Digital Libraries: Towards Human-Machine Collaboration. ICADL 2023. Lecture Notes in Computer Science, vol 14458. Springer, Singapore. https://doi.org/10.1007/978-981-99-8088-8_2
Download citation
DOI: https://doi.org/10.1007/978-981-99-8088-8_2
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-8087-1
Online ISBN: 978-981-99-8088-8
eBook Packages: Computer ScienceComputer Science (R0)