Abstract
E-learning is a fast-growing area thanks to the potential for increased reach and decreased cost of e-learning programs. Usability is of vital importance for e-learning due to the remote nature of the e-learning activities. In order to evaluate usability of e-learning, we apply the following usability factors: 1) E-learning System Feedback, 2) Consistency, 3) Error Prevention, 4) Performance/Efficiency, 5) User like/dislike, 6) Error Recovery, 7) Cognitive load 8) Internationalization, 9) Privacy, 10) On-Line Help [14,15]. We noticed that we needed a way of representing each of these factors separately and finally to combine them into a single figure of merit expressing overall e-learning usability. Note each of the above dimensions is a relatively imprecise concept and cannot be simply represented numerically. Hence, we decided to use Fuzzy system theory as the basis for representing them and the Fuzzy-reasoning paradigm using the Takagi-Sugeno (T-S) model [15] for combining them into a single e-learning usability figure of merit. This approach has 3 components: a) identification of the usability issues in e-learning, b) a testing aspect for the Fuzzy based usability approach, c) combining the results of these tests and turning them into a usability measure and the validation of the Fuzzy model. This paper discusses the use of fuzzy systems to model each of these usability factors and to reflect how each affects the overall value of e-learning usability.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Dillon, T., Maquire, M.: Usability Measurement- Its Practical Value to the Computer Industry. In: Proc. ACM/IFIP Human Factors in Computer System, INTERCHI, vol. 4, pp. 145–148 (1993)
Nielsen, J.: Designing Web Usability (2000)
Bavan, N., Macleod, M.: Usability measurement in context. Behaviour and Information Technology, 132–145 (1994)
Mamdani, E., Assilian, S.: An Experiment Linguistic Synthesis with a Fuzzy Logic Controller. Int. J. Man Machine Studies, 1–1 (1975)
Molich, R., Nielsen, J.: Heuristic Evaluation of User Interfaces. In: Proceedings of ACM Human Factors in Computing Systems CHI 1990, vol. 4, pp. 249–256 (1990)
Nielsen, J., Philips, V.: Estimating the relative Usability of Two Interfaces: Heuristic, Formal, and Empirical Methods Compared. In: Proc. ACM/IFIP Human Factors in Computing Systems INTERCHI 1993, vol. 4, pp. 214–221 (1993)
Nielsen, J.: Enhancing the Explanatory power of Usability Heuristics. In: Proc. ACM/IFIP Human Factors in Computing Systems INTERCHI 1993, vol. 4, pp. 152–158 (1993)
Takagi, T., Sugeuo, M.: Fuzzy Identification of Systems and Its Applications to Modelling and Control. IEEE Transactions on Systems man. & Cybernetics SMC-IS(1), 116–131
Thimbleby, H.: Formulating Usability. SIGCHI Bulletin, pp. 59–64 (April 1994)
Treu, S.: User Interface Evaluation A Structured Approach, pp. 175–195 (1994)
Shackel, B.: The concept of usability. In: Proc. IBM Software and Information Usability symposium, Poughkeepsie, N (September 1981)
Chang, E., Dillon, T.S.: Automated Usability Testing. In: Howard, S., Hammond, J., Lingaard, G. (eds.) Human Computer Interaction INTERACT 1997 (Book Chapter), pp. 77–84. Chapman and Hall, London (1997)
Chang, E., Dillon, T.S., Cook, D.: An Intelligent System Approach to Usability Evaluation. In (IIS 1997). IEEE Conference on Intelligent Information Systems, Bahamas, December 8-10, pp. 218–226 (1997)
Chang, E., Dillon, T.S., Cook, D.: Measurement of Usability of Software Using a Fuzzy System Approach. In: Invited paper Proceeding of Eighth International Conference on Software Engineering and Knowledge Engineering, Lake Tahoe, Nevada, USA, pp. 69–76.
Wong (Brian), S.K., Chang, E.: Usability Measure For Web Based Applications. In: Software Metrics Conference, Melbourne, Australia (2002)
Shackel, B.: The concept of usability. In: Proceedings of IBM Software and Information Usability Symposium, September 15-18, pp. 1–30. IBM Corporation, Poughkeepsie (1981)
Rossett, A., et al.: The ASTD ELearning Handbook: Best Practices, Strategies, and Case Studies for an Emerging Field. McGraw-Hill, New York (2002)
Ruttenbur, B., Spickler, G., Lurie, S.: E-Learning: The Engine of the Knowledge Economy. Morgan Keegan & Co., Inc. (2000)
Shoniregun, C.A., Gray, S.-J.: Is E-learning really the future or a risk? ACM Ubiquity (April 2003)
Kapp, K.M.: E-learning basics: essay: Five technological considerations when choosing an e-learning solution. In: ACM eLearn (June 2003)
Feldstein, M.: E-learning basics: essay: developing your e-learning for your learners. In: ACM eLearn (September 2002)
Tsai, S., Machado, P.: E-Learning Basics: Essay: E-learning, online learning, web-based learning, or distance learning: unveiling the ambiguity in current terminology. In: ACM eLearn (July 2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wong, S.K.(., Nguyen, T.T., Chang, E., Jayaratna, N. (2003). Usability Metrics for E-learning. In: Meersman, R., Tari, Z. (eds) On The Move to Meaningful Internet Systems 2003: OTM 2003 Workshops. OTM 2003. Lecture Notes in Computer Science, vol 2889. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-39962-9_34
Download citation
DOI: https://doi.org/10.1007/978-3-540-39962-9_34
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-20494-7
Online ISBN: 978-3-540-39962-9
eBook Packages: Springer Book Archive