More Web Proxy on the site http://driver.im/

article

Updating quality models for evaluating new generation web applications

Authors:

Alexander Dieser,

Belen RiveraAuthors Info & Claims

Journal of Web Engineering, Volume 11, Issue 3

Pages 209 - 246

Published: 01 September 2012 Publication History

Abstract

Web applications (WebApps) and their quality specification and evaluation have been the subject of abundant research. However, the particular features of new generation WebApps pose new challenges regarding current quality models and their included characteristics and sub-characteristics. For instance, functional added value (e.g. integratedness and beneficialness), learnability in use, communicability, sense of community and, ultimately, user experience are characteristics very often neglected in quality modeling or placed appropriately in quality views. Considering the recently issued ISO 25010/25012 standards and quality models for WebApps, in this work we propose updating our previously developed quality models and framework so-called 2Q2U (Quality, Quality in use, actual Usability and User experience) in the light of those features of new generation WebApps. The resulting quality models and framework in conjunction with evaluation strategies contribute towards a flexible, integrated approach to measure and evaluate different eras of WebApps. In order to illustrate the approach a practical case for evaluating a mashup WebApp is conducted.

References

[1]

Abran A., Surya W., Khelifi A., Rilling J., Seffah A., Robert F.: Consolidating the ISO Usability Models. 11th annual Int'l Software Quality Management Conference, 2003.

[2]

Becker P., Molina H., Olsina L.: Measurement and Evaluation as quality driver. In: Journal ISI (Ingénierie des Systèmes d'Information), Special Issue "Quality of Information Systems", Lavoisier, Paris, France, 15(6), pp. 33-62, 2010.

[3]

Bevan N.: Extending quality in use to provide a framework for usability measurement. In: LNCS 5619, Springer, HCI Int'l 2009, San Diego, USA, pp. 13-22, 2009.

[4]

Bevan N.: Classifying and selecting UX and usability measures, In Proc. of the 5th COST294- MAUSE Workshop on Meaningful Measures: Valid Useful User Experience Measurement, 2008.

[5]

Cappiello C., Daniel F., Koschmider A., Matera M., Picozzi M.: A Quality Model for Mashups. In: LNCS 6757, Springer, Web Engineering, 11th Int'l Conference on Web Engineering (ICWE2011), Auer S., Díaz O., Papadopoulos G. (Eds.), Paphos, Cyprus, pp. 137-151, 2011.

[6]

Cappiello C., Daniel F., Matera M., Pautasso C.: Information quality in mashups. IEEE Internet Computing, 14(4), pp. 14-22, 2010.

Digital Library

[7]

Grossman T, Fitzmaurice G, Attar R.: A survey of software learnability: metrics, methodologies and guidelines, Proceedings of the 27th Int'l Conference on Human factors in computing systems, pp. 649-658, 2009.

Digital Library

[8]

Hassenzahl M.: User experience: towards an experiential perspective on product quality, IHM; V.339, Proc. 20th Int'l Conference of the Assoc. Francophone d'Interaction Homme-Machine, pp. 11-15, 2008.

[9]

Herrera M., Moraga M.A, Caballero I., Calero C.: Quality in Use Model for Web Portals (QiUWeP). ICWE'10 Proceedings of the 10th international conference on Current trends in Web Engineering, Springer, LNCS 6385 pp. 91-101, 2010.

[10]

ISO/IEC 25010: Systems and software engineering. Systems and software Quality Requirements and Evaluation (SQuaRE). System and software quality models, 2011.

[11]

ISO/IEC CD 25010.3: Systems and software engineering. Systems and software Quality Requirements and Evaluation (SQuaRE). System and software quality models, 2009.

[12]

ISO/IEC 25012: Software engineering - Software product Quality Requirements and Evaluation (SQuaRE) - Data quality model, 2008.

[13]

ISO/IEC 9126-1: International Standard, Software Engineering - Product Quality - Part 1: Quality Model, 2001.

[14]

ISO 9241-110: Ergonomics of human-system interaction, Part 110: Dialogue principles, 2006.

[15]

Lew P., Qanber Abbasi M., Rafique I., Wang X., Olsina L.: Using Web Quality Models and Questionnaires for Web Applications Evaluation. To appear in IEEE proceedings of QUATIC, Lisbon, Portugal, 2012.

[16]

Lew P., Olsina L., Becker P., Zhang, L.: An Integrated Strategy to Understand and Manage Quality in Use for Web Applications. Requirements Engineering Journal, Springer, 16 (3), pp. 1-32, DOI 10.1007/s00766-011-0128-x, 2011.

[17]

Lew P., Olsina L., Zhang L.: Quality, Quality in Use, Actual Usability and User Experience as Key Drivers for Web Application Evaluation, In: LNCS 6189, Springer, 10th Int'l Congress on Web Engineering (ICWE2010), Vienne, Austria, pp. 218-232, 2010.

[18]

METI, Ministry of Economy - Trade and Industry - Japan: Software Metrics Advanced Project, Investigative Report on Measure for System/Software Product Quality Requirement Definition and Evaluation, March 2011.

[19]

Molina H., Olsina L.: Assessing Web Applications Consistently: A Context Information Approach. IEEE CS, 8th Int'l Congress on Web Engineering, NY, US, pp. 224-230, 2008.

[20]

Murugesan, S.: Web X.0: A Road Map, Handbook of Research on Web 2.0, 3.0, and X.0: Technologies, Business, and Social Applications, Murugesan Ed., IGI Global, pp. 1-11, 2010.

[21]

Nielsen J: Mobile Usability Update, Jakob Nielsen's Alertbox, Sep 26, 2011, Available at http://www.useit.com/alertbox/mobile-usability.html, accessed by Dec, 2011.

[22]

Olsina L., Lew P., Dieser A., Rivera B.: Using Web Quality Models and a Strategy for Purpose-Oriented Evaluations, Journal of Web Engineering, Rinton Press, US, 10 (4), pp. 316-352, 2011.

[23]

Olsina L., Sassano R., Mich L: Towards the Quality of Web 2.0 Applications, In proc. of 8th Int'l Workshop on Web-oriented Software Technology (IWWOST 2009) held at Int'l Congress on Web Engineering (ICWE09), San Sebastian, Spain, V. 493, pp. 3-15, CEUR (ceur-ws.org), ISSN 1613-0073, 2009.

[24]

Olsina L., Papa F., Molina H.: How to Measure and Evaluate Web Applications in a Consistent Way. Ch. 13 in: Modelling and Implementing Web Applications, Rossi G., Pastor O., Schwabe D. & Olsina L. (Eds), Springer-Verlag HCIS, London, pp. 385-420, 2008.

[25]

Olsina L., Lafuente G., Pastor O.: Towards a Reusable Repository of Web Metrics, Journal of Web Engineering, Rinton Press, US, 1 (1), pp. 61-73, 2002.

[26]

Prates R., de Souza C., Barbosa S.: A method for communicability evaluation of user interfaces. Interactions, ACM, 7(1), pp. 31-3, 2000.

[27]

Rossi G., Urbieta M., Ginzburg J., Distante D., Garrido A.: Refactoring to Rich Internet Applications. A Model-Driven Approach. In: IEEE proceedings of 8th Int'l Congress on Web Engineering (ICWE'08), NY, USA, pp. 1-12, 2008.

Digital Library

[28]

Santos P. J., Badre A. N.: Discount Learnability Evaluation. Graphics, Visualization & Usability Center, Georgia Institute of Technology, 1995, available at http://smartech.gatech.edu/bitstream/1853/3574/1/95-30.pdf, accessed by 2011/12/01.

Cited By

Olsina LLew PPuntikov NTerekhov ATsepkov M(2017)Specifying mobileapp quality characteristics that may influence trustProceedings of the 13th Central & Eastern European Software Engineering Conference in Russia10.1145/3166094.3166097(1-9)Online publication date: 20-Oct-2017
https://dl.acm.org/doi/10.1145/3166094.3166097
OrehovaăźKi TCappiello CMatera M(2016)Identifying Relevant Dimensions for the Quality of Web MashupsProceedings, Part I, of the 18th International Conference on Human-Computer Interaction. Theory, Design, Development and Practice - Volume 973110.1007/978-3-319-39510-4_37(396-407)Online publication date: 17-Jul-2016
https://dl.acm.org/doi/10.1007/978-3-319-39510-4_37
Rümpel ATietz VWagner AMeiβner K(2013)Modeling and Utilizing Quality Properties in the Development of Composite Web MashupsRevised Selected Papers of the ICWE 2013 International Workshops on Current Trends in Web Engineering - Volume 829510.1007/978-3-319-04244-2_7(54-65)Online publication date: 8-Jul-2013
https://dl.acm.org/doi/10.1007/978-3-319-04244-2_7
Show More Cited By

Updating quality models for evaluating new generation web applications
1. Information systems

Recommendations

Using Web Quality Models and Questionnaires for Web Applications Understanding and Evaluation
QUATIC '12: Proceedings of the 2012 Eighth International Conference on the Quality of Information and Communications Technology

As web applications (WebApps) continue to gain popularity, evaluating new generation WebApps poses challenges regarding use of current quality models and their included (sub-) characteristics. For instance, communicability and sense of community are ...
Using web quality models and a strategy for purpose-oriented evaluations

Web applications and their quality evaluation has been the subject of abundant research. However, instantiated models have been used mostly for the purpose of understanding, rather than improving. In this paper, we propose utilizing a quality modeling ...
Improving quality in use of web applications in a systematic way
ICWE'11: Proceedings of the 11th international conference on Current Trends in Web Engineering

A first step to evaluate quality is to define nonfunctional requirements usually through quality models. The ISO 25010 standard describes one such model for general usage in specifying and evaluating software quality requirements, but its concepts need ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Journal of Web Engineering

Journal of Web Engineering Volume 11, Issue 3

September 2012

90 pages

ISSN:1540-9589

Issue’s Table of Contents

Publisher

Rinton Press, Incorporated

Paramus, NJ

Publication History

Published: 01 September 2012

Revised: 25 June 2012

Received: 18 December 2011

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 28 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Olsina LLew PPuntikov NTerekhov ATsepkov M(2017)Specifying mobileapp quality characteristics that may influence trustProceedings of the 13th Central & Eastern European Software Engineering Conference in Russia10.1145/3166094.3166097(1-9)Online publication date: 20-Oct-2017
https://dl.acm.org/doi/10.1145/3166094.3166097
OrehovaăźKi TCappiello CMatera M(2016)Identifying Relevant Dimensions for the Quality of Web MashupsProceedings, Part I, of the 18th International Conference on Human-Computer Interaction. Theory, Design, Development and Practice - Volume 973110.1007/978-3-319-39510-4_37(396-407)Online publication date: 17-Jul-2016
https://dl.acm.org/doi/10.1007/978-3-319-39510-4_37
Rümpel ATietz VWagner AMeiβner K(2013)Modeling and Utilizing Quality Properties in the Development of Composite Web MashupsRevised Selected Papers of the ICWE 2013 International Workshops on Current Trends in Web Engineering - Volume 829510.1007/978-3-319-04244-2_7(54-65)Online publication date: 8-Jul-2013
https://dl.acm.org/doi/10.1007/978-3-319-04244-2_7
Lew POlsina L(2013)Relating User Experience with MobileApp Quality Evaluation and DesignRevised Selected Papers of the ICWE 2013 International Workshops on Current Trends in Web Engineering - Volume 829510.1007/978-3-319-04244-2_23(253-268)Online publication date: 8-Jul-2013
https://dl.acm.org/doi/10.1007/978-3-319-04244-2_23

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents