[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/2662253.2662309acmotherconferencesArticle/Chapter ViewAbstractPublication PagesinteraccionConference Proceedingsconference-collections
research-article

A Review of Quantitative Empirical Approaches in Human-Computer Interaction

Published: 10 September 2014 Publication History

Abstract

Experimentation plays a major role in the development and validation of new theories in the field of human-computer interaction (HCI). In this paper, we address quantitative empirical studies, an approach that has become the standard methodology for conducting research in HCI. This research provides an in-depth review, gathering a representative and relatively extensive collection of primary studies. We aim to identify relevant research lines in HCI in which quantitative approaches have been employed in order to construct a consistent and comprehensive taxonomy of quantitative approaches and form a broad picture of the procedures, tools and techniques employed. A systematic mapping study methodology has been adopted to produce reliable results in a reproducible and agile manner.

References

[1]
M. S. Andreasen, H. V. Nielsen, S. O. Schrø der, and J. Stage. What happened to remote usability testing? An Empirical Study of Three Methods. In Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '07, page 1405, New York, New York, USA, Apr. 2007. ACM Press.
[2]
D. Bolchini, F. Garzotto, and F. Sorce. Does Branding Need Web Usability? A Value-Oriented Empirical Study. In Proceedings of the 12th IFIP TC13 Conference on Human-Computer Interaction, pages 652--665. Springer-Verlag Berlin, 2009.
[3]
K. Browne and C. Anand. An empirical evaluation of user interfaces for a mobile video game. Entertainment Computing, 3(1):1--10, Jan. 2012.
[4]
D. Budgen, M. Turner, P. Brereton, and B. Kitchenham. Using Mapping Studies in Software Engineering. In Proceedings of the 20th Annual Workshop of the Psychology of Programming Interest Group (PPIG'08), volume 2, pages 195--204, Lancaster University, UK, 2008.
[5]
A. G. Cass, C. S. T. Fernandes, and A. Polidore. An empirical evaluation of undo mechanisms. In Proceedings of the 4th Nordic conference on Human-computer interaction changing roles -NordiCHI '06, pages 19--27, New York, New York, USA, Oct. 2006. ACM Press.
[6]
J. W. Castro and S. T. Acuña. Differences between Traditional and Open Source Development Activities. In Proceedings of the 13th International Conference on Product-Focused Software Process Improvement, pages 131--144, 2012.
[7]
C. Conati and H. Maclaren. Empirically building and evaluating a probabilistic model of user affect. User Modeling and User-Adapted Interaction, 19(3):267--303, Jan. 2009.
[8]
G. Cortellessa, V. Giuliani, M. Scopelliti, and A. Cesta. Key Issues in Interactive Problem Solving: An Empirical Investigation on Users Attitude. In M. F. Costabile and F. Paternò, editors, Proceedings of the 10th IFIP TC13 International Conference on Human-Computer Interaction, volume 3585 of Lecture Notes in Computer Science, pages 657--670, Berlin, Heidelberg, Sept. 2005. Springer Berlin Heidelberg.
[9]
V. de Castro, M. Genero, E. Marcos, and M. Piattni. Empirical study to assess whether the use of routes facilitates the navigability of web information systems. IET Software, 5(6):528--542, 2011.
[10]
D. M. Dehn and S. Van Mulken. The impact of animated interface agents: a review of empirical research. International Journal of Human-Computer Studies, 52(1):1--22, Jan. 2000.
[11]
O. Dieste, N. Juristo, and M. D. Martínez. Software industry experiments: A systematic literature review. In Proceedings of the 1st International Workshop on Conducting Empirical Studies in Industry (CESI 2013), pages 2--8, 2013.
[12]
T. Dybå, V. B. Kampenes, and D. I. Sjøberg. A systematic review of statistical power in software engineering experiments. Information and Software Technology, 48(8):745--755, Aug. 2006.
[13]
X. Fang and C. W. Holsapple. An empirical study of web site navigation structures' impacts on web site usability. Decision Support Systems, 43(2):476--491, Mar. 2007.
[14]
F. Farhadi-Niaki, R. GhasemAghaei, and A. Arya. Empirical study of a vision-based depth-sensitive human-computer interaction system. In Proceedings of the 10th asia pacific conference on Computer human interaction - APCHI '12, pages 101--108, New York, New York, USA, Aug. 2012. ACM Press.
[15]
P. Germanakos, N. Tsianos, Z. Lekkas, C. Mourlas, M. Belk, and G. Samaras. Proposing Web Design Enhancements Based on Specific Cognitive Factors: An Empirical Evaluation. In 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, pages 602--605. IEEE, Sept. 2009.
[16]
O. Grynszpan, J.-C. Martin, and J. Nadel. Multimedia interfaces for users with high functioning autism: An empirical investigation. International Journal of Human-Computer Studies, 66(8):628--639, Aug. 2008.
[17]
B. L. Harrison, G. Kurtenbach, and K. J. Vicente. An experimental evaluation of transparent user interface tools and information content. In Proceedings of the 8th Annual Symposium on User Interface Software and Technology, pages 81--90, 1995.
[18]
R. D. Johnson. An empirical investigation of sources of application-specific computer-self-efficacy and mediators of the efficacy-performance relationship. International Journal of Human-Computer Studies, 62(6):737--758, June 2005.
[19]
V. B. Kampenes, T. Dybå, J. E. Hannay, and D. I. Sjøberg. A systematic review of effect size in software engineering experiments. Information and Software Technology, 49(11-12):1073--1086, Nov. 2007.
[20]
D. J. Kim and C. K. Coursaris. A Meta-Analytical Review of Empirical Mobile Usability Studies. Journal of Usability Studies, 6(3):117--171, 2011.
[21]
J. Kim, J. Lee, and D. Choi. Designing emotionally evocative homepages: an empirical study of the quantitative relations between design factors and emotional dimensions. International Journal of Human-Computer Studies, 59(6):899--940, Dec. 2003.
[22]
B. Kitchenham. Procedures for Performing Systematic Reviews. Technical report, Keele University Technical Report TR/SE-0401 and NICTA Technical Report 0400011T.1, 2004.
[23]
B. A. Kitchenham, S. L. Pfleeger, L. M. Pickard, P. W. Jones, D. C. Hoaglin, K. E. Emam, and J. Rosenberg. Preliminary Guidelines for Empirical Research in Software Engineering. IEEE Transactions on Software Engineering, 28(8):721--734, 2002.
[24]
T. Komatsu and S. Yamada. How Does the Agents' Appearance Affect Users' Interpretation of the Agents' Attitudes: Experimental Investigation on Expressing the Same Artificial Sounds From Agents With Different Appearances. International Journal of Human-Computer Interaction, 27(3):260--279, Feb. 2011.
[25]
M. L. A. Kunnath, R. A. Cornell, M. K. Kysilka, and L. Witta. An experimental research study on the effect of pictorial icons on a user-learner's performance. Computers in Human Behavior, 23(3):1454--1480, May 2007.
[26]
V. Tscherter, P. Ravasio, and S. Guttormsen-schär. The Qualitative Experiment in HCI: Definition, Occurrences, Value and Use. ACM Transactions on Computer-Human Interaction, V:1--24, 1986.

Index Terms

  1. A Review of Quantitative Empirical Approaches in Human-Computer Interaction

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      Interacción '14: Proceedings of the XV International Conference on Human Computer Interaction
      September 2014
      435 pages
      ISBN:9781450328807
      DOI:10.1145/2662253
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      In-Cooperation

      • Universidad de La Laguna: Universidad de La Laguna

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 10 September 2014

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Empirical Process
      2. Experimental Study
      3. Human-Computer Interaction
      4. Review
      5. Systematic Mapping Study

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Conference

      Interacción '14
      Interacción '14: XV International Conference on Human Computer Interaction
      September 10 - 12, 2014
      Tenerife, Puerto de la Cruz, Spain

      Acceptance Rates

      Overall Acceptance Rate 109 of 163 submissions, 67%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • 0
        Total Citations
      • 439
        Total Downloads
      • Downloads (Last 12 months)40
      • Downloads (Last 6 weeks)4
      Reflects downloads up to 14 Feb 2025

      Other Metrics

      Citations

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media