More Web Proxy on the site http://driver.im/

Article

A laboratory method for studying activity awareness

Authors:

Gregorio Convertino,

Dennis C. Neale,

John M. Carroll,

Mary Beth RossonAuthors Info & Claims

NordiCHI '04: Proceedings of the third Nordic conference on Human-computer interaction

Pages 313 - 322

https://doi.org/10.1145/1028014.1028063

Published: 23 October 2004 Publication History

Abstract

Many failures in long-term collaboration occur because of a lack of activity awareness. Activity awareness is a broad concept that involves awareness of synchronous and asynchronous interactions over extended time periods. We describe a procedure to evaluate activity awareness and collaborative activities in a controlled setting. The activities used are modeled on real-world collaborations documented earlier in a field study. We developed an experimental method to study these activity awareness problems in the laboratory. Participants worked on a simulated long-term project in the laboratory over multiple experimental sessions with a confederate, who partially scripted activities and probes. We present evidence showing that this method represents a valid model of real collaboration, based on participants' active engagement, lively negotiation, and awareness difficulties. We found that having the ability to define, reproduce, and systematically manipulate collaborative situations allowed us to assess the effect of realistic conditions on activity awareness in remote collaboration.

References

[1]

Arrow H., McGrath, J. E. Berdahl, J. L., Small Groups as Complex Systems: Formation, Co-ordination, Development, and Adaptation. Sage Publications, 2000.

[2]

Baker, K. Heuristic Evaluation of Shared Workspace Groupware based on the Mechanics of Collaboration. MSc Thesis, Department of Computer Science, University of Calgary, Alberta, Canada, 2002.

[3]

Campbell, D., & Fiske, D. W. Convergent and discriminate validation by the multitraitmultimethod matrix. Psychological Bulletin 4, (1959), 297--312.

[4]

Carroll, J. M., Neale, D. C., Isenhour, P. L., Rosson, M. B., and McCrickard, D. S. Notification and awareness: synchronizing task-oriented collaborative activity. Int., Journ. of Human-Computer Studies 58, (2003) 605--32.

Digital Library

[5]

Clark, H. H. Using Language. New York: Cambridge University Press, 1996.

[6]

Cockton, G., & Woolrych, A. Sale must end: Should discount methods be cleared off HCI's shelves?, interactions 9(5) (2002), 13--18.

Digital Library

[7]

Connolly, T., Jessup, L., & Valacich, J. S., "Effects of anonymity and evaluative tone on idea generation in computer-mediated groups," Management Science 36, (1990), 689--703.

Digital Library

[8]

Easterbrook, S. (ed.), CSCW: Co-operation or Conflict, Springer-Verlag, New York, 1993.

Digital Library

[9]

Endsley, M. R., Toward a theory of situation awareness in dynamic systems. Human Factors 37, (1995), 32--64.

[10]

Flanagan, J. C. 1954. The critical incident technique. Psychological bulletin 51(4), (1954), 327--358.

[11]

Ganoe, C. H., Somervell, J. P., Neale, D. C., Isenhour, P. L., Carroll, J. M., Rosson, M. B., and McCrickard, D. S. Classroom BRIDGE: Using Collaborative Public and Desktop Timelines to Support Activity Awareness. Proc. of the ACM '03 Symposium on User Interface Software and Technology, ACM Press, (2003) 21--30.

Digital Library

[12]

Groove Networks Inc., http://www.Grove.com, 2003.

[13]

Grudin, J., Why CSCW Applications Fail: Problems in the Design and Evaluation of Organizational Interfaces, Proc. CSCW'88, (1988), 85--93.

Digital Library

[14]

Gutwin, C. & Greenberg, S. (2000). The Mechanics of Collaboration: Developing Low Cost Usability Evaluation Methods for Shared Workspaces. IEEE 9th Int'l Workshop WET-ICE'00 (2000).

Digital Library

[15]

Gutwin, C. & Greenberg, S. Workspace Awareness Position paper for the ACM CHI'97 workshop on Awareness in Collaborative Systems, organized by McDaniel S. E., & Brinck T., Atlanta, Georgia (1997).

[16]

Gutwin, C. & Greenberg, S., Workspace awareness for groupware. Proc. CHI'96, ACM Press, (1996), 208--209.

Digital Library

[17]

Hayes-Roth, B. & Hayes-Roth, F. A cognitive model of planning. Cognitive Science, 3, (1979), 275--310.

[18]

Kuutti, K. & Arvonen, T. Identifying potential CSCW applications by means of Activity Theory concepts: A case example. Proc. CSCW '92, ACM Press, (1992), 233--240.

Digital Library

[19]

McGrath, J. E., Methodology matters: Doing research in the behavioral and social sciences. In R. M. Baecker, J. Grudin, W. A. S. Buxton, & S. Greenberg (Eds.), Readings in human-computer interaction: Toward the year 2000, Morgan Kaufmann, (1995), 152--169.

Digital Library

[20]

Mohammed, S., & Dumville, B., Team Mental Models: Expanding Theory and Measurement Through Cross-Disciplinary Boundaries. Journal of Organizational Behavior, 22 (2001), 89--106.

[21]

Neale, D. C., Carroll, J. M., Rosson, M. B., Evaluating Computer-Supported Co-operative Work: Models and Frameworks, Proc. CSCW '04, ACM Press, (2004) (to appear).

Digital Library

[22]

Neale, D. C., Carroll, J. M., 1999. Multi-faceted evaluation for complex, distributed activities. Proc. of the CSCL'99 Computer Supported Co-operative Learning. Lawrence Erlbaum, 425--433.

Digital Library

[23]

Pinelle, D., & Gutwin, C., Groupware walkthrough: Adding context to groupware usability evaluation. Proc. 2002, ACM Press, (2002) 455--462.

Digital Library

[24]

Pinelle, D., Gutwin, C., & Greenberg, S., Task Analysis for Groupware Usability Evaluation: Modeling Shared-Workspace Tasks with the Mechanics of Collaboration, ACM Transactions on Computer-Human Interaction, 10, (4) (2003), 281--311.

Digital Library

[25]

Prinz W., Mark G., Pankoke-Babatz P. (1998), Designing Groupware for Congruency in Use, Proc. CSCW'98, ACM Press, 373--382.

Digital Library

[26]

Ramage M., The Learning Way: Evaluating Co-operatives Systems, PhD thesis, Lancaster Univ., 1999.

[27]

Salas, E., Prince, C., Baker, D. P., & Shrestha, L., Situation awareness in team performance: Implications for measurements and training, Human Factors, 37 (1995), 123--136.

[28]

Scriven, M. The methodology of evaluation. In R. Tyler, R. Gagne & M. Scriven (Eds.), Perspectives of curriculum evaluation. Chicago: Rand McNally, p. 39--83, 1967.

[29]

Steves, M., Morse, E., Gutwin, C., & Greengerg, S., A comparison of usage evaluation and inspection methods for assessing groupware usability. Proc. 2001 International ACM SIGGROUP Conference on Supporting Group Work. ACM Press (2001), 125--134.

Digital Library

[30]

Suchman, L. A. Plans and situated actions. New York: Cambridge University Press, 1986.

[31]

Twidale, M. Randal, D., Bentley, R. (1994), Situated Evaluation for Co-operative Systems. Proc. CSCW'94, ACM Press (1994), 22--26.

Digital Library

[32]

Watts, L., Monk, A., & Daly-Jones, O. Inter-Personal Awareness and Synchronization: Assessing the Value of Communication Technologies. International Journal of Human-Computer Studies, 44 (6), (1996), 849--873.

Digital Library

[33]

Weisband, S., Overcoming social awareness in computer-supported groups: Does anonymity really help?, Proc. CSCW'94 (2) (1994), 285--297.

[34]

Winograd, T., & Flores, F., Understanding computers and cognition: A new foundation for design. Norwood, NJ: Ablex, 1986.

Digital Library

Cited By

Mirza RAnderson KVoida S(2021)EPIC Collab: Supporting Asynchronous Collaboration in Big Data Analysis Systems2021 IEEE 6th International Conference on Cloud Computing and Big Data Analytics (ICCCBDA)10.1109/ICCCBDA51879.2021.9442495(17-26)Online publication date: 24-Apr-2021
https://doi.org/10.1109/ICCCBDA51879.2021.9442495
Collazos CGutiérrez FGallardo JOrtega MFardoun HMolina A(2018)Descriptive theory of awareness for groupware developmentJournal of Ambient Intelligence and Humanized Computing10.1007/s12652-018-1165-910:12(4789-4818)Online publication date: 14-Dec-2018
https://doi.org/10.1007/s12652-018-1165-9
Ashaikh RWilson SJones SFaily SJiang NDogan HJacqui T(2016)A persuasive social actor for activity awareness in learning groupsProceedings of the 30th International BCS Human Computer Interaction Conference: Fusion!10.14236/ewic/HCI2016.45(1-12)Online publication date: 11-Jul-2016
https://dl.acm.org/doi/10.14236/ewic/HCI2016.45
Show More Cited By

Recommendations

Evaluating computer-supported cooperative work: models and frameworks
CSCW '04: Proceedings of the 2004 ACM conference on Computer supported cooperative work

Evaluating distributed CSCW applications is a difficult endeavor. Frameworks and methodologies for structuring this type of evaluation have become a central concern for CSCW researchers. In this paper we describe the problems involved in evaluating ...
Awareness and coordination in shared workspaces
CSCW '92: Proceedings of the 1992 ACM conference on Computer-supported cooperative work
Breaking the book: translating the chemistry lab book into a pervasive computing lab environment
CHI '04: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

The UK e-Science programme is relying on the evolution of the paper lab book into a pervasive data gathering lab system. To date take up of existing commercial or research lab book replacement systems has not been great. In this paper, we reconsider ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

NordiCHI '04: Proceedings of the third Nordic conference on Human-computer interaction

October 2004

472 pages

ISBN:1581138571

DOI:10.1145/1028014

General Chair:
Roope Raisamo

Copyright © 2004 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 October 2004

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

NordiCHI04

NordiCHI04: NordiCHI 2004

October 23 - 27, 2004

Tampere, Finland

Acceptance Rates

Overall Acceptance Rate 379 of 1,572 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

38
Total Citations
View Citations
1,300
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)1

Reflects downloads up to 31 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Mirza RAnderson KVoida S(2021)EPIC Collab: Supporting Asynchronous Collaboration in Big Data Analysis Systems2021 IEEE 6th International Conference on Cloud Computing and Big Data Analytics (ICCCBDA)10.1109/ICCCBDA51879.2021.9442495(17-26)Online publication date: 24-Apr-2021
https://doi.org/10.1109/ICCCBDA51879.2021.9442495
Collazos CGutiérrez FGallardo JOrtega MFardoun HMolina A(2018)Descriptive theory of awareness for groupware developmentJournal of Ambient Intelligence and Humanized Computing10.1007/s12652-018-1165-910:12(4789-4818)Online publication date: 14-Dec-2018
https://doi.org/10.1007/s12652-018-1165-9
Ashaikh RWilson SJones SFaily SJiang NDogan HJacqui T(2016)A persuasive social actor for activity awareness in learning groupsProceedings of the 30th International BCS Human Computer Interaction Conference: Fusion!10.14236/ewic/HCI2016.45(1-12)Online publication date: 11-Jul-2016
https://dl.acm.org/doi/10.14236/ewic/HCI2016.45
Tell PBabar M(2016)An Empirical Evaluation of an Activity-Based Infrastructure for Supporting Cooperation in Software Engineering2016 IEEE 11th International Conference on Global Software Engineering (ICGSE)10.1109/ICGSE.2016.25(34-43)Online publication date: Aug-2016
https://doi.org/10.1109/ICGSE.2016.25
Molina AGallardo JRedondo MBravo C(2015)Assessing the awareness mechanisms of a collaborative programming support systemDYNA10.15446/dyna.v82n193.5349782:193(212-222)Online publication date: 20-Oct-2015
https://doi.org/10.15446/dyna.v82n193.53497
Cheung VScott SNunes NCostanza EOlivier PSchöning J(2015)Studying Attraction Power in Proxemics-Based Visual Concepts for Large Public Interactive DisplaysProceedings of the 2015 International Conference on Interactive Tabletops & Surfaces10.1145/2817721.2817749(93-102)Online publication date: 15-Nov-2015
https://dl.acm.org/doi/10.1145/2817721.2817749
Esbensen MTell PCholewa JPedersen MBardram JNunes NCostanza EOlivier PSchöning J(2015)The dBoardProceedings of the 2015 International Conference on Interactive Tabletops & Surfaces10.1145/2817721.2817746(161-170)Online publication date: 15-Nov-2015
https://dl.acm.org/doi/10.1145/2817721.2817746
Cheung VScott SMase KLangheinrich MGatica-Perez DGellersen HChoudhury TYatani K(2015)A laboratory-based study methodology to investigate attraction power of large public interactive displaysProceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/2750858.2805842(1239-1250)Online publication date: 7-Sep-2015
https://dl.acm.org/doi/10.1145/2750858.2805842
Antunes PHerskovic VOchoa SPino J(2014)Reviewing the quality of awareness support in collaborative applicationsJournal of Systems and Software10.5555/2747476.274752089:C(146-169)Online publication date: 1-Mar-2014
https://dl.acm.org/doi/10.5555/2747476.2747520
Houben STell PBardram JDachselt RGraham NHornbæk KNacenta M(2014)ActivitySpaceProceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces10.1145/2669485.2669493(119-128)Online publication date: 16-Nov-2014
https://dl.acm.org/doi/10.1145/2669485.2669493
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents