[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
article

What signal is your inspection team sending to each other? Using a shared collaborative interface to improve shared cognition and implicit coordination in error-detection teams

Published: 01 April 2013 Publication History

Abstract

Coordination theory, created in a collaborative HCI context, has long emphasized the importance of implicit coordination. Such coordination is possible through interactivity design that creates shared cognition. Teams experience implicit coordination when they achieve tacit task coordination without direct or purposeful communication of task strategies among the participants, but this is impossible to achieve without shared cognition. Implicit coordination is often more effective than explicit coordination, and teams increasingly lack sufficient time or capabilities to coordinate explicitly; therefore, methods to foster implicit coordination could result in highly practical techniques to improve task performance. Implicit coordination, despite its promise, has not received much attention in the HCI literature. A particular problem we believe has hindered the application of implicit coordination is the dearth of objective measurement of implicit coordination and the related construct shared cognition. Teams have difficulty improving, implementing, and proving the value of implicit coordination without measurement. For our theoretical foundation, we use implicit coordination theory (ICT) to explain and predict how a simple shared interface in a group error-detection task can establish formalized group memory and group awareness, which foster the shared cognition necessary for implicit coordination to occur. To test ICT, we demonstrate innovative measurement of implicit coordination and shared cognition-without intrusive perceptual survey items-by leveraging measures from signal detection theory (SDT). We use the context of teams performing heuristic data-flow diagramming (HDFD) (which is similar to the Prepare, Collect, and Repair (PCR)-based process of heuristic evaluation) to measure the improved shared cognition and implicit coordination. Namely, we measured shared cognition with SDT's measure of response bias (c); we measured implicit coordination with SDT's measure of discrimination (d'). Supporting our ICT-based predictions, groups operating with a shared interface indeed experienced more shared cognition and implicit coordination-resulting in higher discrimination, more positive response bias, and more accurate hit rates and false-alarm rates than the control groups. Our results show great promise in making similar predictions, measurements, and improvements in other individual or group inspection tasks, which are prevalent in HCI development research and practice.

References

[1]
Collaborative support for informal information in collective memory systems. Information Systems Frontiers. v2. 333-347.
[2]
Using Brunswikian theory and a longitudinal design to study how hierarchical teams adapt to increasing levels of time pressure. Acta Psychologica. v112. 181-206.
[3]
Assessing a firm's web presence: a heuristic evaluation procedure for the measurement of usability. Information Systems Research. v13. 168-186.
[4]
A contingency approach to software project coordination. Journal of Management Information Systems. v18. 41-70.
[5]
Baker, K., Greenberg, S., Gutwin, C., 2001. Heuristic evaluation of groupware based on the mechanics of collaboration. Lecture Notes in Computer Science. In: Proceedings of the 8th IFIP International Conference on Engineering of Human-Computer Interactions, vol. 2254, pp. 123-140.
[6]
Inducing sensitivity into deception in order to improve decision making performance: a field study. Management Information Systems Quarterly. v26. 119-144.
[7]
Reflections on shared cognition. Journal of Organizational Behavior. v22. 195-202.
[8]
Scaling the quality of teammates' mental models: equifinality and normative comparisons. Journal of Organizational Behavior. v26. 37-56.
[9]
Cognitive psychology and team training: training shared mental models of complex systems. Human Factors Society Bulletin. v33. 1-4.
[10]
Notification and awareness: synchronizing task-oriented collaborative activity. International Journal of Human-Computer Studies. v58. 605-632.
[11]
Is out of sight, out of mind? An empirical study of social loafing in technology-supported groups. Information Systems Research. v16. 149-168.
[12]
Group performance in a visual signal detection task. Human Factors. v25. 43-52.
[13]
Statistical Power Analysis for the Behavioral Sciences. 2nd ed. Laurence Erlbaum Associates, Hillsdale.
[14]
Who is liable for bugs and security flaws in software?. Communications of the ACM. v47. 25-27.
[15]
The cognitive underpinnings of effective teamwork: a meta-analysis. Journal of Applied Psychology. v95. 32-53.
[16]
Deeney, J., Fairclough, J., Schaefer, H., 2004. IEEE standard for software reviews. Software Engineering Standards Committee of the IEEE Computer Society.
[17]
The usability analysis with heuristic evaluation and analytic hierarchy process. International Journal of Industrial Ergonomics. v39. 934-939.
[18]
The adoption and use of GSS in project teams: toward more participative processes and outcomes. Management Information Systems Quarterly. v27. 289-323.
[19]
Information exchange and use in GSS and verbal group decision making: effects of minority influence. Journal of Management Information Systems. v14. 61-88.
[20]
Computer brainstorms: more heads are better than one. Journal of Applied Psychology. v78. 531-537.
[21]
Group, sub-group, and nominal group idea generation: new rules for a new media?. Journal of Management. v20. 723-736.
[22]
Process structuring in electronic brainstorming. Information Systems Research. v7. 268-277.
[23]
A meta-analysis of group size effects in electronic brainstorming: more heads are better than one. International Journal of e-Collaboration. v1. 24-42.
[24]
Understanding fit and appropriation effects in group support systems via meta-analysis. Management Information Systems Quarterly. v25. 167-193.
[25]
Performance analysis of filtering software using signal detection theory. Decision Support Systems. v42. 1015-1028.
[26]
Integrating nominal group technique and joint application development for improved systems requirements determination. Information and Management. v41. 399-411.
[27]
An evaluation of generic teamwork skills training with action: effects on cognitive and skill-based outcomes. Personnel Psychology. v58. 641-672.
[28]
Toward a theory of situation awareness in dynamic systems. Human Factors. v37. 32-64.
[29]
Adaptive team coordination. Human Factors. v41. 312-325.
[30]
Social translucence: an approach to designing systems that support social processes. ACM Transactions on Computer-Human Interaction. v7. 59-83.
[31]
Espinosa, A., Kraut, R., Lerch, J., Slaughter, S., Herbsleb, J., Mockus, A., 2001. Shared mental models and coordination in large-scale, distributed software development. In: Twenty-Second International Conference on Information Systems (ICIS'2001), December 16-19. AIS, Atlanta, pp. 513-517.
[32]
Time and transition in work teams: toward a new model of group development. Academy of Management Journal. v31. 9-41.
[33]
Signal Detection Theory and Psychophysics. Wiley, New York.
[34]
Nonparametric indexes for sensitivity and bias: computing formulas. Psychological Bulletin. v75. 424-429.
[35]
Group tasks, group interaction process, and group performance effectiveness: a review and proposed integration. In: Berkowitz, L. (Ed.), Advances in Experimental Social Psychology, Academic Press, New York. pp. 45-99.
[36]
The interaction of task design and group performance strategies in determining group effectiveness. Organizational Behavior & Human Performance. v16. 350-365.
[37]
Attribution accuracy when using anonymity in group support systems. International Journal of Human-Computer Studies. v47. 429-452.
[38]
The effectiveness of groups recognizing patterns. International Journal of Human-Computer Studies. v59. 523-543.
[39]
The evaluator effect: a chilling fact about usability evaluation methods. International Journal of Human-Computer Studies. v13. 421-443.
[40]
Cognitive and consensus processes in group recognition memory performance. Journal of Personality and Social Psychology. v59. 705-718.
[41]
Modern Systems Analysis and Design. 3rd ed. Prentice-Hall, Englewood Cliffs.
[42]
The rank order effect in group decision making. Organizational Behavior and Human Decision Processes. v68. 181-193.
[43]
Heuristic evaluation: comparing ways of finding and reporting usability problems. Interacting with Computers. v19. 225-240.
[44]
Estimating within-group interrater reliability with and without response bias. Journal of Applied Psychology. v69. 85-98.
[45]
Technology dominance in complex decision making: the case of aided credibility assessment. Journal of Management Information Systems. v27. 181-207.
[46]
Estimating the number of usability problems. Applied Ergonomics. v42. 337-347.
[47]
Can humans detect errors in data? Impact of base rates, incentives, and goals. Management Information Systems Quarterly. v21. 169-194.
[48]
Team mental model: construct or metaphor. Journal of Management. v20. 403-437.
[49]
Visual information as a conversational resource in collaborative physical tasks. Human-Computer Interaction. v18. 13-49.
[50]
The effects of group decision support systems and task structures on group communication and decision quality. Journal of Management Information Systems. v13. 193-215.
[51]
Predicting interactions between agents in agent-based modeling and simulation of sociotechnical systems. IEEE Transactions on Systems, Man, and Cybernetics A, 38. 1210-1220.
[52]
Cognitive divergence and shared mental models in software development project teams. Journal of Organizational Behavior. v22. 135-144.
[53]
Optimizing heuristic evaluation process in e-commerce: use of Taguchi method. International Journal of Human-Computer Interaction. v22. 271-287.
[54]
Effect of evaluators' cognitive style on heuristic evaluation: field dependent and field independent evaluators. International Journal of Human-Computer Studies. v67. 382-393.
[55]
The impact of process structure on novice, Internet-based, asynchronous-distributed collaborative writing teams. IEEE Transactions on Professional Communication. v48. 341-364.
[56]
Using Internet-based, distributed collaborative writing tools to improve coordination and group awareness in writing teams. IEEE Transactions on Professional Communication. v46. 277-297.
[57]
Toward building self-sustaining groups in PCR-based tasks through implicit coordination: the case of heuristic evaluation. Journal of the Association for Information Systems. v10. 170-196.
[58]
The impact of group size and social presence on small-group communication: does computer-mediated communication make a difference?. Small Group Research. v37. 631-661.
[59]
The interdisciplinary study of coordination. ACM Computing Surveys. v26. 87-119.
[60]
Detection Theory: A User's Guide. 2nd ed. Lawrence Erlbaum Associates, Mahwah.
[61]
The influence of shared mental models on team process and performance. Journal of Applied Psychology. v85. 273-283.
[62]
Team mental models in a team knowledge framework: expanding theory and measurement across disciplinary boundaries. Journal of Organizational Behavior. v22. 89-106.
[63]
Task structure, work structure, and team performance. Journal of Applied Psychology. v53. 167-177.
[64]
Finding usability problems through heuristic evaluation. In: Bauersfeld, P., Bennett, J., Lynch, G. (Eds.), SIGCHI Conference on Human Factors in Computing Systems, ACM Press, Monterey. pp. 373-379.
[65]
Nielsen, J., 1994. Enhancing the explanatory power of usability heuristics. Computer Human Interaction (CHI), April 24-28. Boston, pp. 152-158.
[66]
Heuristic evaluation of user interfaces. In: Chew, J.C., Whiteside, J. (Eds.), SIG-CHI Conference on Human Factors in Computing Systems: Empowering People, ACM Press, Seattle. pp. 249-256.
[67]
The effects of mutual location-awareness on group coordination. International Journal of Human-Computer Studies. v68. 451-467.
[68]
. Electronic meeting systems to support group work. v34. 40-61.
[69]
The effects of shared cognition on group satisfaction and performance: politeness and efficiency in group interaction. Communication Research. v35. 88-108.
[70]
Accommodating field-dependence: a cross-over study. ACM SIGCSE Bulletin. v36. 72-76.
[71]
Collective memory support and cognitive-conflict group decision-making: an experimental investigation. Decision Support Systems. v36. 261-281.
[72]
Colloquy: do interacting groups perform better than aggregates of individuals? Why we have to be reductionist about group memory. Human Communication Research. v29. 592-599.
[73]
A model to support collaborative work in virtual enterprises. Data & Knowledge Engineering. v50. 63-86.
[74]
A nonparametric analysis of recognition experiments. Psychometric Science. v1. 125-126.
[75]
The role of individual memory and attention processes during electronic brainstorming. Management Information Systems Quarterly. v28. 621-643.
[76]
Individual strategies in a market entry game. Group Decision and Negotiation. v4. 117-133.
[77]
Team implicit coordination processes: a team knowledge-based approach. Academy of Management Review. v33. 163-184.
[78]
The paradox of richness: a cognitive model of media choice. IEEE Transactions on Professional Communication. v48. 10-21.
[79]
Roberts, T.L., Lowry, P.B., Nicholas, C., Romano, J., 2005. Improving design artifact reviews with group support systems and an extension of heuristic evaluation techniques. In: Proceedings of the 38th Annual Hawai'i International Conference on System Sciences, January 3-6. IEEE Press, Kona, pp. 1-12.
[80]
Toward improving the relevance of information systems research to practice: the role of applicability checks. Management Information Systems Quarterly. v32. 1-22.
[81]
Knowledge of results and motor learning: a review and critical appraisal. Psychological Bulletin. v95. 355-386.
[82]
The creative process: the effects of group memory on individual idea generation. Journal of Management Information Systems. v15. 143-160.
[83]
The effectiveness of software development technical reviews: a behaviorally motivated program of research. IEEE Transactions on Software Engineering. v26. 1-14.
[84]
Comparison of individuals and small groups in the rational solution of complex problems. American Journal of Psychology. v44. 491-504.
[85]
How far to commit to open-loop action: a probabilistic decision approach with analogies to signal-detection theory. IEEE Transactions on Systems, Man, and Cybernetics. v23. 888-890.
[86]
Using the theory of signal detection to improve ad recognition testing. Journal of Marketing Research. v23. 327-336.
[87]
Evaluating and tuning predictive data mining models using receiver operating characteristic curves. Journal of Management Information Systems. v21. 249-280.
[88]
Signal detection analysis of the ideal group. Organizational Behavior and Human Decision Processes. v60. 1-13.
[89]
Signal-detection analysis of group decision making. Psychological Review. v108. 183-203.
[90]
Calculation of signal detection theory measures. Behavior Research Methods, Instruments & Computers. v31. 137-149.
[91]
Tacit coordination in anticipation of small group task completion. Journal of Experimental Social Psychology. v32. 129-152.
[92]
Coordination in market entry games with symmetric players. Organizational Behavior and Human Decision Processes. v64. 203-218.
[93]
Sutcliffe, A., 2001. Heuristic evaluation of website attractiveness and usability. In: Johnson, C. (Ed.), Lecture Notes in Computer Science, Proceedings of the 8th International Workshop on Interactive Systems: Design, Specification, and Verification-Revised Papers. Springer-Verlag, Berlin, Germany, pp. 183-198.
[94]
Heuristic evaluation of virtual reality applications. Interacting with Computers. v16. 831-849.
[95]
Applying heuristic evaluation to improve the usability of a telemedicine system. Telemedicine Journal and e-Health. v12. 24-34.
[96]
Signal detection analysis and advertising recognition: an introduction to measurement and interpretation issues. Journal of Marketing Research. v25. 397-404.
[97]
Overcoming roadblocks to effectiveness: incorporating management of performance barriers into models of work group effectiveness. Journal of Applied Psychology. v84. 200-217.
[98]
Communication parallelism and the new media: A new dimension for media richness. Communication Research. v20. 249-276.
[99]
Memory performance by decision-making groups and individuals. Organizational Behavior and Human Decision Processes. v43. 289-300.
[100]
Managerial and organizational cognition: notes from a trip down memory lane. Organization Science. v6. 280-321.
[101]
Transactive memory in close relationships. Journal of Personality and Social Psychology. v61. 923-929.
[102]
Collective mind in organizations: heedful interrelating on flight decks. Administrative Science Quarterly. v38. 357-381.
[103]
A cognitive-based mechanism for constructing software inspection teams. IEEE Transactions on Software Engineering. v30. 811-825.
[104]
Antecedents of coordination effectiveness of software developer dyads from interacting teams: an empirical investigation. IEEE Transactions on Engineering Management. v56. 494-507.

Cited By

View all
  • (2015)A systematic review of shared visualisation to achieve common groundJournal of Visual Languages and Computing10.5555/2781919.278244628:C(83-99)Online publication date: 1-Jun-2015
  • (2015)A Tabletop-Centric Smart Space for Emergency ResponseIEEE Pervasive Computing10.1109/MPRV.2015.2414:2(32-40)Online publication date: 1-Apr-2015
  1. What signal is your inspection team sending to each other? Using a shared collaborative interface to improve shared cognition and implicit coordination in error-detection teams

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image International Journal of Human-Computer Studies
    International Journal of Human-Computer Studies  Volume 71, Issue 4
    April, 2013
    126 pages

    Publisher

    Academic Press, Inc.

    United States

    Publication History

    Published: 01 April 2013

    Author Tags

    1. Collaborative software
    2. Error detection
    3. Explicit coordination
    4. Implicit coordination
    5. Implicit coordination theory
    6. Shared cognition
    7. Signal detection theory

    Qualifiers

    • Article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 20 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2015)A systematic review of shared visualisation to achieve common groundJournal of Visual Languages and Computing10.5555/2781919.278244628:C(83-99)Online publication date: 1-Jun-2015
    • (2015)A Tabletop-Centric Smart Space for Emergency ResponseIEEE Pervasive Computing10.1109/MPRV.2015.2414:2(32-40)Online publication date: 1-Apr-2015

    View Options

    View options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media