More Web Proxy on the site http://driver.im/

research-article

Public Access

Understanding the Practices and Challenges of Networked Orchestration in Research Communities of Practice

Authors:

Haoqi ZhangAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 6, Issue CSCW2

Article No.: 344, Pages 1 - 28

https://doi.org/10.1145/3555764

Published: 11 November 2022 Publication History

Abstract

Work and learning communities have become increasingly networked to support their members in developing the skills to solve complex, real-world problems. Though disciplinary knowledge remains important to tackle these problems, working effectively in these modern-day communities of practice demands the ability for one to learn how to access networked support (e.g., venues, tools, resource guides, or peers) throughout the community for one's needs. Against this backdrop, we study networked orchestration--how community members access and learn to access networked supports--in a community of practice for undergraduate research training. Through field observations and in-depth interviews, we find that students in the networked research community dynamically engage with their mentors and peers across multiple venues throughout the week in order to identify, clarify, and resolve their needs. Mentors in the community monitor how students are engaging with the supports available in the network, and provide coaching on effective strategies when students are ineffective on their own. Finally, we surface the challenges involved in each of these processes and offer practical insights for future ecosystem-level networked orchestration technologies that have an understanding of the interactions occurring across the venues and tools in a community, and can support the learning and practice of effective access strategies. Our paper presents important insights for supporting people's work and learning needs in networked future workplaces and learning communities, and provides guidance on designing new technologies for supporting networked ways of working and learning.

References

[1]

2022. Asana. https://asana.com/product.

[2]

2022. IFTTT and Github Issues. https://ifttt.com/github.

[3]

2022. Jira. https://www.atlassian.com/software/jira.

[4]

2022. Pair Research Platform. https://www.pairresearch.io/.

[5]

2022. Slack. https://slack.com/.

[6]

2022. Slack Workflow Builder. https://slack.com/features/workflow-automation.

[7]

2022. Trello. https://trello.com/.

[8]

Mark S. Ackerman, Juri Dachtera, Volkmar Pipek, and Volker Wulf. 2013. Sharing Knowledge and Expertise: The CSCW View of Knowledge Management. Computer Supported Cooperative Work (CSCW) 22, 4 (Aug. 2013), 531--573. https://doi.org/10.1007/s10606-013--9192--8

Digital Library

[9]

Mark S. Ackerman and Christine Halverson. 2003. Sharing Expertise: The next Step for Knowledge Management. In Social Capital and Information. MIT Press, 273--300. https://doi.org/10.7551/mitpress/6289.003.0015

[10]

Mark S. Ackerman and Thomas W. Malone. 1990. Answer Garden: A Tool for Growing Organizational Memory. In Proceedings of the ACM SIGOIS and IEEE CS TC-OA Conference on Office Information Systems (COCS '90). ACM, New York, NY, USA, 31--39. https://doi.org/10.1145/91474.91485

Digital Library

[11]

Mark S. Ackerman and David W. McDonald. 1996. Answer Garden 2: Merging Organizational Memory with Collaborative Help. In Proceedings of the 1996 ACM Conference on Computer Supported Cooperative Work - CSCW '96. ACM Press, Boston, Massachusetts, United States, 97--105. https://doi.org/10.1145/240080.240203

Digital Library

[12]

Virginia Braun and Victoria Clarke. 2006. Using Thematic Analysis in Psychology. Qualitative Research in Psychology 3, 2 (Jan. 2006), 77--101. https://doi.org/10.1191/1478088706qp063oa

[13]

Susan Cameron and Imani Turtle-Song. 2002. Learning to Write Case Notes Using the SOAP Format. Journal of Counseling & Development 80, 3 (2002), 286--292. https://doi.org/10.1002/j.1556--6678.2002.tb00193.x

[14]

Spencer Evan Carlson, Leesha V. Maliakal, Daniel Rees Lewis, Jamie Gorson, Elizabeth Gerber, and Matthew Easterday. 2018. Defining and Assessing Risk Analysis: The Key to Strategic Iteration in Real-World Problem Solving. (July 2018).

[15]

Kristina B. Dahlin, Laurie R. Weingart, and Pamela J. Hinds. 2005. Team Diversity and Information Use. Academy of Management Journal 48, 6 (Dec. 2005), 1107--1123. https://doi.org/10.5465/amj.2005.19573112

[16]

Pierre Dillenbourg and Patrick Jermann. 2010. Technology for Classroom Orchestration. In New Science of Learning: Cognition, Computers and Collaboration in Education, Myint Swe Khine and Issa M. Saleh (Eds.). Springer New York, New York, NY, 525--552. https://doi.org/10.1007/978--1--4419--5716-0_26

[17]

P. Dillenbourg and P. Tchounikine. 2007. Flexibility in Macro-Scripts for Computer-Supported Collaborative Learning. Journal of Computer Assisted Learning 23, 1 (Feb. 2007), 1--13. https://doi.org/10.1111/j.1365--2729.2007.00191.x

[18]

Carol S. Dweck. 2008. Mindset: The New Psychology of Success. Ballantine Books.

[19]

Amy C. Edmondson. 2012. Teaming: How Organizations Learn, Innovate, and Compete in the Knowledge Economy. John Wiley & Sons.

[20]

Thomas Erickson and Wendy A. Kellogg. 2000. Social Translucence: An Approach to Designing Systems That Support Social Processes. ACM Trans. Comput.-Hum. Interact. 7, 1 (March 2000), 59--83. https://doi.org/10.1145/344949.345004

Digital Library

[21]

Thomas A. Finholt. 2002. Collaboratories. Annual Review of Information Science and Technology 36, 1 (Jan. 2002), 73--107. https://doi.org/10.1002/aris.1440360103

[22]

Thomas A. Finholt and Gary M. Olson. 1997. From Laboratories to Collaboratories: A New Organizational Form for Scientific Collaboration. Psychological Science 8, 1 (Jan. 1997), 28--36. https://doi.org/10.1111/j.1467--9280.1997.tb00540.x

[23]

Frank Fischer, Ingo Kollar, Heinz Mandl, and Jörg M. Haake (Eds.). 2007. Scripting Computer-Supported Collaborative Learning: Cognitive, Computational and Educational Perspectives. Springer US. https://doi.org/10.1007/978-0--387--36949--5

[24]

Gerhard Fischer. 2007. Designing Socio-Technical Environments in Support of Meta-Design and Social Creativity. In Proceedings of the 8th Iternational Conference on Computer Supported Collaborative Learning (CSCL'07). International Society of the Learning Sciences, New Brunswick, New Jersey, USA, 2--11.

Digital Library

[25]

Sharon Nelson-Le Gall. 1981. Help-Seeking: An Understudied Problem-Solving Skill in Children. Developmental Review 1, 3 (Sept. 1981), 224--246. https://doi.org/10.1016/0273--2297(81)90019--8

[26]

Philip J. Guo. 2015. Codeopticon: Real-Time, One-To-Many Human Tutoring for Computer Programming. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST '15). ACM, New York, NY, USA, 599--608. https://doi.org/10.1145/2807442.2807469

Digital Library

[27]

Peter Holdt Christensen and Torben Pedersen. 2018. The Dual Influences of Proximity on Knowledge Sharing. Journal of Knowledge Management 22, 8 (Jan. 2018), 1782--1802. https://doi.org/10.1108/JKM-03--2018-0211

[28]

Kenneth Holstein, Bruce M. McLaren, and Vincent Aleven. 2018. Informing the Design of Teacher Awareness Tools through Causal Alignment Analysis. In Kay, J. and Luckin, R. (Eds.) Rethinking Learning in the Digital Age: Making the Learning Sciences Count. 13th International Conference of the Learning Sciences (ICLS) 2018, Vol. 1. International Society of the Learning Sciences, London, UK.

[29]

Julie S. Hui, Matthew W. Easterday, and Elizabeth M. Gerber. 2019. Distributed Apprenticeship in Online Communities. Human--Computer Interaction 34, 4 (July 2019), 328--378. https://doi.org/10.1080/07370024.2018.1469409

[30]

Julie S. Hui and Elizabeth M. Gerber. 2017. Developing Makerspaces As Sites of Entrepreneurship. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). ACM, New York, NY, USA, 2023--2038. https://doi.org/10.1145/2998181.2998264

Digital Library

[31]

Julie S. Hui, Darren Gergle, and Elizabeth M. Gerber. 2018. IntroAssist: A Tool to Support Writing Introductory Help Requests. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 22. https://doi.org/10.1145/3173574.3173596

Digital Library

[32]

Marleen Huysman and Volker Wulf. 2004. Design Requirements for Knowledge-Sharing Tools: A Need for Social Capital Analysis. In Social Capital and Information Technology. 187--207.

[33]

Sanna Järvelä and Allyson F. Hadwin. 2013. New Frontiers: Regulating Learning in CSCL. Educational Psychologist 48, 1 (Jan. 2013), 25--39. https://doi.org/10.1080/00461520.2012.748006

[34]

Christopher M Johnson. 2001. A Survey of Current Research on Online Communities of Practice. The Internet and Higher Education 4, 1 (Jan. 2001), 45--60. https://doi.org/10.1016/S1096--7516(01)00047--1

[35]

David Jonassen, Johannes Strobel, and Chwee Beng Lee. 2006. Everyday Problem Solving in Engineering: Lessons for Engineering Educators. Journal of Engineering Education 95, 2 (2006), 139--151. https://doi.org/10.1002/j.2168--9830.2006.tb00885.x

[36]

Lars Kobbe, Armin Weinberger, Pierre Dillenbourg, Andreas Harrer, Raija Hämäläinen, Päivi Häkkinen, and Frank Fischer. 2007. Specifying Computer-Supported Collaboration Scripts. International Journal of Computer-Supported Collaborative Learning 2, 2 (Sept. 2007), 211--224. https://doi.org/10.1007/s11412-007--9014--4

[37]

Jean Lave and Etienne Wenger. 1991. Situated Learning: Legitimate Peripheral Participation. Cambridge University Press.

[38]

Eric Lesser and Laurence Prusak. 2000. Communities of Practice, Social Capital and Organizational Knowledge. In Knowledge and Communities. Vol. 1. 123--131. https://doi.org/10.1016/B978-0--7506--7293--1.50011--1

[39]

Daniel G. Rees Lewis, Jamie Gorson, Leesha V. Maliakal, Spencer E. Carlson, Elizabeth M. Gerber, Christopher K. Riesbeck, and Matthew Wayne Easterday. 2018. Planning to iterate: Supporting iterative practices for real-world ill-structured problem-solving. In Proceedings of International Conference of the Learning Sciences, ICLS, Vol. 1. International Society of the Learning Sciences, 9--16.

[40]

Wayne Lutters, Mark Ackerman, James Boster, and David McDonald. 2000. Mapping Knowledge Networks in Organizations: Creating a Knowledge Mapping Instrument. AMCIS 2000 Proceedings (Jan. 2000).

[41]

David W. McDonald and Mark S. Ackerman. 2000. Expertise Recommender: A Flexible Recommendation System and Architecture. In Proceedings of the 2000 ACM Conference on Computer Supported Cooperative Work. ACM Press, Philadelphia, Pennsylvania, United States, 231--240. https://doi.org/10.1145/358916.358994

Digital Library

[42]

Mariel Miller and Allyson Hadwin. 2015. Scripting and Awareness Tools for Regulating Collaborative Learning: Changing the Landscape of Support in CSCL. Computers in Human Behavior 52 (Nov. 2015), 573--588. https://doi.org/10.1016/j.chb.2015.01.050

Digital Library

[43]

Robert C. Miller, Haoqi Zhang, Eric Gilbert, and Elizabeth Gerber. 2014. Pair Research: Matching People for Collaboration, Learning, and Productivity. In Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '14). ACM, New York, NY, USA, 1043--1048. https://doi.org/10.1145/2531602.2531703

Digital Library

[44]

Janine Nahapiet and Sumantra Ghoshal. 1998. Social Capital, Intellectual Capital, and the Organizational Advantage. The Academy of Management Review 23, 2 (1998), 242--266. https://doi.org/10.2307/259373

[45]

Richard S. Newman. 1994. Adaptive Help Seeking: A Strategy of Self-Regulated Learning. In Self-Regulation of Learning and Performance: Issues and Educational Applications. Lawrence Erlbaum Associates, Inc, Hillsdale, NJ, US, 283--301.

[46]

Walter Powell. 1990. Neither Market Nor Hierarchy: Network Forms of Organization. Research in Organizational Behaviour 12 (Jan. 1990), 295--336.

[47]

Sadhana Puntambekar and Janet L. Kolodner. 2005. Toward Implementing Distributed Scaffolding: Helping Students Learn Science from Design. Journal of Research in Science Teaching 42, 2 (2005), 185--217. https://doi.org/10.1002/tea.20048

[48]

John J Robinson, Jim Maddock, and Kate Starbird. 2015. Examining the Role of Human and Technical Infrastructure during Emergency Response. In 12th Proceedings of the International Conference on Information Systems for Crisis Response and Management. ISCRAM Association, Krystiansand, Norway.

[49]

Aaron Shaw, Haoqi Zhang, Andrés Monroy-Hernández, Sean Munson, Benjamin Mako Hill, Elizabeth Gerber, Peter Kinnaird, and Patrick Minder. 2014. Computer Supported Collective Action. Interactions 21, 2 (March 2014), 74--77. https://doi.org/10.1145/2576875

Digital Library

[50]

Herbert A. Simon. 1973. The Structure of Ill Structured Problems. Artificial Intelligence 4, 3 (Dec. 1973), 181--201. https://doi.org/10.1016/0004--3702(73)90011--8

[51]

Linn C. Stuckenbruck. 1979. The Matrix Organization. Project Management Quarterly 10, 3 (1979), 21--33.

[52]

Maria Rita Tagliaventi and Elisa Mattarelli. 2006. The Role of Networks of Practice, Value Sharing, and Operational Proximity in Knowledge Flows between Professional Groups. Human Relations 59, 3 (March 2006), 291--319. https://doi.org/10.1177/0018726706064175

[53]

Stephanie Teasley, Lisa Covi, M. S. Krishnan, and Judith S. Olson. 2000. How Does Radical Collocation Help a Team Succeed?. In Proceedings of the 2000 ACM Conference on Computer Supported Cooperative Work (CSCW '00). ACM, New York, NY, USA, 339--346. https://doi.org/10.1145/358916.359005

Digital Library

[54]

Jaime Teevan, Brent Hecht, Sonia Jaffe, Nancy Baym, Rachel Bergmann, Matt Brodsky, Bill Buxton, Jenna Butler, Adam Coleman, Mary Czerwinski, Brian Houck, Ginger Hudson, Shamsi Iqbal, Chandra Maddila, Kate Nowak, Emily Peloquin, Ricardo Reyna Fernandez, Sean Rintel, Abigail Sellen, Tiffany Smith, Margaret-Anne Storey, Siddharth Suri, Hana Wolf, and Longqi Yang. 2021. The New Future of Work: Research from Microsoft into the Pandemic's Impact on Work Practices. Technical Report MSR-TR-2021--1. Microsoft.

[55]

Mike Tissenbaum, Camillia Matuk, Matthew Berland, Leila Lyons, Felipe Cocco, Marcia Linn, Jan L. Plass, Nik Hajny, Al Olsen, Beat Schwendimann, Mina Shirvani Boroujeni, James D. Slotta, Jonathan Vitale, Libby Gerard, and Pierre Dillenbourg. 2016. Real-Time Visualization of Student Activities to Support Classroom Orchestration. (July 2016).

[56]

Duane P. Truex, Richard Baskerville, and Heinz Klein. 1999. Growing Systems in Emergent Organizations. Commun. ACM 42, 8 (Aug. 1999), 117--123. https://doi.org/10.1145/310930.310984

Digital Library

[57]

Lawrence L. Weed. 1964. Medical Records, Patient Care, and Medical Education. Irish Journal of Medical Science 39, 6 (June 1964), 271--282. https://doi.org/10.1007/BF02945791

[58]

Daniel M. Wegner. 1987. Transactive Memory: A Contemporary Analysis of the Group Mind. In Theories of Group Behavior, Brian Mullen and George R. Goethals (Eds.). Springer New York, New York, NY, 185--208. https://doi.org/10.1007/978--1--4612--4634--3_9

[59]

Armin Weinberger, Ingo Kollar, Yannis Dimitriadis, Kati Mäkitalo-Siegl, and Frank Fischer. 2009. Computer-Supported Collaboration Scripts. In Technology-Enhanced Learning: Principles and Products, Nicolas Balacheff, Sten Ludvigsen, Ton de Jong, Ard Lazonder, and Sally Barnes (Eds.). Springer Netherlands, Dordrecht, 155--173. https://doi.org/10.1007/978--1--4020--9827--7_10

[60]

Etienne Wenger. 1998. Communities of Practice: Learning, Meaning, and Identity. Cambridge University Press, Cambridge. https://doi.org/10.1017/CBO9780511803932

[61]

Longqi Yang, David Holtz, Sonia Jaffe, Siddharth Suri, Shilpi Sinha, Jeffrey Weston, Connor Joyce, Neha Shah, Kevin Sherman, Brent Hecht, and Jaime Teevan. 2021. The Effects of Remote Work on Collaboration among Information Workers. Nature Human Behaviour (Sept. 2021), 1--12. https://doi.org/10.1038/s41562-021-01196--4

[62]

Haoqi Zhang, Matthew W. Easterday, Elizabeth M. Gerber, Daniel Rees Lewis, and Leesha Maliakal. 2017. Agile Research Studios: Orchestrating Communities of Practice to Advance Research Training. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). ACM, New York, NY, USA, 220--232. https://doi.org/10.1145/2998181.2998199

Digital Library

Cited By

Im JToyama K(2024)Understanding How to Design a Social Computing System That Helps PhD Students Collectively Navigate Mistreatment or Abuse in Advising RelationshipsExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651097(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3651097
Huang EGarg KGómez-Zará DHui JKulkarni CMassimi MChurchill EGerber E(2023)Supporting Workers in Developing Effective Collaboration Skills for Complex WorkCompanion Publication of the 2023 Conference on Computer Supported Cooperative Work and Social Computing10.1145/3584931.3611290(486-489)Online publication date: 14-Oct-2023
https://dl.acm.org/doi/10.1145/3584931.3611290

Index Terms

Understanding the Practices and Challenges of Networked Orchestration in Research Communities of Practice
1. Human-centered computing
  1. Collaborative and social computing
    1. Empirical studies in collaborative and social computing
  2. Human computer interaction (HCI)
    1. Empirical studies in HCI

Recommendations

Online communities for teachers and lifelong learners: a framework for comparing similarities and identifying differences in communities of practice and communities of interest

In recent years online and blended communities have become a popular topic among educationalists. In this paper we present a framework that supports the analysis, development and maintenance of online and blended communities. This is applied to two ...
Communities of practice: dare to share the knowledge
SIGUCCS '04: Proceedings of the 32nd annual ACM SIGUCCS conference on User services

Communities of practice are not a new idea, but they are being looked at more closely as an important tool for learning and mastering knowledge challenges. Communities of practice often lend themselves to a particular strategic intent for their ...
Communities of practice in innovation management: sensemaking challenges to mobile organisations

This research article explores the social issues of subjectivity in innovation management, by discussing the significance that communities' symbolic interpretation has on their sensemaking and engagement in informal innovation communities. This article ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 6, Issue CSCW2

CSCW

November 2022

8205 pages

EISSN:2573-0142

DOI:10.1145/3571154

Editor:
Jeff Nichols
Google

Issue’s Table of Contents

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 November 2022

Published in PACMHCI Volume 6, Issue CSCW2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
188
Total Downloads

Downloads (Last 12 months)118
Downloads (Last 6 weeks)25

Reflects downloads up to 11 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Im JToyama K(2024)Understanding How to Design a Social Computing System That Helps PhD Students Collectively Navigate Mistreatment or Abuse in Advising RelationshipsExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651097(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3651097
Huang EGarg KGómez-Zará DHui JKulkarni CMassimi MChurchill EGerber E(2023)Supporting Workers in Developing Effective Collaboration Skills for Complex WorkCompanion Publication of the 2023 Conference on Computer Supported Cooperative Work and Social Computing10.1145/3584931.3611290(486-489)Online publication date: 14-Oct-2023
https://dl.acm.org/doi/10.1145/3584931.3611290

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents