More Web Proxy on the site http://driver.im/

research-article

Open access

Evaluating the impact of the Wikipedia Teahouse on newcomer socialization and retention

Authors:

Jonathan T. Morgan,

Aaron HalfakerAuthors Info & Claims

OpenSym '18: Proceedings of the 14th International Symposium on Open Collaboration

Article No.: 20, Pages 1 - 7

https://doi.org/10.1145/3233391.3233544

Published: 22 August 2018 Publication History

Abstract

Effective socialization of new contributors is vital for the long-term sustainability of open collaboration projects. Previous research has identified many common barriers to participation. However, few interventions employed to increase newcomer retention over the long term by improving aspects of the onboarding experience have demonstrated success. This study presents an evaluation of the impact of one such intervention, the Wikipedia Teahouse, on new editor survival. In a controlled experiment, we find that new editors invited to the Teahouse are retained at a higher rate than editors who do not receive an invite. The effect is observed for both low-and high-activity newcomers, and for both short- and long-term survival.

References

[1]

Mark S. Ackerman and David W. McDonald. 1996. Answer Garden 2: Merging Organizational Memory with Collaborative Help. In Proceedings of the 1996 ACM Conference on Computer Supported Cooperative Work (CSCW '96). ACM, New York, NY, USA, 97--105.

Digital Library

[2]

Ivan Beschastnikh, Travis Kriplean, and David W McDonald. 2008. Wikipedian Self-Governance in Action: Motivating the Policy Lens. In ICWSM.

[3]

Moira Burke, Robert Kraut, and Elisabeth Joyce. 2010. Membership Claims and Requests: Conversation-Level Newcomer Socialization Strategies in Online Groups. Small Group Research 41, 1 (2010), 4--40. arXiv:https://doi.org/10.1177/1046496409351936

[4]

Boreum Choi, Kira Alexander, Robert E. Kraut, and John M. Levine. 2010. Socialization Tactics in Wikipedia and Their Effects. In Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work (CSCW '10). ACM, New York, NY, USA, 107--116.

Digital Library

[5]

Giovanni Luca Ciampaglia and Dario Taraborelli. 2015. MoodBar: Increasing New User Retention in Wikipedia Through Lightweight Socialization. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '15). ACM, New York, NY, USA, 734--742.

Digital Library

[6]

Nicolas Ducheneaut. 2005. Socialization in an open source software community: A socio-technical analysis. Computer Supported Cooperative Work (CSCW) 14, 4 (2005), 323--368.

Digital Library

[7]

Andrea Forte and Cliff Lampe. 2013. Defining, Understanding, and Supporting Open Collaboration: Lessons From the Literature. American Behavioral Scientist 57, 5 (2013), 535--547. arXiv:https://doi.org/10.1177/0002764212469362

[8]

Lauren Gardener, Panthea Lee, Abigail Ripstra, and Neil Patel Quinn. 2017. New Editor Experiences. https://www.mediawiki.org/wiki/New_Editor_Experiences

[9]

R Stuart Geiger, Aaron Halfaker, Maryana Pinchuk, and Steven Walling. 2012. Defense Mechanism or Socialization Tactic? Improving. In Proceedings of the Sixth International AAAI Conference on Weblogs and Social Media.

[10]

Aaron Halfaker. 2013. Wikimedia Foundation Growth Team experiments: Onboarding new Wikipedians. https://meta.wikimedia.org/wiki/Research:Onboarding_new_Wikipedians R@5https://www.mediawiki.org/wiki/ORES

[11]

Aaron Halfaker, R. Stuart Geiger, Jonathan T. Morgan, and John Riedl. 2013. The Rise and Decline of an Open Collaboration System: How WikipediaâĂ&Zacute;s Reaction to Popularity Is Causing Its Decline. American Behavioral Scientist 57, 5 (2013), 664--688. arXiv:https://doi.org/10.1177/0002764212469365

[12]

Aaron Halfaker, R. Stuart Geiger, and Loren G. Terveen. 2014. Snuggle: Designing for Efficient Socialization and Ideological Critique. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 311--320.

Digital Library

[13]

John M Lachin. 2000. Statistical considerations in the intent-to-treat principle. Contemporary Clinical Trials 21, 3 (2000), 167--189.

[14]

Cliff Lampe and Erik Johnston. 2005. Follow the (Slash) Dot: Effects of Feedback on New Members in an Online Community. In Proceedings of the 2005 International ACM SIGGROUP Conference on Supporting Group Work (GROUP '05). ACM, New York, NY, USA, 11--20.

Digital Library

[15]

Cliff Lampe, Rick Wash, Alcides Velasquez, and Elif Ozkaya. 2010. Motivations to Participate in Online Communities. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 1927--1936.

Digital Library

[16]

Jonathan T Morgan. 2012. Teahouse phase two report. https://meta.wikimedia.org/wiki/Research:Teahouse/Phase_2_report

[17]

Jonathan T. Morgan, Siko Bouterse, Heather Walls, and Sarah Stierch. 2013. Tea and Sympathy: Crafting Positive New User Experiences on Wikipedia. In Proceedings of the 2013 Conference on Computer Supported Cooperative Work (CSCW '13). ACM, New York, NY, USA, 839--848.

Digital Library

[18]

Jonathan T. Morgan and Mark Zachry. 2010. Negotiating with Angry Mastodons: The Wikipedia Policy Environment As Genre Ecology. In Proceedings of the 16th ACM International Conference on Supporting Group Work (GROUP '10). ACM, New York, NY, USA, 165--168.

Digital Library

[19]

David R. Musicant, Yuqing Ren, James A. Johnson, and John Riedl. 2011. Mentoring in Wikipedia: A Clash of Cultures. In Proceedings of the 7th International Symposium on Wikis and Open Collaboration (WikiSym '11). ACM, New York, NY, USA, 173--182.

Digital Library

[20]

Sneha Narayan, Jake Orlowitz, Jonathan Morgan, Benjamin Mako Hill, and Aaron Shaw. 2017. The Wikipedia Adventure: Field Evaluation of an Interactive Tutorial for New Users. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). ACM, New York, NY, USA, 1785--1799.

Digital Library

[21]

Katherine Panciera, Aaron Halfaker, and Loren Terveen. 2009. Wikipedians Are Born, Not Made: A Study of Power Editors on Wikipedia. In Proceedings of the ACM 2009 International Conference on Supporting Group Work (GROUP '09). ACM, New York, NY, USA, 51--60.

Digital Library

[22]

Maryana Pinchuk. 2012. Wikimedia Foundation Growth Team experiments: Post-edit feedback. https://meta.wikimedia.org/wiki/Research:Post-edit_feedback

[23]

Jenny Preece, Blair Nonnecke, and Dorine Andrews. 2004. The top five reasons for lurking: improving community experiences for everyone. Computers in human behavior 20, 2 (2004), 201--223.

[24]

Yuqing Ren, Robert Kraut, Sara Kiesler, and Paul Resnick. 2012. Encouraging commitment in online communities. Building successful online communities: Evidence-based social design (2012), 77--124.

[25]

Wikimedia Foundation Research. 2014. Research Metric standardization: Surviving new editor. https://meta.wikimedia.org/wiki/Research:Surviving_new_editor

[26]

Ellen L Rubenstein. 2015. Rituals of introduction and revolving roles: socialization in an online breast cancer community. Library & Information Science Research 37, 4 (2015), 353--362.

[27]

Igor Steinmacher, Tayana Conte, Marco Aurélio Gerosa, and David Redmiles. 2015. Social Barriers Faced by Newcomers Placing Their First Contribution in Open Source Software Projects. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '15). ACM, New York, NY, USA, 1379--1392.

Digital Library

[28]

I. Steinmacher, I. Wiese, A. P. Chaves, and M. A. Gerosa. 2013. Why do newcomers abandon open source software projects?. In 2013 6th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE). 25--32.

[29]

Igor Steinmacher, Igor Scaliante Wiese, Tayana Conte, Marco Aurélio Gerosa, and David Redmiles. 2014. The Hard Life of Open Source Software Project Newcomers. In Proceedings of the 7th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE 2014). ACM, New York, NY, USA, 72--78.

Digital Library

[30]

Bongwon Suh, Gregorio Convertino, Ed H. Chi, and Peter Pirolli. 2009. The Singularity is Not Near: Slowing Growth of Wikipedia. In Proceedings of the 5th International Symposium on Wikis and Open Collaboration (WikiSym '09). ACM, New York, NY, USA, Article 8, 10 pages.

Digital Library

[31]

Georg Von Krogh, Sebastian Spaeth, and Karim R Lakhani. 2003. Community, joining, and specialization in open source software innovation: a case study. Research Policy 32, 7 (2003), 1217--1241.

[32]

Steven Walling and Dario Taraborelli. 2012. Wikimedia Foundation Growth Team experiments: Account creation UX. https://meta.wikimedia.org/wiki/Research:Account_creation_UX

[33]

Dennis M. Wilkinson. 2008. Strong Regularities in Online Peer Production. In Proceedings of the 9th ACM Conference on Electronic Commerce (EC '08). ACM, New York, NY, USA, 302--309.

Digital Library

[34]

Haiyi Zhu, Amy Zhang, Jiping He, Robert E. Kraut, and Aniket Kittur. 2013. Effects of Peer Feedback on Contribution: A Field Experiment in Wikipedia. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 2253--2262.

Digital Library

Cited By

Champion KHill B(2024)Countering underproduction of peer produced goodsNew Media & Society10.1177/14614448241248139Online publication date: 16-May-2024
https://doi.org/10.1177/14614448241248139
Ardati AMiguel AVoss A(2024)Designing for Care in the Wikipedia CommunityProceedings of the Participatory Design Conference 2024: Full Papers - Volume 110.1145/3666094.3666112(75-85)Online publication date: 11-Aug-2024
https://dl.acm.org/doi/10.1145/3666094.3666112
Schwitter N(2024)How offline meetings affect online activities: the case of WikipediaEPJ Data Science10.1140/epjds/s13688-024-00506-w13:1Online publication date: 5-Nov-2024
https://doi.org/10.1140/epjds/s13688-024-00506-w
Show More Cited By

Index Terms

Evaluating the impact of the Wikipedia Teahouse on newcomer socialization and retention
1. Human-centered computing
  1. Collaborative and social computing
    1. Empirical studies in collaborative and social computing
  2. Human computer interaction (HCI)
    1. Empirical studies in HCI

Recommendations

Increasing Participation in Peer Production Communities with the Newcomer Homepage
CSCW

For peer production communities to be sustainable, they must attract and retain new contributors. Studies have identified social and technical barriers to entry and discovered some potential solutions, but these solutions have typically focused on a ...
Socialization tactics in wikipedia and their effects
CSCW '10: Proceedings of the 2010 ACM conference on Computer supported cooperative work

Socialization of newcomers is critical both for conventional groups. It helps groups perform effectively and the newcomers develop commitment. However, little empirical research has investigated the impact of specific socialization tactics on newcomers' ...
Out With The Old, In With The New?: Unpacking Member Turnover in Online Production Groups

Nearly any group is subject to turnover : some people leave, while others join. Turnover can be especially high in online groups, since participation typically is strictly voluntary. We investigated the effects of member turnover in online groups, ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

OpenSym '18: Proceedings of the 14th International Symposium on Open Collaboration

August 2018

208 pages

ISBN:9781450359368

DOI:10.1145/3233391

Copyright © 2018 Owner/Author.

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivs International 4.0 License.

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 August 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

OpenSym '18

OpenSym '18: The 14th International Symposium on Open Collaboration

August 22 - 24, 2018

Paris, France

Acceptance Rates

OpenSym '18 Paper Acceptance Rate 27 of 38 submissions, 71%;

Overall Acceptance Rate 108 of 195 submissions, 55%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
891
Total Downloads

Downloads (Last 12 months)225
Downloads (Last 6 weeks)17

Reflects downloads up to 25 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Champion KHill B(2024)Countering underproduction of peer produced goodsNew Media & Society10.1177/14614448241248139Online publication date: 16-May-2024
https://doi.org/10.1177/14614448241248139
Ardati AMiguel AVoss A(2024)Designing for Care in the Wikipedia CommunityProceedings of the Participatory Design Conference 2024: Full Papers - Volume 110.1145/3666094.3666112(75-85)Online publication date: 11-Aug-2024
https://dl.acm.org/doi/10.1145/3666094.3666112
Schwitter N(2024)How offline meetings affect online activities: the case of WikipediaEPJ Data Science10.1140/epjds/s13688-024-00506-w13:1Online publication date: 5-Nov-2024
https://doi.org/10.1140/epjds/s13688-024-00506-w
Ren YZhang HKraut R(2023)How Did They Build the Free Encyclopedia? A Literature Review of Collaboration and Coordination among Wikipedia EditorsACM Transactions on Computer-Human Interaction10.1145/361736931:1(1-48)Online publication date: 29-Nov-2023
https://dl.acm.org/doi/10.1145/3617369
Ajmani LVincent NChancellor S(2023)Peer Produced Friction: How Page Protection on Wikipedia Affects Editor Engagement and ConcentrationProceedings of the ACM on Human-Computer Interaction10.1145/36101987:CSCW2(1-33)Online publication date: 4-Oct-2023
https://dl.acm.org/doi/10.1145/3610198
Yu YMcDonald D(2023)"Why do you need 400 photographs of 400 different Lockheed Constellation?": Value Expressions by Contributors and Users of Wikimedia CommonsProceedings of the ACM on Human-Computer Interaction10.1145/36100947:CSCW2(1-34)Online publication date: 4-Oct-2023
https://dl.acm.org/doi/10.1145/3610094
Schwitter N(2023)Bridging the offline and online: 20 years of offline meeting data of the German-language WikipediaJournal of Computational Social Science10.1007/s42001-023-00225-86:2(1103-1124)Online publication date: 26-Sep-2023
https://doi.org/10.1007/s42001-023-00225-8
Miquel-Ribé MConsonni CLaniado D(2022)Community Vital Signs: Measuring Wikipedia Communities’ Sustainable Growth and RenewalSustainability10.3390/su1408470514:8(4705)Online publication date: 14-Apr-2022
https://doi.org/10.3390/su14084705
Khatri SShaw ADasgupta SHill B(2022)The social embeddedness of peer production: A comparative qualitative analysis of three Indian language Wikipedia editionsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501832(1-18)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501832
Adak SChakraborty SDas PDas MDash AHazra RMathew BSaha PSarkar SMukherjee A(2022)Mining the online infosphere: A surveyWIREs Data Mining and Knowledge Discovery10.1002/widm.145312:5Online publication date: 28-Feb-2022
https://doi.org/10.1002/widm.1453
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten