[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/1978942.1979366acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Design lessons from the fastest q&a site in the west

Published: 07 May 2011 Publication History

Abstract

This paper analyzes a Question & Answer site for programmers, Stack Overflow, that dramatically improves on the utility and performance of Q&A systems for technical domains. Over 92% of Stack Overflow questions about expert topics are answered - in a median time of 11 minutes. Using a mixed methods approach that combines statistical data analysis with user interviews, we seek to understand this success. We argue that it is not primarily due to an a priori superior technical design, but also to the high visibility and daily involvement of the design team within the community they serve. This model of continued community leadership presents challenges to both CSCW systems research as well as to attempts to apply the Stack Overflow model to other specialized knowledge domains.

References

[1]
Ackerman, M. S. and Malone, T. W. Answer Garden: a tool for growing organizational memory. Proceedings of the ACM SIGOIS and IEEE CS TC-OA conference on Office information systems, ACM (1990), 31--39.
[2]
Adamic, L. A., Zhang, J., Bakshy, E., and Ackerman, M. S. Knowledge sharing and yahoo answers: everyone knows something. Proceeding of WWW 2008, ACM (2008), 665--674.
[3]
Barcellini, F., Détienne, F., Burkhardt, J., and Sack, W. Thematic coherence and quotation practices in OSS design-oriented online discussions. Proceedings of GROUP 2005, ACM (2005), 177--186.
[4]
Bouguessa, M., Dumoulin, B., and Wang, S. Identifying authoritative actors in question-answering forums: the case of Yahoo! answers. Proceeding of ACM SIGKDD 2008, ACM (2008), 866--874.
[5]
Brandt, J., Dontcheva, M., Weskamp, M., and Klemmer, S. R. Example-centric programming: integrating web search into the development environment. Proceedings of CHI 2010, ACM (2010), 513--522.
[6]
Brooks, F. P. The Design of Design: Essays from a Computer Scientist. Addison-Wesley Professional 2010.
[7]
Corbin, J. and Strauss, A. C. Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory. Sage Publications, Inc, 2007.
[8]
Dearman, D. and Truong, K. N. Why users of Yahoo! Answers do not answer questions. Proceedings of CHI 2010, ACM (2010), 329--332.
[9]
Grudin, J. Groupware and social dynamics: eight challenges for developers. Communications of the ACM 37, 1 (1994), 92--105.
[10]
Gyöngyi, Z., Koutrika, G., Pedersen, J., and Garcia-Molina, H. Questioning Yahoo! Answers. Proceedings of the First Workshop on Question Answering on the Web (at WWW 2008), (2008).
[11]
Harper, F. M., Moy, D., and Konstan, J. A. Facts or friends?: distinguishing informational and conversational questions in social Q&A sites. Proceedings of CHI 2009, ACM (2009), 759--768.
[12]
Hartmann, B., MacDougall, D., Brandt, J., and Klemmer, S. R. What would other programmers do: suggesting solutions to error messages. Proceedings of CHI 2010, ACM (2010), 1019--1028.
[13]
Horowitz, D. and Kamvar, S. D. The anatomy of a large-scale social search engine. Proceedings of WWW 2010, ACM (2010), 431--440.
[14]
Hsieh, G. and Counts, S. mimir: a market-based real-time question and answer service. Proceedings of CHI 2009, ACM (2009), 769--778.
[15]
Hsieh, G., Kraut, R. E., and Hudson, S. E. Why pay? Exploring how financial incentives are used for question & answer. Proceedings of CHI 2010, ACM (2010), 305--314.
[16]
Kleinberg, J. M. Authoritative sources in a hyperlinked environment. Journal of the ACM 46/5, 1999, 604--632.
[17]
Konstan, J. A., Miller, B. N., Maltz, D., Herlocker, J. L., Gordon, L. R., and Riedl, J. GroupLens: applying collaborative filtering to Usenet news. Communications of the ACM 40, 1997, 77--87.
[18]
Kumar, R., Lifshits, Y., and Tomkins, A. Evolution of two-sided markets. Proceedings of the third ACM international conference on Web search and data mining, ACM (2010), 311--320.
[19]
Lampe, C. and Resnick, P. Slash(dot) and burn: distributed moderation in a large online conversation space. Proceedings of CHI 2004, ACM (2004), 543--550.
[20]
Morris, M. R., Teevan, J., and Panovich, K. What do people ask their social networks, and why?: a survey study of status message q&a behavior. Proceedings of CHI 2010, ACM (2010), 1739--1748.
[21]
Nam, K. K., Ackerman, M. S., and Adamic, L. A. Questions in, knowledge in? A study of Naver's question answering community. Proceedings of CHI 2009, ACM (2009), 779--788.
[22]
Oktay, H., Taylor, B. J., and Jensen, D. D. Causal Discovery in Social Media Using Quasi-Experimental Designs. Proceedings of the ACM/SIGKDD Workshop on Social Media Analytics, (2010).
[23]
Raban, D. R. and Harper, F. M. Motivations for Answering Questions Online Abstract. New Media and Innovative Technologies, (2008).
[24]
Raymond, E. S. Homesteading the Noosphere. In The Cathedral and the Bazaar. O'Reilly, 1999.
[25]
Rodrigues, E. M. and Milic-Frayling, N. Socializing or knowledge sharing? Characterizing social intent in community question answering. Proceedings of CHI 2009, ACM (2009), 1127--1136.
[26]
Torrey, C., Churchill, E. F., and McDonald, D. W. Learning how: the search for craft knowledge on the internet. Proceedings of CHI 2009, ACM (2009), 1371--1380.
[27]
Zhang, J., Ackerman, M. S., and Adamic, L. Expertise networks in online communities: structure and algorithms. Proceedings of WWW 2007, ACM (2007), 221--230.

Cited By

View all
  • (2025)How are discussions linked? A link analysis study on GitHub DiscussionsJournal of Systems and Software10.1016/j.jss.2024.112196219(112196)Online publication date: Jan-2025
  • (2024)"Positive reinforcement helps breed positive behavior": Moderator Perspectives on Encouraging Desirable BehaviorProceedings of the ACM on Human-Computer Interaction10.1145/36869298:CSCW2(1-33)Online publication date: 8-Nov-2024
  • (2024)A Disruptive Research Playbook for Studying Disruptive InnovationsACM Transactions on Software Engineering and Methodology10.1145/367817233:8(1-29)Online publication date: 15-Jul-2024
  • Show More Cited By

Index Terms

  1. Design lessons from the fastest q&a site in the west
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Please enable JavaScript to view thecomments powered by Disqus.

        Information & Contributors

        Information

        Published In

        cover image ACM Conferences
        CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
        May 2011
        3530 pages
        ISBN:9781450302289
        DOI:10.1145/1978942
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Sponsors

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 07 May 2011

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. mixed methods analysis
        2. q&a

        Qualifiers

        • Research-article

        Conference

        CHI '11
        Sponsor:

        Acceptance Rates

        CHI '11 Paper Acceptance Rate 410 of 1,532 submissions, 27%;
        Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

        Upcoming Conference

        CHI 2025
        ACM CHI Conference on Human Factors in Computing Systems
        April 26 - May 1, 2025
        Yokohama , Japan

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)114
        • Downloads (Last 6 weeks)16
        Reflects downloads up to 12 Dec 2024

        Other Metrics

        Citations

        Cited By

        View all
        • (2025)How are discussions linked? A link analysis study on GitHub DiscussionsJournal of Systems and Software10.1016/j.jss.2024.112196219(112196)Online publication date: Jan-2025
        • (2024)"Positive reinforcement helps breed positive behavior": Moderator Perspectives on Encouraging Desirable BehaviorProceedings of the ACM on Human-Computer Interaction10.1145/36869298:CSCW2(1-33)Online publication date: 8-Nov-2024
        • (2024)A Disruptive Research Playbook for Studying Disruptive InnovationsACM Transactions on Software Engineering and Methodology10.1145/367817233:8(1-29)Online publication date: 15-Jul-2024
        • (2024)It Takes a Team to Triumph: Collaborative Expert Finding in Community QA NetworksProceedings of the 2024 Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region10.1145/3673791.3698404(164-174)Online publication date: 8-Dec-2024
        • (2024)“It would work for me too”: How Online Communities Shape Software Developers’ Trust in AI-Powered Code Generation ToolsACM Transactions on Interactive Intelligent Systems10.1145/365199014:2(1-39)Online publication date: 9-Mar-2024
        • (2024)Is Stack Overflow Obsolete? An Empirical Study of the Characteristics of ChatGPT Answers to Stack Overflow QuestionsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642596(1-17)Online publication date: 11-May-2024
        • (2024)Wikibench: Community-Driven Data Curation for AI Evaluation on WikipediaProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642278(1-24)Online publication date: 11-May-2024
        • (2024)How do Developers Talk about GitHub Actions? Evidence from Online Software Development CommunityProceedings of the IEEE/ACM 46th International Conference on Software Engineering10.1145/3597503.3623327(1-13)Online publication date: 20-May-2024
        • (2024)A Large-Scale Survey on the Usability of AI Programming Assistants: Successes and ChallengesProceedings of the IEEE/ACM 46th International Conference on Software Engineering10.1145/3597503.3608128(1-13)Online publication date: 20-May-2024
        • (2024)Community Security Champions: Studying the Most Influential Users on Security Stack Exchange2024 IEEE Secure Development Conference (SecDev)10.1109/SecDev61143.2024.00015(93-104)Online publication date: 7-Oct-2024
        • Show More Cited By

        View Options

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media