[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

What Happens to All These Hackathon Projects?: Identifying Factors to Promote Hackathon Project Continuation

Published: 15 October 2020 Publication History

Abstract

Time-based events, such as hackathons and codefests, have become a global phenomenon attracting thousands of participants to hundreds of events every year. While research on hackathons has grown considerably, there is still limited insight into what happens to hackathon projects after the event itself has ended. While case studies have provided rich descriptions of hackathons and their aftermath, we add to this literature a large-scale quantitative study of continuation across hackathons in a variety of domains. Our findings indicate that a considerable number of projects get continued after a hackathon has ended. Our results also suggest that short- and long-term continuation are different phenomena. While short-term continuation is associated with technical preparation, number of technologies used in a project and winning a hackathon, long-term continuation is predicated on skill diversity among team members, their technical capabilities in relationship to the technologies and their intention to expand the reach of a project. Moreover, we found intensive short-term activity to be associated with a lower likelihood of long-term project continuation.

References

[1]
Icek Ajzen. 1991. The theory of planned behavior. Organizational behavior and human decision processes, Vol. 50, 2 (1991), 179--211.
[2]
Pantelis Angelidis, Leslie Berman, Maria de la Luz Casas-Perez, Leo Anthony Celi, George E Dafoulas, Alon Dagan, Braiam Escobar, Diego M Lopez, Julieta Noguez, Juan Sebastian Osorio-Valencia, et almbox. 2016. The hackathon model to spur innovation around global mHealth. Journal of medical engineering & technology, Vol. 40, 7--8 (2016), 392--399.
[3]
Bastiaan Baccarne, Peter Mechant, Dimitri Schuurma, Lieven De Marez, and Pieter Colpaert. 2014. Urban socio-technical innovations with and by citizens. Interdisciplinary Studies Journal, Vol. 3, 4 (2014), 143.
[4]
Anol Bhattacherjee. 2001. Understanding information systems continuance: an expectation-confirmation model. MIS quarterly (2001), 351--370.
[5]
Nataly Birbeck, Shaun Lawson, Kellie Morrissey, Tim Rapley, and Patrick Olivier. 2017. Self Harmony: rethinking hackathons to design and critique digital technologies for those affected by self-harm. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 146--157.
[6]
Gerard Briscoe. 2014. Digital innovation: The hackathon phenomenon. Creativeworks London, Vol. 6 (2014), 1--13.
[7]
Alex Carruthers. 2014. Open Data Day Hackathon 2014 at Edmonton Public Library. Partnership: The Canadian Journal of Library and Information Practice and Research, Vol. 9, 2 (2014), 1.
[8]
Nikos LD Chatzisarantis and Martin S Hagger. 2008. Influences of personality traits and continuation intentions on physical activity participation within the theory of planned behaviour. Psychology & Health, Vol. 23, 3 (2008), 347--367.
[9]
Joohee Choi and Yla Tausczik. 2017. Characteristics of collaboration in the emerging practice of open data analysis. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 835--846.
[10]
Irene-Angelica Chounta, Sven Manske, and Ulrich Hoppe. 2017. ”From Making to Learning”: Introducing Dev Camps as an Educational Paradigm for Re-inventing Project-based Learning. International Journal of Educational Technology in Higher Education 14 (2017), 18.
[11]
Aaron Ciaghi, Tatenda Chatikobo, Lorenzo Dalvit, Darsha Indrajith, Mfundiso Miya, Pietro Benedetto Molini, and Adolfo Villafiorita. 2016. Hacking for Southern Africa: Collaborative development of hyperlocal services for marginalised communities. In IST-Africa Week Conference, 2016. IEEE, 1--9.
[12]
David Cobham, Bruce Hargrave, Kevin Jacques, Carl Gowan, Jack Laurel, Scott Ringham, et almbox. 2017a. From hackathon to student enterprise: an evaluation of creating successful and sustainable student entrepreneurial activity initiated by a university hackathon. In 9th annual International Conference on Education and New Learning Technologies. EDULEARN.
[13]
David Cobham, Kevin Jacques, Carl Gowan, Jack Laurel, Scott Ringham, et almbox. 2017b. From appfest to entrepreneurs: using a hackathon event to seed a university student-led enterprise. In 11th annual International Technology, Education and Development Conference.
[14]
Jacob Cohen. 1968. Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. Psychological bulletin, Vol. 70, 4 (1968), 213.
[15]
Jacob Cohen. 2013. Statistical power analysis for the behavioral sciences .Routledge.
[16]
R Cameron Craddock, Daniel S Margulies, Pierre Bellec, B Nolan Nichols, Sarael Alcauter, Fernando A Barrios, Yves Burnod, Christopher J Cannistraci, Julien Cohen-Adad, Benjamin De Leener, et almbox. 2016. Brainhack: a collaborative workshop for the open neuroscience community. GigaScience, Vol. 5, 1 (2016), 16.
[17]
Edward L Deci, Richard Koestner, and Richard M Ryan. 1999. A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. Psychological bulletin, Vol. 125, 6 (1999), 627.
[18]
Carl DiSalvo, Melissa Gregg, and Thomas Lodato. 2014. Building belonging. interactions, Vol. 21, 4 (2014), 58--61.
[19]
Margaret Drouhard, Anissa Tanweer, and Brittany Fiore-Gartland. 2016. A typology of hackathon events. In Hacking at Time-Bound Events Workshop at Computer Supported Cooperative Work, Vol. 2016. 1--4.
[20]
Robert Eisenberger, W David Pierce, and Judy Cameron. 1999. Effects of reward on intrinsic motivation?Negative, neutral, and positive: Comment on Deci, Koestner, and Ryan (1999). (1999).
[21]
Rosta Farzan, Saiph Savage, and Claudia Flores Saviaga. 2016. Bring on board new enthusiasts! A case study of impact of Wikipedia art
[22]
feminism edit-a-thon events on newcomers. In International Conference on Social Informatics. Springer, 24--40.
[23]
Anna Filippova, Erik Trainer, and James D Herbsleb. 2017. From diversity by numbers to diversity as process: supporting inclusiveness in software development teams with brainstorming. In Proceedings of the 39th International Conference on Software Engineering. IEEE Press, 152--163.
[24]
Allan Fowler. 2016. Informal stem learning in game jams, hackathons and game creation events. In Proceedings of the International Conference on Game Jams, Hackathons, and Game Creation Events. ACM, 38--41.
[25]
Sarah Fox, Rachel Rose Ulgado, and Daniela Rosner. 2015. Hacking culture, not devices: Access and recognition in feminist hackerspaces. In Proceedings of the 18th ACM conference on Computer supported cooperative work & social computing. ACM, 56--68.
[26]
Kiev Gama, Breno Alencar, Filipe Calegario, André Neves, and Pedro Alessio. 2018. A Hackathon Methodology for Undergraduate Course Projects. In 2018 IEEE Frontiers in Education Conference (FIE). IEEE, 1--9.
[27]
Patricia J Guinan, Jay G Cooprider, and Samer Faraj. 1998. Enabling software development team performance during requirements definition: A behavioral versus technical approach. Information systems research, Vol. 9, 2 (1998), 101--125.
[28]
David A Harrison, Susan Mohammed, Joseph E McGrath, Anna T Florey, and Scott W Vanderstoep. 2003. Time matters in team performance: Effects of member familiarity, entrainment, and task discontinuity on speed and quality. Personnel Psychology, Vol. 56, 3 (2003), 633--669.
[29]
Sarah Hartmann, Agnes Mainka, and Wolfgang G Stock. 2018. Innovation Contests: How to Engage Citizens in Solving Urban Problems? In Enhancing Knowledge Discovery and Innovation in the Digital Era. IGI Global, 254--273.
[30]
Scott Henderson. 2015. Getting the most out of hackathons for social good. Volunteer Engagement 2.0: Ideas and insights changing the world (2015), 182--194.
[31]
Israel Herraiz, Gregorio Robles, Jesús M González-Barahona, Andrea Capiluppi, and Juan F Ramil. 2006. Comparison between SLOCs and number of files as size metrics for software evolution analysis. In Conference on Software Maintenance and Reengineering (CSMR'06). IEEE, 8--15.
[32]
Chinh Hoang, John Liu, Zubaid Bokhari, and Allen Chan. 2016. IBM 2016 community hackathon. In Proceedings of the 26th Annual International Conference on Computer Science and Software Engineering. IBM Corp., 331--332.
[33]
Alexis Hope, Catherine D'Ignazio, Josephine Hoy, Rebecca Michelson, Jennifer Roberts, Kate Krontiris, and Ethan Zuckerman. 2019. Hackathons as Participatory Design: Iterating Feminist Utopias. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 61.
[34]
Youyang Hou and Cliff Lampe. 2017. Sustainable hacking: characteristics of the design and adoption of civic hacking projects. In Proceedings of the 8th International Conference on Communities and Technologies. ACM, 125--134.
[35]
Youyang Hou and Dakuo Wang. 2017. Hacking with NPOs: collaborative analytics and broker roles in civic data hackathons. Proceedings of the ACM on Human-Computer Interaction, Vol. 1, CSCW (2017), 1--16.
[36]
James Howison and Kevin Crowston. 2014. Collaboration through open superposition: A theory of the open source way. Mis Quarterly, Vol. 38, 1 (2014), 29--50.
[37]
Susan E Jackson, Aparna Joshi, and Niclas L Erhardt. 2003. Recent research on team and organizational diversity: SWOT analysis and implications. Journal of management, Vol. 29, 6 (2003), 801--830.
[38]
Hanna Kienzler and Carolyn Fontanesi. 2017. Learning through inquiry: A global health hackathon. Teaching in Higher Education, Vol. 22, 2 (2017), 129--142.
[39]
Ankunda R Kiremire. 2011. The application of the pareto principle in software engineering. Consulted January, Vol. 13 (2011), 2016.
[40]
Marko Komssi, Danielle Pichlis, Mikko Raatikainen, Klas Kindström, and Janne J"arvinen. 2015. What are Hackathons for? IEEE Software, Vol. 32, 5 (2015), 60--67.
[41]
J Richard Landis and Gary G Koch. 1977. The measurement of observer agreement for categorical data. biometrics (1977), 159--174.
[42]
Hilmar Lapp, Sendu Bala, James P Balhoff, Amy Bouck, Naohisa Goto, Mark Holder, Richard Holland, Alisha Holloway, Toshiaki Katayama, Paul O Lewis, et almbox. 2007. The 2006 NESCent phyloinformatics hackathon: a field report. Evolutionary Bioinformatics Online, Vol. 3 (2007), 287.
[43]
Miguel Lara and Kate Lockwood. 2016. Hackathons as Community-Based Learning: a Case Study. TechTrends, Vol. 60, 5 (2016), 486--495.
[44]
Thomas James Lodato and Carl DiSalvo. 2016. Issue-oriented hackathons as material participation. New Media & Society, Vol. 18, 4 (2016), 539--557.
[45]
Sven Manske, Tobias Hecking, Irene-Angelica Chounta, Sören Werneburg, and Ulrich Hoppe. 2015. Using differences to make a difference: a study on heterogeneity of learning groups. International Society of the Learning Sciences, Inc.[ISLS].
[46]
Jennifer Marlow and Laura Dabbish. 2013. Activity traces and signals in software developer recruitment and hiring. In Proceedings of the 2013 conference on Computer supported cooperative work. 145--156.
[47]
Maria Angelica Medina Angarita and Alexander Nolte. 2019. Does it matter why we hack?--Exploring the impact of goal alignment in hackathons. In Proceedings of 17th European Conference on Computer-Supported Cooperative Work. European Society for Socially Embedded Technologies (EUSSET).
[48]
Rupert G Miller Jr. 2011. Survival analysis. Vol. 66. John Wiley & Sons.
[49]
Steffen Möller, Enis Afgan, Michael Banck, Raoul JP Bonnal, Timothy Booth, John Chilton, Peter JA Cock, Markus Gumbel, Nomi Harris, Richard Holland, et almbox. 2014. Community-driven development for computational biology at Sprints, Hackathons and Codefests. BMC bioinformatics, Vol. 15, 14 (2014), S7.
[50]
Shinichi Nakagawa and Holger Schielzeth. 2013. A general and simple method for obtaining R2 from generalized linear mixed-effects models. Methods in Ecology and Evolution, Vol. 4, 2 (2013), 133--142.
[51]
Arnab Nandi and Meris Mandernach. 2016. Hackathons as an informal learning platform. In Proceedings of the 47th ACM Technical Symposium on Computing Science Education. ACM, 346--351.
[52]
Mark EJ Newman. 2001. Scientific collaboration networks. II. Shortest paths, weighted networks, and centrality. Physical review E, Vol. 64, 1 (2001).
[53]
Alexander Nolte, Linda Bailey Hayden, and James D Herbsleb. 2020. How to Support Newcomers in Scientific Hackathons-An Action Research Study on Expert Mentoring. Proceedings of the ACM on Human-Computer Interaction, Vol. 4, CSCW1 (2020), 1--23.
[54]
Alexander Nolte, Ei Pa Pa Pe-Than, Anna Filippova, Christian Bird, Steve Scallen, and James D. Herbsleb. 2018. You Hacked and Now What? - Exploring Outcomes of a Corporate Hackathon. Proceedings of the ACM on Human-Computer Interaction, Vol. 2, CSCW (2018), 129:1--129:23.
[55]
Ei Pa Pa Pe-Than and James D Herbsleb. 2019. Understanding Hackathons for Science: Collaboration, Affordances, and Outcomes. In International Conference on Information. Springer, 27--37.
[56]
Ei Pa Pa Pe-Than, Alexander Nolte, Anna Filippova, Christian Bird, Steve Scallen, and James D Herbsleb. 2019. Designing Corporate Hackathons With a Purpose: The Future of Software Development. IEEE Software, Vol. 36, 1 (2019), 15--22.
[57]
Jari Porras, Antti Knutas, Jouni Ikonen, Ari Happonen, Jayden Khakurel, and Antti Herala. 2019. Code camps and hackathons in education-literature review and lessons learned. In Proceedings of the 52nd Hawaii International Conference on System Sciences.
[58]
Emily Porter, Chris Bopp, Elizabeth Gerber, and Amy Voida. 2017. Reappropriating Hackathons: The Production Work of the CHI4Good Day of Service. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 810--814.
[59]
Huilian Sophie Qiu, Alexander Nolte, Anita Brown, Alexander Serebrenik, and Bogdan Vasilescu. 2019. Going farther together: The impact of social capital on sustained participation in open source. ICSE. IEEE (2019).
[60]
Bard Rosell, Shiven Kumar, and John Shepherd. 2014. Unleashing innovation through internal hackathons. In Innovations in Technology Conference (InnoTek), 2014 IEEE. IEEE, 1--8.
[61]
Bradley R Staats, Katherine L Milkman, and Craig R Fox. 2012. The team scaling fallacy: Underestimating the declining efficiency of larger teams. Organizational Behavior and Human Decision Processes, Vol. 118, 2 (2012), 132--142.
[62]
Gerry Stahl. 2000. A model of collaborative knowledge-building. In Fourth international conference of the learning sciences, Vol. 10. Mahwah, NJ: Erlbaum, 2000a, 70--77.
[63]
Arlin Stoltzfus, Michael Rosenberg, Hilmar Lapp, Aidan Budd, Karen Cranston, Enrico Pontelli, Shann Oliver, and Rutger A Vos. 2017. Community and code: Nine lessons from nine NESCent hackathons. F1000Research, Vol. 6 (2017).
[64]
James Tandon, Reza Akhavian, Mario Gumina, and Nazzy Pakpour. 2017. CSU East Bay Hack Day: A University hackathon to combat malaria and zika with drones. In Global Engineering Education Conference (EDUCON), 2017 IEEE. IEEE, 985--989.
[65]
Nick Taylor and Loraine Clarke. 2018. Everybody's Hacking: Participation and the Mainstreaming of Hackathons. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 172.
[66]
Nick Taylor, Loraine Clarke, Martin Skelly, and Sara Nevay. 2018. Strategies for Engaging Communities in Creating Physical Civic Technologies. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 507.
[67]
John W Thomas. 2000. A review of research on project-based learning. (2000).
[68]
Erik H Trainer, Arun Kalyanasundaram, Chalalai Chaihirunkarn, and James D Herbsleb. 2016. How to hackathon: Socio-technical tradeoffs in brief, intensive collocation. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing. ACM, 1118--1130.
[69]
Marat Valiev, Bogdan Vasilescu, and James Herbsleb. 2018. Ecosystem-level determinants of sustained activity in open-source projects: a case study of the PyPI ecosystem. In Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering. ACM, 644--655.
[70]
J Torkel Wallmark, Sven Eckerstein, Birgitta Langered, and Hans ES Holmqvist. 1973. The increase in efficiency with size of research teams. IEEE Transactions on engineering management 3 (1973), 80--86.
[71]
Jorge Luis Zapico, Daniel Pargman, Hannes Ebner, and Elina Eriksson. 2013. Hacking sustainability: Broadening participation through green hackathons. In Fourth International Symposium on End-User Development. June 10--13, 2013, IT University of Copenhagen, Denmark.

Cited By

View all
  • (2024)Hack the Border: Empowering Experiential Learning Competencies in Computing through HackathonsJournal of Computing Sciences in Colleges10.5555/3665482.366548839:7(52-57)Online publication date: 1-Apr-2024
  • (2024)Discovering Sources and Approaches in Financing HackathonsFinancial Internet Quarterly10.2478/fiqf-2024-002620:4(48-55)Online publication date: 17-Dec-2024
  • (2024)The First Generative AI Prompt-A-Thon in Healthcare: A Novel Approach to Workforce Engagement with a Private Instance of ChatGPTPLOS Digital Health10.1371/journal.pdig.00003943:7(e0000394)Online publication date: 23-Jul-2024
  • Show More Cited By

Index Terms

  1. What Happens to All These Hackathon Projects?: Identifying Factors to Promote Hackathon Project Continuation

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image Proceedings of the ACM on Human-Computer Interaction
    Proceedings of the ACM on Human-Computer Interaction  Volume 4, Issue CSCW2
    CSCW
    October 2020
    2310 pages
    EISSN:2573-0142
    DOI:10.1145/3430143
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 15 October 2020
    Published in PACMHCI Volume 4, Issue CSCW2

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. hackathon
    2. project continuation
    3. project sustainability
    4. social computing

    Qualifiers

    • Research-article

    Funding Sources

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)193
    • Downloads (Last 6 weeks)25
    Reflects downloads up to 09 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Hack the Border: Empowering Experiential Learning Competencies in Computing through HackathonsJournal of Computing Sciences in Colleges10.5555/3665482.366548839:7(52-57)Online publication date: 1-Apr-2024
    • (2024)Discovering Sources and Approaches in Financing HackathonsFinancial Internet Quarterly10.2478/fiqf-2024-002620:4(48-55)Online publication date: 17-Dec-2024
    • (2024)The First Generative AI Prompt-A-Thon in Healthcare: A Novel Approach to Workforce Engagement with a Private Instance of ChatGPTPLOS Digital Health10.1371/journal.pdig.00003943:7(e0000394)Online publication date: 23-Jul-2024
    • (2024)Hackeanos: A new collaborative event format for hacking the Ocean-humanity relationshipCompanion Publication of the 2024 ACM Designing Interactive Systems Conference10.1145/3656156.3663722(162-165)Online publication date: 1-Jul-2024
    • (2024)FlashHack: Reflections on the Usage of a Micro Hackathon as an Assessment Tool in a Machine Learning CourseProceedings of the 2024 on ACM Virtual Global Computing Education Conference V. 110.1145/3649165.3690128(67-73)Online publication date: 5-Dec-2024
    • (2024)Navigating the hackathon: Exploring participant experience, confidence and anxietyEuropean Journal of Education10.1111/ejed.1265659:3Online publication date: 21-Apr-2024
    • (2024)The Future of Hackathon Research and PracticeIEEE Access10.1109/ACCESS.2024.345509212(133406-133425)Online publication date: 2024
    • (2024)Challenging the status quo: A feminist analysis of gender dynamics, motivation, and empowerment in hackathonsWomen's Studies International Forum10.1016/j.wsif.2024.103009107(103009)Online publication date: Nov-2024
    • (2024)Academic performance indicators for the hackathon learning approach – The case of the blockchain hackathonJournal of Innovation & Knowledge10.1016/j.jik.2024.1005019:3(100501)Online publication date: Jul-2024
    • (2024)Can Hackathons Contribute to the Development of Entrepreneurship Among Students at All? Case Study of an Educational Cross Functional HackathonUnderstanding the Digital Transformation of Socio-Economic-Technological Systems10.1007/978-3-031-56677-6_3(31-47)Online publication date: 21-Jun-2024
    • Show More Cited By

    View Options

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media