[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3408877.3432419acmconferencesArticle/Chapter ViewAbstractPublication PagessigcseConference Proceedingsconference-collections
research-article

Gamification Works, but How and to Whom?: An Experimental Study in the Context of Programming Lessons

Published: 05 March 2021 Publication History

Abstract

Programming is a complex, not trivial to learn and teach task, which gamification can facilitate. However, how gamification affects learning and the influence of context-related aspects on that effect demand research to better understand how and to whom gamification enhances programming learning. Therefore, we conducted an experimental study analyzing how gamification worked and the role of context-related aspects in terms of intervention duration and learners' familiarity with programming (i.e., the task's topic). It was a six-week study with 19 undergraduate students from an Algorithms class that measured their learning gains, intrinsic motivation, and number of completed quizzes. Mainly, we found gamification affected learning via intrinsic motivation, effect that depended on intervention duration and learners' familiarity with programming. That is, intrinsic motivation strongly predicted learning gains and gamification's effect on intrinsic motivation changed over time, decreasing from positive to negative as learners had less familiarity with programming. Thus, showing gamification can positively impact programming learning by improving students' intrinsic motivation, although that effect changes over time depending on one's previous familiarity with programming.

References

[1]
Raad A Alturki et al. 2016. Measuring and improving student performance in an introductory programming course. Informatics in Education-An International Journal 15, 2 (2016), 183--204.
[2]
Shurui Bai, Khe Foon Hew, and Biyun Huang. 2020. Is gamification "bullshit"? Evidence from a meta-analysis and synthesis of qualitative data in educational contexts. Educational Research Review(2020), 100322.
[3]
Edward L. Deci and Richard M. Ryan. 2000. The "What" and "Why" of Goal Pursuits: Human Needs and the Self-Determination of Behavior.PsychologicalInquiry11, 4 (2000), 227--268.https://doi.org/10.1207/S15327965PLI1104_01 arXiv: https://doi.org/10.1207/S15327965PLI1104_01
[4]
Paul Denny, Fiona McDonald, Ruth Empson, Philip Kelly, and Andrew Petersen. 2018. Empirical Support for a Causal Relationship Between Gamification and Learning Outcomes. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems(Montreal QC, Canada)(CHI '18). Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/10.1145/3173574.3173885
[5]
Panagiotis Fotaris, Theodoros Mastoras, Richard Leinfellner, and Yasmine Rosunally. 2016. Climbing up the Leaderboard: An Empirical Study of Applying Gamification Techniques to a Computer Programming Class.Electronic Journal of e-learning 14, 2 (2016), 94--110.
[6]
MN Gari, GS Walia, and AD Radermacher. 2018. Gamification in computer science education: A systematic literature review. In American Society for Engineering Education.
[7]
Andrew Gelman and Jennifer Hill. 2006. Data analysis using regression and multilevel/hierarchical models. Cambridge university press.
[8]
Lasse Hakulinen, Tapio Auvinen, and Ari Korhonen. 2015. The Effect of Achievement Badges on Students' Behavior: An Empirical Study in a University-Level Computer Science Course. International Journal of Emerging Technologies in Learning 10, 1 (2015).
[9]
Stuart Hallifax, Audrey Serna, Jean-Charles Marty, and Élise Lavoué. 2019. Adaptive Gamification in Education: A Literature Review of Current Trends and Developments. In European Conference on Technology Enhanced Learning. 294--307.
[10]
Stuart Hallifax, Audrey Serna, Jean-Charles Marty, Guillaume Lavoué, and Elise Lavoué. 2019. Factors to Consider for Tailored Gamification. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play(Barcelona, Spain)(CHI PLAY '19). 559--572. https://doi.org/10.1145/3311350.3347167
[11]
Michael D. Hanus and Jesse Fox. 2015. Assessing the effects of gamification in the classroom: A longitudinal study on intrinsic motivation, social comparison, satisfaction, effort, and academic performance. Computers & Education 80 (2015),152 -- 161. https://doi.org/10.1016/j.compedu.2014.08.019
[12]
Joop J Hox, Mirjam Moerbeek, and Rens Van de Schoot. 2010. Multilevel analysis: Techniques and applications. Routledge.
[13]
Mohieddin Jafari and Naser Ansari-Pour. 2019. Why, when and how to adjust your P values? Cell Journal (Yakhteh)20, 4 (2019), 604.
[14]
Jonna Koivisto and Juho Hamari. 2014. Demographic differences in perceived benefits from gamification. Computers in Human Behavior 35 (2014), 179 -- 188. https://doi.org/10.1016/j.chb.2014.03.007
[15]
Jonna Koivisto and Juho Hamari. 2019. The rise of motivational information systems: A review of gamification research. International Journal of Information Management 45 (2019), 191 -- 210. https://doi.org/10.1016/j.ijinfomgt.2018.10.013
[16]
David R Krathwohl. 2002. A revision of Bloom's taxonomy: An overview. Theory into practice 41, 4 (2002), 212--218. https://doi.org/10.1207/s15430421tip4104_2
[17]
Markus Krause, Marc Mogalle, Henning Pohl, and Joseph Jay Williams. 2015. A Playful Game Changer: Fostering Student Retention in Online Education with Social Gamification. In Proceedings of the Second (2015) ACM Conference on Learning @ Scale(Vancouver, BC, Canada)(L@S '15). 95--102.
[18]
Max Kuhn and Kjell Johnson. 2013. Applied predictive modeling. Vol. 26. Springer.
[19]
Richard N Landers, Elena M Auer, Andrew B Collmus, and Michael B Armstrong. 2018. Gamification science, its history and future: Definitions and a research agenda. Simulation & Gaming 49, 3 (2018), 315--337.
[20]
B. Marín, J. Frez, J. Cruz-Lemus, and M. Genero. 2018. An Empirical Investigation on the Benefits of Gamification in Programming Courses. ACM Trans. Comput. Educ. 19, 1, Article 4 (Nov. 2018), 22 pages. https://doi.org/10.1145/3231709
[21]
Daniel Mirman. 2016.Growth curve analysis and visualization using R. CRC press.
[22]
Julian MORENO and Andres F PINEDA. 2018. Competitive programming and gamification as strategy to engage students in computer science courses. Revista ESPACIOS 39, 35 (2018).
[23]
Benedikt Morschheuser, Lobna Hassan, Karl Werder, and Juho Hamari. 2018. How to design gamification? A method for engineering gamified software. Information and Software Technology95 (2018), 219--237.
[24]
IT Chan Mow. 2008. Issues and difficulties in teaching novice computer programming. In Innovative techniques in instruction technology, e-learning, e-assessment,and education. Springer, 199--204.
[25]
Paula Palomino, Armando Toda, Wilk Oliveira, Luiz Rodrigues, and Seiji Isotani.2020. From the Lack of Engagement to Motivation: Gamification Strategies to Enhance Users Learning Experiences. In 2020 19th Brazilian Symposium on Computer Games and Digital Entertainment (SBGames) - GranDGames BR Forum.
[26]
Paula T Palomino, Armando M Toda, Wilk Oliveira, Luiz Rodrigues, and Seiji Isotani. 2019. Gamification journey: A Novel approach for classifying gamer types for gamified educational systems. 2019 18th Brazilian Symposium on Computer Games and Digital Entertainment (SB Games)(2019), 165--173.
[27]
Laís Zagatti Pedro. 2016. Uso de gamificação em ambientes virtuais de aprendiza-gem para reduzir o problema da externalização de comportamentos indesejáveis. Ph. D. Dissertation. Universidade de São Paulo.
[28]
Yizhou Qian and James Lehman. 2017. Students' Misconceptions and Other Difficulties in Introductory Programming: A Literature Review. ACM Trans. Comput. Educ. 18, 1, Article 1 (Oct. 2017), 24 pages.
[29]
Luiz Rodrigues and Jacques Duílio Brancher. 2019. Playing an Educational Game Featuring Procedural Content Generation: Which Attributes Impact Players' Curiosity? Journal New Technologies on Education (Revista Novas Tecnologias na Educação - RENOTE)(2019).
[30]
Luiz Rodrigues, Wilk Oliveira, Armando Toda, Paula Palomino, and Seiji Isotani. 2019. Thinking Inside the Box: How to Tailor Gamified Educational Systems Based on Learning Activities Types. In Proceedings of the Brazilian Symposium on Computers in Education (Simpósio Brasileiro de Informática na Educação - SBIE).
[31]
Luiz Rodrigues, Armando Toda, Wilk Oliveira, Paula Palomino, and Seiji Isotani. 2020. Just beat it: Exploring the influences of competition and task-related factors in gamified learning environments. In Proceedings of the Brazilian Symposium on Computers in Education (Simpósio Brasileiro de Informática na Educação-SBIE), Vol. 31.
[32]
Luiz Rodrigues, Armando M. Toda, Paula T. Palomino, Wilk Oliveira, and Seiji Isotani. 2020. Personalized gamification: A literature review of outcomes, experiments, and approaches. In Proceedings of the 8th International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM 2020) (Salamanca, Spain, October 21--23, 2020), F. J. García-Peñalvo (Ed.).
[33]
Christopher A Rowland. 2014. The effect of testing versus restudy on retention:a meta-analytic review of the testing effect. Psychological Bulletin140, 6 (2014), 1432.
[34]
Michael Sailer and Lisa Homner. 2019. The Gamification of Learning: a Meta-analysis. Educational Psychology Review(15 Aug 2019).
[35]
Diana R. Sanchez, Markus Langer, and Rupinder Kaur. 2020. Gamification in the classroom: Examining the impact of gamified quizzes on student learning. Computers & Education 144 (2020), 103666.
[36]
Isabelle Savard and Riichiro Mizoguchi. 2019. Context or culture: what is the difference? Research and Practice in Technology Enhanced Learning 14, 1 (2019).
[37]
Armando Toda, Wilk Oliveira, Lei Shi, Ig Ibert Bittencourt, Seiji Isotani, and Alexandra I. Cristea. 2019. Planning gamification strategies based on user characteristics and DM : a gender-based case study. In Proceedings of the 12th International Conference on Educational Data Mining., Michel Desmarais, Collin F.Lynch, Agathe Merceron, and Roger Nkambou (Eds.). Educational Data Mining 2019, Montréal, Canada, 438--443. http://dro.dur.ac.uk/28609/
[38]
Armando Toda, Filipe Dwan Pereira, Ana Carolina Tomé Klock, Luiz Rodrigues, Paula Palomino, Wilk Oliveira, and Elaine Oliveira. 2020. For whom should we gamify? Insights on the users intentions and context towards gamification in education. In Proceedings of the Brazilian Symposium on Computers in Education(Simpósio Brasileiro de Informática na Educação-SBIE), Vol. 31.
[39]
Armando M. Toda, Pedro H. D. Valle, and Seiji Isotani. 2018. The Dark Side of Gamification: An Overview of Negative Effects of Gamification in Education. In Higher Education for All. From Challenges to Novel Technology-Enhanced Solutions,Alexandra Ioana Cristea, Ig Ibert Bittencourt, and Fernanda Lima (Eds.). Springer International Publishing, Cham, 143--156.
[40]
Rob van Roy and Bieke Zaman. 2017. Why gamification fails in education and how to make it successful: introducing nine gamification heuristics based on self-determination theory. In Serious Games and edutainment applications. Springer, 485--509.
[41]
Rob Van Roy and Bieke Zaman. 2018. Need-supporting gamification in education: An assessment of motivational effects over time. Computers & Education 127(2018), 283--297.
[42]
Maarten Vansteenkiste, Eline Sierens, Bart Soenens, Koen Luyckx, and Willy Lens. 2009. Motivational profiles from a self-determination perspective: The quality of motivation matters. Journal of educational psychology 101, 3 (2009),671.
[43]
Zamzami Zainuddin, Samuel Kai Wah Chu, Muhammad Shujahat, and Corinne Jacqueline Perera. 2020. The impact of gamification on learning and instruction: A systematic review of empirical evidence. Educational Research Review(2020), 100326.

Cited By

View all
  • (2025)Teaching Programming Through MetaphorsEffective Computer Science Education in K-12 Classrooms10.4018/979-8-3693-4542-9.ch012(319-348)Online publication date: 24-Jan-2025
  • (2024)Forming the Depth-Annex-Motion-Placement (DAMP) Conceptual Model for Gamified LearningIntegrating Technology in Problem-Solving Educational Practices10.4018/979-8-3693-6745-2.ch006(117-140)Online publication date: 25-Oct-2024
  • (2024)Exploring the Use of Unplugged Gamification on Programming Learners’ ExperienceACM Transactions on Computing Education10.1145/368616524:3(1-25)Online publication date: 27-Sep-2024
  • Show More Cited By

Index Terms

  1. Gamification Works, but How and to Whom?: An Experimental Study in the Context of Programming Lessons

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      SIGCSE '21: Proceedings of the 52nd ACM Technical Symposium on Computer Science Education
      March 2021
      1454 pages
      ISBN:9781450380621
      DOI:10.1145/3408877
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 05 March 2021

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. gamification
      2. learning
      3. longitudinal
      4. moderators
      5. motivation

      Qualifiers

      • Research-article

      Funding Sources

      Conference

      SIGCSE '21
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 1,595 of 4,542 submissions, 35%

      Upcoming Conference

      SIGCSE TS 2025
      The 56th ACM Technical Symposium on Computer Science Education
      February 26 - March 1, 2025
      Pittsburgh , PA , USA

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)224
      • Downloads (Last 6 weeks)27
      Reflects downloads up to 15 Jan 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2025)Teaching Programming Through MetaphorsEffective Computer Science Education in K-12 Classrooms10.4018/979-8-3693-4542-9.ch012(319-348)Online publication date: 24-Jan-2025
      • (2024)Forming the Depth-Annex-Motion-Placement (DAMP) Conceptual Model for Gamified LearningIntegrating Technology in Problem-Solving Educational Practices10.4018/979-8-3693-6745-2.ch006(117-140)Online publication date: 25-Oct-2024
      • (2024)Exploring the Use of Unplugged Gamification on Programming Learners’ ExperienceACM Transactions on Computing Education10.1145/368616524:3(1-25)Online publication date: 27-Sep-2024
      • (2024)Gamification enhances student intrinsic motivation, perceptions of autonomy and relatedness, but minimal impact on competency: a meta-analysis and systematic reviewEducational technology research and development10.1007/s11423-023-10337-7Online publication date: 16-Jan-2024
      • (2023)The Use of Gamification Elements in an Online Introduction to Programming CourseShaping the Future of Online Learning10.4018/978-1-6684-6513-4.ch015(284-300)Online publication date: 13-Jan-2023
      • (2023)FGPE+: The Mobile FGPE Environment and the Pareto-Optimized Gamified Programming Exercise Selection Model—An Empirical EvaluationComputers10.3390/computers1207014412:7(144)Online publication date: 21-Jul-2023
      • (2023)Gamification to Help Inform Students About Programming Plagiarism and CollusionIEEE Transactions on Learning Technologies10.1109/TLT.2023.324389316:5(708-721)Online publication date: 1-Oct-2023
      • (2023)Difficulty-Adjusted Quizzes: An Effectiveness Analysis2023 IEEE International Conference on Teaching, Assessment and Learning for Engineering (TALE)10.1109/TALE56641.2023.10398305(1-6)Online publication date: 28-Nov-2023
      • (2023)Improving Long-Term Retention through Personalized Recall Testing and Immediate Feedback2023 11th International Conference on Information and Education Technology (ICIET)10.1109/ICIET56899.2023.10111487(277-281)Online publication date: 18-Mar-2023
      • (2023)What Forces Us To Gamify The Programming In Higher Education: A Literature Review2023 17th International Conference on Electronics Computer and Computation (ICECCO)10.1109/ICECCO58239.2023.10146601(1-4)Online publication date: 1-Jun-2023
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media