More Web Proxy on the site http://driver.im/

research-article

Student Profiles of Change in a University Course: A Complex Dynamical Systems Perspective

Authors:

Oleksandra Poquet,

Jelena Jovanovic,

Abelardo PardoAuthors Info & Claims

LAK2023: LAK23: 13th International Learning Analytics and Knowledge Conference

Pages 197 - 207

https://doi.org/10.1145/3576050.3576077

Published: 13 March 2023 Publication History

Abstract

Learning analytics approaches to profiling students based on their study behaviour remain limited in how they integrate temporality and change. To advance this area of work, the current study examines profiles of change in student study behaviour in a blended undergraduate engineering course. The study is conceptualised through complex dynamical systems theory and its applications in psychological and cognitive science research. Students were profiled based on the changes in their behaviour as observed in clickstream data. Measure of entropy in the recurrence of student behaviour was used to indicate the change of a student state, consistent with the evidence from cognitive sciences. Student trajectories of weekly entropy values were clustered to identify distinct profiles. Three patterns were identified: stable weekly study, steep changes in weekly study, and moderate changes in weekly study. The students with steep changes in their weekly study activity had lower exam grades and showed destabilisation of weekly behaviour earlier in the course. The study investigated the relationships between these profiles of change, student performance, and other approaches to learner profiling, such as self-reported measures of self-regulated learning, and profiles based on the sequences of learning actions.

References

[1]

Laura Kristen Allen, Aaron D. Likens, and Danielle S. McNamara. 2017. Recurrence quantification analysis: A technique for the dynamical analysis of student writing. In Proceedings of the Thirtieth International Florida Artificial Intelligence Research Society Conference.

[2]

Nicola C Anderson, Walter F Bischof, Kaitlin EW Laidlaw, Evan F Risko, and Alan Kingstone. 2013. Recurrence quantification analysis of eye movements. Behavior research methods 45, 3 (2013), 842–856.

[3]

Roger Azevedo. 2009. Theoretical, conceptual, methodological, and instructional issues in research on metacognition and self-regulated learning: A discussion. Metacognition and Learning 4, 1 (2009), 87–95.

[4]

John Biggs, David Kember, and Doris YP Leung. 2001. The revised two-factor study process questionnaire: R-SPQ-2F. British journal of educational psychology 71, 1 (2001), 133–149.

[5]

Gautam Biswas, Hogyeong Jeong, John S. Kinnebrew, Brian Sulcer, and R. O. D. Roscoe. 2010. Measuring self-regulated learning skills through social interactions in a teachable agent environment. Research and Practice in Technology Enhanced Learning 5, 2 (2010), 123–152.

[6]

Monique Boekaerts and Eduardo Cascallar. 2006. How far have we moved toward the integration of theory and practice in self-regulation?Educational psychology review 18, 3 (2006), 199–210.

[7]

Ralf FA Cox, Steffie van der Steen, Marlenny Guevara, Lisette de Jonge-Hoekstra, and Marijn van Dijk. 2016. Chromatic and anisotropic cross-recurrence quantification analysis of interpersonal behavior. In Recurrence plots and their quantifications: expanding horizons. Springer, 209–225.

[8]

Rick Dale and Michael J Spivey. 2006. Unraveling the dyad: Using recurrence analysis to explore patterns of syntactic coordination between children and caregivers in conversation. Language Learning 56, 3 (2006), 391–430.

[9]

Daryn Dever, Mary Amon, Hana Vrzakova, Megan Wiedbusch, Elizabeth Cloude, and Roger Azevedo. 2022. Capturing Sequences of Learners’ Self-Regulatory Interactions with Instructional Metarial during Game-Based Learning Using Auto-Recurrence Quantification Analysis. Frontiers in Psychology 13, 813677 (2022).

[10]

Muhterem Dindar, Iman Alikhani, Jonna Malmberg, Sanna Järvelä, and Tapio Seppänen. 2019. Examining shared monitoring in collaborative learning: A case of a recurrence quantification analysis approach. Computers in Human Behavior 100 (2019), 335–344.

Digital Library

[11]

Sidney D’Mello and Art Graesser. 2007. Monitoring affective trajectories during complex learning. In Proceedings of the annual meeting of the cognitive science society, Vol. 29.

[12]

Yizhou Fan, John Saint, Shaveen Singh, Jelena Jovanovic, and Dragan Gašević. 2021. A learning analytic approach to unveiling self-regulatory processes in learning tactics. In LAK21: 11th international learning analytics and knowledge conference. 184–195.

[13]

Ed Fincham, Dragan Gašević, Jelena Jovanović, and Abelardo Pardo. 2018. From study tactics to learning strategies: An analytical method for extracting interpretable representations. IEEE Transactions on Learning Technologies 12, 1(2018), 59–72.

[14]

Lisa Haake, Sebastian Wallot, Monika Tschense, and Joachim Grabowski. 2022. Global temporal typing patterns in foreign language writing: exploring language proficiency through recurrence quantification analysis (RQA). Reading and Writing (2022), 1–33.

[15]

Allyson F. Hadwin, John C. Nesbit, Dianne Jamieson-Noel, Jillianne Code, and Philip H. Winne. 2007. Examining trace data to explore self-regulated learning. Metacognition and Learning 2, 2 (2007), 107–124.

[16]

Rick H. Hoyle and Amy L. Dent. 2017. Developmental trajectories of skills and abilities relevant for self-regulation of learning and performance. In Handbook of self-regulation of learning and performance. Routledge, 49–63.

[17]

Jelena Jovanovic, Negin Mirriahi, Dragan Gašević, Shane Dawson, and Abelardo Pardo. 2019. Predictive power of regularity of pre-class activities in a flipped classroom. Computers & Education 134 (2019), 156–168.

Digital Library

[18]

Jelena Jovanović, Dragan Gašević, Shane Dawson, Abelardo Pardo, and Negin Mirriahi. 2017. Learning analytics to unveil learning strategies in a flipped classroom. The Internet and Higher Education 33, 4 (2017), 74–85.

[19]

Shan Li, Juan Zheng, Xudong Huang, and Charles Xie. 2022. Self-regulated learning as a complex dynamical system: Examining students’ STEM learning in a simulation environment. Learning and Individual Differences 95 (2022), 102144.

[20]

Anna Lichtwarck-Aschoff, Fred Hasselman, Ralf Cox, Debra Pepler, and Isabela Granic. 2012. A characteristic destabilization profile in parent-child interactions associated with treatment efficacy for aggressive children. Nonlinear Dynamics-Psychology and Life Sciences 16, 3 (2012), 353.

[21]

Jorge Maldonado-Mahauad, Mar Pérez-Sanagustín, René F. Kizilcec, Nicolás Morales, and Jorge Munoz-Gama. 2018. Mining theory-based patterns from Big data: Identifying self-regulated learning strategies in Massive Open Online Courses. Computers in Human Behavior 80 (2018), 179–196.

Digital Library

[22]

Wannisa Matcha, Dragan Gašević, Ahmad Uzir, Jelena Jovanović, Abelardo Pardo, Jorge Maldonado-Mahauad, Mar Pérez-Sanagustín, 2019. Detection of learning strategies: A comparison of process, sequence and network analytic approaches. In European conference on technology enhanced learning. Springer, 525–540.

Digital Library

[23]

Inge Molenaar and Alyssa Friend Wise. 2022. Temporal Aspects of Learning Analytics-Grounding Analyses in Concepts of Time. In Handbook of Learning Analytics, A. Friend Wise D. Gašević Ch. Lang, G. Siemens (Ed.). Chapter 7, 66–76.

[24]

Daniel S. Nagin and Daniel Nagin. 2005. Group-based modeling of development. Harvard University Press.

[25]

Abelardo Pardo, Dragan Gašević, Jelena Jovanovic, Shane Dawson, and Negin Mirriahi. 2018. Exploring student interactions with preparation activities in a flipped classroom experience. IEEE Transactions on Learning Technologies 12, 3(2018), 333–346.

Digital Library

[26]

Paul R Pintrich and Elisabeth V De Groot. 1990. Motivational and self-regulated learning components of classroom academic performance.Journal of educational psychology 82, 1 (1990), 33.

[27]

Jovanovic J. Pardo A. Poquet, O.2022. Student profiles of change in a university course: A complex dynamical systems perspective. Supplementary material. (2022). http://dx.doi.org/10.5281/zenodo.7438629

[28]

Oleksandra Poquet, Kirsty Kitto, Jelena Jovanovic, Shane Dawson, George Siemens, and Lina Markauskaite. 2021. Transitions through lifelong learning: Implications for learning analytics. Computers and Education: Artificial Intelligence 2 (2021), 100039.

[29]

Cécile Proust, Hélène Jacqmin-Gadda, Jeremy MG Taylor, Julien Ganiayre, and Daniel Commenges. 2006. A nonlinear model with latent process for cognitive evolution using multivariate longitudinal data. Biometrics 62, 4 (2006), 1014–1024.

[30]

Cécile Proust-Lima, Hélène Amieva, and Hélène Jacqmin-Gadda. 2013. Analysis of multivariate mixed longitudinal data: a flexible latent process approach. 66, 3 (2013), 470–487.

[31]

Cécile Proust-Lima and Benoit Liquet. 2011. LCMM: an R package for estimation of latent class mixed models and joint latent class models. In The R User Conference, useR! 2011 August 16-18 2011 University of Warwick, Coventry, UK. Citeseer, 66.

[32]

Peter Reimann. 2009. Time is precious: Variable-and event-centred approaches to process analysis in CSCL research. International Journal of Computer-Supported Collaborative Learning 4, 3(2009), 239–257.

[33]

Bart Rienties, Dirk Tempelaar, Quan Nguyen, and Allison Littlejohn. 2019. Unpacking the intertemporal impact of self-regulation in a blended mathematics environment. Computers in Human Behavior 100 (2019), 345–357.

Digital Library

[34]

John Saint, Dragan Gašević, and Abelardo Pardo. 2018. Detecting learning strategies through process mining. In European Conference on Technology Enhanced Learning. Springer, 385–398.

Digital Library

[35]

John Saint, Alexander Whitelock-Wainwright, Dragan Gašević, and Abelardo Pardo. 2020. Trace-SRL: a framework for analysis of microlevel processes of self-regulated learning from trace data. IEEE Transactions on Learning Technologies 13, 4(2020), 861–877.

[36]

Cornelia Schoor and María Bannert. 2012. Exploring regulatory processes during a computer-supported collaborative learning task using process mining. Computers in Human Behavior 28, 4 (2012), 1321–1331.

Digital Library

[37]

Dale H. Schunk and Barry J. Zimmerman. 1997. Social origins of self-regulatory competence. Educational psychologist 32, 4 (1997), 195–208.

[38]

Mina Shirvani Boroujeni and Pierre Dillenbourg. 2018. Discovery and Temporal Analysis of Latent Study Patterns from MOOC Interaction Sequences. In 8th International Learning Analytics and Knowledge Conference (LAK18).

[39]

Robert S. Siegler. 2016. Continuity and change in the field of cognitive development and in the perspectives of one cognitive developmentalist. Child Development Perspectives 10, 2 (2016), 128–133.

[40]

Linda B Smith and Esther Thelen. 2003. Development as a dynamic system. Trends in cognitive sciences 7, 8 (2003), 343–348.

[41]

Damian G. Stephen, Rebecca A. Boncoddo, James S. Magnuson, and James A. Dixon. 2009. The dynamics of insight: Mathematical discovery as a phase transition. Memory & Cognition 37, 8 (2009), 1132–1149.

[42]

Floris Takens. 1981. Detecting strange attractors in turbulence. In Dynamical systems and turbulence. Warwick, Springer, 366–381.

[43]

Esther Thelen, Beverly D. Ulrich, and Peter H. Wolff. 1991. Hidden skills: A dynamic systems analysis of treadmill stepping during the first year. Monographs of the society for research in child development (1991), i–103. Publisher: JSTOR.

[44]

Jos Twisk and Trynke Hoekstra. 2012. Classifying developmental trajectories over time should be done with great caution: a comparison between methods. Journal of clinical epidemiology 65, 10 (2012), 1078–1087.

[45]

Sebastian Wallot and Joachim Grabowski. 2019. A tutorial introduction to recurrence quantification analysis (RQA) for keystroke logging data. Observing writing (2019), 163–189.

[46]

Klaas Wardenaar. 2020. Latent Class Growth Analysis and Growth Mixture Modeling using R: A tutorial for two R-packages and a comparison with Mplus.(2020). Publisher: PsyArXiv.

[47]

Charles L. Webber Jr and Joseph P. Zbilut. 2005. Recurrence quantification analysis of nonlinear dynamical systems. Tutorials in contemporary nonlinear methods for the behavioral sciences 94, 2005(2005), 26–94.

[48]

Travis J Wiltshire, Jonathan E Butner, and Stephen M Fiore. 2018. Problem-solving phase transitions during team collaboration. Cognitive science 42, 1 (2018), 129–167.

[49]

Philip H. Winne. 1994. Exploring individual differences in studying strategies using graph theoretic statistics.Alberta journal of educational research 40, 2 (1994), 177–93. Publisher: ERIC.

[50]

Philip H. Winne. 2001. ISelf-regulated learning viewed from models of information processing. In Self-Regulated Learning and Academic Achievement, Dale H. Schunk Barry J. Zimmerman (Ed.). Lawrence Erlbaum Associates Publishers, New York, New York, USA, Chapter 2, 145–178.

[51]

Philip H. Winne. 2014. Issues in researching self-regulated learning as patterns of events. Metacognition and Learning 9, 2 (2014), 229–237.

[52]

Zheng Yan and Kurt Fischer. 2002. Always under construction. Human development 45, 3 (2002), 141–160.

[53]

Perry Zurn, Danielle S Bassett, and Nicole C Rust. 2020. The citation diversity statement: a practice of transparency, a way of life. Trends in Cognitive Sciences 24, 9 (2020), 669–672.

Cited By

Song YOliveira EKirley MThompson P(2024)A Case Study on University Student Online Learning Patterns Across Multidisciplinary SubjectsProceedings of the 14th Learning Analytics and Knowledge Conference10.1145/3636555.3636939(936-942)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3636555.3636939
Kitto KGibson A(2024)Places to intervene in complex learning systemsProceedings of the 14th Learning Analytics and Knowledge Conference10.1145/3636555.3636938(929-935)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3636555.3636938
Bourguet M(2024)Demonstrating the impact of study regularity on academic success using learning analyticsProceedings of the 14th Learning Analytics and Knowledge Conference10.1145/3636555.3636845(736-741)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3636555.3636845
Show More Cited By

Index Terms

Student Profiles of Change in a University Course: A Complex Dynamical Systems Perspective
1. Applied computing
  1. Education
    1. E-learning
2. Computing methodologies
  1. Modeling and simulation
    1. Model development and analysis
      1. Modeling methodologies

Recommendations

Examining change in students’ self-regulated learning patterns after a formative assessment using process mining techniques
Abstract
The growing popularity of e-learning platforms, such as learning management systems, has foregrounded the role of self-regulated learning (SRL) in student success. In many e-learning environments, students typically complete learning assignments ...
Highlights
- Students engage in a loosely sequenced recursive self-regulated learning cycle.
- Students actively adjust self-regulated learning patterns in response to a formative assessment.
- There are group differences in the adjustment of self-...
Analytics of scaffold compliance for self-regulated learning
LAK '24: Proceedings of the 14th Learning Analytics and Knowledge Conference

The shift toward digitally-based education has emphasised the need for learners to have strong skills for self-regulated learning (SRL). The use of scaffolding prompts is seen as an effective way to stimulate SRL and enhance academic outcomes. A key ...
Self-regulated learning strategies predict learner behavior and goal attainment in Massive Open Online Courses

Individuals with strong self-regulated learning (SRL) skills, characterized by the ability to plan, manage and control their learning process, can learn faster and outperform those with weaker SRL skills. SRL is critical in learning environments that ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

LAK2023: LAK23: 13th International Learning Analytics and Knowledge Conference

March 2023

692 pages

ISBN:9781450398657

DOI:10.1145/3576050

Program Chairs:
Isabel Hilliger
Pontificia Universidad Católica de Chile, Chile
,
Hassan Khosravi
University of Queensland, Australia
,
Bart Rienties
Open University, United Kingdom
,
Shane Dawson
University of South Australia, Australia

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 March 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Bettencourt Schueller Foundation

Conference

LAK 2023

LAK 2023: 13th International Learning Analytics and Knowledge Conference

March 13 - 17, 2023

TX, Arlington, USA

Acceptance Rates

Overall Acceptance Rate 236 of 782 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
407
Total Downloads

Downloads (Last 12 months)104
Downloads (Last 6 weeks)8

Reflects downloads up to 12 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Song YOliveira EKirley MThompson P(2024)A Case Study on University Student Online Learning Patterns Across Multidisciplinary SubjectsProceedings of the 14th Learning Analytics and Knowledge Conference10.1145/3636555.3636939(936-942)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3636555.3636939
Kitto KGibson A(2024)Places to intervene in complex learning systemsProceedings of the 14th Learning Analytics and Knowledge Conference10.1145/3636555.3636938(929-935)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3636555.3636938
Bourguet M(2024)Demonstrating the impact of study regularity on academic success using learning analyticsProceedings of the 14th Learning Analytics and Knowledge Conference10.1145/3636555.3636845(736-741)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3636555.3636845
Villalobos EPérez-Sanagustín MBroisin J(2024)From Learning Actions to Dynamics: Characterizing Students’ Individual Temporal Behavior with Sequence AnalysisArtificial Intelligence in Education10.1007/978-3-031-64302-6_1(3-17)Online publication date: 8-Jul-2024
https://dl.acm.org/doi/10.1007/978-3-031-64302-6_1
Mejia-Domenzain PNazaretsky TSchultze SHochweber JKäser T(2024)Navigating Self-regulated Learning Dimensions: Exploring Interactions Across ModalitiesArtificial Intelligence in Education10.1007/978-3-031-64299-9_8(104-118)Online publication date: 2-Jul-2024
https://doi.org/10.1007/978-3-031-64299-9_8
Dever DWiedbusch MAzevedo R(2024)Analytical Approaches for Examining Learners’ Emerging Self-regulated Learning Complex Behaviors with an Intelligent Tutoring SystemAdaptive Instructional Systems10.1007/978-3-031-60609-0_9(116-129)Online publication date: 1-Jun-2024
https://doi.org/10.1007/978-3-031-60609-0_9
Esnaashari SGardner LArthanari TRehm M(2023)Unfolding self‐regulated learning profiles of students: A longitudinal studyJournal of Computer Assisted Learning10.1111/jcal.1283039:4(1116-1131)Online publication date: 7-Jun-2023
https://doi.org/10.1111/jcal.12830
Saqr MLópez-Pernas SVogelsmeier L(2023)When, how and for whom changes in engagement happenComputers & Education10.1016/j.compedu.2023.104934207:COnline publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1016/j.compedu.2023.104934

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents