Ruffle&Riley: From Lesson Text to Conversational Tutoring
Pages 547 - 549
Abstract
Conversational tutoring systems (CTSs) offer learning experiences driven by natural language interactions. They are recognized for promoting cognitive engagement and improving learning outcomes, especially in reasoning tasks. Ruffle&Riley is a novel type of CTS that explores the potential of LLMs for efficient AI-assisted content authoring and for facilitating structured free-form conversational tutoring. This interactive event enables participants to engage with the LLM-based CTS introduced in our recent AIED2024 paper in two ways: (1) Attendees will interact with the web application using their personal devices. (2) Attendees will learn how to import learning materials into the system and generate custom tutoring scripts through a detailed tutorial. Ruffle&Riley is an extendable, open-source framework that promotes research on effective instructional design of LLM-based learning technologies. The interactive event will foster related discussions.
References
[1]
Vincent Aleven, Bruce M McLaren, Jonathan Sewall, Martin Van Velsen, Octav Popescu, Sandra Demi, Michael Ringenberg, and Kenneth R Koedinger. 2016. Example-tracing tutors: Intelligent tutor development for non-programmers. International Journal of Artificial Intelligence in Education, Vol. 26 (2016), 224--269.
[2]
Mary A Clark, Matthew Douglas, and Jung Choi. 2018. Biology 2e. OpenStax, Houston, TX, USA.
[3]
David Duran. 2017. Learning-by-teaching. Evidence and implications as a pedagogical mechanism. Innovations in Education and Teaching International, Vol. 54, 5 (2017), 476--484.
[4]
Arthur C Graesser, Shulan Lu, George Tanner Jackson, Heather Hite Mitchell, Mathew Ventura, Andrew Olney, and Max M Louwerse. 2004. AutoTutor: A tutor with dialogue in natural language. Behavior Research Methods, Instruments, & Computers, Vol. 36 (2004), 180--192.
[5]
Arthur C Graesser, Natalie K Person, and Joseph P Magliano. 1995. Collaborative dialogue patterns in naturalistic one-to-one tutoring. Applied cognitive psychology, Vol. 9, 6 (1995), 495--522.
[6]
Xudong Huang, Scotty D. Craig, Jun Xie, Arthur Graesser, and Xiangen Hu. 2016. Intelligent tutoring systems work as a math gap reducer in 6th grade after-school program. Learning and Individual Differences, Vol. 47 (2016), 258--265.
[7]
James A. Kulik and J. D. Fletcher. 2016. Effectiveness of Intelligent Tutoring Systems: A Meta-Analytic Review. Review of Educational Research, Vol. 86, 1 (2016), 42--78.
[8]
Krittaya Leelawong and Gautam Biswas. 2008. Designing learning by teaching agents: The Betty's Brain system. International Journal of Artificial Intelligence in Education, Vol. 18, 3 (2008), 181--208.
[9]
Benjamin D Nye, Arthur C Graesser, and Xiangen Hu. 2014. AutoTutor and family: A review of 17 years of natural language tutoring. International Journal of Artificial Intelligence in Education, Vol. 24 (2014), 427--469.
[10]
OpenAI. 2023. GPT-4 Technical Report. arxiv: 2303.08774 [cs.CL]
[11]
Robin Schmucker, Meng Xia, Amos Azaria, and Tom Mitchell. 2024. Ruffle&Riley: Insights from Designing and Evaluating a Large Language Model-Based Conversational Tutoring System. In Proceedings of the 25th International Conference on Artificial Intelligence in Education (AIED2024). Springer, Cham, 1--14.
Index Terms
- Ruffle&Riley: From Lesson Text to Conversational Tutoring
Recommendations
Authoring Conversational Intelligent Tutoring Systems
Adaptive Instructional SystemsAbstractConversational Intelligent Tutoring Systems (ITSs) are expensive to develop. While simple online courseware could be easily authored by teachers, the authoring of conversational ITSs usually involves a team of experts with different expertise, ...
Spoken Versus Typed Human and Computer Dialogue Tutoring
While human tutors typically interact with students using spoken dialogue, most computer dialogue tutors are text-based. We have conducted two experiments comparing typed and spoken tutoring dialogues, one in a human-human scenario, and another in a ...
A conversational intelligent tutoring system to automatically predict learning styles
This paper proposes a generic methodology and architecture for developing a novel conversational intelligent tutoring system (CITS) called Oscar that leads a tutoring conversation and dynamically predicts and adapts to a student's learning style. Oscar ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
July 2024
582 pages
ISBN:9798400706332
DOI:10.1145/3657604
- General Chair:
- David Joyner,
- Program Chairs:
- Min Kyu Kim,
- Xu Wang,
- Meng Xia
Copyright © 2024 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 15 July 2024
Check for updates
Author Tags
Qualifiers
- Demonstration
Funding Sources
- AFOSR
Conference
L@S '24
Acceptance Rates
Overall Acceptance Rate 117 of 440 submissions, 27%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 84Total Downloads
- Downloads (Last 12 months)84
- Downloads (Last 6 weeks)26
Reflects downloads up to 10 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in