Abstract
Artificial intelligence (AI) holds great promise for improving classroom orchestration—the teacher’s management of a classroom workflow that mixes small group, individual, and whole class activities. Although we have developed an orchestration system, named FACT, that uses AI, we were concerned that usability issues might decrease its effectiveness. We conducted an analysis of classroom video recordings that classified and compared the time FACT students spent to the time spent by students using paper versions of the same lessons. FACT wasted half the time that paper did. However FACT students spent slightly more time off task and had difficulties referring to objects on shared documents.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Dillenbourg, P.: Design for classroom orchestration. Comput. Educ. 69, 485–492 (2013)
Roschelle, J., Dimitriadis, Y., Hoppe, U.: Classroom orchestration: Synthesis. Comput. Educ. 69, 523–526 (2013)
Prieto, L.P., Dlab, M.H., Abdulwahed, M., Balid, W.: Orchestrating technology enhanced learning: a literature review and conceptual framework. Int. J. Technol. Enhanc. Learn. 3(6), 583–598 (2011)
Holstein, K., McLaren, B., Aleven, V.: Intelligent tutors as teachers’ aids: exploring teacher needs for real-time analytics in blended classrooms. In: Proceedings of the. Learning Analytics and Knowledge: LAK 2017, Vancouver, BC, Canada (2017)
Cheema, S., VanLehn, K., Burkhart, H., Pead, D., Schoenfeld, A.H.: Electronic posters to support formative assessment. In: Proceedings of the CHI 2016: Extended Abstracts (2016)
VanLehn, K., Cheema, S., Wetzel, J., Pead, D.: Some less obvious features of classroom orchestration systems. In: Lin, L., Atkinson, R.K. (eds.) Educational Technologies: Challenges, Applications and Learning Outcomes (2016)
Viswanathan, S.A., VanLehn, K.: Using the tablet gestures and speech of pairs of students to classify their collaboration. IEEE Trans. Learn. Technol. (2017)
VanLehn, K., Burkhardt, H., Cheema, S., Pead, D., Schoenfeld, A.H., Wetzel, J.: How can FACT encourage collaboration and self-correction?. In: Millis, K., Long, D., Magliano, J., Wiemer, K. (eds.) Multi-Disciplinary Approaches to Deep Learning, Routledge (in press)
Holstein, K., Hong, G., Tegene, M., McLaren, B., Aleven, V.: The classroom as a dashboard: co-designing wearable cognitive augmentation for K-12 teachers. In: Proceedings of the International Conference on Learning Analytics and Knowledge, Sydney, Australia (2018)
Martinez-Maldonado, R., Yacef, K., Kay, J.: TSCL: a conceptual model to inform understanding of collaborative learning processes at interactive tabletops. Int. J. Hum. Comput. Stud. 83, 62–82 (2015)
Looi, C.-K., Lin, C.-P., Liu, K.-P.: Group Scribbles to support knowledge building in a jigsaw method. IEEE Trans. Learn. Technol. 1(3), 157–164 (2008)
Hao, C.F.: A comparative study of collaborative learning in Paper Scribbles and Group Scribbles. Australas. J. Educ. Technol. 26(5), 659–674 (2010)
Acknowledgements
The FACT project is sponsored by the Bill and Melinda Gates Foundation under grant OPP10612881. We also thank all the students at ASU who have worked on FACT and the video analyses. Finally, we thank the Silicon Valley Mathematics Initiative and the Shell Center for conducting the classroom testing.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Wetzel, J. et al. (2018). A Preliminary Evaluation of the Usability of an AI-Infused Orchestration System. In: Penstein Rosé, C., et al. Artificial Intelligence in Education. AIED 2018. Lecture Notes in Computer Science(), vol 10948. Springer, Cham. https://doi.org/10.1007/978-3-319-93846-2_71
Download citation
DOI: https://doi.org/10.1007/978-3-319-93846-2_71
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-93845-5
Online ISBN: 978-3-319-93846-2
eBook Packages: Computer ScienceComputer Science (R0)