More Web Proxy on the site http://driver.im/

research-article

A Penny for your Thoughts: Students and Instructors’ Expectations about Learning Analytics in Brazil

Authors:

Taciana Pontual Falcão,

Rodrigo Lins Rodrigues,

Cristian Cechinel,

Diego Dermeval,

Elaine Harada Teixeira de Oliveira,

Isabela Gasparini,

Rafael D. Araújo,

Dragan Gasevic,

Rafael Ferreira MelloAuthors Info & Claims

LAK22: LAK22: 12th International Learning Analytics and Knowledge Conference

Pages 186 - 196

https://doi.org/10.1145/3506860.3506886

Published: 21 March 2022 Publication History

Abstract

Stakeholder engagement is a key aspect for the successful implementation of Learning Analytics (LA) in Higher Education Institutions (HEIs). Studies in Europe and Latin America (LATAM) indicate that, overall, instructors and students have positive views on LA adoption, but there are differences between their ideal expectations and what they consider realistic in the context of their institutions. So far, very little has been found about stakeholders’ views on LA in Brazilian higher education. By replicating the survey conducted in other countries, in seven Brazilian HEIs, we found convergences both with Europe and LATAM, reinforcing the need for local diagnosis and indicating the risk of assuming a ”LATAM identity”. Our findings contribute to building a corpus of knowledge on stakeholders expectations with a contextualised comprehension of the gaps between ideal and predicted scenarios, which can inform institutional policies for LA implementation in Brazil.

References

[1]

June Ahn, Fabio Campos, Maria Hays, and Daniela DiGiacomo. 2019. Designing in Context: Reaching beyond Usability in Learning Analytics Dashboard Design.Journal of Learning Analytics 6, 2 (2019), 70–85.

[2]

Carlos Prieto Alvarez, Roberto Martinez-Maldonado, and Simon Buckingham Shum. 2020. LA-DECK: A card-based learning analytics co-design tool. In Proceedings of the tenth international conference on learning analytics & knowledge. 63–72.

Digital Library

[3]

Cecilia Avila, Silvia Baldiris, Ramon Fabregat, and Sabine Graf. 2020. Evaluation of a learning analytics tool for supporting teachers in the creation and evaluation of accessible and quality open educational resources. British Journal of Educational Technology 51, 4 (2020), 1019–1038.

[4]

Colleen Carmean, David Kil, and Linda Baer. 2021. Why Data Matters for Student Success in a Post-Pandemic World. https://er.educause.edu/articles/2021/8/why-data-matters-for-student-success-in-a-post-pandemic-world. Online; accessed 30 September 2021.

[5]

Cristian Cechinel, Xavier Ochoa, Henrique Lemos dos Santos, João Batista Carvalho Nunes, Virginia Rodés, and Emanuel Marques Queiroga. 2020. Mapping Learning Analytics initiatives in Latin America. British Journal of Educational Technology 51, 4 (2020), 892–914.

[6]

Mohamed Amine Chatti and Arham Muslim. 2019. The PERLA framework: Blending personalization and learning analytics. International review of research in open and distributed learning 20, 1(2019).

[7]

Cristóbal Cobo and Cecilia Aguerrebere. 2018. Building capacity for learning analytics in Latin America. INCludE uS All! dIRECtIONS fOR AdOPtION Of lEARNINg ANAlYtICS IN thE glObAl SOuth (2018), 58.

[8]

Linda Corrin, PG De Barba, L Lockyear, Dragan Gašević, D Williams, Shane Dawson, R Mulder, S Copeland, and A Bakharia. 2016. Completing the loop: Returning meaningful learning analytic data to teachers. (2016).

[9]

Shane Dawson, Srecko Joksimovic, Oleksandra Poquet, and George Siemens. 2019. Increasing the impact of learning analytics. In Proceedings of the 9th international conference on learning analytics & knowledge. 446–455.

Digital Library

[10]

Mollie Dollinger and Jason M Lodge. 2018. Co-creation strategies for learning analytics. In Proceedings of the 8th international conference on learning analytics and knowledge. 97–101.

Digital Library

[11]

Taciana Pontual Falcao, Rafael Ferreira, Rodrigo Lins Rodrigues, Juliana Diniz, and Dragan Gasevic. 2019. Students’ perceptions about learning analytics in a brazilian higher education institution. In 2019 IEEE 19th International Conference on Advanced Learning Technologies (ICALT), Vol. 2161. IEEE, 204–206.

[12]

Taciana Pontual Falcão, Rafael Ferreira Mello, Rodrigo Lins Rodrigues, Juliana Regueira Basto Diniz, Yi-Shan Tsai, and Dragan Gašević. 2020. Perceptions and expectations about learning analytics from a brazilian higher education institution. In Proceedings of the Tenth International Conference on Learning Analytics & Knowledge. 240–249.

Digital Library

[13]

Rebecca Ferguson. 2012. Learning analytics: drivers, developments and challenges. International Journal of Technology Enhanced Learning 4, 5-6 (2012), 304–317.

Digital Library

[14]

Gustavo E Fischman and Molly Ott. 2018. Access, equity and quality trends in Latin America’s public universities. International Journal of Educational Development 58 (2018), 86–94.

[15]

Samantha Garcia, Elaine Cristina Moreira Marques, Rafael Ferreira Mello, Dragan Gašević, and Taciana Pontual Falcão. 2021. Aligning Expectations About the Adoption of Learning Analytics in a Brazilian Higher Education Institution. In International Conference on Artificial Intelligence in Education. Springer, 173–177.

Digital Library

[16]

Dragan Gašević. 2018. Include us all! Directions for adoption of learning analytics in the global south. Learning analyfics for the global south(2018), 1–22.

[17]

Geraldine Gray, Ana Schalk, Pauline Rooney, and Charles Lang. 2021. A stakeholder informed professional development framework to support engagement with learning analytics. In LAK21: 11th International Learning Analytics and Knowledge Conference. 237–247.

Digital Library

[18]

Julio Guerra, Margarita Ortiz-Rojas, Miguel Angel Zúñiga-Prieto, Eliana Scheihing, Alberto Jiménez, Tom Broos, Tinne De Laet, and Katrien Verbert. 2020. Adaptation and evaluation of a learning analytics dashboard to improve academic support at three Latin American universities. British Journal of Educational Technology 51, 4 (2020), 973–1001.

[19]

Christothea Herodotou, Bart Rienties, Avinash Boroowa, Zdenek Zdrahal, and Martin Hlosta. 2019. A large-scale implementation of predictive learning analytics in higher education: the teachers’ role and perspective. Educational Technology Research and Development 67, 5(2019), 1273–1306.

[20]

Christothea Herodotou, Bart Rienties, Martin Hlosta, Avinash Boroowa, Chrysoula Mangafa, and Zdenek Zdrahal. 2020. The scalable implementation of predictive learning analytics at a distance learning university: Insights from a longitudinal case study. The Internet and Higher Education 45 (2020), 100725. https://doi.org/10.1016/j.iheduc.2020.100725

[21]

Isabel Hilliger, Margarita Ortiz-Rojas, Paola Pesántez-Cabrera, Eliana Scheihing, Yi-Shan Tsai, Pedro J Muñoz-Merino, Tom Broos, Alexander Whitelock-Wainwright, Dragan Gašević, and Mar Pérez-Sanagustín. 2020. Towards learning analytics adoption: A mixed methods study of data-related practices and policies in Latin American universities. British Journal of Educational Technology 51, 4 (2020), 915–937.

[22]

Isabel Hilliger, Margarita Ortiz-Rojas, Paola Pesántez-Cabrera, Eliana Scheihing, Yi-Shan Tsai, Pedro J Muñoz-Merino, Tom Broos, Alexander Whitelock-Wainwright, and Mar Pérez-Sanagustín. 2020. Identifying needs for learning analytics adoption in Latin American universities: A mixed-methods approach. The Internet and Higher Education 45 (2020), 100726.

[23]

Kenneth Holstein, Bruce M McLaren, and Vincent Aleven. 2019. Co-designing a real-time classroom orchestration tool to support teacher–AI complementarity. Journal of Learning Analytics 6, 2 (2019).

[24]

Joel A Howell, Lynne D Roberts, Kristen Seaman, and David C Gibson. 2018. Are we on our way to becoming a “helicopter university”? Academics’ views on learning analytics. Technology, Knowledge and Learning 23, 1 (2018), 1–20.

[25]

Dirk Ifenthaler and Monica W Tracey. 2016. Exploring the relationship of ethics and privacy in learning analytics and design: implications for the field of educational technology. Educational Technology Research and Development 64, 5(2016), 877–880.

[26]

Jelena Jovanović, Dragan Gašević, Shane Dawson, Abelardo Pardo, and Negin Mirriahi. 2017. Learning analytics to unveil learning strategies in a flipped classroom. The Internet and Higher Education 33 (2017), 74–85. https://doi.org/10.1016/j.iheduc.2017.02.001

[27]

Rogers Kaliisa, Anders Kluge, and Anders I Mørch. 2020. Combining Checkpoint and Process Learning Analytics to Support Learning Design Decisions in Blended Learning Environments.Journal of Learning Analytics 7, 3 (2020), 33–47.

[28]

Carrie Klein, Jaime Lester, Huzefa Rangwala, and Aditya Johri. 2019. Learning analytics tools in higher education: Adoption at the intersection of institutional commitment and individual action. The Review of Higher Education 42, 2 (2019), 565–593.

[29]

Kaire Kollom, Kairit Tammets, Maren Scheffel, Yi-Shan Tsai, Ioana Jivet, Pedro J Muñoz-Merino, Pedro Manuel Moreno-Marcos, Alexander Whitelock-Wainwright, Adolfo Ruiz Calleja, Dragan Gasevic, 2021. A four-country cross-case analysis of academic staff expectations about learning analytics in higher education. The Internet and Higher Education 49 (2021), 100788.

[30]

Michael Kwet and Paul Prinsloo. 2020. The ‘smart’classroom: a new frontier in the age of the smart university. Teaching in Higher Education 25, 4 (2020), 510–526.

[31]

Philipp Leitner, Mohammad Khalil, and Martin Ebner. 2017. Learning analytics in higher education—a literature review. Learning analytics: Fundaments, applications, and trends (2017), 1–23.

[32]

Valesca Lima and Sue Iamamoto. 2021. “Culture War´´ against Brazilian universities: how budget cuts and changes in tertiary education policies are affecting the academic community. http://www.alternautas.net/blog/2020/9/9/culture-war-against-brazilian-universities-how-budget-cuts-and-changes-in-tertiary-education-policies-are-affecting-the-academic-community. Online; accessed 03 October 2021.

[33]

Phillip D. Long, George Siemens, Grainne Conole, and Dragan Gašević (Eds.). 2011. Proceedings of the 1st International Conference on Learning Analytics and Knowledge (LAK’11). ACM, New York, NY, USA.

Digital Library

[34]

Jorge Maldonado-Mahauad, Isabel Hilliger, Tinne De Laet, Martijn Millecamp, Katrien Verbert, Xavier Ochoa, and Mar Pérez-Sanagustín. 2018. The LALA project: Building capacity to use learning analytics to improve higher education in Latin America. In Companion Proceedings of the 8th International Learning Analytics & Knowledge conference. 630–637.

[35]

Gary E Meek, Ceyhun Ozgur, and Kenneth Dunning. 2007. Comparison of the t vs. Wilcoxon signed-rank test for Likert scale data and small samples. Journal of modern applied statistical methods 6, 1 (2007), 10.

[36]

Yishay Mor, Rebecca Ferguson, and Barbara Wasson. 2015. Learning design, teacher inquiry into student learning and learning analytics: A call for action.

[37]

Abelardo Pardo, Jelena Jovanovic, Shane Dawson, Dragan Gašević, and Negin Mirriahi. 2019. Using learning analytics to scale the provision of personalised feedback. British Journal of Educational Technology 50, 1 (2019), 128–138.

[38]

Carlos G Prieto-Alvarez, Roberto Martinez-Maldonado, and Theresa Dirndorfer Anderson. 2018. Co-designing learning analytics tools with learners. In Learning Analytics in the Classroom. Routledge, 93–110.

[39]

Elizabeth Redden. 2019. In Brazil, a Hostility to Academe. https://www.insidehighered.com/news/2019/05/06/far-right-government-brazil-slashes-university-funding-threatens-cuts-philosophy-and. Online; accessed 03 October 2021.

[40]

Bart Rienties, Christothea Herodotou, Tom Olney, Mat Schencks, and Avi Boroowa. 2018. Making sense of learning analytics dashboards: A technology acceptance perspective of 95 teachers. International Review of Research in Open and Distributed Learning 19, 5(2018).

[41]

Sdenka Zobeida Salas-Pilco and Yuqin Yang. 2020. Learning analytics initiatives in Latin America: Implications for educational researchers, practitioners and decision makers. British Journal of Educational Technology 51, 4 (2020), 875–891.

[42]

Neil Selwyn. 2015. Data entry: Towards the critical study of digital data and education. Learning, Media and Technology 40, 1 (2015), 64–82.

[43]

Neil Selwyn. 2020. Re-imagining ‘Learning Analytics’… a case for starting again?The Internet and Higher Education 46 (2020), 100745.

[44]

George Siemens. 2013. Learning analytics: The emergence of a discipline. American Behavioral Scientist 57, 10 (2013), 1380–1400.

[45]

Sharon Slade, Paul Prinsloo, and Mohammad Khalil. 2019. Learning analytics at the intersections of student trust, disclosure and benefit. In Proceedings of the 9th International Conference on learning analytics & knowledge. 235–244.

Digital Library

[46]

Erveson Sousa, Bruno Alexandre, Rafael Ferreira Mello, Taciana Pontual Falcão, Boban Vesin, and Dragan Gašević. 2021. Applications of learning analytics in high schools: a Systematic Literature review. Frontiers in Artificial Intelligence(2021), 1–14.

[47]

Yi-Shan Tsai and Dragan Gasevic. 2017. Learning analytics in higher education—challenges and policies: a review of eight learning analytics policies. In Proceedings of the seventh international learning analytics & knowledge conference. 233–242.

Digital Library

[48]

Yi-Shan Tsai, Dragan Gašević, Alexander Whitelock-Wainwright, Pedro J Muñoz-Merino, Pedro M Moreno-Marcos, Aarón Rubio Fernández, Carlos Delgado Kloos, Maren Scheffel, Ioana Jivet, Hendrik Drachsler, 2018. SHEILA: Supporting higher education to integrate learning analytics. Retrieved from https://sheilaproject. eu/2018/11/30/sheilafinal-research-report (2018).

[49]

Yi-Shan Tsai, Pedro Manuel Moreno-Marcos, Ioana Jivet, Maren Scheffel, Kairit Tammets, Kaire Kollom, and Dragan Gašević. 2018. The SHEILA framework: Informing institutional strategies and policy processes of learning analytics. Journal of Learning Analytics 5, 3 (2018), 5–20.

[50]

Yi-Shan Tsai, Carlo Perrotta, and Dragan Gašević. 2020. Empowering learners with personalised learning approaches? Agency, equity and transparency in the context of learning analytics. Assessment & Evaluation in Higher Education 45, 4 (2020), 554–567.

[51]

Yi-Shan Tsai, Diego Rates, Pedro Manuel Moreno-Marcos, Pedro J Munoz-Merino, Ioana Jivet, Maren Scheffel, Hendrik Drachsler, Carlos Delgado Kloos, and Dragan Gašević. 2020. Learning analytics in European higher education—Trends and barriers. Computers & Education 155 (2020), 103933.

[52]

Yi-Shan Tsai, Alexander Whitelock-Wainwright, and Dragan Gašević. 2020. The privacy paradox and its implications for learning analytics. In Proceedings of the tenth international conference on learning analytics & knowledge. 230–239.

Digital Library

[53]

Anouschka Van Leeuwen. 2019. Teachers’ perceptions of the usability of learning analytics reports in a flipped university course: When and how does information become actionable knowledge?Educational Technology Research and Development 67, 5(2019), 1043–1064.

[54]

Olga Viberg, Mathias Hatakka, Olof Bälter, and Anna Mavroudi. 2018. The current landscape of learning analytics in higher education. Computers in Human Behavior 89 (2018), 98–110.

Digital Library

[55]

Deborah West, Zaidatun Tasir, Ann Luzeckyj, Kew Si Na, Danny Toohey, Zaleha Abdullah, Bill Searle, Nurul Farhana Jumaat, and Richard Price. 2018. Learning analytics experience among academics in Australia and Malaysia: A comparison. Australasian Journal of Educational Technology 34, 3(2018).

[56]

Alexander Whitelock-Wainwright, Dragan Gašević, Ricardo Tejeiro, Yi-Shan Tsai, and Kate Bennett. 2019. The student expectations of learning analytics questionnaire. Journal of Computer Assisted Learning 35, 5 (2019), 633–666.

[57]

Alexander Whitelock-Wainwright, Dragan Gašević, Yi-Shan Tsai, Hendrik Drachsler, Maren Scheffel, Pedro J Muñoz-Merino, Kairit Tammets, and Carlos Delgado Kloos. 2020. Assessing the validity of a learning analytics expectation instrument: a multinational study. Journal of Computer Assisted Learning 36, 2 (2020), 209–240.

[58]

Alyssa Friend Wise and Yeonji Jung. 2019. Teaching with analytics: Towards a situated model of instructional decision-making. Journal of Learning Analytics 6, 2 (2019), 53–69.

[59]

Annika Wolff, Zdenek Zdrahal, Drahomira Herrmannova, Jakub Kuzilek, and Martin Hlosta. 2014. Developing predictive models for early detection of at-risk students on distance learning modules. (2014).

[60]

Shoshana Zuboff. 2015. Big other: surveillance capitalism and the prospects of an information civilization. Journal of information technology 30, 1 (2015), 75–89.

Cited By

Henklain MPereira FSilva LRibeiro ARocha HBalico LUrquiza MOliveira MZambonin GFerreira Mello R(2024)Uso de learning analytics para Avaliação de eficiência de curso de introdução à Inteligência ArtificialAnais do IV Simpósio Brasileiro de Educação em Computação (EDUCOMP 2024)10.5753/educomp.2024.237389(113-122)Online publication date: 22-Apr-2024
https://doi.org/10.5753/educomp.2024.237389
Lim TGottipati SCheong M(2023)Ethical Considerations for Artificial Intelligence in Educational AssessmentsCreative AI Tools and Ethical Implications in Teaching and Learning10.4018/979-8-3693-0205-7.ch003(32-79)Online publication date: 29-Dec-2023
https://doi.org/10.4018/979-8-3693-0205-7.ch003
Asher ABriney KGoben A(2023)Valid questions: the development and evaluation of a new library learning analytics surveyPerformance Measurement and Metrics10.1108/PMM-04-2023-000924:2(101-119)Online publication date: 21-Jul-2023
https://doi.org/10.1108/PMM-04-2023-0009
Show More Cited By

Index Terms

A Penny for your Thoughts: Students and Instructors’ Expectations about Learning Analytics in Brazil

Index terms have been assigned to the content through auto-classification.

Recommendations

Effects of Learning Analytics on Students' Self-Regulated Learning in Flipped Classroom

The present article is aimed at analyzing the effects of learning analytics on students' self-regulated learning in a flipped classroom. An experiment was conducted with 96 engineering students, enrolled in a subject offered in the Flipped Classroom ...
Expectations of High School Teachers Regarding the Use of Learning Analytics
Proceedings of the 18th Latin American Conference on Learning Technologies (LACLO 2023)
Abstract
The search for improved teaching methods and a more personalized education has been a constant challenge in the educational field. Learning Analytics (LA), the measurement, collection, analysis, and reporting of data about students and their ...
Linking students' timing of engagement to learning design and academic performance
LAK '18: Proceedings of the 8th International Conference on Learning Analytics and Knowledge

In recent years, the connection between Learning Design (LD) and Learning Analytics (LA) has been emphasized by many scholars as it could enhance our interpretation of LA findings and translate them to meaningful interventions. Together with numerous ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

LAK22: LAK22: 12th International Learning Analytics and Knowledge Conference

March 2022

582 pages

ISBN:9781450395731

DOI:10.1145/3506860

Program Chairs:
Alyssa Friend Wise
New York University, USA
,
Roberto Martinez-Maldonado
Monash University, Australia
,
Isabel Hilliger
Pontificia Universidad Católica de Chile, Chile

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 March 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

LAK22

LAK22: 12th International Learning Analytics and Knowledge Conference

March 21 - 25, 2022

Online, USA

Acceptance Rates

Overall Acceptance Rate 236 of 782 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
257
Total Downloads

Downloads (Last 12 months)41
Downloads (Last 6 weeks)3

Reflects downloads up to 12 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Henklain MPereira FSilva LRibeiro ARocha HBalico LUrquiza MOliveira MZambonin GFerreira Mello R(2024)Uso de learning analytics para Avaliação de eficiência de curso de introdução à Inteligência ArtificialAnais do IV Simpósio Brasileiro de Educação em Computação (EDUCOMP 2024)10.5753/educomp.2024.237389(113-122)Online publication date: 22-Apr-2024
https://doi.org/10.5753/educomp.2024.237389
Lim TGottipati SCheong M(2023)Ethical Considerations for Artificial Intelligence in Educational AssessmentsCreative AI Tools and Ethical Implications in Teaching and Learning10.4018/979-8-3693-0205-7.ch003(32-79)Online publication date: 29-Dec-2023
https://doi.org/10.4018/979-8-3693-0205-7.ch003
Asher ABriney KGoben A(2023)Valid questions: the development and evaluation of a new library learning analytics surveyPerformance Measurement and Metrics10.1108/PMM-04-2023-000924:2(101-119)Online publication date: 21-Jul-2023
https://doi.org/10.1108/PMM-04-2023-0009
Biancato GMarques Queiroga EMuñoz RRamos VThompsen Primo TRodés VCechinel C(2023)Expectations of High School Teachers Regarding the Use of Learning AnalyticsProceedings of the 18th Latin American Conference on Learning Technologies (LACLO 2023)10.1007/978-981-99-7353-8_34(459-471)Online publication date: 17-Oct-2023
https://doi.org/10.1007/978-981-99-7353-8_34
Viberg OJivet IScheffel M(2023)Designing Culturally Aware Learning Analytics: A Value Sensitive PerspectivePracticable Learning Analytics10.1007/978-3-031-27646-0_10(177-192)Online publication date: 31-Mar-2023
https://doi.org/10.1007/978-3-031-27646-0_10
Mello RNeto RFiorentino GAlves GArêdes VSilva JFalcão TGašević D(2022)Enhancing Instructors’ Capability to Assess Open-Response Using Natural Language Processing and Learning AnalyticsEducating for a New Future: Making Sense of Technology-Enhanced Learning Adoption10.1007/978-3-031-16290-9_8(102-115)Online publication date: 12-Sep-2022
https://dl.acm.org/doi/10.1007/978-3-031-16290-9_8

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents