[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/2479787.2479817acmotherconferencesArticle/Chapter ViewAbstractPublication PageswimsConference Proceedingsconference-collections
research-article

Open data framework for sustainable assessment in software forges

Published: 12 June 2013 Publication History

Abstract

In a project-based learning experience, the detailed monitoring of the activities in which team members participate can be useful to evaluate their work. Using learning-oriented assessment procedures, supervisors can assess the teamwork abilities with a formative purpose. Evaluation strategies such as self-assessment, peer assessment and co-assessment are often used to make evaluation formative and sustainable. Conducting an assessment strategy is not easy for team members, since they need before to have a reasonable understanding of the evaluation process and criteria. This paper describes a learning-oriented evaluation methodology and a open data framework that can be applied to collaborative software development project settings. An evaluation rubric and a series of indicators that provide evidences about the developed skills have been elaborated and applied in a small-scale project-based course on Web Engineering. Projects were managed and developed with the help of an open source software forge that contains a ticketing tool for planning and tracking of tasks, a version control repository to save the software deliverables, and using a wiki to host text deliverables. The experience provides evidences in favor of using the assessment method and open data framework to make teamwork evaluation more sustainable.

References

[1]
N. Barootchi and M. Keshavarz. Assessment of achievement through portfolios and teacher-made tests. Educational Research, 44(3):279--288, 2002.
[2]
C. Bizer, T. Heath, and T. Berners-Lee. Linked Data - The Story So Far. International Journal on Semantic Web and Information Systems, 5(3):1--22, 2009.
[3]
D. Boud. Sustainable assessment: rethinking assessment for the learning society. Studies in continuing education, 22(2):151--167, 2000.
[4]
D. Boud. Reframing assessment as if learning were important. Rethinking assessment in higher education: Learning for the longer term, pages 14--25, 2007.
[5]
R. Bouman and J. van Dongen. Pentaho Solutions: Business Intelligence and Data Warehousing with Pentaho and MySQL. Wiley, 2010.
[6]
A. Colombo, E. Damiani, F. Frati, S. Oltolina, K. Reed, and G. Ruffatti. The use of a meta-model to support multi-project process measurement. In Software Engineering Conference, 2008. APSEC'08. 15th Asia-Pacific, pages 503--510. IEEE, 2008.
[7]
M. D'Aquin. Putting linked data to use in a large higher-education organisation. In Proceedings of the Interacting with Linked Data (ILD) workshop at Extended Semantic Web Conference (ESWC), Heraklion, Crete, 2012.
[8]
S. Davies. Effective assessment in a digital age, 2010.
[9]
J. M. Dodero, I. Ruiz-Rube, M. Palomo-Duarte, and J. Cabot. Model-driven learning design. Journal of Research and Practice in Information Technology, 44(3):267--288, 2012.
[10]
N. Falchikov. Improving assessment through student involvement: Practical solutions for aiding learning in higher and further education. RoutledgeFalmer, 2005.
[11]
R. Ferguson. The state of learning analytics in 2012: A review and future challenges. Technical Report KMI-12-01, Knowledge Media Institute, The Open University, 2012.
[12]
S. J. Gala-Pérez. Intensive metrics for the study of the evolution of open source projects. Master's thesis, Universidad Rey Juan Carlos, 2013. http://hdl.handle.net/10115/11518.
[13]
D. Hernández Leo, V. Moreno, J. Dodero, A. Pardo, M. Romero Ternero, Y. Dimitriadis, and J. Asensio-Pérez. Aplicación de recomendaciones para la alineación de competencias, metodología y evaluación en asignaturas de ingeniería telemática, informática y electrónica. IEEE-RITA, 7(1):13--20, 2012.
[14]
D. Karger. Standards opportunities around data-bearing Web pages. Philosophical Transactions of the Royal Society A, 371(February):1--23, 2013.
[15]
V. Klenowski, S. Askew, and E. Carnell. Portfolios for learning, assessment and professional development in higher education. Assessment & Evaluation in Higher Education, 31(3):267--286, 2006.
[16]
O. Liber and M. Johnson. Personal learning environments. Interactive Learning Environments, 16(1):1--2, 2008.
[17]
R. J. Markham T, Larmer J. Project Based Learning Handbook: A Guide to Standards-Focused Project Based Learning for Middle and High School Teachers. Buck Institute for Education, 2003.
[18]
M. Palomo-Duarte, J. M. Dodero, I. Medina-Bulo, E. J. Rodríguez-Posada, and I. Ruiz-Rube. Assessment of collaborative learning experiences by graphical analysis of wiki contributions. Interactive Learning Environments, pages 1--23, May 2012.
[19]
G. Robles, S. Koch, and J. M. Gonzalez-Barahona. Remote analysis and measurement of libre software systems by means of the CVSAnalY tool. In Proceedings of the 2nd ICSE Workshop on Remote Analysis and Measurement of Software Systems (RAMSS), Edinburg, Scotland, UK, 2004.
[20]
D. Sadler. Beyond feedback: Developing student capability in complex appraisal. Assessment & Evaluation in Higher Education, 35(5):535--550, 2010.
[21]
P. Vassiliadis. A survey of extract-transform-load technology. International Journal of Data Warehousing and Mining, 5(3):1--27, 2009.
[22]
B. Walvoord and V. Anderson. Effective grading: A tool for learning and assessment in college. Jossey-Bass, 2009.
[23]
L. Zhao and S. Elbaum. Quality assurance under the open source development model. Journal of Systems and Software, 66(1):65--75, Apr. 2003.

Cited By

View all
  • (2021)The Quest for Sustainable Teaching Praxis: Opportunities and Challenges of Multidisciplinary and Multicultural TeamworkSustainability10.3390/su1313721013:13(7210)Online publication date: 28-Jun-2021
  • (2018)A framework for software process deployment and evaluationInformation and Software Technology10.1016/j.infsof.2014.12.00159:C(205-221)Online publication date: 29-Dec-2018
  • (2015)Reutilización de datos abiertos en el aprendizaje de diseño de bases de datos a través de proyectosEducation in the Knowledge Society (EKS)10.14201/eks2015164638016:4(63)Online publication date: 10-Dec-2015
  • Show More Cited By

Recommendations

Reviews

Stewart Mark Godwin

As educational organizations move toward online delivery, the burden on educators to assess and grade student work is complicated by many factors not associated with a regular classroom. While it is critical to establish the authenticity of online student submissions for group work, it can be difficult for a supervisor to determine the contribution of each member. This paper investigates a solution for assessment purposes using software forges (collaboration platforms that support collaborative software development over the Internet) to log the activity of students working as a team on a combined project. The main focus of the investigation is to determine how supervisors can evaluate complex learning environments such as project-based tasks. The grading of project-based assessments with multiple criteria requires careful consideration and evaluation. For example, peer assessments and self-assessments can introduce errors because team members may find it difficult to estimate assessment criteria. Using a case study approach, the paper establishes that the proposed approach has similar outcomes to previous iterations of the same project-based assessment. In their conclusion, the authors note that the purpose of the assessment instrument is to improve assessments rather than improve student grades, and the consistency of the results ensures the long-term sustainability of the assessment process. This paper should be significant to educators involved in virtual learning environments. Online Computing Reviews Service

Access critical reviews of Computing literature here

Become a reviewer for Computing Reviews.

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences
WIMS '13: Proceedings of the 3rd International Conference on Web Intelligence, Mining and Semantics
June 2013
408 pages
ISBN:9781450318501
DOI:10.1145/2479787
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

  • UAM: Autonomous University of Madrid

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 June 2013

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. assessment
  2. project-based learning
  3. software forges

Qualifiers

  • Research-article

Funding Sources

  • University of Cádiz
  • Andalusian Government

Conference

WIMS '13
Sponsor:
  • UAM

Acceptance Rates

WIMS '13 Paper Acceptance Rate 28 of 72 submissions, 39%;
Overall Acceptance Rate 140 of 278 submissions, 50%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)6
  • Downloads (Last 6 weeks)1
Reflects downloads up to 12 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2021)The Quest for Sustainable Teaching Praxis: Opportunities and Challenges of Multidisciplinary and Multicultural TeamworkSustainability10.3390/su1313721013:13(7210)Online publication date: 28-Jun-2021
  • (2018)A framework for software process deployment and evaluationInformation and Software Technology10.1016/j.infsof.2014.12.00159:C(205-221)Online publication date: 29-Dec-2018
  • (2015)Reutilización de datos abiertos en el aprendizaje de diseño de bases de datos a través de proyectosEducation in the Knowledge Society (EKS)10.14201/eks2015164638016:4(63)Online publication date: 10-Dec-2015
  • (2014)Automating Technical Reviews in Software Forges and Repositories Based on Linked DataMetadata and Semantics Research10.1007/978-3-319-13674-5_4(30-41)Online publication date: 2014

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media