Abstract
The rapid growth in the number of ontologies has not met with the wide adoption of ontology in practice. Ontology evaluation can promote ontology use by facilitating the selection of a good ontology. Despite that a host of ontology evaluation methodologies are available, many of them are fragmentary and strongly tied to ontology development methodologies. Based on a review of extant ontology evaluation methods, we propose a framework for ontology evaluation. The framework provides a holistic view of ontology evaluation, suggesting both fundamental ontology dimensions and concrete criteria.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Brank, J., Grobelnik, M., Mladenic, D.: A survey of ontology evaluation techniques. In: The Conference on Data Mining and Data Warehouses, SiKDD (2005)
Brewster, C., Alani, H., Dasmahapatra, S., Wilks, Y.: Data Driven Ontology Evaluation. In: The Language Resources and Evaluation Conference (LREC), Lisbon, Portugal (2004)
Daelemans, W., Reinverger, M.L.: Shallow Text Understanding for Ontology Content Evaluation. IEEE Intelligent Systems 19(4), 74–81 (2004)
Devedzic, V.: Understanding Ontological Engineering. Communications of the ACM 45, 135–144 (2005)
Fernández, M., Gòmez-Pérez, A., Juristo, N.: METHONTOLOGY: From Ontological Art Towards Ontological Engineering. In: The AAAI Spring Symposium on Ontological Engineering, pp. 33–40. Stanford University, AAAI Press, Stanford, CA (1997)
Fernández-López, M.: Overview of Methodologies for Building Ontologies. In: The IJCAI 1999 Workshop on Ontologies and Problem-Solving Methods, Stockholm, Sweden (1999)
Gangemi, A., Catenacci, C., Ciaramita, M., Lehmann, J.: A theoretical framework for ontology evaluation and validation. In: The 2nd Italian Semantic Web Workshop (SWAP) (2005)
Gómez-Pérez, A.: Some ideas and examples to evaluate ontologies. In: The 11th Conference on Artificial Intelligence for Applications (CAIA 1995), Washington DC, p. 299 (1995)
Gómez-Pérez, A.: Towards a framework to verify knowledge sharing technology. Expert Systems with Applications 4, 519–529 (1996)
Gómez-Pérez, A.: Knowledge sharing and reuse. In: Liebowitz, J. (ed.) The Handbook of Applied Expert Systems, p. 10.1–10.35. CRC, Boca Raton (1998)
Gómez-Pérez, A.: Ontology Evaluation. In: Staab, S., Studer, R. (eds.) Handbook on Ontologies, pp. 251–274. Springer, Heidelberg (2003)
Gruber, T.R.: A translation approach to portable ontology specifications. Knowledge Acquisition 5, 199–220 (1998)
Guarino, N., Welty, C.: Evaluating ontological decisions with OntoClean. Comm. of the ACM 45(2), 61–65 (2002)
Hartmann, J., Sure, Y., Giboin, A., Maynard, D., Suárez-Figueroa, M., Cuel, R.: Methods for Ontology Evaluation. KWeb Deliverable D1.2.3, University of Karlsruhe (2004)
Kehagias, D.D., Papadimitriou, I., Hois, J., Tzovaras, D., Bateman, J.: A methodological approach for ontology evaluation and refinement. In: 2nd International ASK-IT Final Conference, Nuremberg, Germany (2008)
Lovrencic, S., Cubrilo, M.: Ontology Evaluation-comprising verification and validation. In: The 19th Central European Conference on Information and Intelligent Systems, pp. 657–663 (2008)
Lozano-Tello, A., Gómez-Pérez, A.: ONTOMETRIC: A Method to Choose the Appropriate Ontology. Journal of Database Management. Special Issue on Ontological analysis, Evaluation, and Engineering of Business Systems Analysis Methods 15(2), 1–18 (2004)
Maedche, A., Staab, S.: Measuring Similarity between Ontologies. In: Gómez-Pérez, A., Benjamins, V.R. (eds.) EKAW 2002. LNCS (LNAI), vol. 2473, pp. 251–263. Springer, Heidelberg (2002)
Noy, N.F.: Semantic Integration: A Survey Of Ontology-Based Approaches. SIGMOD Record, Special Issue on Semantic Integration 33(4), 65–70 (2004)
Porzel, R., Malaka, R.: A Task-based Approach for Ontology Evaluation. In: ECAI 2004 Workshop on Ontology Learning and Population, Valencia, Spain (2004)
Spyns, P., Meersman, R., Jarrar, M.: Data modelling versus Ontology engineering. In: Sheth, A., Meersman, R. (eds.) SIGMOD Record Special Issue 31 (4), 12–17 (2002)
Spyns, P., Reinberger, M.-L.: Lexically evaluating ontology triples automatically generated from text. In: Gómez-Pérez, A., Euzenat, J. (eds.) ESWC 2005. LNCS, vol. 3532, pp. 563–577. Springer, Heidelberg (2005)
Dellschaft, K., Staab, S.: On How to Perform a Gold Standard Based Evaluation of Ontology Learning. In: Cruz, I., Decker, S., Allemang, D., Preist, C., Schwabe, D., Mika, P., Uschold, M., Aroyo, L.M. (eds.) ISWC 2006. LNCS, vol. 4273, pp. 228–241. Springer, Heidelberg (2006)
Stojanovic, N., Maedche, A., Staab, S., Studer, R., Sure, Y.: SEAL-A Framework for Developing Semantic PortALs. In: The 1st International Conference on Knowledge captures (ACM K-CAP), Vancouver, pp. 155–162 (2001)
Sure, Y., Gómez-Pérez, A., Daelemans, W., Reinberger, M., Guarino, N., Noy, N.F.: Why Evaluate Ontology Technologies? Because It Works! IEEE Intelligent Systems 19(4), 74–81 (2004)
Uschold, M., Gruninger, M.: Ontologies: Principles, methods, and applications. Knowledge Engineering Review 11(2), 93–155 (1996)
Ushold, M.: Creating, integrating and maintaining local and global ontologies. In: The First Workshop on Ontology Learning (OL-2000) in Conjunction with the 14th European Conference on Artificial Intelligence (ECAI ). IOS Press, Berlin (2000)
Welty, C.A., Guarino, N.: Supporting ontological analysis of taxonomic relationships. Data & Knowledge Engineering 39, 51–74 (2004)
Yao, H., Orme, A.M., Etzkorn, L.: Cohesion metrics for ontology design and application. Journal of Computer Science 1(1), 107–113 (2005)
Yu, J., Thom, J., Tam, A.: Requirements-oriented methodology for evaluating ontologies. Information Systems, Sixteenth ACM 34(8), 686–711 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Pak, J., Zhou, L. (2010). A Framework for Ontology Evaluation. In: Sharman, R., Rao, H.R., Raghu, T.S. (eds) Exploring the Grand Challenges for Next Generation E-Business. WEB 2009. Lecture Notes in Business Information Processing, vol 52. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-17449-0_2
Download citation
DOI: https://doi.org/10.1007/978-3-642-17449-0_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-17448-3
Online ISBN: 978-3-642-17449-0
eBook Packages: Computer ScienceComputer Science (R0)