Abstract
Handling the growing amount of digital information is one of the major challenges when dealing with the World Wide Web (WWW). In particular, users crave for an effective and efficient retrieval of needed information. In this context, search engines adopt a key role. Besides conventional search engines such as Google, semantic search engines have emerged as an alternative approach in recent years. The quality of search results delivered by search engines is influenced by many criteria. This paper picks up one specific issue, the precision, and investigates and compares the precision of current both conventional (i.e., non-semantic) and semantic search engines based on a controlled experiment with 77 participants. Specifically, Google, AltaVista, MetaGer, Hakia, Kngine, and WolframAlpha are investigated and compared.
This paper was done in the niPRO research project. The project is funded by the German Federal Ministry of Education and Research (BMBF) under grant number 17102X10. More information can be found at http://www.nipro-project.org
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Levene, M.: An Introduction to Search Engines and Web Navigation, 2nd edn. John Wiley & Sons, Inc., Hoboken (2010)
Cambazoglu, B.B., Beaze-Yates, R.: Scalability Challenges in Web Search Engines. In: Book of Advanced Topics in Information Retrieval, pp. 27–49. Springer (2011)
Gordon, M., Pathak, P.: Finding Information on the World Wide Web: the Retrieval Effectiveness of Search Engines. J. Information Processing and Management 35(2), 141–180 (1999)
Silverstein, C., Heinzinger, M., Maires, H., Moricz, M.: Analysis of a Very Large Web Search Engine Query Log. J. ACM Sigir Forum 33(1), 6–12 (1999)
Risvik, K.M., Michelsen, R.: Search Engines and Web Dynamics. J. of Computer Networks 39(3), 289–302 (2002)
Arasu, A., Cho, J., Garcia-Molina, H., Paepcke, A., Raghavan, S.: Searching the Web. J. of ACM Transactions on Internet Technology (TOIT) 1(1), 2–43 (2001)
Langville, A.N., Meyer, C.D.: Google’s PageRank and Beyond: The Science of Search Engine Rankings. Princeton Univers. Press, Princeton (2006)
Mika, P.: Ontologies are us: A Unified Model of Social Networks and Semantics. J. of Web Semantics: Science, Services and Agents on the World Wide Web 5(1), 5–15 (2007)
Mayfield, J., Finin, T.: Information Retrieval on the Semantic Web: Integrating Inference and Retrieval. In: Proc. of the Int’l Workshop on the Semantic Web at the 26th Int’l ACM SIGIR Confe. on Research and Development in Information Retrieval, Toronto, Canada (2003)
Esmaili, K.S., Abolhassani, H.: A Categorization Scheme for Semantic Web Search Engines. In: Proc. of the 2006 IEEE Int’l Conf. of Computer Systems & Applications, pp. 171–178 (2006)
Vaughan, L.: New Measurements for Search Engine Evaluation Proposed and Tested. J. Information Processing and Management 40(4), 677–691 (2004)
Lewandowski, D.: Web Information Retrieval: Technologien zur Informationssuche im Internet. Deutsche Gesellschaft für Informationswissenschaft und Informationspraxis e.V (DGI), Frankfurt am Main (2005)
Tague-Sutcliffe, J.: The Pragmatics of Information Retrieval Experimentation, Revisited. J. of Information Process Management 28(4), 467–490 (1992)
Mizzaro, S.: How Many Relevances in Information Retrieval. J. Interacting with Computers 10(3), 303–320 (1998)
Cooper, W.S.: A Definition of Relevance for Information Retrieval. J. Information Storage and Retrieval 7(1), 19–37 (1971)
Crestani, F., Lalmas, M.: Logic and Uncertainty in Information Retrieval. In: Agosti, M., Crestani, F., Pasi, G. (eds.) ESSIR 2000. LNCS, vol. 1980, pp. 179–206. Springer, Heidelberg (2001)
Yang, X., Zhang, M.: Necessary Constraints for Fusion Algorithms in Meta Search Engine Systems. In: Proc. of the Int’l Conf. on Intelligent Technologies, pp. 409–416 (2000)
Campesato, O., Nilson, K.: Web 2.0 Fundamentals with AJAX, Development Tools, and Mobile Platforms. Jones and Barlett Publishers LLC (2011)
Weikum, G.: Search for Knowledge. In: Proc. SeCO Workshop on Search Computing Challenges and Directions, pp. 24–39 (2009)
Buckley, C., Voorhees, E.M.: Evaluating Evaluation Measure Stability. In: SIGIR 2000 Proc. of the 23rd Annual Int’l ACM SIGIR Conf. on Research and Development in Information Retrieval, pp. 33–40 (2000)
Hendler, J., Golbeck, J.: Metcalfe’s Law, Web 2.0, and the Semantic Web. J. of Web Semantics: Science, Services and Agents on the World Wide Web 6(1), 14–20 (2008)
Xu, Z., Fu, Y., Mao, J., Su, D.: Towards the Semantic Web: Collaborative Tag Suggestions. In: Proc. of the Collaborative Web Tagging Workshop at the WWW 2006 (2006)
Finin, T., Ding, L.: Search Engines for Semantic Knowledge. In: Proc. of XTech 2006: Building Web 2.0 (2006)
Ding, L., Finin, T., Joshi, A., Pan, R., Cost, R.S., Pen, Y., Reddivari, P., Doshi, V., Sachs, J.: Swoogle: A Search and Metadata Engine for the Semantic Web. In: Proc. of the 13th Int’l Confernce on Information and Knowledge (CIKM 2004), pp. 652–659 (2004)
Ding, L., Finin, T., Joshi, A., Peng, Y., Pan, R., Reddivari, P.: Search on the Semantic Web. J. Computer 38, 62–69 (2005)
Brin, S., Page, L.: The Anatomy of a Large Scale Hypertextual Web Search Engine. J. Computer Networks ISDN Syst. 30(1-7), 107–117 (1998)
Page, L., Brin, S., Motwani, R., Winograd, T.: The PageRank Citation Ranking: Bringing Order to the Web. Stanford InfoLab, Technical Report (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Girit, H., Eberhard, R., Michelberger, B., Mutschler, B. (2012). On the Precision of Search Engines: Results from a Controlled Experiment. In: Abramowicz, W., Kriksciuniene, D., Sakalauskas, V. (eds) Business Information Systems. BIS 2012. Lecture Notes in Business Information Processing, vol 117. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-30359-3_18
Download citation
DOI: https://doi.org/10.1007/978-3-642-30359-3_18
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-30358-6
Online ISBN: 978-3-642-30359-3
eBook Packages: Computer ScienceComputer Science (R0)