Abstract
This article describes the universal web pages content parser – cross-platform application enhancing the process of data extraction from the web pages. In this implementation user friendly interface, possibility of significant automation and reusability of already created patterns had been the key elements. Moreover, the original approach to the issue of parsing the not well-formed HTML, stating the application’s core, is precisely presented. Universal web pages content parser shows that the simplified web scrapping utility may be available to masses and not well-formed HTML sources may feed useful tree-like data structures as well as the well-formed ones.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Hu, J., Zhou, X., Shu, J., Xiong, C.: Research of Self-Adaptive Web Page Parser Based on Templates and Rules. In: International Conference on Management and Service Science (2009)
Zhang, W., van Engelen, R.: An Adaptive XML Parser for Developing High-Performance Web Services. In: IEEE Fourth International Conference on eScience (2008)
Malik, S.K., Rizvi, S.A.M.: Information Extraction Using Web Usage Mining, Web Scrapping and Semantic Annotation. In: International Conference on Digital Object Identifier (2011)
Li, Y., Yang, J.: A Novel Method to Extract Informative Blocks from Web Pages. In: International Joint Conference on Artificial Intelligence (2009)
Jianyi, N., Zhengqiu, Y.: An Automated Test Tool of Web Application Based on Struts. In: International Symposium on Computer Science and Computational Technology (2008)
Feng, D., Shanahan, J., Murray, N., Zajac, R.: Learning a Query Parser for Local Web Search. In: IEEE Fourth International Conference on Semantic Computing (2010)
Chen, K.-Y., Huang, C.-C., Hou, T.-W., Lee, T.-C., Yang, S.-F., Cheng, P.-W.: A quick XML parser for extracting signatures of secure Web services. In: The Fifth International Conference on Computer and Information Technology (2005)
Liu, F., Deng, S., Wang, N., Li, X.: A CS Grammar Based Query Form Information Extraction Method. In: International Symposium on Computer Science and Computational Technology (2008)
Takase, T., Tajima, K.: Lazy XML Parsing/Serialization Based on Literal and DOM Hybrid Representation. In: IEEE International Conference on Digital Object Identifier (2008)
Qin, J., Zhao, S., Yang, S., Dou, W.: Efficient storing well-formed XML documents using RDBMS. In: International Conference on Digital Object Identifier (2005)
Simple HTML and XHTML parser. Python v3.2.2 documentation, http://docs.python.org/py3k/library/html.parser.html
Introduction, MongoDB, http://www.mongodb.org/display/DOCS/Introduction
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Pawlas, P., Domański, A., Domańska, J. (2012). Universal Web Pages Content Parser. In: Kwiecień, A., Gaj, P., Stera, P. (eds) Computer Networks. CN 2012. Communications in Computer and Information Science, vol 291. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-31217-5_14
Download citation
DOI: https://doi.org/10.1007/978-3-642-31217-5_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-31216-8
Online ISBN: 978-3-642-31217-5
eBook Packages: Computer ScienceComputer Science (R0)