[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to main content
Springer Nature Link
Log in

A Fuzzy Synset-Based Hidden Markov Model for Automatic Text Segmentation

  • Chapter
Soft Methods for Integrated Uncertainty Modelling

Part of the book series: Advances in Soft Computing ((AINSC,volume 37))

  • 626 Accesses

Abstract

Automatic segmentation of text strings, in particular entity names, into structured records is often needed for efficient information retrieval, analysis, mining, and integration. Hidden Markov Model (HMM) has been shown as the state of the art for this task. However, previous work did not take into account the synonymy of words and their abbreviations, or possibility of their misspelling. In this paper, we propose a fuzzy synset-based HMM for text segmentation, based on a semantic relation and an edit distance between words. The model is also to deal with texts written in a language like Vietnamese, where a meaningful word can be composed of more than one syllable. Experiments on Vietnamese company names are presented to demonstrate the performance of the model.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
£29.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
GBP 19.95
Price includes VAT (United Kingdom)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
GBP 103.50
Price includes VAT (United Kingdom)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
GBP 129.99
Price includes VAT (United Kingdom)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Agichtein E., Ganti V., (2004), Mining Reference Tables for Automatic Text Segmentation, Procs of ACM Conference on Knowledge Discovery and Data Mining (SIGKDD), pp. 20–29.

    Google Scholar 

  2. Bilenko M., Mooney R., Cohen W., Ravikumar P., Fienberg S., (2003), Adaptive Name Matching in Information Integration, IEEE Intelligent Systems, Vol. 18, No. 5, 16–23.

    Article  Google Scholar 

  3. Borkar V., Deshmukh K., Sarawagi S., (2001), Automatic Segmentation of Text into Structured Records, Procs of the ACM SIGMOD Conference.

    Google Scholar 

  4. Cao T.H., Do H.T., Pham B.T.N., Huynh T.N., Vu D.Q, (2005). Conceptual Graphs for Knowledge Querying in VN-KIM, Contributions to the 13th International Conference on Conceptual Structures, pp. 27–40.

    Google Scholar 

  5. Freitag D., McCallum A.K., (2000), Information Extraction with HMM Structure Learned by Stochastic Optimization, Procs of the 18th Conference on Artificial Intelligence, pp. 584–589.

    Google Scholar 

  6. Ha L.A., (2003), A Method for Word Segmentation in Vietnamese, Procs of Corpus Linguistics Conference, pp. 17–22.

    Google Scholar 

  7. Nguyen Q.C., Phan T.T., Cao T.H., (2006), Vietnamese Proper Noun Recognition, Procs of the 4th International Conference on Computer Sciences, pp. 145–152.

    Google Scholar 

  8. Rabiner L.R., (1989), A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition, Procs of the IEEE, Vol. 77, No. 2, 257–286.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Information Technology, Ho Chi Minh City University of Technology, Vietnam

    Viet Ha-Thuc & Jonathan Lawry

Authors
  1. Viet Ha-Thuc
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Quang-Anh Nguyen-Van
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tru Hoang Cao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jonathan Lawry
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. AI Group Department of Engineering Mathematics, University of Bristol, BS8 1TR, Bristol, UK

    Jonathan Lawry

  2. Statistics and Operations Research, Rey Juan Carlos University, C-Tulip˙n s/n MÛstoles28933, Spain

    Enrique Miranda

  3. Intelligent Systems Group Department of Electronics & Computer Science, University of Santiago de Compostela Santiago de Compostela, Spain

    Alberto Bugarin

  4. Department of Applied Mathematics, Beijing University of Technology, 100022, Beijing, P.R. China

    Shoumei Li

  5. Dpto. Estadistica e I.O y D.M. Calle Calvo Sotelo s/n, Universiad de Oviedo Fac. Ciencias, 33071, Oviedo, Spain

    Maria Angeles Gil

  6. Systems Research Institute Polish Academy of Sciences, Newelska 6, 01-447, Warsaw, Poland

    Przemys aw Grzegorzewski

  7. Systems Research Institute Polish Academy of Sciences, Newelska 6, 01-447, Warsaw, Poland

    Olgierd Hyrniewicz

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer

About this chapter

Cite this chapter

Ha-Thuc, V., Nguyen-Van, QA., Cao, T.H., Lawry, J. (2006). A Fuzzy Synset-Based Hidden Markov Model for Automatic Text Segmentation. In: Lawry, J., et al. Soft Methods for Integrated Uncertainty Modelling. Advances in Soft Computing, vol 37. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-34777-1_43

Download citation

  • DOI: https://doi.org/10.1007/3-540-34777-1_43

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-34776-7

  • Online ISBN: 978-3-540-34777-4

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation