KR20010004090A - Hyperlink generator for korean language terminology based HTML - Google Patents

Abstract

PURPOSE: A generator of Korean vocabulary/abbreviation hyperlink based on HTML is provided to easily and rapidly sample vocabulary/abbreviation by using HTML analyzing technology and morpheme analyzing method. CONSTITUTION: An HTML analyzer(20) samples real document content of an HTML document for automatically generating a hyperlink tag based on HTML/TEXT documents. A morpheme analyzer(30) samples vocabulary/abbreviation through analyzing morphemes. A document formatter(40) generates a hyperlink document. Therefore, vocabulary/abbreviation are sampled by using a vocabulary/abbreviation dictionary(70) and a dependent morpheme dictionary(60) after separating morphemes into independent/dependent morphemes.

Description

Hyperlink generator for korean language terminology based HTML}

The present invention relates to a Korean terminology / abbreviation hyperlink generator, and in particular, to extract terminology / abbreviation using a morphological analysis technique to provide more accurate information in an Internet specialized information system, and to easily use it in the HTML environment of the Internet. An HTML-based Hangul / abbreviation hyperlink generator for generating hyperlinked documents.

Recently, due to the rapid development of the Internet environment and the rapid increase of users, many new technologies have emerged. Especially in the field of information retrieval, Internet information retrieval technologies for efficient information retrieval have been developed and used in specialized information systems. Indexing techniques are used to ensure accuracy.

This indexing technology is a technology that helps users search for information through a medium that connects users with information.It is a method to perform such an index automatically, by statistical methods, by morphological analysis, and by syntax and semantic analysis. The method by etc. is used.

First, the indexing method by statistics is to find the frequency appearing in the literature for each word, and then to select the high frequency words as index words by discarding the ones that are hard to become realistic index words and the stopwords. There is a disadvantage in that it is difficult to use due to the use of verbs or the investigational combination of statements.

In addition, the indexing method by morphological analysis is a morphological morpheme (investigation, ending, pre-mother, noun, pronoun, rhetoric, adverbs, adjectives, verbs) that has a meaning or sentence without meaning. After separating the morphemes and selecting only the remaining real morphemes as index words, the memory space is wasted and processing speed is slowed down by selecting all real morphemes as index words. In particular, in compound nouns, the n-gram method (the method of extracting n adjacent syllables for each index segment) and the words in all cases by the noun dictionary are selected as index words, so the accuracy of similar terms / abbreviations is inferior. In addition, there is a disadvantage in that each dictionary for a morpheme is required.

The method that is one step further than the index method by morphological analysis is the index method by syntax analysis, and the method further developed by the syntax method by index analysis is the index method by semantic analysis. However, while the index method by morpheme analysis uses only simple morphological information, the index method by syntax analysis or semantic analysis analyzes with necessary grammar information and semantic information in a sentence composed of various words. It is different from the index method by morphological analysis. Therefore, the indexing method using the syntax analysis or semantic analysis is more efficient than the morphological analysis indexing method, but is difficult to implement in reality, and is used only in a limited environment or presented only as a theoretical model.

On the other hand, the conventional Internet information retrieval technology that focuses on the effective and fast information retrieval for the user's specific information needs, information ambiguity due to the use of unfamiliar terms / abbreviations and overlapping terms / abbreviations in the information content The problem of ambiguity is more serious in Hangeul with descriptive characteristics.

Therefore, in the present invention, to solve this problem, by applying HTML analysis technology and stemming analysis method, HTML-based to extract terms / abbreviations quickly and easily and generate hyperlinked documents so that they can be easily utilized in the HTML environment of the Internet. We want to provide a Korean term / abbreviation hyperlink generator.

In order to achieve the above object, the Korean terminology / abbreviation hyperlink generator provided by the present invention automatically generates a hyperlink tag that supports an additional description of the term / abbreviation in the content of information based on HTML and TEXT documents. It consists of an HTML parser that extracts the actual document contents of HTML documents, a new morpheme parser that extracts terms / abbreviations through morphological analysis considering the descriptive characteristics of Hangul, and a document formatter that creates hyperlinked documents. To separate independent morphemes and independent morphemes that can be used independently, and then to extract terms / abbreviations contained in Internet documents using only the term / abbreviation dictionary and the dependent morpheme dictionaries, It features.

1 is an overall configuration diagram of the Hangul terms / abbreviation hyperlink generator of the present invention,

2 is a block diagram of an HTML analyzer of the present invention;

3 is an exemplary diagram for defining a content tag in an HTML DTD;

4 is an exemplary diagram for processing and results of an HTML analyzer;

5 is a block diagram of a morpheme analyzer of the present invention;

6 is a block diagram of a document formatter of the present invention;

7 is an exemplary diagram of a final result document and term / abbreviation dictionary generated by the hyperlink generator of the present invention.

<Explanation of symbols for main parts of drawing>

10: Source Document 20: HTML Analyzer

21: Document Analyzer 22: HTML Specification

23: document converter 30: stemmer

31: Morphological group globe generator 33: Hyperlink generator

40: Document Formatter 41: Globe Finder

42: Dictionary Finder 43: Document Generator

50: hyperlinked document 60: stemming dictionary

70: Hangul term / abbreviation dictionary

Hereinafter, the Korean terminology / abbreviation hyperlink generator of the present invention will be described in more detail with reference to the accompanying drawings.

1 is an overall configuration diagram of the Korean terminology / abbreviation hyperlink generator of the present invention. Referring to FIG. 1, the hyperlink generator of the present invention operates by input of a source document 10 composed of HTML or text. And an HTML analyzer 20 for analyzing / extracting actual content of the HTML document 10 to generate a list of text objects, a morpheme dictionary 60 and a Hangul term / abbreviation dictionary, which are built in advance. Stemming analyzer 30 for extracting terms / abbreviations through stemming analysis of a list of text objects output from the HTML analyzer 20 and generating hyperlink object information using the stemming analyzer 30. The document formatter 40 outputs a hyperlinked document by using the result of.

The Hangul hyperlink generator of the present invention configured as described above is based on HTML and text documents, and analyzes and extracts the actual content of the HTML document in the content of information, and analyzes the morphemes. Internet hyperlink is created to help the additional explanation of the elements. The detailed contents of each element are as follows.

First, the HTML parser 20 defines a content tag that is an actual content portion of a document among tags defined in an HTML document type definition (DTD) to extract the actual content portion of an HTML document, and based on this, the HTML analyzer 20 By cutting and extracting document content, a text list object is generated and outputted, and the text stemmer 30 which receives the text or text list object uses the morpheme dictionary 60 and the Hangul term / abbreviation dictionary 70. After extracting hyperlink objects from text or text list objects, we create a morpheme group glove, which is a collection of structural objects. The morphemes are divided into independent and independent morphemes that can be used independently. It features concise and fast processing speed by extracting terms / abbreviations using only dictionaries.

In this case, the morpheme dictionary 60 is used for morphological analysis of the processing result of the HTML analyzer 20, and the term / abbreviation dictionary 70 is a term / abbreviation included in the processing result of the HTML analyzer 20. It is used when searching and generating hyperlink documents. Each dictionary is stored as a text document for easy use. In particular, the term / abbreviation dictionary 70 requires the user to build a dictionary for each field.

Meanwhile, as an algorithm for loading and searching the dictionaries 60 and 70, the AVL tree (Adelson Velskii and Landis Tree) is used to guarantee the search speed and stability for the addition and deletion of terms / abbreviations for the dictionary.

When the morpheme group glove is generated in the morpheme analyzer 30 as described above, the document formatter 40 generates a hyperlinked document through a dictionary search using the morpheme group glove.

Components of each of the hyperlink generators of the present invention will be described in more detail with reference to FIGS. 2 to 6.

FIG. 2 is a block diagram of an HTML analyzer of the present invention. Referring to FIG. 2, the HTML analyzer of the present invention is a document analyzer which performs an elemental analysis process on an HTML document 10 input from the outside by an HTML specification 22 therein. (21) and a document converter for tokenizing and converting the results of the document analysis processing to create a text object along with object information such as index, position, and length, and to generate a text object list 24 that is a collection thereof ( 23).

At this time, the document analyzer 21 defines a tag containing the actual contents portion of the HTML document as a "content tag" among the tags defined in the HTML document definition (DTD), and defines the content tag as <P>, It is defined as <PRE>, <DT>, <DD>, <LI>, <TH>, and <TD> and extracts the text contained in these tags.

3 shows an example of the definition of the content tag in the HTML DTD, the definition of the content tag in the HTML DTD shows the part defined as the content tag in the present invention among the tags defined in the HTML DTD v4.0 (W3C). have.

Referring to FIG. 3, the content tags Paragraphs (P), Preformatted Text (PRE), Lists (DT, DD, LI), Table (TH, TD), etc. are composed of “% inline” and “% flow”. "% inline" consists of "#PCDATA", "% fontstyle", "% phrase", "% special", "% formctrl", etc. "% flow" consists of "% block" and "% inline" respectively. "% Inline" means #PCDATA, TT, I, B, U, S, STRIKE, BIG, SMALL, EM, STRONG, DFN, CODE, SAMP, KBD, VAR, CITE, ABBR, ACRONYM, A, IMG, APPLET , OBJECT, FONT, BASEFONT, BR, SCRIPT, MAP, Q, SUB, SUP, SPAN, BDO, IFRAME, INPUT, SELECT, TEXTAREA, LABEL, BUTTON, etc., and "% flow" is "% inline" , "% heading", "% list", "% preformatted", DL, DIV, CENTER, NOSCRIPT, NOFRAMES, BLOCKQUOTE, FORM, ISINDEX, HR, TABLE, FIELDSET, ADDRESS.

Therefore, in document analysis, these dependent tags must be considered. Among these dependent tags, tags that are regarded as having no contents because they are hyperlink objects (<A>) and tags for font expressions are processed. There is a tag (<SUB> or </ SUB>) which should be extracted and processed only by the contents of the tag, and in the present invention, the former (<A>) is defined as an 'ignored tag' and the latter (<SUB>). Or </ SUB>).

An example of the disregarding tag and the virtual tag shown in FIG. 3 is displayed as follows.

1. Ignore Tag

: DFN, CODE, SAMP, KBD, VAR, CITE, ABBR, ACRONYM, A, IMG, APPLET, OBJECT, SCRIPT, MAP, SPAN, BDO, INPUT, SELECT, TEXTAREA, LABEL, BUTTON, FIELDSET, ADDRESS

2. State

: TT, I, B, U, S, STRIKE, BIG, SMALL, EM, STRONG, FONT, BASEFONT, BR, Q, SUB, SUP, IFRAME, DL, DIV, CENTER, NOSCRIPT, NOFRAMES, BLOCKQUOTE, FORM, ISINDEX Tags other than content and ignore tags

On the other hand, Figure 4 is an exemplary view showing the processing and results of the HTML analyzer according to the present invention, an example of the HTML document 400 and the text extracted by the document analysis processing using the content tag, ignore tag, temporary tag 410 is shown.

Referring to FIG. 4, the <HTML> and </ HTML> tags in the HTML document 400 are tags indicating the start and end of the HTML document, and the first <P> and </ P> tags are the content tags. The content between the two is extracted (401), and the second &lt; P &gt; and the &lt; / P &gt; include another kind of tags therebetween, and the &quot; br &quot; When the <br> tag is encountered, only the content starting from the <P> tag and before the temporary tag <br> is extracted (402), the tag indicating that the image file is hyperlinked (<IMG>), the document file and the hyperlink (<A>, </A>) indicating that the tag is a ignore tag, the contents of which are not extracted from the text. Therefore, after the extracted contents, contents from the ignore tag </A> to </ P> are extracted (403).

On the other hand, among the contents between the tags (<Table>, </ Table>) indicating the start and end of the table, tags (<TR>, </ TR>, <TD) for distinguishing rows and columns in the table ), </ TD>, <TH>, and </ TH>) are extracted (404).

That is, the content extracted as the analysis result of the document analyzer 21 of FIG. 2 is the same as the text area 410 of FIG. 4.

5 is a schematic diagram of a stemmer of the present invention. Referring to FIG. 5, when the text object list 24 that is the result of the HTML analyzer 20 is input, the stemmer may refer to the stemmer dictionary 60. When the morpheme group globe generator 31 and the resultant globe 32 outputted from the morpheme group globe generator 31 are inputted, the term / abbreviation dictionary 70 is inputted. The hyperlink generator 33 extracts a term / abbreviation and performs an object link. The result globe 34 is extracted from the hyperlink generator 33.

At this time, the morpheme group glove generator 31 is divided into independent morphemes that can be used independently of the morphemes in the morpheme analysis and dependent morphemes that do not have a dependent morpheme. Therefore, the morpheme dictionary 60 needs only dependent morpheme dictionaries such as "to", "to", "of", "to", and the like.

Eighty dependent morphemes of the present invention are listed as follows.

〈Going, high, and, and, drawn, until, ,, ,, 나, me, maybe, ,, 더, ,, ,, ,,, 될, 들이, 들은, 들, 등 , La, as, as, as, every, even, only, as much as, from, as, only, calligraphy, poetry, shih, ah, yah, to, to, to, to, to, to, to , W, W, W, W, W, W, W, W, W, W, W, W, W, W, W, W, W, W, W, W, W, W, W, W, W, W, W, W, W, W, W Instead, let's, do, do, do, do, tell, "." 〉

On the other hand, the morpheme group is defined as the range from the beginning of the sentence or the end of the dependent morpheme until the dependency morpheme is found. For example, the emphasis on the following text objects is the dependent morpheme.

〈Java language application adopted for commercial software development in Korea Developers are following. 〉

Therefore, the morpheme groups extracted from the example sentences are seven such as "domestic", "commercial software development", "Java language application", "adoption", "development company", "following", "is", and so on. The groups are distinguished by dependent morphemes.

Also, using the extracted morpheme group as an element of a globe, a morpheme group globe to which the AVL tree algorithm is applied is generated.

When the resultant glove 32 is generated by the morpheme group glove generator 31 as described above, the hyperlink generator 33 extracts a term / abbreviation from each morpheme group of the resultant glove and contains the hyperlink information. 34).

At this time, the method of extracting the term / abbreviation separates the words of the morpheme group to form an ordered combination, and compares the ordered combination with the term / abbreviation dictionary to determine a combination existing in the dictionary as a hyperlink object. In particular, when multiple combinations appear, such as compound nouns, the number and order of combinations are given priority.

For example, for the morpheme group "Java language application", the number of cases of ordinal combinations is as follows, and the priority is given in order.

(Java language application)> (Java language)> (Language application)> (Java)> (Language)> (Application)

If there are "Java language", "language application", "language", "Java", etc. in the term / abbreviation dictionary, the combination that is extracted as a hyperlink object because the highest priority among them is "Java language" ( Java language).

Accordingly, the hyperlink generator 33 stores the hyperlink information on the "Java language" portion in the globe for the morpheme group "Java language application". In addition, a combination consisting of two or more has several internal combinations as follows, and all of these internal combinations are treated as the same.

(Java language application): (Java language application), (Java language application), (Java language application), (Java language application)

(Java language): (Java language), (Java language)

(Language Application): (Language Application), (Language Application)

6 is a block diagram of a document formatter of the present invention. Referring to FIG. 6, the document formatter includes a globe searcher 41 for searching for a stem group group glove 34 output from the stemmer analyzer 30, and the term / A dictionary searcher 42 for adding a hypertext tag of a hyperlink object with reference to the abbreviation dictionary 70, and a document generator for generating an output of the globe searcher 41 as an HTML document, text, or a text variable ( 43).

At this time, the globe searcher 41 searches the hyperlink object of the morpheme group globe and passes it to the dictionary searcher 42. The dictionary searcher 42 searches the term / abbreviation dictionary 70 and uses it in the hyperlink tag. In order to clarify the query, the document generator 43 sequentially records and stores all the information of the morpheme group glove output from the glove searcher 41 and records / stores it in a file or a string variable. Has

Meanwhile, FIG. 7 is an exemplary diagram of the final result document 71 and the term / abbreviation dictionary 72 generated by the hyperlink generator of the present invention. Referring to FIG. 7, the final result document 71 It can be seen that the term / abbreviation registered in the term / abbreviation dictionary 72 is hyperlinked.

At this time, the construction of the dictionary 72 can be easily made into a text document, and a comma (,), a semicolon (;), quotes (""), etc. are used as identifiers of terms / abbreviations. Abbreviations are recognized as synonyms. In other words, "Internet" and "INTERNET", "Computer" and "COMPUTER" in the term / abbreviation dictionary 72 are synonymous.

On the other hand, in the HTML document 71, the tag "<A Href = "TermSearch? key = document standard"> which is the last line among the contents existing between the first content tags <P> and </ P> is used. A> ", the hyperlink object is" document standard ", but the query is" standard document ". This is because queries for term / abbreviated content search must be generated as being in the term / abbreviation dictionary because all of the internal combinations of hyperlink objects are treated as the same.

The present invention as described above, by applying the HTML analysis technology and morphological analysis techniques to extract the terms / abbreviations quickly and concisely and to generate hyperlinked documents to easily use them in the Internet HTML environment, Internet-based professional information It is possible to solve the ambiguity of the user due to the use of unfamiliar terms / abbreviations in the contents of information in the system and the overlapping use of the fields.

In addition, by automatically processing the term / abbreviation hyperlink operation of the HTML document being processed manually, errors can be avoided and cost reduction can be expected. Technically, new Hangul stemming analysis for term / abbreviation extraction By presenting the method, it can contribute to the accumulation of basic technology in the field of Internet related information service in Korea.

Claims (7)

An HTML analyzer operated by input of a source document composed of HTML or text and generating a text object list by analyzing / extracting an actual content portion of the HTML document; A morpheme analyzer for extracting a term / abbreviation through morphological analysis of a list of text objects output from the HTML analyzer by using a morpheme dictionary and a Hangul term / abbreviation dictionary constructed in a dictionary and generating hyperlink object information; And An HTML-based Hangul / abbreviation hyperlink generator, characterized in that the document formatter for outputting a hyperlinked document using the results of the stemmer. The method of claim 1, wherein the HTML parser is A document analyzer for elementally analyzing an HTML document input from the outside by an internal HTML specification; And An HTML-based converter comprising a document converter configured to tokenize and convert the document analyzer's processing result to create a text object with object information such as index, position, and length, and to generate a list of text objects that are a group of them. Hangul term / abbreviation hyperlink generator. The method of claim 1, wherein the morpheme analyzer A morpheme group globe generator configured to analyze a morpheme in units of text objects by referring to the morpheme dictionary and to generate a morpheme group globe when the text object list which is a result of the HTML analyzer is input; And An HTML-based Hangul term / abbreviation hyperlink generator, comprising: a hyperlink generator for extracting a term / abbreviation from a stem group group glove output from the stem group group glove generator and performing an object link by referring to the term / abbreviation dictionary. The method according to claim 1 or 3, wherein the morpheme analyzer is An HTML-based Hangul / abbreviation hyperlink generator characterized by separating the morphemes into independent morphemes that can be used independently and dependent morphemes that are not, and extracting the terms / abbreviations with only the term / abbreviation dictionary and the dependent morpheme dictionary. The method of claim 3, wherein the hyperlink generator HTML-based Hangul terminology, which separates the words of the morpheme groups to form an ordered combination, compares the ordered combination with the term / abbreviation dictionary, and extracts the combination existing in the dictionary as a term / abbreviation and decides it as a hyperlink object. / Abbreviation hyperlink generator. The method of claim 3, wherein the hyperlink generator When creating the ordinal combination by separating the words of the morpheme group, if several combinations appear like compound nouns, the priority is given according to the number and order of the combinations, and the highest priority among the words existing in the term / abbreviation dictionary An HTML-based Hangul / abbreviation hyperlink generator characterized by determining a combination as a hyperlink object. The method of claim 1, wherein the document formatter A globe searcher for searching for and outputting a hyperlink object of a stem stem group globe output from the stem stem analyzer; A dictionary searcher for searching the term / abbreviation dictionary to add a hypertext tag for a hyperlink object of a stem group globe output from the globe searcher and outputting a search result to the globe searcher; And In order to generate all the information of the morpheme group glove output from the globe searcher as an HTML document, text, or a character variable, a document generator for sequentially searching and recording / saving all the information of the morpheme group glove in a file or string variable HTML-based Hangul / abbreviation hyperlink generator, characterized in that.