JP4591947B2 - Information filtering apparatus and method - Google Patents

Description

  The present invention relates to an information filtering apparatus and method for performing processing such as alerting a user or canceling search processing when searching for a word that is not suitable as a search term such as an adult word when performing information search. About.

  Conventionally, in order to prohibit minors from accessing adult websites or access websites that are inappropriate for business, information filtering is performed on each user's computer or Internet mediation device. (See Non-Patent Document 1).

  In such a filtering technology, a group of website addresses to be prohibited from access is accumulated as a black list, and when a user tries to access an address on the black list, the access is prohibited or a warning is issued. To emit.

  On the other hand, it is known that access to a Web site on the Internet is often performed via a search site for statistical purposes. In this search site, if a search word that is not suitable as a search word is entered, such as an adult word, the user is asked whether or not to stop the information search process or continue the process. Information filtering processing, such as calling attention to the fact that a word is a search attention word, is performed. For example, goo (URL: http://www.goo.ne.jp/), which is known as a portal site, provides an option for prohibiting search by adult language.

In such information filtering, a dictionary (search attention word dictionary) in which words that are not suitable as search terms are collected in advance is prepared, and information filtering is performed when the input search terms are registered in this dictionary. Yes.
Kazuma Ando, “Prevent Web Filtering Software and Internet Troubles, Beware of Differences in Site Categorization and Manageability”, Nikkei Internet Technology, Nikkei Business Publications, April 2002, No. 58, p. 48-58

  However, this conventional technique has the following problems.

  (1) When a search word is divided and input, information filtering is not performed because there is no description in the search attention word dictionary. For example, even if the word “filtering” is registered in the search attention word dictionary, the search cannot be restricted if the search word is divided into two words “Fi” and “Luttering”.

  (2) If the search attention word to be information-filtered is a compound word, when the constituent words of the compound word are divided and input, information filtering is not performed because there is no description in the search attention word dictionary. For example, even if the word “information filtering” is registered in the search attention word dictionary, if the search word is divided into two words “information” and “filtering”, the search cannot be restricted.

  An object of the present invention is to provide an information filtering apparatus and method that can cope with divided input of search terms, which solves the above-described problems.

In order to achieve the above object, the present invention searches whether or not an input search term is registered in a search attention word dictionary in which search terms to be filtered are stored in advance. In an information filtering apparatus provided with an information filtering determination unit that outputs a result indicating filtering target, the information filtering determination unit includes a search word storage unit that stores an input search word, and n input searches A search word string creating means for creating a search word string consisting of i search words (i = 2 to n) from all words for all permutation combinations, and each search word string created by the search word string creating means Search term connecting means for connecting the search terms in consideration of the order, search term adding means for adding the search terms connected by the search term connecting means to the search term storage means, and search term storage means And a search attention word search means search word stored searches whether or not it is registered in the search note dictionary, the search word connecting means, the connection result a result of simply connecting a search term In addition, when the second search word is connected after the first search word, if there is an overlap between the k character at the end of the first search word and the k character at the beginning of the second search word , The main feature is that the result of connecting the first search word and the second search word by eliminating duplication is also the connection result .

  According to the present invention, the search terms are connected in consideration of the order for all permutation combinations of the input search terms, and the connected terms are also subjected to the search using the search attention word dictionary. Even when a word obtained by dividing the search attention word registered in the word dictionary is input as a search word, more accurate information filtering can be performed.

  As described above, according to the present invention, the following effects can be obtained.

  (1) Even if a search word is divided and input, the divided search words are connected to form a new search word, and the search attention word dictionary is examined. Therefore, information filtering is correctly performed on the assumption that the search attention word is included in the input. Is done.

  (2) Even when the search attention word to be information-filtered is a compound word, and the constituent words of the compound word are divided and input, information filtering is correctly performed as in (1).

  An information filtering apparatus according to an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a principle configuration diagram of an information filtering apparatus according to the present embodiment.

  The information filtering device 1 is a device that, when a search word is input from a user, returns as a determination result whether or not the search word is a filtering target, and is configured by installing a program in a computer. The The user includes not only humans but also other devices and programs.

  As shown in FIG. 1, the information filtering device 1 includes a search word input unit 2 that receives input from a user, and whether or not the input search word is an information filtering target. An information filtering determination unit 3 that determines with reference to the registered search attention word dictionary 5 and an information filtering result return unit 4 that returns a determination result of information filtering to the user are provided.

  Details of the information filtering determination unit 3 will be described with reference to FIG. FIG. 2 is a principle configuration diagram of the information filtering determination unit.

  As shown in FIG. 2, the information filtering determination unit 3 is created by a search word string creation unit 31 that creates a search word string that combines them when a plurality of search words are input, and a search word string creation unit 31. A search word connection unit 32 that connects search terms included in the search word string, and a search word addition unit 33 that adds the words connected by the search word connection unit 32 to the search word list 36 as new search terms, The search attention word dictionary search section 34 that searches the search attention word dictionary 5 using the words registered in the search word list 36 as a key, the combination control section 35 that controls the creation of the search word string, and the memory that stores the search words And a search word list 36 as means.

  Details of the search word connection unit 32 will be described with reference to FIG. FIG. 3 is a principle configuration diagram of the search word connection unit.

  As shown in FIG. 3, when connecting two search terms, the search term connecting unit 32 compares a character k suffix of the preceding search term with a prefix k character of the subsequent search term. If the k character is the same character string as a result of the comparison in 321 and the character string comparison unit 321, that is, if there is an overlap between the ending of the preceding search word and the beginning of the subsequent search word, the duplication is eliminated. And a search character string connection unit 322 for connecting search words.

  Next, the operation of the information filtering apparatus according to the present invention will be described with reference to the flowcharts of FIGS. First, the schematic operation of the information filtering apparatus will be described with reference to FIG.

  When a search word is input to the information filtering device 1, the search word input unit 2 receives the search word and sends it to the information filtering determination unit 3 (step S1). The information filtering determination unit 3 performs an information filtering determination process (described in detail later), and sends the determination result to the information filtering result return unit 4 (step S2). The information filtering result return unit 4 returns the result of the information filtering determination process to the user (step S3). Here, the result returned to the user is either the input search term “filtering target” or “not filtering target (non-target)”.

  Next, the information filtering determination process in step S2 will be described with reference to the flowchart of FIG.

  The combination control unit 35 of the information filtering determination unit 3 registers the input search word in the search word list 36, and sets the number of words as a variable n (step S2-1). Next, the combination control unit 35 divides the processing depending on whether the number of input search words n is plural (whether it is larger than 1). If the number of input search words n is plural, the process proceeds to step S2-3. If the number of input search words n is singular (when the variable n is 1), the process proceeds to step S2-9 (step S2-2). .

  In step S2-3, the combination control unit 35 sets 2 to the variable i, and sends the value of the variable n and the value of the variable i together with the input search word to the search word string creation unit 31 (step S2-3). Next, the search word string creation unit 31 creates all permutations (combinations that take into account the order) that extract i from the input n search words, and sends them to the search word connection unit 32 (step S2-4). . For example, consider the case where there are three search input words {A, B, C} and the variable i is 2. In this case, the search word string creation unit 31 uses {{A, B}, {B, A}, {A, C}, {C, A}, {B, C}, {C, B}}. Create one search term string.

  Next, the search term connection unit 32 connects the search terms included in the search term sequence created by the search term sequence creation unit 31 in consideration of the order, and sends the result to the search term addition unit 33 (step S2). -5). For example, in the above-described example, six search terms {{A, B}, {B, A}, {A, C}, {C, A}, {B, C}, {C, B}}. Are connected to each other, and {AB, BA, AC, CA, BC, CB} is sent to the search word adding unit 33. Details of the operation of the search word connection unit 32 will be described later.

  The search word adding unit 33 adds a word newly obtained by the search word connecting unit 32 to the search word list 36, and transfers control to the combination control unit 35 (step S2-6).

  The combination control unit 35 changes the variable i from 2 to n with respect to the number of words n of the input search word, and performs the permutation creation process (step S2-4), the search word connection process (step S2-5), and the search. The word addition process (step S2-6) is repeated. That is, it is determined whether the variable i is equal to the word number n. If the variable i is less than the word number n, the variable i is increased by 1 and the above steps S2-4 to S2-6 are repeated (steps S2-7, S2-8). ). As a result of such processing, the input search terms and those connected in all permutation combinations with respect to the total number of input search terms are stored in the search term list 36. For example, in the above example, for three search input words {A, B, C}, the search word list 36 is {A, B, C, AB, BA, AC, CA, BC, CB, ABC, ACB, BAC, BCA, CAB, CBA}.

  Next, the search attention word dictionary search unit 34 searches the search attention word dictionary 5 using each word in the search word list 36 as a key, and sends the search result to the combination control unit 35 (step S2-9).

  As a result of searching the search attention word dictionary 5 as a result of searching the search attention word dictionary 5, the combination control unit 35 sets the information filtering determination result as “filtering target” (step S2-10). , S2-11), if a word matching the word in the search word list 36 is not searched, it is set as “non-filtering target” (steps S2-10, S2-12).

  Next, the search word connection process of step S2-5 will be described with reference to the flowchart of FIG.

  The search word connection unit 32 advances the process in order for all search word permutations (step S2-5-1), and advances the process in order for connections between two words existing in the permutation of individual words (step S2-5-1). S2-5-2).

  First, the search word connection unit 32 connects two words of interest (step S2-5-3). Here, the method of connecting two words is not only the method of simply connecting them, but if the last g character of the preceding word is the same as the first g character of the other word, the duplication is eliminated and the connection is made. However, the connection method is not particularly limited in the present invention. Moreover, it does not limit about using together the several connection method. In the present embodiment, the two methods are used in combination.

  The search word connection unit 32 performs the connection process between all two words (steps S2-5-4, S2-5-5), and performs the connection process for all search word strings (step S2- 5-6, S2-5-7).

[Concrete example]
Since there is a risk of violating public order and morals, the following examples are described using ordinary words that are not normally filtered. Specifically, “promotion” and “laboratory director” are described in the search attention word dictionary 5 as search attention words and are described as words to be filtered.

  Conventionally, when “promotion” or “institutional director” is input as a search word, each word is described in the search attention word dictionary 5 and thus the search word is filtered. However, if these words are entered separately (for example, “Promo” and “Motion”, “Pro” and “Motion”, “Research” and “Director”, “Research” and “Director”) ) Since each word is not described in the search attention word dictionary 5, the search process is performed without filtering.

  In the present invention, it is possible to restore and filter the words described in the search attention word dictionary 5 by connecting the input words even when the search words are divided and input as shown below. Become. Hereinafter, specific examples will be described with reference to the flowcharts of FIGS.

  First, when “promo” and “motion” are input as search terms to the search term input unit 2, these are sent to the information filtering determination unit 3 (step S1). The combination control unit 35 registers the input search words “promo” and “motion” in the search word list 36, and sets the number of search words 2 to a variable n (step S2-1). Since n = 2, the process proceeds to step S2-3 and i = 2 is set (step 2-3). The search word string creation unit 31 creates two pieces of “promo”, “motion”, and “motion” and “promo” as permutations (combination considering the order) that extract two from the two input search words, The search term connection unit 32 is sent (step S2-4). The search word connection unit 32 performs a search word connection process and sends the result to the search word addition unit 33 (step S2-5).

  In the search word connection process, first, “promo” and “motion” are connected. "Promo motion" is obtained as a result of simple connection. In addition, as a result of the connection that eliminates duplication of the same character string of both, “promotion” (the duplication is eliminated because the last character “mo” of “promo” and the first character “mo” of “motion” are the same) is obtained. (Step S2-5-3). Similarly, connection for “motion” and “promo” is performed. As a result of simple connection, “motion promo” is obtained. Also, as a result of performing the connection that eliminates the duplication of the same character strings of both, since there is no duplication here, “motion promo” that is the same result as the simple connection is obtained (step S2-5-3).

  The search word adding unit 33 adds the words “promo motion”, “promotion”, and “motion promo” newly obtained by the search word connection process to the search word list 36 (step S2-6). The search attention word dictionary search unit 34 includes words “promo”, “motion” (the two are input search words), “promo motion”, “promotion”, “motion promo” (this 3) The search attention word dictionary 5 is searched by using each of the five words in total as a key (a word newly obtained by the search word connection process) (step S2-9). Since “promotion” is registered in the search attention word dictionary 5, the search result is “filtering target” (step S2-11). The information filtering result return unit 4 returns the fact that it is a filtering target as a result of the information filtering determination process because the combination of search words is described in the search attention word dictionary 5 (step S3).

  As described above in detail, according to the information filtering apparatus of the present invention, search terms are connected in consideration of the order for all permutation combinations of the input search terms, and the connected words are also searched attention word dictionary. Therefore, even when a word obtained by dividing a search attention word registered in the search attention word dictionary 5 is input as a search word, more accurate information filtering can be performed. It becomes possible.

  As mentioned above, although embodiment of this invention was explained in full detail, the said embodiment is an illustration and this invention is not limited to this. The scope of the invention is set forth in the appended claims, and all modifications that come within the meaning of the claims are intended to be embraced by the invention.

  For example, in the above-described embodiment, the search word connection unit performs both simple connection and connection that eliminates duplication. However, the present invention can be implemented even with only one of them.

  In the above embodiment, as shown in FIG. 1, the search attention word dictionary 5 is provided separately from the information filtering device 1, but may be built in the information filtering device 1.

Configuration diagram of information filtering device Configuration diagram of information filtering judgment unit Configuration diagram of search term connection part Flowchart explaining operation outline of information filtering apparatus Flowchart explaining information filtering determination process Flowchart explaining search word connection processing

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Information filtering apparatus, 2 ... Search term input part, 3 ... Information filtering determination part, 31 ... Search word sequence creation part, 32 ... Search word connection part, 321 ... Character string comparison part, 322 ... Search character string connection part, 33 ... Search word addition unit, 34 ... Search attention word dictionary search unit, 35 ... Combination control unit, 36 ... Search word list, 4 ... Information filtering result return unit, 5 ... Search attention word dictionary.

Claims (2)

Information filtering that searches whether or not the input search word is registered in the search attention word dictionary in which the search word to be filtered is stored in advance, and if it is registered, information filtering that outputs the result of filtering In the information filtering device provided with the determination means,
The information filtering determination means includes
Search word storage means for storing the input search word;
A search word string creating means for creating a search word string consisting of i (i = 2 to n) search words from all the n search words inputted for all permutation combinations;
Search term connection means for connecting the search terms included in each search term string created by the search term string creation means in consideration of the order;
Search term adding means for adding the search term connected by the search term connecting means to the search term storage means;
Search attention word search means for searching whether or not the search word stored in the search word storage means is registered in the search attention word dictionary,
The search word connecting means uses a result obtained by simply connecting the search words as a connection result, and further adds a ending k of the first search word when connecting the second search word behind the first search word. When there is an overlap between the character and the first k characters of the second search word, the result of connecting the first search word and the second search word by eliminating the overlap is also the connection result. Information filtering device. Information filtering that searches whether or not the input search word is registered in the search attention word dictionary in which the search word to be filtered is stored in advance, and if it is registered, information filtering that outputs the result of filtering An information filtering method in an information filtering device provided with a determination means,
The information filtering determination means is
A search word storage step for storing a search word in the input search word storage means;
A search word string creation step for creating a search word string consisting of i (i = 2 to n) search words from all n input search words for all permutation combinations;
A search term connection step for connecting the search terms included in each created search term string in consideration of the order,
A search term adding step of adding a connected search term to the search term storage means;
A search step for searching whether or not the search word stored in the search word storage means is registered in the search attention word dictionary,
In the search word connection step, the result of simply connecting the search words is used as a connection result, and when the second search word is connected after the first search word, the ending k of the first search word When there is an overlap between the character and the first k characters of the second search word, the result of connecting the first search word and the second search word by eliminating the overlap is also the connection result. Information filtering method.

Images