KR101354721B1 - Search system and method of search service - Google Patents

Abstract

The search system according to the present invention generates an image cluster generation unit for generating an image cluster based on the meta feature value of the image and the image feature value, and generates and provides a search result based on the image cluster for a query received from a user terminal. And a search processing unit.

Description

Search system and search service method {SEARCH SYSTEM AND METHOD OF SEARCH SERVICE}

The present invention relates to a search system and a search service method.

Internet users can search for companies that they are interested in on a portal site or the like, and receive information on the searched companies. At this time, the user's search may be performed by variously inputting a query related to a company of interest. That is, when a user inputs a query related to a company, a portal site or the like provides the user with a search result related to the query input by the user.

The search results include various data such as text data, music data, image data, and video data. The search service provider acquires and stores search data to provide a search service, and selects and outputs search result information from the search data.

Meanwhile, it is determined whether the image data among the search results is appropriate as a search result for the query by using meta information around the image, for example, an image title, an image generation date, and an image size. However, as the search result, the image data may not be secured as accurate as the meta information or the duplicated image may not be maintained according to the intention of the provider. For example, if a user posts a plurality of images on his or her blog that do not match the metadata actually written to promote a particular image, selecting a search result based only on the meta data of the image data may result in a less relevant query. Image data may be exposed as a search result, thereby reducing search quality.

The technical problem to be achieved by the present invention is to improve the quality of the search service by clustering the image data through analysis of the image data content description as well as the meta information of the image data, and selecting a search result for the query based on the image data.

According to an embodiment of the present invention, a search system includes an image cluster generation unit generating an image cluster based on meta image values and image feature values of an image, and a search result based on the image cluster with respect to a query received from a user terminal. It includes a search processing unit for generating and providing.

The image cluster generation unit may include a collection unit collecting a plurality of images to be searched, a meta feature extractor extracting meta feature values of the plurality of images, and a candidate cluster based on the similarity of the meta feature values. The candidate cluster generation unit may be included.

And an image feature extracting unit for extracting image feature values of each image belonging to the candidate cluster, and a feature connection diagram generating unit for generating a feature connection diagram connecting lines of images having a difference value of the image feature values below a reference. have.

The apparatus may further include a document linkage generation unit configured to generate a document linkage diagram connecting lines of an image included in the same document among images belonging to the candidate cluster.

The apparatus may further include a final cluster generation unit configured to generate the image cluster by removing the overlapping lines by comparing the feature connection diagram and the document connection diagram.

The meta feature value may be determined based on at least one of a title, a text, an image generation date, and a category of a webpage on which an image is displayed.

The meta feature value may be determined based on the title of the document including the image and the frequency of words described in the text.

The image feature value may include a value obtained by dividing the image into a plurality of regions and digitizing a change in pixel value for each region.

The representative image tree may further include a representative image tree generation unit for selecting a representative image from the image cluster and generating a representative image tree for hierarchically classifying the remaining images based on the representative image.

The representative image tree generation unit may determine, as the representative image tree, a tree having the lowest cost to generate a tree among a plurality of trees generated using a minimum cost spanning tree.

The apparatus may further include a keyword tree generator that generates a keyword tree based on the representative image tree.

The keyword tree generating unit may group a plurality of images connected to the same connection line among the connection lines extending from the representative image into a group, and generate the keyword tree using the meta feature values of the images belonging to the same group.

The search processor may provide the search result to the user terminal based on a query receiver that receives a query from the user terminal, a representative image tree selector that selects the representative image tree related to the query, and the representative image tree. It may include a providing unit.

The providing unit may sequentially provide a plurality of images included in the representative image tree.

The providing unit may provide the representative image tree as the search result.

The providing unit may further include a keyword tree selecting unit selecting the keyword tree related to the query, and the providing unit may provide a related keyword using the keyword tree.

A search service method according to another embodiment of the present invention is a method for providing a search service by a search system, the method comprising: collecting an image of a search result; extracting a meta feature value of the collected image; Arranging the images based on the similarity of meta feature values to generate candidate clusters; extracting image feature values for images belonging to the candidate clusters; Generating a feature connection diagram by connecting, generating a document connection diagram by connecting images included in the same document with lines with respect to an image belonging to the candidate cluster, and comparing the feature connection diagram and the document connection diagram to overlap each other. Generating an image cluster from which the lines are removed; and Generating a search result for the query based on the result.

The method may further include selecting a representative image from the image cluster, and generating a representative image tree by classifying the remaining images based on the representative image.

The generating of the search result may include selecting a representative image tree related to the query and providing an image included in the representative image tree to the user terminal.

A plurality of images connected to the same connection line among the connection lines extending from the representative image may be bundled into a group, and a keyword tree may be generated using the meta feature values of the images belonging to the same group.

The method may further include providing a related keyword by using the keyword tree.

According to an embodiment of the present invention, image data may be clustered through image data content description analysis as well as meta information of image data, and a search result for a query may be selected based on the image data.

In addition, it is possible to improve the quality of the search service by providing the search results to the user intuitively.

1 is a block diagram of a search system in accordance with an embodiment of the present invention.
2 is a block diagram illustrating an image cluster generation unit of a search system according to an exemplary embodiment of the present invention.
3 is a view for explaining the operation of the image cluster generation unit according to an embodiment of the present invention.
4 is another diagram for describing an operation of an image cluster generation unit according to an exemplary embodiment of the present invention.
5 is another diagram for describing an operation of a representative image tree generator of a search system according to an exemplary embodiment of the present invention.
6 is another diagram for describing an operation of a keyword tree generator of a search system according to an exemplary embodiment of the present invention.
7 is another diagram for describing an operation of a keyword tree generation unit of a search system according to an exemplary embodiment of the present invention.
8 is a block diagram illustrating a search processing unit of a search system according to an embodiment of the present invention.
9 is an example of a screen provided by a search processor according to an exemplary embodiment.
10 is another example of a screen provided by a search processor according to an exemplary embodiment of the present invention.
11 is another example of a screen provided by a search processor according to an exemplary embodiment of the present invention.
12 is a flowchart illustrating a search service method according to another embodiment of the present invention.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when a part is said to "include" a certain component, it means that it can further include other components, without excluding other components unless specifically stated otherwise. Also, the terms " part, "" module," and " module ", etc. in the specification mean a unit for processing at least one function or operation and may be implemented by hardware or software or a combination of hardware and software have.

A search system and a search service method according to an embodiment of the present invention will be described in detail with reference to the drawings.

1 is a block diagram of a search system in accordance with an embodiment of the present invention.

The search system 100 is a server that receives a query from the user terminal 200, generates a search result for the query, and provides the search result to the user terminal 200. The data is clustered and the image data for the query is provided as a search result in consideration of whether the image contains the same document.

In this case, the user terminal 200 is a device in which a user who receives an advertisement connects to the search system 100 through a network and communicates with the user, for example, a computer, a personal digital assistant (PDA), a mobile communication terminal, and the like. Various communication devices, such as a television, may be used.

The search system 100 includes an image cluster generator 110, a representative image tree generator 120, a keyword tree generator 130, and a search processor 140.

The image cluster generation unit 110 generates an image cluster based on meta information of the image data, an image data feature vector, document information including the image, and the like. This will be described in detail with reference to FIGS. 2 to 4.

FIG. 2 is a block diagram illustrating an image cluster generation unit of a search system according to an embodiment of the present invention. FIG. 3 is a view for explaining an operation of an image cluster generation unit according to an embodiment of the present invention. Another diagram for describing an operation of an image cluster generation unit according to an exemplary embodiment of the present invention.

2, the image cluster generator 110 may include a collector 111, a meta feature extractor 112, a candidate cluster generator 113, an image feature extractor 114, and a feature connection diagram generator ( 115, a document linkage generation unit 116, and a final cluster generation unit 117.

The collecting unit 111 collects and stores an image that is a target of the search result.

The meta feature extractor 112 extracts meta information related to the collected image and generates a meta feature value for each image. Here, the meta information may be a title, a body, an image generation date, a category of a web page on which the document is published, and the like. In addition, the meta feature value may be determined based on the title of the document including the image and the frequency of words described in the body of the document, and may be weighted based on the creation date of the image and the category of the web page on which the document is displayed. .

The candidate cluster generation unit 113 generates a candidate cluster that can be an image cluster according to whether the frequency of a specific word is similar to the meta feature value generated by the meta feature extraction unit 112.

The image feature extractor 114 extracts an image feature value for each image included in the candidate cluster generated by the candidate cluster generator 113. The image feature value may be a value obtained by dividing an image into a plurality of regions and quantifying the degree of change in horizontal and vertical pixel values for each region.

The feature linkage generation unit 115 generates a feature linkage by connecting an image that is a distance difference less than or equal to a reference to an image in the candidate cluster generated by the candidate cluster generation unit 113 according to a distance difference of image feature values. This feature connection is shown in FIG. 3. Referring to FIG. 3, a plurality of images form a candidate cluster according to a meta feature value, and images having an image feature value below a reference are connected by lines.

The document connection diagram generation unit 116 generates a document connection diagram in which images included in the same document among the images forming candidate clusters are connected with each other by lines. This document link is shown in FIG. 4. Referring to FIG. 4, when images 41, 42, 43, 44, and 45 exist in candidate clusters, images 41, 42 are included in document 1, and images 43, 44, 45 are document 2. Included in In this case, a document connection diagram 40 in which the images 41 and 42 are connected to each other and the images 43, 44 and 45 are connected to each other is generated.

The final cluster generation unit 117 compares the feature connection diagram generated by the feature connection diagram generator 115 with the document connection diagram generated by the document connection diagram generator 116 and removes the connection line when the connection lines overlap. Creates clusters of images. In other words, the image clusters connect images having similar meta feature values and similar image feature values, except for concatenation of images included in the same document. As a result, it is possible to prevent the user from repeatedly reducing the accuracy of the search result by repeatedly displaying the overlapping image in order to promote a specific image.

Referring back to FIG. 1, the representative image tree generator 120 generates a tree centered on the representative image with respect to the image cluster generated by the image cluster generator 110. This will be described in detail with reference to FIG. 5.

5 is another diagram for describing an operation of a representative image tree generator of a search system according to an exemplary embodiment of the present invention.

Referring to FIG. 5, an example of an image cluster 51 is shown. This image cluster 51 was generated according to the candidate clusters based on the similarity of the meta feature values as described above. Therefore, the plurality of images included in the image cluster 51 are distributed according to the similarity of the meta feature values, and the image 53 at the center is the representative image. The representative image tree generation unit 120 selects the representative image 53 from the image cluster and generates a representative image tree 52 hierarchically classifying the remaining images based on the representative image 53. The representative image tree generation unit 120 may determine a tree having the lowest cost as a representative image tree 51 from which a tree is generated from a plurality of trees generated through a minimum cost spanning tree. The representative image tree 51 includes a representative image 53 and a plurality of images 54, 55, 56 connected to the representative image 53.

Referring again to FIG. 1, the keyword tree generator 130 generates a keyword tree based on the representative image tree generated by the representative image tree generator 120. This will be described in detail with reference to FIGS. 6 and 7.

6 and 7 are different diagrams for describing an operation of a keyword tree generator of a search system according to an exemplary embodiment of the present invention, respectively.

Referring to FIG. 6, the keyword tree generation unit 130 includes the remaining images 54, 55, and 56 in the representative image tree generated by the representative image tree generation unit 120 except for the representative image 53 as a plurality of groups. Can be tied That is, the keyword tree generator 130 bundles the plurality of images 54, 55, and 56 connected to the same connecting line extending from the representative image 53, respectively, into a plurality of groups. Thereafter, the keyword tree generator 130 extracts a keyword frequently appearing using meta feature values of images belonging to each group 54, 55, and 56 to generate a keyword tree based on the keyword. The keyword of the representative image was determined to be Captiva, the keyword of the group 54 was determined to be a Captiva image, the keyword of the group 55 was determined to be a Captiva daytime photo, and the keyword of the group 56 was determined to be Captiva snow driving. . Accordingly, the keyword tree generator 130 may generate a keyword tree as shown in FIG. 7.

Referring back to FIG. 1, the search processor 140 receives a query from the user terminal 200 and provides a search result for the query to the user terminal 200 using the representative image tree and the keyword image tree. This will be described in detail with reference to FIG. 8.

8 is a block diagram illustrating a search processing unit of a search system according to an embodiment of the present invention.

Referring to FIG. 8, the search processor 140 includes a query receiver 141, a representative image tree selector 142, a keyword tree selector 143, and a provider 144.

The query receiving unit 141 receives a query for a search service from the user terminal 200. In this case, the query may be text or an image. When the query is a text, the query receiver 141 may perform stemming analysis to remove a search or a space, replace a synonym with a single word, and generate a final query. In addition, when the query is an image, the query receiver 141 divides the image into a plurality of regions, and generates an image characteristic value by quantifying the degree of change in the horizontal and vertical pixel values for each region. If the query is a mixture of text and image, the above-described process can be performed for each.

The representative image tree selector 142 selects a representative image tree for the query. If the query is text, at least one representative image tree associated with the query is selected through meta feature values previously extracted from the plurality of representative image trees. If the query is an image, at least one representative image tree associated with the query is selected based on a predefined index in the representative image tree.

The keyword tree selector 143 selects a keyword related to a query based on the keyword tree.

The provider 144 provides an image included in the representative image tree selected by the representative image tree selector 142 to the user terminal 200 as a search result for the query. This will be described in detail with reference to FIGS. 9 and 10.

9 is an example of a screen provided by a search processor according to an embodiment of the present invention, and FIG. 10 is another example of a screen provided by a search processor according to an embodiment of the present invention.

When the user terminal 200 inputs "new equus" as a query, the provider 144 arranges a plurality of images included in the representative image tree selected in relation to "new equus" in order as shown in FIG. It may be provided to the user terminal 200.

On the contrary, when the user terminal 200 inputs "Chevrolet" as a query, the providing unit 144 uses the representative image tree itself selected in relation to "Chevrolet" as a search result as shown in FIG. 10. Can be provided to In this case, when the user terminal 200 selects any image included in the representative image tree, the user terminal 200 may show an image tree extending around the selected image.

On the other hand, the provider 144 provides the user terminal 200 with the keywords included in the keyword tree selected by the keyword tree selector 143 for the query input by the user terminal 200. This will be described in detail with reference to FIG. 11.

11 is another example of a screen provided by a search processor according to an exemplary embodiment of the present invention.

Referring to FIG. 11, when the user terminal 200 inputs "Chevrolet" as a query, a keyword tree related to "Chevrolet" is selected, and the providing unit 144 is a keyword included in the selected keyword tree. Captiva weekly picture ”,“ Captiva image ”and“ Captiva snow road driving ”may be provided to the user terminal 200 as a related keyword.

In this way, image data is clustered by analyzing meta information of image data, image feature values, and the document to which the image belongs, and selecting a search result for a query based on this results by removing images repeatedly included in the same document on the web. You can increase the accuracy of the results. In addition, it is possible to improve the search service quality by providing the search results to the user intuitively, and can effectively select and provide related keywords.

A search service method according to another embodiment of the present invention will now be described in detail with reference to FIG. 12.

12 is a flowchart illustrating a search service method according to another embodiment of the present invention.

Referring to FIG. 12, the search system 100 collects an image of a search result (S111). Thereafter, the search system 100 extracts meta feature values of the collected images (S112), and generates a candidate cluster by arranging a plurality of images based on the similarity of the meta feature values (S113).

In addition, the search system 100 extracts an image feature value with respect to an image belonging to the candidate cluster (S114), and generates a feature connection diagram by connecting images having a difference value of the image feature value below a reference (S115).

On the other hand, the search system 100 generates a document connection diagram by connecting the images included in the same document with respect to the candidate cluster (S116).

Thereafter, the search system 100 compares the feature connection diagram and the document connection diagram to remove overlapping connection lines to generate a final image cluster (S117).

Subsequently, the search system 100 generates a representative image tree and a keyword tree based on the generated image cluster (S118). That is, a representative image tree is selected to select a representative image from the image cluster and classify the remaining images based on the representative image. In addition, the images connected to the same connection line extending from the representative image tree are grouped into a plurality of groups, and a keyword tree is generated based on the frequently appearing keywords by using meta feature values of the images belonging to each group.

Then, the search system 100 receives a query from the user (S119), and selects a representative image tree and a keyword tree for the query (S120). Subsequently, the search system 100 provides the selected representative image tree as a search result to the user terminal 200, and also provides a keyword belonging to the keyword tree as an associated keyword (S121).

The embodiments of the present invention described above are not implemented only by the apparatus and method, but may be implemented through a program for realizing the function corresponding to the configuration of the embodiment of the present invention or a recording medium on which the program is recorded.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, It belongs to the scope of right.

Claims (21)

An image cluster generator for generating an image cluster based on the meta feature value of the image and the image feature value, and
A search processor that generates and provides a search result based on the cluster of images with respect to a query received from a user terminal.
Lt; / RTI >
The image cluster generation unit,
Collecting unit for collecting a plurality of images to be searched,
A meta feature extractor for extracting meta feature values of each of the plurality of images;
A candidate cluster generation unit generating a candidate cluster based on the similarity of the meta feature values;
An image feature extraction unit for extracting an image feature value of each image belonging to the candidate cluster;
Feature connection diagram generation unit for generating a feature connection diagram connecting the images with a difference value of the image feature value is less than the reference line
≪ / RTI > delete delete In claim 1,
A document linkage generation unit for generating a document linkage diagram connecting lines of images included in the same document among images belonging to the candidate cluster.
Further comprising: 5. The method of claim 4,
The final cluster generation unit for generating the image cluster by removing the overlapping lines by comparing the feature connection diagram and the document connection diagram.
Further comprising: In claim 1,
The meta feature value is determined based on at least one of a title of a document including an image, a body, an image generation date, and a category of a webpage on which the image is displayed. In claim 1,
The meta feature value is determined based on the frequency of the words described in the title and body of the document containing the image. In claim 1,
And the image feature value includes a value obtained by dividing the image into a plurality of regions and quantifying a change in pixel value for each region. In claim 1,
Representative image tree generation unit for selecting a representative image from the image cluster, and generates a representative image tree for classifying the remaining images based on the representative image
Further comprising: The method of claim 9,
And the representative image tree generation unit determines, as the representative image tree, a tree having the least cost from generation of a tree among a plurality of trees generated using a minimum cost spanning tree. The method of claim 9,
And a keyword tree generator for generating a keyword tree based on the representative image tree. 12. The method of claim 11,
And the keyword tree generating unit bundles a plurality of images connected to the same connection line among the connection lines extending from the representative image into a group, and generates the keyword tree using the meta feature values of the images belonging to the same group. 12. The method of claim 11,
The search processing unit,
Query receiving unit for receiving a query from the user terminal,
A representative image tree selection unit for selecting the representative image tree related to the query, and
Providing unit for providing the search results to the user terminal based on the representative image tree
≪ / RTI > The method of claim 13,
Wherein the providing unit comprises:
And a search system for sequentially arranging a plurality of images included in the representative image tree. The method of claim 14,
Wherein the providing unit comprises:
A search system for providing the representative image tree as the search result. The method of claim 13,
Wherein the providing unit comprises:
Keyword tree selection unit for selecting the keyword tree related to the query
Further comprising:
The providing unit provides a related keyword using the keyword tree. As a way for a search system to provide a search service,
Collecting the images that are the target of the search results,
Extracting meta feature values of the collected image;
Generating a candidate cluster by arranging the images based on the similarity of the extracted meta feature values;
Extracting an image feature value for an image belonging to the candidate cluster;
Generating a feature connection diagram by connecting the images having the difference value of the image feature values below the reference line;
Generating a document connection diagram by connecting images included in the same document with lines with respect to the images belonging to the candidate cluster;
Comparing the feature connection diagram and the document connection diagram to generate an image cluster from which overlapping lines are removed; and
Generating a search result for the query based on the cluster of images;
Search service method comprising a. The method of claim 17,
Selecting a representative image from the image cluster, and classifying the remaining images based on the representative image to generate a representative image tree
Search service method further comprising. The method of claim 18,
Wherein the generating the search result comprises:
Selecting a representative image tree related to the query and providing an image included in the representative image tree to a user terminal
Search service method comprising a. The method of claim 18,
Grouping a plurality of images connected to the same connection line among the extension lines extending from the representative image into a group, and generating a keyword tree using the meta feature values of the images belonging to the same group;
Search service method further comprising. In paragraph 20
Providing an associated keyword using the keyword tree
Search service method further comprising.

Images