KR20130046011A - System and method for analysing images of video contents - Google Patents

Abstract

PURPOSE: A device for analyzing an image of image content and a method thereof are provided to analyze the same image content in a plurality of image analysis devices, thereby minimizing loads of the image analysis devices and analyzing the image. CONSTITUTION: An analysis performance determination unit(220) obtains one or more image analysis devices which first image content and second image content are same based on second display image information received from a display image information transmitting/receiving unit(210). When an image analysis device(100-1) is included in N image analysis devices which are determined corresponding to a high rank based on an analysis rank table, the analysis performance determination unit determines performance of image analysis. An image analysis unit(240) performs the image analysis for a part of the first image content by obtaining a feature descriptor from the first image content. [Reference numerals] (210) Display image information transmitting/receiving unit; (220) Analysis performance determination unit; (230) Analysis condition determination unit; (240) Image analysis unit; (250) Storage unit; (260) Analysis result providing unit; (270) Control unit

Description

System and method for analyzing images of video content {System and method for analysing images of video contents}

The present invention relates to a system and method for analyzing an image of image content, and more particularly, to a system and method for simultaneously analyzing image content by a plurality of image analysis devices.

Recently, with the development of computer and network technology, video content, text content and image content, as well as their use range and usage are rapidly increasing. Accordingly, interest in a technology of searching for video content desired by a user among video contents is increasing. The conventional video content search technology is a method of searching for video content desired by a user through a title of the video content.

However, there is a need for a user who wants to search for a specific scene. Accordingly, a technology for searching based on the content of image content has been developed. The content-based retrieval technique of image content includes extracting and storing a feature from image content in advance, and searching for an image matching a search word input by a user using the stored image content feature. Techniques for extracting features from video content include manual extraction and automatic extraction. The manual extraction method is that the user directly tags the feature points in the image, but there is an advantage that accurate analysis of the feature points and tagging is possible, but it takes a lot of time and effort to extract the features from the image. The automatic extraction method automatically extracts the features from the image, which can reduce the time and effort required to extract the features from the image, but it requires additional time and effort to extract the features of the image content. And there is a limit in that it takes a lot of time and effort to extract features to all video content. Accordingly, there is a need for a method for efficiently analyzing image content to acquire characteristics of the image content.

KR 10-0323364 (Korea Institute of Science and Technology) 2002. 1. 23. Patent document 1 is a method of extracting feature vector from color images and an image retrieval method using the same. In patent document 1, color information and shape Disclosed is the use of feature vectors that simultaneously consider information. KR 10-0715094 (Pantech & Curitel Co., Ltd.) April 27, 2007 Patent document 2 is a method / apparatus for extracting and retrieving features using an old feature, and patent document 2 includes randomness, repeatability, and directionality. (directionality) Describes the use of feature values as texture descriptors.

It is an object of the present invention to provide an image analysis system and method for simultaneously analyzing image content by a plurality of image analysis apparatuses.

In accordance with another aspect of the present invention, there is provided an image analysis apparatus that broadcasts first display image information, which is information about a first image content output to an image output means connected thereto, and analyzes another image. A display image information transmitting / receiving unit for receiving second display image information, which is information on second image content output to an image output means connected to a device, from the other image analyzing apparatus; Acquiring at least one image analyzing apparatus in which the second image content is the same as the first image contents based on the second display image information, and using the second display image information received from the at least one image analyzing apparatus. An analysis performing determiner configured to determine to perform image analysis when the user is included in a predetermined number of image analyzing apparatuses determined according to a high rank based on the obtained analysis ranking table; If it is determined to perform the image analysis, the image analysis unit for obtaining a feature descriptor (feature descriptor) in the first image content to perform an image analysis of at least a portion of the first image content; includes.

According to an aspect of the present invention, there is provided an image analysis management apparatus comprising: an image information receiver configured to receive display image information, which is information about image content output to an image output means connected to an image analysis apparatus, from a plurality of image analysis apparatuses ; Based on the display image information received from the plurality of image analyzing apparatuses, a plurality of image analyzing apparatuses having the same image content are obtained, and an analysis ranking obtained using the display image information received from the plurality of image analyzing apparatuses. An analysis performing subject selecting unit configured to select a predetermined number of image analyzing apparatuses as an image analyzing subject according to a high rank based on a table; An image analysis result receiver configured to acquire a feature descriptor from the image content and to receive image analysis results of at least a portion of the image content from the predetermined number of image analysis apparatuses; And an image analysis manager which merges the image analysis results received from the predetermined number of image analyzing apparatuses and obtains an integrated image analysis result of the image contents.

According to an aspect of the present invention, there is provided a method of analyzing an image, the method comprising: receiving display image information, which is information about an image content output to an image output unit connected to an image analyzing apparatus, from a plurality of image analyzing apparatuses; Acquiring a plurality of image analyzing apparatuses having the same image content based on the display image information received from the plurality of image analyzing apparatuses; Selecting a predetermined number of image analyzing apparatuses as an image analyzing subject based on a high ranking based on the analysis ranking table obtained by using the display image information received from the plurality of image analyzing apparatuses; Acquiring a feature descriptor from the image content and receiving image analysis results of at least a portion of the image content from the predetermined number of image analysis devices; And merging the image analysis results received from the predetermined number of image analyzing apparatuses to obtain an integrated image analysis result for the image contents.

A computer-readable medium according to the present invention for achieving the above technical problem records a program for causing a computer to execute any one of the above methods.

According to an aspect of the present invention, there is provided a computer-readable medium comprising: broadcasting first display image information, which is information on a first image content output to an image output means connected thereto; Receiving second display image information, which is information on second image content output to an image output means connected to another image analyzing apparatus, from the other image analyzing apparatus; Acquiring at least one image analyzing apparatus having the second image content equal to the first image content based on the second display image information; Performing image analysis when the self-participation device is included in a predetermined number of image analyzing apparatuses determined according to a high rank based on the analysis ranking table obtained by using the second display image information received from the at least one image analyzing apparatus. Determining; And if it is determined to perform image analysis, acquiring a feature descriptor from the first image content and performing image analysis on at least a portion of the first image content. Record a program to run the analysis method on a computer.

According to the system and method for analyzing the image of the image content according to the present invention, by analyzing the same image content in a plurality of image analysis apparatus, it is possible to analyze the image while minimizing the load of the image analysis apparatus and to reduce the image analysis time have.

In addition, by analyzing the same image content by different analysis conditions for each of the plurality of image analysis apparatus, it is possible to advance the image analysis result and improve the reliability of the image analysis result. Accordingly, when searching for video content, it is possible to search for video content that more closely meets the needs of the user.

1 is a block diagram illustrating an image analysis system according to an embodiment of the present invention;
2 is a block diagram showing in more detail the configuration of an image analyzing apparatus according to an embodiment of the present invention;
3 is a flowchart illustrating an image analyzing process of an image analyzing apparatus according to an embodiment of the present invention;
4 is a block diagram showing in more detail the configuration of an image analysis management apparatus according to an embodiment of the present invention;
5 to 7 are views for explaining the results of the integrated image analysis of the image content according to an embodiment of the present invention,
8 is a flowchart illustrating an image analysis process of an image analysis management apparatus according to an embodiment of the present invention;
9 is a block diagram showing in more detail the configuration of an image analyzing apparatus according to another embodiment of the present invention;
10 is a block diagram showing in more detail the configuration of an image analysis management apparatus according to another embodiment of the present invention;
11 is a flowchart illustrating an image analysis process of an image analysis management device according to another embodiment of the present invention.

Hereinafter, with reference to the accompanying drawings will be described in detail a preferred embodiment of a system (hereinafter referred to as the "image analysis system") and method for analyzing the image of the video contents (video contents) according to the present invention.

1 is a block diagram illustrating an image analysis system according to an exemplary embodiment of the present invention.

Referring to FIG. 1, an image analyzing apparatus 100-1 according to an embodiment of the present invention is connected to an image display apparatus 500-1, and other image analyzing apparatuses 100-2 to 100 through a communication network 400. -n), the video analysis management device 200 and / or the plurality of broadcast providing devices 300-1 to 300-n.

The image analyzing apparatuses 100-1 to 100-n analyze images of image contents displayed through the connected image display apparatuses 500-1 to 500-n. Here, the video content is a video broadcast in real time from the broadcast providing apparatuses 300-1 to 300-n, and from the broadcast providing apparatuses 300-1 to 300-n using a video on demand (VOD). Refers to the provided video, user-created video, etc. In this case, the image analyzing apparatuses 100-1 to 100-n may analyze the image of the image content when the image analyzing function is set to on by a user's manipulation.

The image analyzing apparatuses 100-1 to 100-n store the image analysis result, which is a result of analyzing the image of the image content, and provide the image analysis management apparatus 200 with respect to the image content.

The image display apparatuses 500-1 to 500-n display a stored image or an image provided through the communication network 400. The image display apparatuses 500-1 to 500-n include terminals having memory means and a microprocessor. The video display devices 500-1 to 500-n include a television, a computer, a tablet PC, a personal digital assistant (PDA), and a portable multimedia player (PMP). ), A mobile phone, a smart phone, a navigation device, and the like.

Meanwhile, although the image analyzing apparatuses 100-1 to 100-n and the image display apparatuses 500-1 to 500-n are shown as independent apparatuses in FIG. 1, the image analyzing apparatuses are not limited thereto. And the image display device may be formed of one device. In addition, an image analysis application that performs an image analysis function or the like according to an embodiment of the present invention may be installed in the image display apparatus to analyze an image of image content. That is, an image analysis function, an image analysis result providing function, and the like performed by the image analyzing apparatus are implemented as an application, and the image analysis application is mounted in the manufacturing of the image display apparatus, or the image analysis application is applied to the image display apparatus by a user's operation. Can be installed.

The image analysis management apparatus 200 obtains an integrated image analysis result of the image content by using the image analysis result of the image content received from the image analysis apparatuses 100-1 to 100-n. In addition, the image analysis management apparatus 200 may store the acquired integrated image analysis result in a storage means provided therein or an external storage means.

The broadcast providing apparatuses 300-1 to 300-n are apparatuses for broadcasting a video in real time or providing a requested video through an on-demand video service. That is, the broadcast providing apparatuses 300-1 to 300-n provide various programs such as dramas, news, and movies to the image analyzing apparatuses 100-1 to 100-n through the communication network 400. The communication network 400 includes not only a data network including a local area network (LAN), a metropolitan area network (MAN), a wide area network (WAN), the Internet, but also a broadcasting network and a telephone network. It may include, wired and wireless, and may use any communication method.

Meanwhile, the broadcast providing apparatuses 300-1 to 300-n may provide an image through a one-way broadcasting network using airwaves, satellites, terrestrial waves, etc. In this case, the image analyzing apparatuses 100-1 to 100-n may Data is transmitted and received with the image analysis management apparatus 200 through the communication network 400.

Meanwhile, although the image analysis management apparatus 200 and the broadcast providing apparatuses 300-1 to 300-n are shown as independent apparatuses in FIG. 1, the present invention is not limited thereto and according to an embodiment, the image analysis management apparatus ( 200 and the broadcast providing devices 300-1 to 300-n may be formed of one device.

2 is a block diagram illustrating in detail the configuration of an image analyzing apparatus according to an exemplary embodiment.

The image analyzing apparatus 100-1 may include a display image information transmitting and receiving unit 210, an analysis performing determiner 220, an analysis condition determiner 230, an image analyzer 240, a storage 250, and an analysis result. Study 260 and the control unit 270 is provided.

The display image information transmitter / receiver 210 broadcasts display image information, which is information about image contents output to the image display apparatus 500-1. Here, the display image information includes identification data of the image analysis apparatus, identification data of the displayed image content, network status, past analysis history, image analysis application version, and the like. The past analysis history includes the number of past image analyzes, the amount of past image analyzes, and the number of times of termination during image analysis. In this case, the display image information transmitting / receiving unit 210 completes partial analysis when the image analyzing apparatus 100-1 or the image display apparatus 500-1 is driven or from other image analyzing apparatuses 100-2 to 100-5. When the message is received or periodically, the display image information may be broadcast.

In addition, the display image information transmitting and receiving unit 210 receives the display image information broadcast from the other image analysis apparatus (100-2 to 100-n).

The analysis performing determiner 220 determines whether to perform image analysis on the image content output to the image display apparatus 500-1.

That is, the analysis performing determiner 220 obtains the display image table as shown in Table 1 below based on the display image information received from the other image analyzing apparatuses 100-2 to 100-n.

Video analysis device

Video content
Network status
Historical analysis
Application version
...
Device A (self)

Image A
Prize
3rd time
1.0
...
Device B

Image A
Ha
5 times
1.0
...
Device C

Image B
medium
Episode 2
1.1
...
Device D

Image A
medium
5 times
1.0
...
Device E

Image C
Prize
1 time
1.1
...
Device F

Image A
Prize
4 times
0.9
...
Device G

Image D
Ha
3rd time
1.0
...
...

Here, each record of the display image table may include identification data of the image analyzing apparatuses 100-1 to 100-n, identification data of the displayed image contents, network status, and the past of the image analyzing apparatuses 100-1 to 100-n. It is composed of the number of analysis, the image analysis application version items, and the like.

The analysis performing determiner 220 analyzes another image outputted on the image display apparatus to which the same image content is output to the image display apparatus 500-1 based on the display image table as shown in [Table 1]. Obtain an analysis ranking table as shown in Table 2 below, which consists of the device and itself. In this case, the analysis performance determiner 220 may determine the ranking based on items such as network status, past analysis history, image analysis application version, and the like. Of course, the ranking may be determined by assigning a weight to each item.

ranking

Video analysis device
Network status
Historical analysis
Application version
One

Device F
Prize
4 times
0.9
2

Device A (self)
Prize
3rd time
1.0
3

Device D
medium
5 times
1.0
4

Device B
Ha
5 times
1.0
...

Here, 'device F' and 'device A' (self) have the same network status as 'phase', but since the past analysis history of 'device F' is larger than the past analysis history of 'device A (self)' The rank of device F 'is higher than the rank of' device A '. The analysis ranking table in [Table 2] is just one example and may vary depending on the priority of each item.

The analysis performance determiner 220 determines that the analysis is performed when it is included in a predetermined number of image analyzing apparatuses according to the ranking based on the analysis ranking table. Here, the number of image analysis apparatuses that perform image analysis may be predetermined or may be determined by exchanging messages with other image analysis apparatuses 100-2 to 100-n. For example, if the number of image analyzing apparatuses is two, it is determined that the image analysis is performed because it includes itself ('device A'). If the number of image analyzing apparatuses is one, it includes itself ('device A'). It is determined that no image analysis will be performed.

If it is determined that the analysis condition determiner 230 performs the image analysis by the analysis execution determiner 220, the analysis condition is determined based on the analysis ranking table of the above [Table 2] using the analysis condition information for each type. May be determined.

Here, the analysis conditions include a temporal analysis range in which some sections of all sections of the image content are analyzed, a spatial analysis range in which some sections of the entire video region of the image contents are analyzed, and a combination of a temporal analysis range and a spatial analysis range. Indicates one. The spatial scope of analysis consists of the object of analysis, the level of analysis, or a combination thereof. The object to be analyzed is an object, color, area, motion, or a combination thereof. Objects refer to people, animals, objects, etc., colors refer to blue, red, and gray, and areas refer to backgrounds and foregrounds. The analysis level refers to the analysis level of the image. For example, the level for analyzing a person's movement, the level for analyzing a change in a person's facial expression, and the like.

The analysis condition information for each type refers to analysis conditions defined for each type obtained by combining at least one of the number of network analysis apparatuses determined to perform an analysis, a network state, a past analysis history, and an image analysis application version. For example, when the number of image analysis devices determined to perform analysis is one and there is no past analysis history, the lowest analysis level may be determined as an analysis condition. In addition, when there are a plurality of image analyzing apparatuses determined to perform the analysis, the entire section may be divided by the number of the image analyzing apparatuses, and corresponding sections may be determined as analysis conditions according to their ranks.

In addition, when it is determined that the analysis condition determiner 230 performs the image analysis by the analysis performance determiner 220, the analysis condition determiner 230 exchanges a message with another image analysis device determined to perform the image analysis, and analyzes the analysis condition of the image content. It is possible to determine its own analysis conditions by making the image analysis device different.

That is, the analysis condition determiner 230 exchanges a message with another image analysis device determined to perform image analysis, and determines the analysis conditions differently for each image analysis device to generate an analysis condition table as shown in Table 3 below. can do.

ranking

Video analysis device
Analysis condition
One

Device F
Analytical Condition A
2

Device A (self)
Analytical Condition B
3

Device D
Analytical Condition C

Here, the analysis condition table indicates an analysis condition table generated when three image analysis apparatuses are determined to perform image analysis based on the analysis ranking table of the above [Table 2].

The analysis condition determiner 230 may determine its analysis condition based on the analysis condition table. For example, according to the analysis ranking table of the above [Table 2], the analysis condition determiner 230 may determine its analysis condition as 'analysis condition B'.

In addition, when it is determined that the analysis condition determiner 230 performs the image analysis by the analysis performance determiner 220, the image analysis apparatus having the same image content as the image content output to the image display apparatus 500-1 is different. If it is not output to the image display apparatuses 500-2 to 500-n connected to (100-2 to 100-n), the image analysis management apparatus 200 may request a past image analysis result of the image content. The analysis condition determiner 230 may determine its analysis condition based on the past image analysis result provided from the image analysis management apparatus 200. For example, when there is a past image analysis result for some sections of all sections of the image content, the analysis condition determiner 230 may determine a section in which the image analysis result does not exist as the analysis condition. When there is a past image analysis result for the entire section of the image content, the analysis condition determiner 230 may determine an analysis level higher than the past image analysis result as an analysis condition.

When it is determined that the image analysis unit 240 performs image analysis by the analysis execution determiner 220, the image analysis unit 240 performs image analysis on the image content output to the image display apparatus 500-1. That is, the image analyzer 240 extracts a feature from an image of the video content being viewed using a feature extraction algorithm, and converts the extracted feature into text data to obtain a feature descriptor. . Here, the feature refers to color, shape, texture, motion, spatial layout, and the like.

In this case, the image analyzer 240 may perform image analysis on at least a portion of the image content according to the analysis condition determined by the analysis condition determiner 240. For example, when a section corresponding to '10 minutes to 20 minutes 'of the entire section of the image content is determined as its analysis condition, the image analyzer 240 corresponds to '10 minutes to 20 minutes' of the entire section of the image content. Image analysis may be performed on the section. When the 'background' of the image of the image content is determined as its analysis condition, the image analyzer 240 may perform image analysis on a region corresponding to the 'background' of the image of the image content. When the 'level of analyzing the change in the human facial expression' is determined as the analysis condition of the user, the image analyzer 240 may perform the image analysis at the level of analyzing the difference of the human facial expression in the image of the image content.

The image analyzer 240 obtains an image analysis result of the image content based on the acquired feature descriptor. Here, the image analysis result includes identification data of the image analysis apparatus, image content identification data, analysis conditions, frame identification data, feature descriptors, and the like.

The storage unit 250 stores the image analysis result for the image content analyzed by the image analyzer 240. The storage unit 250 is a storage medium that is built in the image analyzing apparatus 100-1 or is a removable storage medium. The storage medium may include a flash memory, a hard disk, a card type memory (eg, SD memory, XD memory, etc.), random access memory (RAM), and read only memory (ROM). ), Magnetic memory, magnetic disk, optical disk, and the like.

The analysis result providing unit 260 provides the image analysis management apparatus 200 with an image analysis result of the image content analyzed by the image analysis unit 240.

When the image analysis of the image content output to the image display apparatus 500-1 is completed, the controller 270 may transmit the entire analysis completion message to other image analysis apparatuses 100-2 to 100-n and / or image analysis management. Broadcast to device 200. Here, the image analysis normal end message includes identification data of the image analyzing apparatus 100-1, identification data of image contents, analysis conditions, image analysis results, and the like.

When the video content output to the video display device 500-1 is changed, the power is turned off, or abnormally terminates by a user's manipulation, the controller 270 sends a partial analysis completion message to another video analysis device 100-2 to 100. 100-n) and / or the video analysis management device 200 may be broadcast. Here, the partial analysis end message includes identification data of the image analyzing apparatus 100-1, identification data of image content, frame identification data at the end of image analysis, an analysis condition, an image analysis result, and the like.

The image analyzing apparatus 100-1 may determine an image analyzing apparatus that performs image analysis and analysis conditions, and may broadcast the same to other image analyzing apparatuses 100-2 to 100-n.

3 is a flowchart illustrating an image analyzing process of the image analyzing apparatus according to an embodiment of the present invention.

The image analyzing apparatus 100-1 may display display image information output to the image display apparatuses 500-2 to 500-n connected to the other image analyzing apparatuses 100-2 to 100-n. 2 to 100-n), and based on the received display image information, a display image table as shown in [Table 1] is obtained (S320).

Thereafter, the image analysis apparatus 100-1 obtains an analysis ranking table as shown in Table 2 above based on the obtained display image table (S330). The image analysis apparatus 100-1 determines whether to perform image analysis based on the acquired analysis ranking table in operation S340. In this case, when it is determined to perform the image analysis, the image analysis apparatus 100-1 may determine its own analysis condition.

Thereafter, if it is determined that image analysis is to be performed, the image analysis apparatus 100-1 performs image analysis on image content (S350). In this case, the image analysis apparatus 100-1 may perform image analysis on at least a portion of the image content according to its analysis condition.

Thereafter, the image analysis apparatus 100-1 stores the image analysis result of the analyzed image content (S360), and provides the image analysis result of the analyzed image content to the image analysis management apparatus 200 (S370). .

4 is a block diagram illustrating in detail the configuration of an apparatus for managing video analysis according to an embodiment of the present invention, and FIGS. 5 to 7 illustrate integrated video analysis results for video content according to an embodiment of the present invention. It is for the drawing.

The image analysis management apparatus 200 includes an image analysis result receiver 410, an image analysis result manager 420, and a storage 430.

The image analysis result receiver 410 receives image analysis results of image content from the plurality of image analysis apparatuses 100-1 to 100-n, respectively.

The image analysis result manager 420 obtains a combined image analysis result of the image content for each image content based on the image analysis result of the image content received through the image analysis result receiver 210.

In this case, the image analysis result manager 420 analyzes the same image content among the received image analysis results and analyzes the image analysis results analyzed according to different analysis conditions according to the flow of the playback time, and thus The integrated image analysis result can be obtained.

For example, referring to FIG. 5, the first and second image analysis results AR5_1 and AR5_2 of the image content VC5 received from the first and second image analyzing apparatuses 100-1 and 100-2 are displayed. In the case of the image analysis result analyzed for the different analysis sections among the entire sections of the content VC5, the image analysis result manager 420 displays the first and second image analysis results AR5_1 and AR5_2 as a flow of playback time. By merging on the basis, the integrated image analysis result AR5 of the image content VC5 may be obtained. Referring to FIG. 6, different analysis results of the first and second image analysis results AR6_1 and AR6_2 of the image content VC6 received from the first and second image analyzing apparatuses 100-1 and 100-2 are different from each other. In the case of the image analysis result analyzed at the level, the image analysis result management unit 420 merges the first and second image analysis results AR6_1 and AR6_2 in a hierarchical manner, thereby integrating the image analysis result for the image content VC6 (AR6). ) Can be obtained. Referring to FIG. 7, the first and second image analysis results AR7_1 and AR7_2 of the image content VC7 received from the first and second image analyzing apparatuses 100-1 and 100-2 are different from each other. In the case of an image analysis result analyzed for a range, the image analysis result management unit 420 merges the first and second image analysis results AR7_1 and AR7_2 so as to overlap each other based on the flow of the playback time, and thus the image content VC7. Integrated image analysis result AR7 may be obtained.

In addition, the image analysis result manager 420 analyzes the same image content among the received image analysis results, and when the analysis results for some sections of all sections of the image content are included in the image analysis result, the corresponding image analysis One of the image analysis results may be selected based on the display image information received from the device, and may be determined as the analysis result of the overlapping section. For example, the image analysis result manager 420 may determine the image analysis result analyzed by the image analysis device having a large number of past analysis times as the analysis result for the overlapping section. The image analysis result manager 420 may determine the image analysis result analyzed by the image analysis device having fewer ending times during the image analysis as the analysis result for the overlapping section.

In addition, when the image analysis result manager 420 receives a request for a past image analysis result of the image content from the image analysis apparatus, the image analysis result manager 420 may provide the image analysis apparatus with the past image analysis result of the image content.

The storage unit 430 stores the integrated image analysis result for the image content acquired by the image analysis result management unit 420. The storage unit 430 is a storage medium embedded in the image analysis management apparatus 200 or a removable storage medium. Of course, the storage unit 430 may be configured as an independent device from the image analysis management apparatus 200, and may be connected to the image analysis management apparatus 200 by wire or wirelessly to exchange data.

8 is a flowchart illustrating an image analysis process of an image analysis management apparatus according to an embodiment of the present invention.

The image analysis management apparatus 200 receives an image analysis result of the image content from the plurality of image analysis apparatuses 100-1 to 100-n (S810), and based on the received image analysis result, the image content for each image content. Acquire the integrated image analysis result for (S820).

At this time, the image analysis management apparatus 200 is an analysis result of the same image content among the received image analysis results, and the image analysis results analyzed according to different analysis conditions are merged according to the flow of playback time for the image content. The integrated image analysis result can be obtained. In addition, when the image analysis management apparatus 200 analyzes the same image content among the received image analysis results and the analysis results for some sections of all the sections of the image content are included in the image analysis result, the corresponding image analysis One of the image analysis results may be selected based on the display image information received from the device, and may be determined as the analysis result of the overlapping sections.

Thereafter, the image analysis management apparatus 200 stores the integrated image analysis result of the obtained image content in operation S830.

As described above, the image analyzing apparatus 100-1 according to the present exemplary embodiment determines whether to perform image analysis and analysis conditions based on the display image information received from the other image analyzing apparatuses 100-2 to 100-n. When the analysis is performed, the image analysis result is provided to the image analysis management apparatus 200. That is, an image analysis apparatus that performs image analysis on image content is determined by a peer to peer (P2P) method.

Alternatively, the image analysis management apparatus 200 may select an image analysis apparatus to perform image analysis among the image analysis apparatuses 100-1 to 100-n and determine analysis conditions for each image analysis apparatus. Then, the image analysis apparatus selected as the subject of image analysis performs image analysis, and provides the image analysis result to the image analysis management apparatus 200. That is, the image analyzing apparatus for performing image analysis on the image content is determined by the server-client method.

Hereinafter, an image analysis process performed when the image analysis management apparatus 200 performs a server role and the image analysis apparatuses 100-1 to 100-n perform a client role will be described.

9 is a block diagram illustrating in detail the configuration of an image analyzing apparatus according to another exemplary embodiment.

The image analyzing apparatus 900 includes an image analyzing unit 910, a storage unit 920, an analysis result providing unit 930, and a controller 940.

The image analyzing unit 910, the storage unit 920, the analysis result providing unit 930, and the controller 940 of the image analyzing apparatus 900 according to the present exemplary embodiment may each be the image analyzing apparatus 100 according to the previous embodiment. Since the image analysis unit 240, the storage unit 250, the analysis result providing unit 260, and the control unit 270 are substantially the same, only other portions will be described below.

The controller 940 provides the image analysis management apparatus 200 with display image information, which is information about image content output to the image display apparatus 500-1. In this case, the controller 940 may provide the display image information to the image analysis management apparatus 200 when the image analysis apparatus 900 or the image display apparatus 500-1 is driven or periodically.

When the image analysis unit 910 receives the image analysis execution message from the image analysis management apparatus 200, the image analysis unit 910 performs image analysis on the image content output to the image display apparatus 500-1. In this case, when the analysis condition message includes the analysis condition or receives the analysis condition message, the image analyzer 910 may perform image analysis on at least a portion of the image content according to the analysis condition.

10 is a block diagram illustrating in detail the configuration of an apparatus for managing video analysis according to another embodiment of the present invention.

The image analysis management apparatus 1000 may include a display image information receiver 1010, an analysis performing subject selection unit 1020, an analysis condition determiner 1030, an image analysis result receiver 1040, an image analysis result manager 1050, and storage. The unit 1060 is provided.

The image analysis result receiver 1040, the image analysis result management unit 1050, and the storage unit 1060 of the image analysis management apparatus 1000 according to the present exemplary embodiment may each be an image of the image analysis management apparatus 200 according to the previous embodiment. Since the analysis result receiver 410, the image analysis result manager 420, and the storage 430 are substantially the same, a detailed description thereof will be omitted.

The display image information receiver 1010 receives display image information from the plurality of image analysis apparatuses 900-1 to 900-n.

The analysis performing subject selecting unit 1020 selects a predetermined number of image analyzing apparatuses for each image content as an image analyzing subject based on the display image information received through the display image information receiving unit 1010.

That is, the analysis performing subject selecting unit 1020 obtains a display image table as shown in Table 4 below based on the display image information received from the plurality of image analysis apparatuses 900-1 to 900-n.

Video analysis device

Video content
Network status
Historical analysis
Application version
...
Device A

Image A
Prize
3rd time
1.0
...
Device B

Image A
Ha
5 times
1.0
...
Device C

Image B
medium
Episode 2
1.1
...
Device D

Image A
medium
5 times
1.0
...
Device E

Image B
Prize
1 time
1.1
...
Device F

Image A
Prize
4 times
0.9
...
Device G

Image B
Ha
3rd time
1.0
...
...

The analysis performing subject selecting unit 1020 obtains an analysis ranking table as shown in Table 5 below for each image content based on the display image table as shown in Table 4 above.

Video content A

ranking

Video analysis device
Network status
Historical analysis
Application version
One

Device F
Prize
4 times
0.9
2

Device A
Prize
3rd time
1.0
3

Device D
medium
5 times
1.0
4

Device B
Ha
5 times
1.0
...

Video content B

ranking

Video analysis device
Network status
Historical analysis
Application version
One

Device E
Prize
1 time
1.1
2

Device C
medium
Episode 2
1.1
3

Device G
Ha
3rd time
1.0
...

The analysis performing subject selecting unit 1020 selects a predetermined number of image analyzing apparatuses for each image content as an image analyzing subject based on the analysis ranking table as shown in [Table 5].

The analysis performing subject selecting unit 720 provides an image analyzing performing message to a predetermined number of image analyzing apparatuses selected as subjects for performing image analysis for each image content. The image analysis performing message includes identification data of the image analyzing apparatus and identification data of the image content.

When the analysis performing subject selecting unit 1020 receives the partial analysis end message from the image analyzing apparatus selected as the image analyzing subject, the analysis subject selecting unit 1020 selects another image analyzing apparatus based on the analysis ranking table as shown in [Table 5] of the corresponding image content. It can be selected as the subject of image analysis. The analysis performing subject selecting unit 1020 may provide an image analyzing performing message to the image analyzing apparatus selected as the newly selected image analyzing subject.

The analysis condition determiner 1030 may differently determine an analysis condition of the image content for each of the image analysis apparatuses selected as the subject of the image analysis.

That is, the analysis condition determiner 1030 determines analysis conditions differently for each image analysis device selected as an image analysis subject for each image content, and obtains an analysis condition table as shown in Table 6 below. In this case, the analysis condition determiner 1030 may obtain an analysis condition table based on the analysis ranking table as shown in Table 5 above using preset analysis condition information for each type.

Video content A

ranking

Video analysis device
Analysis condition
One

Device F
Analytical Condition A
2

Device A
Analytical Condition B
3

Device D
Analytical Condition C
Video content B

ranking

Video analysis device
Analysis condition
One

Device E
Analytical Condition D
2

Device C
Analytical Condition E
3

Device G
Analytical Condition F

Here, the analysis condition table represents an analysis condition table obtained when three image analysis apparatuses are selected as subjects of image analysis based on the analysis ranking table of the above [Table 5].

The analysis condition determiner 1030 provides information on the analysis conditions by using the analysis condition table as shown in [Table 6] to each of the image analysis apparatuses selected as the subjects of the image analysis for each image content. The analysis condition determiner 1030 may provide information about the analysis condition to the image analysis device by including the analysis condition in the image analysis performance message provided by the analysis performing entity selection unit 1020 to the image analysis device. Of course, the analysis condition determiner 1030 may provide the analysis condition message to the image analysis device. The analysis condition message may include identification data of the image analyzing apparatus, identification data of the image content, analysis conditions, and the like.

11 is a flowchart illustrating an image analysis process of an image analysis management device according to another embodiment of the present invention.

The image analysis management apparatus 1000 receives display image information from the plurality of image analysis apparatuses 900-1 to 900-n (S1110) and displays the display as shown in [Table 4] based on the received display image information. An image table is obtained (S1120).

Subsequently, the image analysis management apparatus 1000 obtains an analysis ranking table as shown in Table 5 above for each image content based on the obtained display image table (S1130), and for each image content based on the acquired analysis ranking table. A predetermined number of image analyzing apparatuses are selected as subjects for performing image analysis (S1140). In this case, the image analysis management apparatus 1000 may differently determine an analysis condition of the image content for each image analysis device selected as an image analysis subject. The image analysis management apparatus 1000 provides an image analysis execution message to a predetermined number of image analysis apparatuses selected as subjects of image analysis for each image content (S1150).

Thereafter, the image analysis management apparatus 1000 receives an image analysis result of the image content from the plurality of image analysis apparatuses 900-1 to 900-n (S1160), and for each image content based on the received image analysis result. An integrated image analysis result of the image content is obtained (S1170). The image analysis management apparatus 1000 stores the integrated image analysis result of the obtained image content in operation S1180.

On the other hand, the image analysis device according to an embodiment of the present invention further includes an image search unit (not shown) for searching the image content based on the search word input by the user's operation using the image analysis result for the image content. can do.

The image retrieval unit searches for the image content matching the search word by using the image analysis result of the image content stored in the image analysis apparatus or the image analysis result of the image content stored in the image analysis management apparatus. The image retrieval unit displays the retrieved image content list, and displays the image content selected by the user on the screen. Of course, the image retrieval unit may request a search from the image analysis management apparatus and receive a list of image contents as a search result from the image analysis management apparatus.

The image retrieval unit immediately displays the image content when the image content selected by the user's operation is stored in the image analysis device. If the image content selected by the user's manipulation does not exist in the image analyzing apparatus, the image searching unit displays the image contents provided through another image analyzing apparatus, a broadcasting providing apparatus, an image sharing apparatus, or the like.

The present invention can also be embodied as computer-readable codes on a computer-readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer apparatus is stored. Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like in the form of a carrier wave . In addition, the computer-readable recording medium may be distributed to computer devices connected to a wired / wireless communication network, and a computer-readable code may be stored and executed in a distributed manner.

Although the preferred embodiments of the present invention have been described in detail above, the present invention is not limited to the specific preferred embodiments described above, and the technical field to which the present invention pertains without departing from the gist of the present invention claimed in the following claims. Anyone of ordinary skill in the art of various modifications can be made, of course, such changes are within the scope of the claims.

100-1 to 100-n, 900: an image analysis device,
200, 1000: video analysis management device,
300: a broadcast providing device,
400: network,
500: video display device

Claims (14)

Broadcasting first display image information, which is information on the first image content output to the image output means connected to the self, and information on the second image content output to the image output means connected to the other image analysis device. A display image information transmitting / receiving unit which receives second display image information from the other image analyzing apparatus;
Acquiring at least one image analyzing apparatus in which the second image content is identical to the first image contents based on the second display image information, and using the second display image information received from the at least one image analyzing apparatus. An analysis performing determiner configured to determine to perform image analysis when the user is included in a predetermined number of image analyzing apparatuses determined according to a high rank based on the obtained analysis ranking table;
And if it is determined to perform image analysis, an image analyzer for acquiring a feature descriptor from the first image content and performing image analysis on at least a portion of the first image content. Video analysis device. The method of claim 1,
If it is determined to perform the image analysis further comprises an analysis condition determination unit for determining the analysis conditions based on the analysis ranking table,
And the image analyzing unit performs image analysis on the first image content according to the analysis condition. The method of claim 2,
The analysis condition may be a temporal analysis range representing a partial section of the entire section of the first image content, a spatial analysis range representing a part of the entire image region of the first image content, and a combination of the temporal analysis range and the spatial analysis range. An image analyzing apparatus, characterized in that one of the. The method of claim 1,
And a controller for broadcasting a partial analysis end message when the video analysis is terminated during the video analysis of the first video content. An image information receiver configured to receive, from a plurality of image analysis apparatuses, display image information that is information about image content output to an image output means connected to the image analysis apparatus;
Based on the display image information received from the plurality of image analyzing apparatuses, a plurality of image analyzing apparatuses having the same image content are obtained, and an analysis ranking obtained using the display image information received from the plurality of image analyzing apparatuses. An analysis performing subject selecting unit configured to select a predetermined number of image analyzing apparatuses as an image analyzing subject according to a high rank based on a table;
An image analysis result receiver configured to acquire a feature descriptor from the image content and to receive image analysis results of at least a portion of the image content from the predetermined number of image analysis apparatuses; And
And an image analysis management unit which merges the image analysis results received from the predetermined number of image analysis apparatuses and obtains an integrated image analysis result of the image contents. 6. The method of claim 5,
And an analysis condition determiner configured to differently determine an analysis condition of the image content for each of the predetermined number of image analysis devices.
And the image analysis result receiving unit receives the image analysis result analyzed according to the analysis condition determined by the analysis condition determining unit. The method according to claim 6,
The analysis condition may be one of a temporal analysis range representing a partial section of the entire section of the image content, a spatial analysis range representing a part of the entire image region of the image content, and a combination of the temporal analysis range and the spatial analysis range. Image analysis management apparatus, characterized in that. 6. The method of claim 5,
When the analysis performing subject selection unit receives the partial analysis end message from at least one of the predetermined number of image analyzing apparatuses, the new image analyzing apparatus is selected as an image analyzing subject based on the analysis ranking table. Video analytics management device. Receiving display image information, which is information about an image content output to an image output means connected to the image analyzing apparatus, from the plurality of image analyzing apparatuses;
Acquiring a plurality of image analyzing apparatuses having the same image content based on the display image information received from the plurality of image analyzing apparatuses;
Selecting a predetermined number of image analyzing apparatuses as an image analyzing subject based on a high ranking based on the analysis ranking table obtained by using the display image information received from the plurality of image analyzing apparatuses;
Acquiring a feature descriptor from the image content and receiving image analysis results of at least a portion of the image content from the predetermined number of image analysis devices; And
And merging the image analysis results received from the predetermined number of image analyzing apparatuses to obtain an integrated image analysis result for the image contents. The method of claim 9,
Determining different analysis conditions of the image content for each of the predetermined number of image analysis devices;
And receiving the image analysis result analyzed according to the determined analysis condition in the image analysis result receiving step. The method of claim 10,
The analysis condition may be one of a temporal analysis range representing a partial section of the entire section of the image content, a spatial analysis range representing a part of the entire image region of the image content, and a combination of the temporal analysis range and the spatial analysis range. Image analysis method, characterized in that. The method of claim 9,
And when the partial analysis end message is received from at least one of the predetermined number of image analyzing apparatuses, selecting a new image analyzing apparatus as an image analyzing subject based on the analysis ranking table. Analytical Method. A computer-readable recording medium having recorded thereon a program for executing the image analysis method according to any one of claims 9 to 12 on a computer. Broadcasting first display video information which is information on the first video content output to the video output means connected thereto;
Receiving second display image information, which is information on second image content output to an image output means connected to another image analyzing apparatus, from the other image analyzing apparatus;
Acquiring at least one image analyzing apparatus having the second image content equal to the first image content based on the second display image information;
Performing image analysis when the self-participation device is included in a predetermined number of image analyzing apparatuses determined according to a high rank based on the analysis ranking table obtained by using the second display image information received from the at least one image analyzing apparatus. Determining; And
And if it is determined that image analysis is to be performed, acquiring a feature descriptor from the first image content and performing image analysis on at least a portion of the first image content. A computer readable recording medium having recorded thereon a program for executing a method on a computer.

Images