JP3477450B2 - Video information reaction analysis system - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a reaction analysis system for moving image information, and more particularly, a server collects reaction information of viewers at each terminal of moving image information of moving image content distributed from a server to a plurality of terminals. The present invention relates to a reaction analysis system of moving picture information to be analyzed.

[0002]

2. Description of the Related Art Conventionally, a method of collecting reader / viewer's reaction to a certain content using the Internet is well known. This collects the reaction to the question in correspondence with the set identification information. But,
A method of collecting a reaction by associating this with a time axis for an object having a time axis such as a moving image has not been conventionally known.

In the case of a moving image, the reaction to the entire content may be identified at the stage when the projection is finished, but it does not correspond to the time axis during the operation of the moving image. Further, it is possible to correlate it with the relative time on the moving image by moving the clock separately during the projection of the moving image and measuring the absolute time when the reaction occurs. For example, in the current television broadcasting, viewing information is collected from the viewers of the television who watched a moving image of a program or a commercial being broadcast, and the audience rating is calculated.

[0004]

However, as a method of associating with a relative time on a moving image by moving a clock separately while a moving image is being projected and measuring an absolute time when a reaction occurs, various devices are available. Requires strict control,
It was expensive.

Further, the conventional method of analyzing the reaction of the viewer by measuring the audience rating of a moving image such as a program or a commercial broadcast on television is based on the viewing information at the absolute time of the moving image. However, since the viewing information is collected over the telephone line and during the viewing time, if the number of viewers is too large, the same phone call will be applied. The number of incoming calls concentrates on the number, the possibility of congestion of the telephone line increases, and it is difficult to collect viewing information from a large number of viewers of several thousand or more, and the number of samples is limited.

Further, in the past, MPEG (Moving Pictu)
In the compression coding standard for moving images such as re Experts Group), CSCW (Computer Supported Cooperative Work) is a collaborative work by a group that uses computers to write the same content from multiple terminals.
However, it does not mention the method of integrating the information collected by distributing the same content.

The present invention has been made in view of the above points,
An object of the present invention is to provide a reaction analysis system of moving image information that can easily collect and analyze reaction data of a plurality of clients of moving image information of the same moving image file without strict control.

[0008]

In order to achieve the above object, the present invention provides a system in which one server is connected to a plurality of clients via a network, in which the server transfers content data of a moving image file to a plurality of clients. Delivery means for delivering via the network to the, and sent from multiple clients over the network,
Receiving the identification information of the distributed video file and reaction data related to the time axis, and integrating the reaction data by associating the reaction data for each video file on the time axis, and a plurality of integrated means integrated by the integration means. And an analysis unit for analyzing reaction data from the client, each of the plurality of clients receiving the content data of the moving image file from the server via the network, and reproducing the received content data of the moving image file. However, the input means for inputting reaction data in relation to the playback time axis, and the reaction data input by the input means, which is associated with the time axis during playback of the video file,
The identification information of the distributed moving image file and a transmission unit for transmitting the identification information to the server via the network are provided.

According to the present invention, the server collects reaction data corresponding to the content data of the moving image file distributed to a plurality of clients from each client, and the reaction data is integrated in association with the time axis during the reproduction of the content data. Since the integrated reaction data group is analyzed, it is possible to collect the reaction data input from each client by reproducing the content data at each client's own arbitrary time.

Further, in order to achieve the above object, the present invention separates the transmission means of the client from the content data of the received moving image file and transmits only the reaction data and the identification information of the moving image file to the server. Characterize. In this invention, the client
Although the distributed content data can be integrated with the reaction data and the identification information, only the reaction data and the identification information are transmitted, and the content data is not transmitted. Here, the above-mentioned reaction data may be information of a key operation indicating an arbitrary or set keyword or a preset reaction pattern.

[0011]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Next, embodiments of the present invention will be described with reference to the drawings. FIG. 1 shows a system configuration diagram of an embodiment of a reaction analysis system of moving image information according to the present invention. The reaction analysis system according to the present embodiment includes a client 10 that transmits reaction data of moving image information, a server 20 that distributes moving image information and analyzes and displays reaction data,
It is generally constituted by the Internet 30 connecting the client 10 and the server 20. Client 1
Although there are many 0s, only one is shown as a representative in FIG. 1 for convenience of illustration.

The client 10 is the Internet 30.
A terminal that downloads moving image information (also called moving image content data) of a moving image file distributed from the server 20 via the download wizard 11 and decodes and reproduces the moving image information by the moving image decoder 12. Also, the client 10 reproduces the decoded moving image signal by the moving image and the object reproducing function 13 of the plug-in AEG (Active Echo Gathering), and also the reaction data associated with the time axis at the time of reproducing the distributed moving image file. , The server 20 via the Internet 30 by the upload wizard 14 together with the identification information of the distributed video file.
Return to. Note that AEG refers to the system according to the present invention.

The server 20 uses the moving picture encoder 21 to convert the moving picture information of the original content into, for example, MPEG4.
The encoded data is generated according to the standard. Further, the server 20 has an AEG setting wizard 22, and distributes the encoded moving image information to a large number of clients 10 via the Internet 30 by the moving image and object distribution function 23 of the plug-in AEG.

The AEG setting wizard 22 defines attributes such as an image file to be surveyed and a storage location of reaction data, and defines a survey method. That is, the "reaction pattern definition" and the "measurement rule setting" are determined by the operator on the server side selecting from the types and formulas prepared in advance or independently defining them. Also, AEG setting wizard 2
2 selects and decides the layout of the screen displayed on the client of the surveyee, determines other necessary survey conditions, and sets various parameters of the execution program based on these selections Prepare for delivery.

In addition, the server 20 converts a large number of reaction data and identification information of a moving image file, which are reconstructed from a large number of clients 10 via the Internet 30, by a data converter 24, and uses an analyzer 25 to convert them. Integrate by relating by axis, analyze collective reaction to video files,
evaluate.

Next, the operation of the client 10 will be described in more detail with reference to FIG. The client 10 decodes the moving image information (moving image content data) of the moving image file distributed from the server 20 via the Internet 30 with the moving image decoder 12 and reproduces the moving image signal from the target file of FIG. It is displayed on the selection directory display screen (step 41).

When the viewer selects an arbitrary target file from the target file selection directory display screen, the screen of the client 10 includes the definition of the reaction pattern of the target file, the measurement rule, the feedback method, and the like. The screen is switched to the operation explanation screen (step 42). The method of feedback is to display an explanation about notifying the viewer of the measured result as information or saying thank you for the cooperation (for example, giving a telephone card as a gift).

When the viewer accepts the contents displayed on the operation explanation screen and presses the OK button, the server 20 subsequently activates the media player and AEG.
The viewer is started and the target file is downloaded OC
The object reproduction function 13 of the moving image and the plug-in AEG is activated by X (step 43).

As a result, the screen 44 of the client 10
On the screen, a moving image display 44a of the target file distributed from the server 20 and selected from the moving image files, a reaction input status display 44b, and a display 44c of measurement rules and the like are displayed. Based on this screen 44, the viewer can display a moving image 44a.
The keyboard buffer is monitored whether or not a key input has been made in the scene in which the user's interest is shown (steps 45 and 46), and when the key input is made, a moving image display 44a at the time of key input is displayed.
The elapsed time value from the first display time of the moving image and the input flag are stored or written (step 47).

Subsequently, when all the storage or writing of the time value and the input flag is completed, the viewer confirms the state of the key input (step 48). If the key input based on the screen 44 is redone and the state of the key input is OK,
Using the upload wizard 14, the reaction data composed of the above-mentioned time value stored or written and the input flag is stored on the Internet 30 together with the identification information of the moving image file.
Upload to server 20 via (step 4
9).

Here, in the above-mentioned upload, only the reaction data and the identification information of the moving image file are performed. This will be described with reference to FIGS. 3 to 6. The moving picture information of the distributed moving picture file is compressed and encoded according to the MPEG4 standard. As shown in FIG. 3, the above-mentioned moving image information is M as an element data group of a moving image associated with a common time axis together with background video, audio information, data, and the like.
It is compressed and encoded according to PEG4, distributed to the client 10, and decoded and reproduced by the client 10.

As described in step 45 of FIG. 2, the viewer of the client 10 inputs a reaction value at the moment of displaying a scene of interest, as shown in FIG. 4, as shown in FIG. To do. This response data is generally entered as a proportional or qualitative measure that corresponds to the time axis and is a dimension perpendicular to the time value. In MPEG4, the reaction data added to the first distributed moving image data group is shown in FIG.
As shown in (1), they are related to each other with respect to the time axis and can be integrated as an integrated content. However, the encoder is expensive, and it is inefficient to encode and communicate the entire image data.

Therefore, in the present embodiment, as shown in FIG. 6, the reaction data 50 and the identification information of the moving picture file are separated from the first distributed moving picture data group, transmitted to the server 20, and totaled, Enables communication with a small load. The reaction data 50 is composed of the relative time and the reaction value 52, and is uploaded to the server together with the file ID and the file attribute 51 which are the identification information of the moving image file. The relative time is the time from the first display time of the file when the reaction value is input at the moment when the client (viewer) is interested in the scene display.

As described above, the client 10 reproduces the received moving image content data such as commercial information, movie information, program information (first distributed moving image data group) at its own desired time, and inputs reaction data. . After the playback of the video content data, the reaction data is separated from the video content data (the first video data group delivered),
It transmits to the server 20 via the internet 30 with the moving image file identification information.

Since the reaction data is the reaction input at the relative time from the reproduction start time of the moving image content, it is not necessary for all the clients to reproduce the same time at the same time.
It can be played back at any time for each client.
Therefore, there is no congestion of the line when uploading reaction data of a large number of clients, and reaction data can be easily collected from a large number of clients as compared with the conventional case.
Further, since the reaction data is transmitted and the content data is not transmitted, communication with a small load is possible.

The server 20 analyzes reaction data collected from a large number of clients 10 via the Internet 30 with the analyzer 25 and displays the analysis result. Next, the processing of the analyzer 25 will be described in more detail with reference to FIG. When a moving image file is displayed on the target file selection directory display screen of the server 20 (step 61) and an arbitrary target file is selected from the target file selection directory display screen,
The screen of the server 20 is switched to the operation explanation screen including the definition of the reaction pattern of the target file, the measurement rule, the feedback method, etc. (step 6).
2).

When the server accepts the contents of the display and presses the OK button, the screen is switched to the analysis setting screen for designating the editing of the counting unit and selecting the analysis (display) type for the data type (step 63). ), When the designation and selection are performed, the screen is switched to the analysis reproduction screen (step 64). This analysis playback screen includes a moving image display area 64a of the selected target file, a real-time indicator area 64b, an analysis graph display area 64c, a play button 64d, a fast forward button 64e, and a rewind button 6.
4f, a stop button 64g, a print button 64h, a whole area display button 64i, and a rear display button 64j. The analysis graph 64c shows a graph of the analysis result. The moving image itself, which is the content, is displayed in the moving image display area 64a.

The whole area display button 64i and the rear display button 64j are used for the analysis graph display area 64c at the bottom of the screen.
Button for selecting the display format in the case of the whole area display button 64i, that is, 10
If it is a video of minutes, the reaction value is displayed on a scale from 0 minutes 0 seconds to 10 minutes 0 seconds. The current relative time is displayed by changing the color or moving the indicator. By the way, all the graphs shown in each display example described later are represented by this whole area display.

On the other hand, the rear display button 64j displays only the transition of the reaction data up to the current relative time. Speaking of each display example described later, "current time ▼"
It means that the right side (that is, the future side) of the place indicated by is not displayed. Such a display format is selected in consideration of preventing future analysts from contacting the reaction to the content by displaying the data on the future side.

Next, it is judged whether the analysis of the target file is completed (step 65), and if it is not completed, the screen is switched to the analysis setting screen again (step 63),
If it is finished, the process is finished. In this embodiment, the server 20 distributes the original moving image content data to a large number of clients 10 and inputs them as independent contents from the clients (viewers) 10 based on the time axis that maintains the sameness. -Collect, combine, integrate, and analyze only the integrated difference data (reaction data).

Next, the analysis method and examples of the display will be described in more detail. The first analysis method is a method in which, for each set period (for example, 1 minute), the number of reactions that occurred during that period is totaled and displayed for each period. In this first analysis method, when each client (viewer) 10 is a subject, as shown in the reaction pattern of the client (viewer) 10 in 71a of FIG. The reaction procedure in is shown. The test subject's reaction operation is limited to once within the same set period.

Further, on the real-time indicator 64b of FIG. 7, as shown by 72a in FIG. 8, the total number of reactions during the set period is displayed in the form of a bar graph for each set period. Further, the analysis graph 64c in FIG. 7 shows 73a in FIG.
As shown in, a bar graph of the total number of reactions for each set period from the past to the present is displayed. The first analysis method is a simple analysis method that is most intuitively understandable when the number of clients is large. This is an effective analysis method for actual measurement after viewing several times, such as measurement by the public and selection of popular scenes by voting once.

The second analysis method is to count the number of reactions in the set period (for example, 1 minute) preceding the present time,
This is a method of displaying the current coordinates. In this second analysis method, the client (viewer) is shown in 71b of FIG.
As shown schematically in the reaction pattern 10 of FIG. 10, when each client (viewer) 10 is a subject, the reaction operation of the subject on the moving image time axis is shown. The test subject's reaction operation is limited to once within the same set period.

Further, the real-time indicator 64b of FIG. 7 displays the total number of reactions in the set period preceding the present time, as indicated by 72b in FIG. For this display, all reaction data is collected and aggregated in advance from all of the clients 10. Even if the set time is 1 minute, for example, the display is continuously set every 1 second from the current time point. The total number of reactions during the period is displayed. For example, the number of reactions for a set period of 1 minute from 10: 10: 0 to 10: 11: 0 seconds is displayed at 10: 10: 0, and from 10: 10: 1 to 10: 11: 1 The number of reactions for a set period of 1 minute is displayed at 10: 10: 1.

Furthermore, the analysis graph 64c of FIG.
As indicated by 73b, a rough rough summary of the total number of reactions in the set period preceding the present time point from the past to the present time is displayed. In the second analysis method, when it is assumed that the reaction operation is delayed with respect to the moving image on the actual screen,
It has the effect of correcting the delay. Expressively, it has the feature that continuous measurement values can be obtained. This second analysis method is a preferable method for analyzing an object to be measured immediately after one viewing.

The third analysis method is a method of analyzing and displaying the cumulative value of the number of reactions up to the present time. In the third analysis method, the client (viewer) is shown at 71c in FIG.
As shown schematically in the reaction pattern 10 of FIG. 10, when each client (viewer) 10 is a subject, the reaction operation of the subject on the moving image time axis is shown. The test subject's reaction operation is limited to once within the same set period.

Further, the real-time indicator 64b in FIG. 7 displays the number of incremental reactions at the present time in the form of a bar graph, as indicated by 72c in FIG. Furthermore, FIG.
In the analysis graph 64c, the cumulative value of the total number of reactions up to the present time is displayed as a graph, as indicated by 73c in FIG. This third analysis method is suitable for grasping the degree of a receptive attitude such as a commercial film as the time required and the speed of attitude formation, and the degree of speed of attitude determination with respect to the measurement by the public is measured ( It is an effective analytical method for measuring approval, approval, satisfaction, etc.).

The fourth analysis method is a method in which the reaction operation is not restricted, the set reactions are repeated indefinitely, and the frequency is measured and displayed within the set period. In the fourth analysis method, the client (viewer) 1 is added to 71d in FIG.
As schematically shown by the reaction pattern of 0, when each client (viewer) is a subject, the reaction operation of the subject on the moving image time axis is shown. The fourth analysis method is similar to the first analysis method in that the number of reactions for each set time is displayed, but the reaction operation of the subject is 1 in the same set period in the first analysis method. In contrast to the limited number of reactions, this fourth analysis method is different in that the number of reactions in the set time is unlimited.

Further, as shown by 72d in FIG. 11, the real-time indicator 64b of FIG. 7 displays, for each set period, the total number of reactions during that period in the form of a bar graph. Furthermore, the analysis graph 64c of FIG.
As shown by d, a bar graph of the total number of reactions for each set period from the past to the present is displayed.

In the fourth analysis method, since there is no constraint on the number of reaction operations, the subject can participate without being nervous, the reaction when he / she is excited appears strongly, and the variation of the reaction is likely to occur. There is a feature of. In addition, although the fourth analysis method has a problem that the reaction frequency is not rigorous (the reaction of the same person may be counted as duplication), the reaction is expanded and grasped by selecting popular scenes. This is an effective analytical method when you want to.

The fifth analysis method is a method of analyzing and displaying the cumulative value of the number of reactions up to the present time. In the fifth analysis method, the client (viewer) is shown at 71e in FIG.
As shown schematically in the reaction pattern 10 of FIG. 10, when each client 10 is a subject, the reaction operation of the subject on the moving image time axis is shown. The fifth analysis method is an analysis method in which the third analysis method is repeated a plurality of times.

In the fifth analysis method, the real-time indicator 64b of FIG. 7 shows a bar graph of the cumulative value of the number of reactions up to the present time for each set period (for example, 1 minute), as shown by 72e in FIG. It is displayed in the shape of. Furthermore,
In the analysis graph 64c of FIG. 7, as shown by 73e in FIG. 12, a cumulative value of the total number of reactions up to the present time is displayed in a graph for each set period.

Like the third analysis method, this fifth analysis method is suitable for grasping the degree of a receptive attitude such as a commercial film as the time required and the speed of attitude formation, and is measured by the public. It is an effective analytical method when measuring the speed of attitude determination for a target (approval, approval, satisfaction, etc.).

Incidentally, as another aggregation / analysis method,
The client enters any or set keywords for the relative time value, the server merges the keywords from all clients to the relative time,
With the relative time value as the starting point, the direct display method that displays all of these keywords for a preset time, or the numeric key (the proportional scale) that the client indicates the degree of reaction is input, and the server For example, there is a method in which, for each client, interval estimation (extrapolation method, interpolation method) of the reaction degree value with respect to the relative time axis is totaled for all clients, and the absolute value or ratio is displayed.

[0045]

EXAMPLES Next, examples of the present invention will be described.
1st Example of this invention is the reaction analysis system of the moving image information which evaluates with respect to a moving image training program. In the first embodiment, the server records the lecture scenery of the lecturer as a moving image, and the information of the moving image (including sound) is MPEG4.
After compressing and encoding with, it is distributed to the client who is a student on the Internet, and the server sends the reaction data to the degree of the student's interest in the lecture and the degree of understanding (or not) of the lecture. Received data is collected, and the reaction data is linked to the video scene of the lecture scene and displayed. In this embodiment, the degree of understanding of the students is quantitatively displayed along the time axis of the lecture contents, which is a material for improving and improving the lecture contents.

Next, a second embodiment of the present invention will be described. The second embodiment of the present invention is a reaction analysis system of moving image information for evaluating a viewer with respect to a video work. In the second embodiment, the server distributes the video work to the client, the viewer, via the Internet, and the viewer shows the degree of excitement and the like to each scene of the distributed video work. This is an example of returning reaction data to a server via the Internet. In this embodiment, the server can quantitatively understand the degree of excitement and the likeness of each scene of the video work based on the reaction data in correspondence with the scene.

Next, a third embodiment of the present invention will be described. The third embodiment is a reaction analysis system of moving image information for evaluating a viewer with respect to a commercial (CM) film. In the third embodiment, the server distributes the moving image information (including audio) of the CM to the viewer who is the client via the Internet, and the viewer distributes the CM.
This is an example of replaying reaction data indicating the degree of excitement and the like for each scene of the moving image of the above to the server via the Internet.

In this embodiment, the server can systematically collect and analyze the reaction information in which the viewer specifically expresses the viewer's liking for the CM and the reaction when the product appears.

As another embodiment, there is an example of summarizing the public reaction to a specific image. In this embodiment, the server can aggregate comments from a client on a specific screen and display them efficiently.

The present invention is not limited to the above-described embodiments and examples, and may be distributed via, for example, an intranet, and distribution and concentration by a mobile phone such as i-mode is also possible. . Further, the reaction data may use sentences such as arbitrary short sentences and comments instead of arbitrary or set keywords. Furthermore, the compression encoding of moving images is not limited to MPEG4.

[0051]

As described above, according to the present invention,
The server correlates reaction data from multiple clients by associating it with the time axis during the content data reproduction, and analyzes the integrated reaction data group, so that each client reproduces the content data at its own arbitrary time. Since the server can collect the reaction data entered by each client, the reaction data input work of each client can be done at each client's favorite time, and at the same time using the conventional telephone line. Compared to the method that collects and analyzes reaction data, line congestion does not occur, so reaction data can be collected from a large number of clients compared to the conventional method, and it is possible to react, recognize, and evaluate moving images. Can be obtained more accurately and easily.

Further, according to the present invention, since the plurality of clients separates the client data from the server and sends only the reaction data and the identification information, communication with a small load is possible.

[Brief description of drawings]

FIG. 1 is a system configuration diagram of an embodiment of the present invention.

2 is an explanatory diagram of processing of a client in FIG. 1. FIG.

FIG. 3 is an explanatory diagram of an example of distributed moving image information.

FIG. 4 is a diagram illustrating the input of viewer reaction data with respect to distributed moving image information.

FIG. 5 is a diagram illustrating that reaction data and distributed moving image information can be integrated as an integrated content.

FIG. 6 is a diagram illustrating that the client sends only the reaction data and the identification information to the server according to the present invention.

FIG. 7 is an explanatory diagram of an example of analyzer processing of the client of the present invention.

FIG. 8 is a diagram showing a first example of display of measurement patterns, real-time indicators, and analysis graphs in the present invention.

FIG. 9 is a diagram showing a second example of display of measurement patterns, real-time indicators, and analysis graphs in the present invention.

FIG. 10 is a diagram showing a third example of display of measurement patterns, real-time indicators, and analysis graphs according to the present invention.

FIG. 11 is a diagram showing a fourth example of display of measurement patterns, real-time indicators, and analysis graphs according to the present invention.

FIG. 12 is a diagram showing a fifth example of the display of measurement patterns, real-time indicators, and analysis graphs of the present invention.

[Explanation of symbols]

10 Client 11 Download Wizard 12 Video Decoder 13 Video and Plug-in AEG Object Playback 14 Upload Wizard 20 Server 21 Video Encoder 22 AEG Setting Wizard 23 Video and Plug-in AEG Object Distribution Function 24 Data Converter 25 Analyzer 30 Internet

─────────────────────────────────────────────────── ─── Continuation of the front page (56) References Japanese National Publication No. 9-503636 (JP, A) International publication 00/28737 (WO, A1) (58) Fields investigated (Int.Cl. ⁷ , DB name) H04N 17/00 H04N 7/173 640

Claims (3)

(57) [Claims] 1. A system in which one server is connected to a plurality of clients via a network, wherein the server distributes content data of a moving image file to the plurality of clients via the network, Receiving the identification information of the distributed video file and the reaction data related to the time axis, which are transmitted from a plurality of clients via the network, and correlating the reaction data for each video file on the time axis. Integration means for integrating by means of, and analysis means for analyzing reaction data from the plurality of clients integrated by the integration means, wherein each of the plurality of clients includes the moving image from the server via the network. Receiving means for receiving file content data and before receiving An input unit for inputting the reaction data in association with a reproduction time axis while reproducing the content data of the video file, and a time axis for reproducing the video file input by the input unit. A reaction analysis system for moving picture information, comprising: a transmission unit that transmits the reaction data together with the identification information of the distributed moving picture file to the server via the network. 2. The transmitting means of the client separates from the received content data of the moving image file and transmits only the reaction data and identification information of the moving image file to the server. Reaction analysis system for the described video information. 3. The reaction of moving image information according to claim 1, wherein the reaction data is information of a key operation indicating an arbitrary or set keyword or sentence, or a preset reaction pattern. Analysis system.