JP2013157871A - Information processing device, program, information processing method and regenerating method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To facilitate video retrieval based on an imaging time.SOLUTION: An information processing device 100 includes: an analysis unit 104 for analyzing video data to identify a section in which continuous imaging is performed with one frame rate to identify an imaging time and one of the frame rate and a reproduction time in the section; a conversion information creating unit 107 for creating conversion information including the identified information; a converting unit 103 for converting the video data into digital information having a predetermined format; a program storing unit 108 for storing an imaging time reproduction control program for reproducing video data having a reproduction time corresponding to the imaging time from the digital information by using the conversion information; a data layout unit 109 for generating content data containing the conversion information, the digital information and the imaging time reproduction control program; and a writing unit 110 for writing the content data to a portable storage medium.

Description

  The present invention relates to an information processing apparatus, a program, an information processing method, and a playback method.

In the past, there has been a technique for storing video data captured by a surveillance camera in a surveillance recorder in order to monitor buildings and public areas. At present, monitoring recorders mainly record video data in a large-capacity storage device fixed in the main body such as a hard disk (for example, see Patent Document 1).
When viewing the video of the captured video data, in addition to viewing it on a monitor connected to the surveillance recorder body, optical disks such as DVDs and Blu-ray Discs are used for submission to the police and reporting to owners and affiliated companies. There is a method in which video data is written to the PC and the video is viewed using a PC, a home disk player, or the like.

JP 2000-125256 A (paragraphs 0027 to 0041, FIG. 8)

  However, in the conventional method, when video data is written on an optical disc and the video of the written video data is viewed, a search based on the shooting time is performed at the time of playback due to discontinuous shooting, change in frame rate, etc. It was difficult to do. In this regard, in the case of collation with witness testimony, and record collation with other monitoring devices such as sensors, collation is performed based on the time at the time of photographing, so if searching based on the photographing time is not possible, Based on the time stamp recorded as a video, the user needs to fast forward and rewind to find the collation part.

  Also, when it is desired to switch the video at the same time to a video taken by another camera, it is necessary to repeat fast-forwarding and rewinding again.

  Therefore, the present invention is to solve the above-described problems, and an object of the present invention is to facilitate video search based on shooting time.

  The information processing apparatus according to one embodiment of the present invention identifies a section that is continuously captured at one frame rate by analyzing video data, and includes a shooting time, a frame rate, and a playback time of the section. An analysis unit that identifies at least one of them, a conversion information creation unit that creates conversion information including information identified by the analysis unit, a conversion unit that converts the video data into digital information of a predetermined format, A program storage unit for storing a shooting time reproduction control program for reproducing video data of a reproduction time corresponding to the shooting time from the digital information using the conversion information, the conversion information, the digital information, and the shooting time A data layout unit for generating content data including a playback control program, and writing the content data to a portable storage medium And to document output unit, characterized in that it comprises a.

  According to one embodiment of the present invention, video search based on shooting time can be easily performed.

It is a block diagram which shows roughly the structure of the authoring apparatus in Embodiment 1-4. 6 is a schematic diagram illustrating an example of conversion information in Embodiment 1. FIG. In Embodiment 1, it is the schematic which shows an example of the conversion information described by XML. FIG. 3 is a block diagram schematically showing a configuration of a playback device in the first and fourth embodiments. In Embodiment 1, it is a schematic diagram which shows the outline of the process in the process execution part when the user inputs the reproduction | regeneration instruction | indication which designated imaging | photography time to the input part. In Embodiment 1, it is the schematic which shows an example of the conversion information described in XML when a frame rate is abbreviate | omitted. In Embodiment 1, it is a schematic diagram which shows the outline of the process in the process execution part when the user inputs the reproduction | regeneration instruction | indication which designated imaging | photography time to the input part. In Embodiment 1, it is the schematic which shows the imaging | photography time when a user switches the image | video of three cameras. In Embodiment 1, it is the schematic which shows the reproduction time when a user switches the image | video of three cameras. 6 is a schematic diagram for explaining processing performed by a processing execution unit according to Embodiment 1. FIG. 10 is a schematic diagram illustrating an example of a four-divided divided screen in Embodiment 2. FIG. 10 is a schematic diagram illustrating an example of a nine-divided divided screen according to Embodiment 2. FIG.

Embodiment 1 FIG.
FIG. 1 is a block diagram schematically showing a configuration of an authoring apparatus 100 as an information processing apparatus in the first embodiment. The authoring apparatus 100 includes a condition input unit 101, a video data extraction unit 102, a conversion unit 103, an analysis unit 104, a conversion information creation unit 107, a program storage unit 108, a data layout unit 109, and a writing unit. 110. Reference numerals in parentheses in FIG. 1 indicate configurations in the fourth embodiment.

The condition input unit 101 receives an input of video data conditions to be extracted from the operator 130. For example, the conditions for receiving an input are a camera name, a shooting time, a shooting time, and the like of a camera as an imaging device.
The video data extraction unit 102 extracts video data from a monitoring video database 131 serving as a video data storage unit that stores video data, in accordance with a condition that the condition input unit 101 has received an input. Here, in the present invention, it is assumed that video data captured by a monitoring recorder equipped with a camera is stored in the monitoring video database 131. The surveillance recorder finely controls the start and end of photographing, the frame rate, and the like by input from a timer and a sensor. Then, it is assumed that the video data stored in the monitoring video database 131 is added with shooting time information as metadata for each frame.
The conversion unit 103 generates digital information by converting the video data extracted by the video data extraction unit 102 into a predetermined format. Here, the predetermined format is a format in accordance with the standard of the content written out by the writing unit 110.

The analysis unit 104 analyzes the video data extracted by the video data extraction unit 102, thereby specifying the shooting time, the frame rate, and the playback time of a section continuously shot at a constant frame rate. The analysis unit 104 includes a frame rate determination unit 105 and a continuous section determination unit 106.
The frame rate determination unit 105 calculates the frame rate by detecting the shooting time for each frame included in the metadata of the video data and calculating the frame shooting interval. If the frame rate is recorded with the video, this value is taken out and used.
The continuous section discriminating unit 106 discriminates a video continuous section that is a section in which video is continuously shot at one frame rate from the video data extracted by the video data extracting unit 102, and determines the video continuous section. Specify the shooting time and playback time. For example, sections in the video data where the shooting interval is constant can be regarded as the same video continuous section. Therefore, the continuous section determination unit 106 sets a portion where the frame of the video is interrupted for a predetermined period or a portion where the frame rate is changed as a break of the video continuous section. Then, the continuous segment determination unit 106 specifies the start point and end point of the shooting time and the start point and end point of the reproduction time in each video continuous segment.

The conversion information creation unit 107 calculates the shooting time and / or information on at least one of the frame rate and the reproduction time based on the condition received by the condition input unit 101 and the analysis result analyzed by the analysis unit 104. Create conversion information including. FIG. 2 is a schematic diagram illustrating an example of the conversion information 140. The conversion information 140 includes a camera column 140a, a video continuous section column 140b, a shooting start time column 140c, a shooting end time column 140d, a frame rate column 140e, a playback start time column 140f, and a playback end time column 140g. Information in a table format.
The camera column 140a stores camera identification information for identifying each camera that captured the video data extracted by the video data extraction unit 102.
The video continuous section column 140b stores section identification information for identifying each continuous video section of video data captured by the camera identified by the camera column 140a.
The shooting start time column 140c stores the shooting start time of the video continuous section identified by the video continuous section column 140b.
The shooting end time column 140d stores the shooting end time of the video continuous section identified by the video continuous section column 140b.
The frame rate column 140e stores the frame rate at the time of shooting in the video continuous section identified by the video continuous section column 140b.
The reproduction start time column 140f stores a reproduction start time when reproducing the video data of the video continuous section identified by the video continuous section column 140b.
The reproduction end time column 140g stores the reproduction end time when reproducing the video data of the video continuous section identified by the video continuous section column 140b.

  Normally, when handling data in a program, it is often used after being converted into a format that can be handled easily by the program. Here, FIG. 3 is a schematic diagram showing conversion information 140 # 1 described in XML which is an example of conversion information.

  Using the conversion information 140, the program storage unit 108 stores a shooting time playback control program for playing back video data having a playback time corresponding to the shooting time from digital information. Here, the data written on the portable storage medium such as an optical disk is reproduced by, for example, a home player. In Blu-ray Disc, a Java (registered trademark) execution environment called BD-J is prepared, and advanced functions can be realized. Here, it is assumed that the shooting time reproduction control program is a program executed in the BD-J, for example.

The data layout unit 109 combines the digital information generated by the conversion unit 103, the conversion information 140 generated by the conversion information creation unit 107, and the shooting time reproduction control program stored in the program storage unit 108. In addition to laying out according to the content standard written out by the writing unit 110, consistency is obtained by adding necessary metadata, and content data is generated.
The writing unit 110 writes the content data generated by the data layout unit 109 to a portable storage medium such as the optical disk 132. Therefore, in the portable storage medium, digital information for reproducing the captured video data, a shooting time of a section continuously shot at one frame rate in this digital information, a frame rate and Content data including conversion information including at least one information of the reproduction time and a photographing time reproduction control program for reproducing the video data of the reproduction time corresponding to the photographing time from the digital information is stored.

The authoring apparatus 100 described above includes, for example, a CPU (Central Processing Unit), a memory, an external storage device such as an HDD (Hard Disk Drive), a BD (Blu-ray Disk: registered trademark), and a DVD (Digital). A reading / writing device for reading and writing information from / to a portable storage medium such as Versatile Disk, an input device such as a keyboard and a mouse, an output device such as a display, and a NIC (Network Interface) for connection to a communication network And a communication device such as Card).
For example, the program storage unit 108 can be realized by the CPU using a memory or an external storage device. The video data extraction unit 102, the conversion unit 103, the analysis unit 104, the conversion information creation unit 107, and the data layout unit 109 This can be realized by loading a predetermined program stored in the storage device into the memory and executing it by the CPU, and the condition input unit 101 can be realized by the CPU using the input device. The monitoring video database 131 may be realized by the CPU using a memory or an external storage device, and the CPU is connected to the external monitoring video database 131 using a communication device or other interface. Also good. The writing unit 110 can be realized by the CPU 901 using a reading / writing device.
The predetermined program is downloaded from the storage medium via the read / write device or from the network via the communication device to the external storage device, and then loaded onto the memory and executed by the CPU. May be. Alternatively, the program may be loaded directly from the storage medium via the reading / writing device or from the network via the communication device onto the memory and executed by the CPU.

  FIG. 4 is a block diagram schematically showing the configuration of the playback device 150 in the first embodiment. The playback device 150 includes an input unit 151, a UI control unit 152, a reading unit 153, a process execution unit 154, and a playback processing unit 155. Reference numerals in parentheses in FIG. 4 indicate configurations in the fourth embodiment.

The input unit 151 receives an operation input by a user. For example, the input unit 151 can be configured with a remote controller, operation buttons, and the like.
The UI control unit 152 controls the input unit 151 to give an instruction corresponding to an operation from the user to each unit of the playback device 150.
The reading unit 153 reads content data from a portable storage medium such as an optical disk.
The process execution unit 154 executes a shooting time reproduction control program included in the content data read by the reading unit 153 to perform shooting time reproduction control. Note that the process execution unit 154 provides, for example, a BD-J execution environment.

The reproduction processing unit 155 performs processing for reproducing video data based on digital information and metadata included in the content data read by the reading unit 153 in response to an instruction from the processing execution unit 154. The reproduction processing unit 155 includes a reproduction control unit 156, a presentation control unit 157, a decoder unit 158, and a screen synthesis unit 159.
The reproduction control unit 156 controls processing for reproducing video data based on digital information and metadata included in the content data read by the reading unit 153.
The presentation control unit 157 generates image data such as character information and a user interface based on metadata or the like included in the content data.
The decoder unit 158 generates video data by decoding the digital information included in the content data read by the reading unit 153.
The screen combining unit 159 generates screen information by combining the video data generated by the decoder unit 158 and the image data generated by the presentation control unit 157, and displays the generated screen information. Output to the unit 170. The display unit 170 displays a screen based on the input screen information.

The playback device 150 described above includes, for example, a CPU, a memory, an external storage device such as an HDD, a read / write device that reads and writes information from and on a portable storage medium such as a CD and a DVD, and a keyboard. And a general computer including an input device such as a mouse and an output device such as a display.
For example, the UI control unit 152, the processing execution unit 154, and the reproduction processing unit 155 can be realized by loading a predetermined program stored in an external storage device and a portable storage medium into a memory and executing it by the CPU. The unit 151 can be realized by using the input device by the CPU, the display unit 170 can be realized by using the output device by the CPU, and the reading unit 153 can be realized by using the reading / writing device by the CPU. realizable.
The predetermined program is downloaded from the storage medium via the read / write device or from the network via the communication device to the external storage device, and then loaded onto the memory and executed by the CPU. May be. Alternatively, the program may be directly loaded onto a memory from a portable storage medium via a reading / writing device or from a network via a communication device and executed by a CPU.

Hereinafter, shooting time reproduction control performed by the processing execution unit 154 of the reproduction apparatus 150 will be described.
FIG. 5 is a schematic diagram showing an outline of processing in the processing execution unit 154 when the user inputs a reproduction instruction specifying the shooting time to the input unit 151. FIG. 5 shows a case where the photographing time is discontinuous. In FIG. 5, it is assumed that the frame rate at the time of shooting is always constant and is the same as the frame rate at the time of reproduction.

As shown in FIG. 5, the first video continuous section is 35 minutes from 4:20 at time A to 4:55 at time B. This section becomes a video from 0 minute (0:00) which is the head of time a to 35 minutes (0:35) of time b at the time of reproduction.
The second video continuous period is from 5:25 at time C to 5:55 at time D. This section becomes a video from 35 minutes (0:35) at time b to 1 hour 5 minutes (1:05) at time c during reproduction.

  In the example shown in FIG. 5, in the first video continuous section, time A is the shooting start time, time B is the shooting end time, time a is the playback start time, and time b is the playback end time. Stored in In the second video continuous section, time C is stored in the conversion information as shooting start time, time D is shooting end time, time b is playback start time, and time c is playback end time. The frame rate is, for example, 30 ms, which is the same as that during reproduction.

If the user wants to start playback from 5:30 of the shooting time during playback of this video, the user inputs an operation to start playback from 5:30 via the input unit 151. Upon receiving such an operation input, the UI control unit 152 gives an instruction to reproduce from 5:30 to the process execution unit 154. Upon receiving such an instruction, the process execution unit 154 refers to the conversion information 140 and calculates that the shooting time 5:30 is a position 5 minutes from the beginning of the second video continuous section. At the time of reproduction, it is calculated that the position is 5 minutes from the head of the second video continuous section, that is, 40 minutes from the head of the whole. Then, the process execution unit 154 instructs the reproduction control unit 156 to reproduce the position for 40 minutes from the beginning.
Receiving such an instruction, the reproduction control unit 156 causes the reading unit 153 to read the digital information corresponding to the position of 40 minutes from the beginning, and gives the read digital information to the decoder unit 158.
As described above, in this embodiment, it is possible to perform a search using the time at the time of shooting.

  If there is no camera change as in the example shown in FIG. 5, it is not necessary to provide the camera column 140a in the conversion information 140 shown in FIG. If the frame rate is not changed, the frame rate column 140e can be omitted in the conversion information 140 shown in FIG. FIG. 6 is a schematic diagram showing conversion information 140 # 2 described in XML, which is an example of conversion information when the frame rate is omitted.

Embodiment 2. FIG.
Next, a case where there are sections with different frame rates during shooting will be described. Here, the playback frame rate is 30 fps.
The authoring device 100 and the playback device 150 in the second embodiment are configured in the same manner as in the first embodiment.

FIG. 7 is a schematic diagram showing an outline of processing in the processing execution unit 154 when a user inputs a reproduction instruction specifying a shooting time to the input unit 151.
In the example of FIG. 7, in the first video continuous section, the shooting start time is 1: 10: 0 of time A, and the shooting end time is 1: 40: 0 of time B, which is 30 minutes. Is taken at 30 fps. The first video continuous section is a 30-minute video from 0 minute 0 seconds as the playback start time to 30 minutes 0 seconds as the playback end time during playback.
In the second video continuous section, the shooting start time is 1: 40: 00: 00 of time B, the shooting end time is 5: 40: 0 of time C, and these 4 hours are shot at 1 fps. ing. Then, the second video continuous section is an 8-minute video from playback time 30 minutes 0 seconds to playback end time 38 minutes 0 seconds during playback. In this section, video shot at 1 fps is played back at 30 fps, so the playback time is 1 / 30th of the shooting time.
The AB section and the BC section are continuous in time, but are different video continuous sections because of different frame rates.

If the user wants to start playback from 3:40 of the shooting time during playback of this video, the user inputs an operation to start playback from 3:40 via the input unit 151. Upon receiving such an operation input, the UI control unit 152 gives an instruction to play back from 3:40 to the process execution unit 154. Upon receiving such an instruction, the process execution unit 154 refers to the conversion information 140, and the shooting time of 3:40 is 2 hours and 0 minutes after the beginning of the second video continuous section. Is identified. Then, the 2 hours from the beginning of the second video continuous section is 4 minutes according to the following equation (1) when the playback time is set.
2 hours × (time c−time b) ÷ (time C−time B) (1)
Since the playback start time in the second video continuous section is 30 minutes 0 seconds of time b, the process execution unit 154 specifies 34 minutes as the playback time corresponding to the shooting time of 3:40. Then, the process execution unit 154 instructs the reproduction control unit 156 to reproduce the position 34 minutes from the beginning.
Receiving such an instruction, the reproduction control unit 156 causes the reading unit 153 to read the digital information corresponding to the position 34 minutes from the beginning, and gives the read digital information to the decoder unit 158.
In this way, in the second embodiment, it is possible to perform a search using the time at the time of shooting even if the frame rates are different.

ここで、ｔは、利用者から指示された撮影時刻に対応する再生時間である。Ｔ_ｕは、利用者から指示された撮影時刻である。ｔ_ｉｓは、利用者から指示された撮影時刻が含まれる映像連続区間の再生開始時間である。ｔ_ｉｅは、利用者から指示された撮影時刻が含まれる映像連続区間の再生終了時間である。Ｔ_ｉｓは、利用者から指示された撮影時刻が含まれる映像連続区間の撮影開始時刻である。Ｔ_ｉｅは、利用者から指示された撮影時刻が含まれる映像連続区間の撮影終了時刻である。
また、利用者から指示された撮影時刻が含まれる映像連続区間の撮影時のフレームレートをＦ_ｉ、再生時のフレームレートをｆとすると、実施の形態２における、利用者から指示された撮影時刻に対応する再生時間の算出は、例えば、下記の（３）式により行うこともできる。

In the second embodiment, the reproduction time corresponding to the photographing time instructed by the user can be calculated by the following equation (2), for example.

Here, t is a reproduction time corresponding to the photographing time instructed by the user. _Tu is the shooting time instructed by the user. tis _is the playback start time of the video continuous section including the shooting time instructed by the user. “ _tie” is a reproduction end time of the video continuous section including the photographing time instructed by the user. Tis _is the shooting start time of the video continuous section including the shooting time instructed by the user. _Tie is the shooting end time of the video continuous section including the shooting time instructed by the user.
Further, assuming that the frame rate at the time of shooting in the video continuous section including the shooting time instructed by the user is F _i and the frame rate at the time of reproduction is f, the shooting time instructed by the user in the second embodiment. The reproduction time corresponding to can also be calculated by the following equation (3), for example.

  Since the frame rate can be calculated from the shooting time and the reproduction time, the frame rate column 140e can be omitted in the conversion information 140 shown in FIG. Further, since the playback time can also be calculated from the shooting time and the frame rate, in the conversion information 140 shown in FIG. 2, one of the playback start time column 140f and the playback end time column 140g is omitted. Is possible.

Embodiment 3 FIG.
Next, a case will be described in which videos of video data shot by a plurality of cameras are switched at the same time.
The authoring device 100 and the playback device 150 in the third embodiment are configured in the same manner as in the first embodiment.

  FIGS. 8 to 10 are schematic diagrams illustrating an outline of processing in the processing execution unit 154 when the user inputs an operation of switching cameras during video playback via the input unit 151. 8 to 10 show an example in which the images of the three surveillance cameras are reproduced while being switched.

  FIG. 8 is a schematic diagram showing the shooting time when the user switches the images of the three cameras Ch1, Ch2, and Ch3. Each camera changes its operation mode according to time and sensor. In the example shown in FIG. 8, the video of the Ch1 camera is switched to the video of the Ch2 camera at 6:00:00 (switch A) and the video of the Ch2 camera at 7:30 by the user's operation. Is switched to the video of the camera of Ch1 (switch B), and the video of the camera of Ch1 is switched to the video of the camera of Ch3 at 23:00:00 (switch C).

  FIG. 9 is a schematic diagram showing the playback time when the user switches the images of the three cameras Ch1, Ch2, and Ch3. Due to changes in frame rate, shooting pause time, etc., it is difficult to easily correspond to shooting time. For example, in the switching A in FIG. 8, the reproduction time of Ch1 is 12 minutes and the reproduction time of Ch2 is 1 hour 40 minutes. In the switching B, the playback time of Ch2 is 2 hours and 0 minutes, and the playback time of Ch1 is 44 minutes. In the switching C, the reproduction time of Ch1 is 10 hours and 27 minutes, and the reproduction time of Ch3 is 15 minutes.

ここで、Ｔは、利用者が切り替えを行った再生時間に対応する撮影時刻である。ｔ_ｕは、利用者が切り替えを行った再生時間である。
次に、処理実行部１５４は、（４）式又は（５）式で算出された撮影時刻に対応する、切替先のカメラの映像における再生時間を、上記の（２）式又は（３）式で算出する。ここでは、（４）式又は（５）式で算出された撮影時刻がＴ_ｕとなる。換算情報１４０により、撮影時刻６時０分は、Ｃｈ２における再生時間１時間４０分に対応する。このため、処理実行部１５４は、Ｃｈ２の映像データの先頭から１時間４０分の位置を再生するように再生制御部１５６に指示を出す。
同様に、利用者が、Ｃｈ２のカメラの映像の再生時間２時間０分に、Ｃｈ１のカメラの映像に切り替える操作を行った場合には、処理実行部１５４は、換算情報１４０を参照して、Ｃｈ２のカメラの映像の再生時間２時間０分が、撮影時刻７時３０分に対応することを算出する。そして、処理実行部１５４は、換算情報１４０を参照することにより、撮影時刻７時３０分は、Ｃｈ１における再生時間４４分に対応することを算出する。そして、処理実行部１５４は、Ｃｈ１の映像データの先頭から４４分の位置を再生するように再生制御部１５６に指示を出す。
また、利用者が、Ｃｈ１のカメラの映像の再生時間１０時間２７分に、Ｃｈ３のカメラの映像に切り替える操作を行った場合には、処理実行部１５４は、換算情報１４０を参照して、Ｃｈ１のカメラの映像の再生時間１０時間２７分が、撮影時刻２３時００分に対応することを算出する。そして、処理実行部１５４は、換算情報１４０を参照することにより、撮影時刻２３時００分は、Ｃｈ３における再生時間１５分に対応することを算出する。そして、処理実行部１５４は、Ｃｈ３の映像データの先頭から１５分の位置を再生するように再生制御部１５６に指示を出す。 Next, how the processing execution unit 154 processes the above switching A to C will be described with reference to FIG.
When the user performs an operation of switching to the video of the Ch2 camera within 12 minutes of the playback time of the video of the Ch1 camera, the process execution unit 154 refers to the conversion information 140 and refers to the video of the Ch1 camera. The reproduction time of 12 minutes corresponds to the shooting time of 6:00:00. This can be calculated by, for example, the following formula (4) or formula (5).

Here, T is a photographing time corresponding to the reproduction time when the user switches. t _u is the playback time when the user switched.
Next, the process execution unit 154 sets the reproduction time in the video of the switching destination camera corresponding to the shooting time calculated by the expression (4) or (5) to the above expression (2) or (3). Calculate with Here, the shooting time calculated by the equation (4) or (5) is _Tu . According to the conversion information 140, the shooting time of 6:00:00 corresponds to the playback time of 1 hour 40 minutes in Ch2. Therefore, the process execution unit 154 instructs the reproduction control unit 156 to reproduce the position of 1 hour and 40 minutes from the beginning of the video data of Ch2.
Similarly, when the user performs an operation of switching to the video of the Ch1 camera at the playback time of the video of the Ch2 camera at 2 hours and 0 minutes, the process execution unit 154 refers to the conversion information 140, It is calculated that the playback time 2 hours and 0 minutes of the Ch2 camera image corresponds to the shooting time 7:30. Then, the process execution unit 154 refers to the conversion information 140 to calculate that the shooting time of 7:30 corresponds to the playback time of 44 minutes in Ch1. Then, the process execution unit 154 instructs the reproduction control unit 156 to reproduce the position of 44 minutes from the beginning of the Ch1 video data.
In addition, when the user performs an operation of switching to the video of the Ch3 camera within the playback time of the video of the Ch1 camera, which is 10 hours and 27 minutes, the process execution unit 154 refers to the conversion information 140 and selects the Ch1. It is calculated that the video playback time of 10 hours and 27 minutes corresponds to the shooting time of 23:00. Then, the process execution unit 154 refers to the conversion information 140 to calculate that the photographing time 23:00 corresponds to the reproduction time 15 minutes in Ch3. Then, the process execution unit 154 instructs the reproduction control unit 156 to reproduce the position of 15 minutes from the beginning of the Ch3 video data.

  As described above, in video data shot discontinuously, it is complicated to switch the video at the same shooting time, but the conversion information 140 and the shooting time reproduction control program are recorded together with the video digital information. Therefore, it is possible to easily switch the video of the camera with the same shooting time.

  In the embodiment described above, one frame at the time of shooting corresponds to one frame at the time of reproduction. For this reason, when the frame rate at the time of shooting is low, an image is displayed like fast-forwarding at the time of reproduction. In order to prevent this, the data layout unit 109 can perform a frame complementation and adjust so that 1 second at the time of shooting corresponds to 1 second at the time of reproduction. In addition, it is possible to take a method of reducing unnaturalness by issuing a slow playback command from the shooting time playback control program according to the frame rate at the time of shooting without performing complementation.

Embodiment 4 FIG.
The fourth embodiment shows an example in which videos of video data shot by each camera are displayed together. Many commercial monitoring recorders have such a split screen display function, but Blu-ray players, which are home-use playback devices, usually do not have such a split screen display function. Therefore, in the case of realizing the same operability as that for business use, it is necessary to synthesize video data of a video corresponding to a divided screen in advance and hold it as a stream even in a home playback device.
As shown in FIG. 1, an authoring apparatus 400 according to the fourth embodiment includes a condition input unit 101, a video data extraction unit 102, a conversion unit 103, an analysis unit 104, a conversion information creation unit 107, and a program storage unit. 108, a data layout unit 409, and a writing unit 110. The authoring device 400 according to the fourth embodiment is different from the authoring device 100 according to the first embodiment in the processing in the data layout unit 409.

The data layout unit 409 synthesizes the digital information video generated by the conversion unit 103 to generate digital information of a divided screen in which the video captured by each camera is arranged at a predetermined position.
For example, FIG. 11 is an example of a four-divided divided screen, and FIG. 12 is an example of a nine-divided divided screen. For example, in the four-split screen shown in FIG. 11, video data captured by the Ch1 camera is arranged on the screen 1, and video data captured by the Ch2 camera is displayed on the screen 2. The video data image captured by the Ch3 camera is disposed on the screen 3, and the video data image captured by the Ch4 camera is disposed on the screen 4.
Here, the data layout unit 409 aligns the shooting times when synthesizing the images captured by the cameras.
In this embodiment, the frame rate of the video captured by each camera may be different, but the video data captured by each camera at this reference frame rate with a predetermined frame rate as the reference frame rate. Synthesize the video. For example, for video data having a frame rate lower than the reference frame rate, a new frame may be generated by complementation or the like, and a predetermined frame may be inserted for a missing frame. Here, the predetermined frame may be a single color frame such as blue and black. For video data having a frame rate lower than the reference frame rate, an extra frame may be deleted. The reference frame rate is preferably the highest frame rate among the frame rates of the video data to be synthesized.
Furthermore, in the present embodiment, the video data captured by each camera may be interrupted. In such a case, a predetermined frame is not used for a time slot when the image is not captured. Insert it. Here, the predetermined frame may be a single color frame such as blue and black.

  In addition, the data layout unit 409 adds, to the conversion information 140 generated by the conversion information generation unit 107, camera identification information, section identification information, shooting start time, shooting end time, frame rate, playback corresponding to the digital information of the divided screen. Stores the start time and playback end time.

Further, the data layout unit 409 generates information indicating which camera image is located at which position as metadata. Instead of generating such metadata, for example, the conversion information 140 # 1 in the XML format shown in FIG. 3 includes the number of effective channels (the number of playlists), the arrangement position on the divided screen, the arrangement position and the channel. It is also possible to add information indicating the correspondence with (camera).
The data layout unit 409 then stores the digital information generated by the conversion unit 103, the digital information of the split screen, the conversion information 140 generated and updated by the conversion information creation unit 107, and the program storage unit 108. In combination with the shooting time playback control program, the layout is performed according to the standard of the content written out by the writing unit 110, and consistency is obtained by adding necessary metadata to generate content data.

  As illustrated in FIG. 4, the playback device 450 in the fourth embodiment includes an input unit 151, a UI control unit 152, a reading unit 153, a process execution unit 454, and a playback processing unit 155. The playback device 450 in the fourth embodiment is different from the playback device 150 in the first embodiment in the processing in the processing execution unit 454.

  The process execution unit 454 executes a shooting time reproduction control program included in the content data read by the reading unit 153 to perform shooting time reproduction control. In the present embodiment, when a split screen is displayed on the display unit 170, the process execution unit 454 controls the presentation control unit 157 to display the split displayed via the input unit 151. On the screen, it is possible to select an area in which video data captured by each camera is placed. Then, when the user performs an input of an operation for selecting an area in which a video data image captured by the camera is arranged via the input unit 151, the processing execution unit 454 performs a reproduction time when the input is performed. The video of the video data of the selected camera is displayed on the display unit 170 based on the shooting time corresponding to. This process is the same as the process in the third embodiment.

  As described above, according to the fourth embodiment, the user of the playback device 450 can view the video data captured by each camera on a single screen, and can be enlarged on this screen. By selecting a video to be displayed, the video is enlarged and displayed on the display unit 170. Therefore, the newly added digital information for the split display screen is also switched to the video of another channel based on the shooting time as one of the channels, so that the split display screen and the individual screen can be freely set. It will be possible to switch. For this reason, even in a home playback device, it is possible to realize operability similar to the split display of a commercial monitoring recorder.

  In the above description, the data layout unit 409 generates metadata indicating information indicating which camera's video is located at which position. However, the data layout unit 409 uses a predetermined number of divisions to determine in advance. In the case where a predetermined camera image is arranged at a predetermined division position, it is not necessary to generate such metadata. In such a case, a predetermined number of divisions, division positions, and camera video arrangements may be incorporated into the shooting time reproduction control program.

  Note that each of the authoring device 400 and the playback device 450 in the fourth embodiment may be able to perform the processes performed by the authoring device 100 and the playback device 150 in the second or third embodiment.

  In the first to fourth embodiments described above, the monitoring video database 131 is provided outside the authoring devices 100 and 400, but may be provided inside the authoring devices 100 and 400.

  100: 400: Authoring device 101: Condition input unit 102: Video data extraction unit 103: Conversion unit 104: Analysis unit 105: Frame rate discrimination unit 106: Continuous segment discrimination unit 107: Conversion information creation unit 108: Program storage unit 109, 409: Data layout unit 110: Export unit 131: Monitoring video database 132: Storage medium 150, 450: Playback device 151: Input unit 152: UI control unit 153: Reading unit, 154, 454: Processing execution unit, 155: Playback processing unit, 156: Playback control unit, 157: Presentation control unit, 158: Decoder unit, 159: Screen composition unit

Claims (12)

By analyzing the video data, the section that is continuously shot at one frame rate is specified, and the analysis unit that specifies the shooting time of the section and at least one of the frame rate and the playback time;
A conversion information creation unit for creating conversion information including information specified by the analysis unit;
A conversion unit for converting the video data into digital information of a predetermined format;
A program storage unit for storing a shooting time reproduction control program for reproducing video data of a reproduction time corresponding to a shooting time from the digital information using the conversion information;
A data layout unit for generating content data including the conversion information, the digital information, and the shooting time reproduction control program;
An information processing apparatus comprising: a writing unit that writes the content data to a portable storage medium. A condition input unit for receiving an input of a condition for extracting the video data;
A video data extraction unit that extracts video data that satisfies a condition that the condition input unit has received an input from a video data storage unit that stores a plurality of video data; and
The analysis unit analyzes the video data extracted by the video data extraction unit,
The information processing apparatus according to claim 1, wherein the conversion unit converts the video data extracted by the video data extraction unit. The video data storage unit stores a plurality of video data captured by a plurality of imaging devices,
The condition input unit accepts input of information indicating an imaging device that has captured the video data to be extracted as the condition,
The analysis unit analyzes the video data extracted by the video data extraction unit, and is continuously photographed at one frame rate for each imaging device indicated by the information received by the condition input unit. Identifying a section, identifying a shooting time of the section and at least one of a frame rate and a playback time,
The conversion information is information including information specified by the analysis unit for each imaging device indicated by the information received by the condition input unit,
The shooting time reproduction control program uses the conversion information to reproduce the video data of the reproduction time corresponding to the shooting time from the digital information for each imaging device indicated by the information received by the condition input unit. The information processing apparatus according to claim 2, wherein the information processing apparatus is a program. The data layout unit receives an input from the condition input unit based on the digital information using the conversion information when a plurality of imaging devices are indicated by the information received by the condition input unit. By synthesizing the video data captured by the plurality of imaging devices indicated by the information so that the shooting times are the same, digital information of the synthesized video data is generated, and the digital information of the synthesized video data is Included in the content data, and in the digital information of the composite video data, specify the shooting time of the section continuously shot at one frame rate and at least one of the frame rate and the playback time, and specify The information processing apparatus according to claim 3, wherein the processed information is added to the conversion information. Digital information for playing back captured video data from a portable storage medium on a computer, shooting time of a section continuously shot at one frame rate in the digital information, and frame rate and playback A reading unit that reads content data including conversion information including at least one of the time;
An input unit for receiving an input of a shooting time;
A process execution unit for specifying a reproduction time corresponding to a shooting time at which the input unit has received an input, using the conversion information read by the reading unit;
A program that causes video data corresponding to a reproduction time specified by the processing execution unit to function as a reproduction processing unit that reproduces digital data read by the reading unit. The content data includes digital information for reproducing video data shot for each imaging device, shooting time of a section continuously shot at one frame rate for each imaging device, a frame rate, Conversion information including at least one of the playback times, and
The input unit accepts input of information indicating an imaging device while the reproduction processing unit reproduces video data,
The processing execution unit uses the conversion information read by the reading unit, and corresponds to the shooting time of the video data reproduced by the reproduction processing unit, and is indicated by information received by the input unit Specify the playback time of the video data recorded in
The reproduction processing unit reproduces, from the reproduction time specified by the processing execution unit, the video data captured by the imaging device indicated by the information received by the input unit based on the digital information read by the reading unit. The program according to claim 5, wherein: By analyzing the video data, an analysis process for specifying a section that is continuously shot at one frame rate, and specifying a shooting time of the section and at least one of a frame rate and a playback time;
A conversion information creation process for creating conversion information including the information specified by the analysis process;
A conversion process for converting the video data into digital information of a predetermined format;
A data layout for generating content data including a shooting time playback control program for playing back video data of a playback time corresponding to a shooting time from the digital information using the conversion information, the digital information, and the conversion information Process,
And a writing process for writing the content data to a portable storage medium. A condition input process for receiving an input of conditions for extracting the video data;
A video data extraction process for extracting video data that satisfies the condition of receiving an input in the condition input process,
The analysis process analyzes the video data extracted in the video data extraction process,
The information processing method according to claim 7, wherein the conversion process converts the video data extracted in the video data extraction process. In the condition input process, as the condition, an input of information indicating an image pickup apparatus that picks up image data to be extracted is received,
The analysis process analyzes the video data extracted in the video data extraction process, and the condition input process continuously captures images at one frame rate for each imaging device indicated by the received information. Identifying a section, identifying a shooting time of the section and at least one of a frame rate and a playback time,
The conversion information is information including information specified by the analysis process for each imaging device indicated by the information received in the condition input process,
The shooting time reproduction control program uses the conversion information to reproduce video data of a reproduction time corresponding to the shooting time from the digital information for each imaging device indicated by the information received in the condition input process. The information processing method according to claim 8, wherein the information processing method is a program. In the data layout process, when a plurality of imaging devices are indicated by the information received in the condition input process, the input is received in the condition input process based on the digital information using the conversion information. By synthesizing the video data captured by the plurality of imaging devices indicated by the information so that the shooting times are the same, digital information of the synthesized video data is generated, and the digital information of the synthesized video data is Included in the content data, and in the digital information of the composite video data, specify the shooting time of the section continuously shot at one frame rate and at least one of the frame rate and the playback time, and specify The information processing method according to claim 9, wherein the converted information is added to the conversion information. Digital information for reproducing captured video data from a portable storage medium, the shooting time of a section continuously shot at one frame rate in the digital information, and the frame rate and playback time A reading process of reading content data including conversion information including at least one of them,
An input process for accepting an input of a shooting time;
Using the conversion information read in the reading process, a process execution process for specifying a reproduction time corresponding to a shooting time at which an input is received in the input process;
A reproduction processing step of reproducing the video data corresponding to the reproduction time specified in the processing execution step from the digital information read in the reading step. The content data includes digital information for reproducing video data shot for each imaging device, shooting time of a section continuously shot at one frame rate for each imaging device, a frame rate, Conversion information including at least one of the playback times, and
In the input process, during the reproduction of the video data, the reproduction processing unit accepts input of information indicating the imaging device,
The process execution process uses the conversion information read by the reading unit, and corresponds to the shooting time of the video data reproduced in the reproduction process, and is an imaging apparatus indicated by information received in the input process Specify the playback time of the video data recorded in
In the reproduction process, from the digital information read in the reading process, the video data captured by the imaging apparatus indicated by the information received in the input process is obtained from the reproduction time specified in the process execution process. The reproduction method according to claim 11, wherein reproduction is performed.

Images