JP5597061B2 - Video playback apparatus and control method thereof - Google Patents

Description

  The present invention relates to a video playback device and a control method thereof.

  When recording an image with an imaging and recording apparatus such as a video camera, the recorded image may be blurred due to the shake of the video camera due to camera shake or the like. As a technique for correcting such blur at the time of video reproduction, there is known a technique for detecting a motion vector representing the blur of the video, and selecting and enlarging and displaying a partial area of the video according to the motion vector (Patent Document 1). reference). There is also known a technique for detecting shake of a video camera with a sensor at the time of image capturing, recording the shake data together with the image data, and correcting the shake using the shake data at the time of reproducing the image (see Patent Document 2).

JP-A-7-143380 Japanese Patent Laid-Open No. 10-42233

  When correcting blur during video playback using the conventional technology described above, if you attempt to correct a large blur, the partial area to be enlarged will be outside the area where the video exists and the effective image circle of the lens, and the displayed video Chipping may occur. In order to prevent such a drop in image quality due to chipping, it is necessary to increase the image enlargement ratio. However, if the image enlargement ratio is increased, the image quality deterioration associated with enlargement becomes significant. For example, if the blur is small, the zoom ratio is reduced. If the blur is large, the zoom ratio is increased. If the blur size changes, the zoom ratio changes and the angle of view changes suddenly. This leads to a decrease in image quality that may cause a sense of discomfort.

  The present invention has been made in view of such a situation, and an object of the present invention is to provide a technique for correcting image blur at the time of image playback while enabling large blur correction and suppressing deterioration in image quality. To do.

In order to solve the above-described problem, the first aspect of the present invention provides an acquisition unit that acquires video data representing a video imaged by an imaging device and shake data representing a shake of the imaging device at the time of imaging the video. Replaying means for replaying the video data, and replaying means for sequentially cutting out images of a predetermined cutout size from a predetermined cutout position of the unit image for each of a plurality of unit images constituting the video; And moving means for moving the predetermined cutout position so as to correct blurring of the video during reproduction of the video data, and a unit image obtained from the shake data and having a predetermined value than the unit image being reproduced by the reproduction means. Based on the magnitude of the shake of the imaging device at the time of unit image reproduction after time, the larger the shake, the smaller the smaller the shake And determining the target size of the cutout size, and changing the predetermined cutout size so that the predetermined cutout size gradually approaches the target size during the reproduction of the video data by the playback means Changing means, and when the changing means is changing to increase the cutout size, the determining means is changing the cutout size and changing the cutout size. Provided is a video playback device characterized in that the predetermined time is set longer than in the case of not being in the middle .

  Other features of the present invention will become more apparent from the accompanying drawings and the following description of the preferred embodiments.

  With the above configuration, according to the present invention, it is possible to correct a blur of a video at the time of video playback while enabling a correction of a large blur and suppressing a deterioration in image quality.

1 is a block diagram illustrating a configuration of an imaging device and a recording device of a video camera 100 according to a first embodiment. Block diagram showing the configuration of the video camera 100 as a video playback device The flowchart which shows the flow of the video data reproduction | regeneration processing which concerns on 1st Embodiment. The flowchart which shows the detail of the target size determination process in S307 of FIG. The flowchart which shows the detail of the cut-out size change process in S308 of FIG. Conceptual diagram showing the relationship between the entire unit image and the image to be cut out Conceptual diagram of image clipping and enlargement Schematic diagram showing the change in the cut-out size accompanying the change in runout size The flowchart which shows the flow of the video data reproduction | regeneration processing based on 2nd Embodiment. The flowchart which shows the detail of the predetermined period setting process in S909 of FIG. A diagram showing the difference in the cut-out target position by changing the setting for a specified period The flowchart which shows the process different from FIG. 10 of the predetermined period setting process in S909 of FIG.

  Embodiments of the present invention will be described below with reference to the accompanying drawings. The technical scope of the present invention is determined by the claims, and is not limited by the following individual embodiments. In addition, not all combinations of features described in the embodiments are essential to the present invention.

[First Embodiment]
An embodiment in which the video playback apparatus of the present invention is applied to a video camera (imaging recording / playback apparatus) will be described. FIG. 1 is a block diagram illustrating a configuration of the video camera 100 according to the first embodiment as an imaging device and a recording device. FIG. 2 is a block diagram showing the configuration of the video camera 100 as a video playback device.

  In FIG. 1, the lens unit 101 forms a subject image on the image sensor 102. The image sensor 102 includes a CCD, a CMOS sensor, and the like, and photoelectrically converts the formed subject image. The analog signal processing unit 103 performs a predetermined process on the signal obtained by the image sensor 102 to generate an analog image signal. The analog signal processing unit 103 includes, for example, a CDS (Co-related Double Sampling) circuit, an AGC (Automatic Gain Control) circuit, and the like. The camera signal processing unit 104 includes an A / D converter, and generates a digital video signal from the analog imaging signal generated by the analog signal processing unit 103. The encoding unit 105 encodes the generated digital video signal in the MPEG2 format and outputs an MPEG2 stream.

  The angular velocity sensor 111 detects the angular velocity of shake applied to the video camera. The shake data setting unit 112 calculates the shake amount of the video camera based on the output of the angular velocity sensor 111. The time code setting unit 114 sets a time code at the time of video recording based on the time information acquired from the clock 113. The metadata setting unit 115 outputs shake data, time code, camera related data (not shown), and the like as metadata.

  The recording control unit 121 records the MPEG2 stream (video data) from the encoding unit 105 and the metadata from the metadata setting unit 115 on the recording medium 122. As will be described later with reference to FIG. 2, the recording control unit 121 can reproduce and output an MPEG2 stream from the recording medium 122, and can read arbitrary metadata.

  Through the above processing, video data to which metadata including shake data is added is recorded on the recording medium 122.

  Next, the configuration of the video camera 100 as a video playback device will be described with reference to FIG. The recording medium 122 records video data to which metadata including shake data described with reference to FIG. 1 is added. However, the recording format of the metadata and video data is not limited to this, and any format may be used as long as the video camera 100 can acquire shake data and video data. It may be recorded separately.

  The recording control unit 121 acquires video data and metadata (particularly shake data) from the recording medium 122. The decoding unit 221 decodes the video data (MPEG2 stream) acquired by the recording control unit 121 and outputs the decoded digital video signal to the memory 222 together with the metadata.

  The memory 222 stores the decoded digital video signal for several seconds. By storing a digital video signal for several seconds in the memory 222, it becomes possible to obtain information that is temporally ahead of the reproduced image (image being reproduced) output to the display device 224. .

  The image processing unit 223 reproduces the video data according to the cutout position and cutout size determined by the processing of a microcomputer 210 described later. Specifically, the image processing unit 223 sequentially cuts out images having a predetermined cutout size from a predetermined cutout position of the unit image for each of a plurality of unit images (field image or frame image) constituting the video represented by the video data. . Then, the image processing unit 223 performs electronic zoom on the clipped image and outputs it to the display device 224. The display device 224 displays video by sequentially displaying the output images.

  The motion vector detection unit 201 detects a motion vector from the digital image stored in the memory 222. This motion vector serves as an index of image blur. The cutout position setting unit 202 determines (moves) the cutout position of the unit image so as to correct the image blur based on the motion detected by the motion vector detection unit, and sets the cutout position in the image processing unit 223.

  The metadata reading unit 203 reads metadata from the memory 222 (metadata is added to a decrypted digital image, for example). The metadata reading unit 203 reads metadata from a read address set by a read address setting unit 207 described later.

  The shake data acquisition unit 204 acquires shake data from the read metadata. The cutout size setting unit 205 determines the cutout size of the unit image based on the acquired shake data and sets it in the image processing unit 223 (details will be described later with reference to FIGS. 3 to 5).

  The time code setting unit 206 acquires the time code of the current reproduction image (unit image being reproduced) from the metadata reading unit 203, and reads the time code after a predetermined time from the acquired time code, and reads the address code setting unit 207. Notify The read address setting unit 207 sets an address corresponding to the notified time code in the memory 222. Thereby, the metadata reading unit 203 can acquire metadata of an image (unit image) reproduced after a predetermined time from the current reproduced image.

  The microcomputer 210 implements the functions of a motion vector detection unit 201, a cutout position setting unit 202, a metadata reading unit 203, a shake data acquisition unit 204, a cutout size setting unit 205, a time code setting unit 206, and a read address setting unit 207. To do. The microcomputer 210 also controls various processes shown in the flowcharts of FIGS.

  FIG. 3 is a flowchart showing a flow of video data reproduction processing according to the first embodiment. When the video camera 100 starts reproducing the video data, the processing of this flowchart starts.

  In step S <b> 301, the shake data acquisition unit 204 acquires shake data for a predetermined period from the playback start point of the video data via the metadata reading unit 203. In step S302, the cut-out size setting unit 205 checks the amplitude of shake represented by the shake data acquired in step S301. In step S303, the cutout size setting unit 205 determines whether the amplitude checked in step S302 is greater than a threshold value. If the amplitude is greater than the threshold value, the process proceeds to S304; otherwise, the process proceeds to S305.

  In step S304, the cutout size setting unit 205 sets the cutout size = “small”. The cutout size setting unit 205 also sets target size = “small” (the same as the cutout size). The small cutout size means that the enlargement ratio of the video displayed on the display device 224 is large. In this case, even if a relatively large shake is corrected, it is unlikely that the region to be cut out will be outside the region where the video exists.

  In step S305, the cutout size setting unit 205 sets the cutout size = “large”. The cutout size setting unit 205 also sets target size = “large” (the same as the cutout size). A large cut-out size means that the enlargement rate of the video displayed on the display device 224 is small. In this case, the quality of the video displayed on the display device 224 is relatively high, but only a relatively small amount of blur can be corrected so that the region to be cut out does not go outside the region where the video exists. .

  The threshold value in S303 is, for example, 0.5 degrees in terms of correction angle. This is because, for an image taken by a person with little camera shake, the image blur can be sufficiently corrected with a correction amount of 0.5 degrees. Therefore, the cutout size = “large” in S305 is a cutout size that can correct blur equivalent to 0.5 degrees. In addition, the cutout size = “small” in S304 is set to a cutout size that can correct blur equivalent to twice in order to prevent the number of pixels of the cutout image from becoming extremely small.

  FIG. 6 is a conceptual diagram showing the relationship between the entire unit image and the clipped image. In FIG. 6A, the size of the unit image 601 corresponds to the size of the image sensor 102. A cutout area 602 indicates a cutout area when the cutout size = “large”, and a cutout area 603 indicates a cutout area when the cutout size = “small”. If an attempt is made to correct a large camera shake while the cutout size is large, a part of the cutout region appears outside the unit image 601 as shown in FIG. Therefore, the displayed video is chipped. Therefore, when the camera shake is large, if the cut-out size is reduced, the cut-out area 603 can be accommodated in the unit image 601 as shown in FIG.

  In addition, as shown in FIG. 6B, when a part of the image sensor 102 exists outside the effective image circle 611 of the lens unit 101, not only the size of the image sensor 102 but also the effective image circle of the lens unit 101. In some cases, the lack of video may occur due to the above. The size of the unit image 612 corresponds to the size of the image sensor 102. However, the four corners of the unit image 612 are missing because they are outside the effective image circle 611. A cutout area 613 indicates a cutout area when the cutout size = “large”, and a cutout area 614 indicates a cutout area when the cutout size = “small”. Although the cutout region 613 is contained within the unit image 612, the cutout region 613 includes the outside of the effective image circle 611, and thus the image is actually missing. In this case as well, if the cutout size is reduced as shown by the cutout area 614, the possibility of missing in the video can be reduced.

  Returning to FIG. 3, in S306, the video camera 100 performs video reproduction with blur correction. Specifically, the cutout position setting unit 202 determines (moves) the cutout position and sets the cutout position in the image processing unit 223 so as to correct the image blur based on the motion vector detected by the motion vector detection unit 201. The cut-out position can be determined using any known technique. The image processing unit 223 cuts out an image having the cut-out size set in S304 or S305 from the set cut-out position of the unit image. Then, the image processing unit 223 outputs the clipped image to the display device 224. When it is determined that panning has occurred in S402 in FIG. 4 described later, the cutout position setting unit 202 stops changing the cutout position. In general, during the panning operation, the detected shake data and vector amount increase, and therefore control is performed so that large camera shake correction is not applied so that the cutout position does not reach the correction limit. Therefore, there is no problem even if the cutout position setting is stopped.

  In step S307, the cut-out size setting unit 205 determines a target size based on the magnitude of the shake of the video camera 100 at the time of capturing a unit image reproduced after a predetermined time from the unit image being reproduced (S304 or The target size set in S305 is changed). Details will be described later with reference to FIG.

  In step S308, the cutout size setting unit 205 changes the cutout size set in the image processing unit 223 so as to gradually approach the target size determined in step S307. In order to realize the approach gradually, the cutout size setting unit 205 changes the cutout size only slightly in one process of S308. By repeatedly executing the processing of S306, S307, and S308, the cutout size finally reaches the target size (if the target size does not change in S307). Details will be described later with reference to FIG.

  FIG. 7 is a conceptual diagram of image clipping and enlargement. If the cutout size is reduced, the angle of view becomes narrower. Conversely, if the cutout size is increased, the angle of view becomes wider. For this reason, if the cutout size is changed suddenly, the viewer may feel uncomfortable. In this embodiment, since the cutout size is gradually changed as described in S308, such a sense of incongruity can be reduced.

  FIG. 4 is a flowchart showing details of the target size determination process in S307 of FIG. In step S <b> 401, the shake data acquisition unit 204 acquires shake data for a predetermined period from the current reproduction point via the metadata reading unit 203. Since camera shake normally has a frequency of 4 to 9 Hz, the predetermined period is, for example, about two seconds of a low frequency for about 0.5 seconds. In step S402, the cut-out size setting unit 205 checks the amplitude of the shake represented by the shake data acquired in step S401.

  In step S <b> 403, the cutout size setting unit 205 determines whether the shake data represents panning of the video camera 100. Specifically, the cut-out size setting unit 205 determines that panning has occurred when the shake data for the acquired period has increased or decreased in one direction. When panning has occurred, since the large camera shake correction is not performed as described above, the processing of this flowchart ends (therefore, the target size is not changed). Otherwise, the process proceeds to S404.

  In step S404, the cutout size setting unit 205 determines whether the currently set cutout size is equal to the target size. If they are equal, the process proceeds to S405. If they are not equal (that is, the cutout size is being changed by the process of FIG. 5 described later), the process proceeds to S413.

  In step S405, the cut-out size setting unit 205 determines the magnitude of the shake of the video camera 100 at the time of capturing a unit image that is reproduced after a predetermined time from the unit image being reproduced (that is, the last amplitude of the period acquired in step S401). ) To get. Then, the cutout size setting unit 205 determines whether or not the amplitude is larger than the threshold value. If so, the process proceeds to S409; otherwise, the process proceeds to S406.

  In step S <b> 406, the cutout size setting unit 205 determines whether the current target size = “large”. If the current target size is “large”, it is not necessary to change the target size, and the processing of this flowchart ends. Otherwise, the process proceeds to S407, and the cut-out size setting unit 205 sets target size = “large”. Thus, when the shake is relatively small, the target size is set to “large” in order to finally increase the cutout size.

  On the other hand, when it is determined in S405 that the amplitude is larger than the threshold value, in S409, the cut-out size setting unit 205 determines whether or not the current target size is “small”. If the current target size is “small”, it is not necessary to change the target size, and the processing of this flowchart ends. Otherwise, the process proceeds to S410, and the cut-out size setting unit 205 sets target size = “small”. As described above, when the shake is relatively large, the target size is set to “small” in order to finally reduce the cut-out size so that large blur can be corrected.

  In the description of S405, S406, S407, S409, and S410, there is only one threshold value, and the target size is only two types, “large” and “small”. However, if the shake of the video camera 100 at the time of capturing a unit image to be played back after a predetermined time is larger than the unit image being played back, the target size becomes smaller, and if the target size becomes larger as the shake is smaller, the number of thresholds And any number of types of target sizes corresponding thereto.

  If “NO” is determined in S404, that is, if the cutout size is being changed, the cutout size setting unit 205 determines whether or not the currently set cutout size is larger than the target size in S413. . The case where the cutout size is larger than the target size is a case where the cutout size is being reduced in S503 described later. In this case, the processing of this flowchart ends. This prevents the target size from being changed during the reduction of the cutout size, and prevents the video visibility from being lowered due to frequent switching of the cutout size. On the other hand, when the cutout size is not larger than the target size, it is a case where the cutout size is being enlarged in S504 described later. In this case, since large blur correction is impossible, it is necessary to check the size of the shake, and when it is large, it is necessary to switch to reduction even when the cutout size is being enlarged. Therefore, the process proceeds to S414.

  In S414, the cut-out size setting unit 205 determines whether the amplitude is larger than the threshold value as in S405. If it is larger, the process proceeds to S409, and in S409, it is always determined “NO”. Therefore, the process finally proceeds to S410, the target size is set to “small”, and a relatively large blur can be corrected. . Otherwise, the process of this flowchart ends.

  FIG. 5 is a flowchart showing details of the cut-out size changing process in S308 of FIG. In step S501, the cutout size setting unit 205 determines whether the currently set cutout size is equal to the target size. If they are equal, there is no need to change the cut-out size, so the processing of this flowchart ends. If not equal, the process proceeds to S502.

  In step S502, the cutout size setting unit 205 determines whether the cutout size currently set is larger than the target size. If so, the process proceeds to S503; otherwise, the process proceeds to S504.

  In step S503, the cutout size setting unit 205 decreases the cutout size by one step. On the other hand, in S504, the cutout size setting unit 205 increases the cutout size by one step. Here, the size of “1 step” is determined so that the cut-out size reaches the target size after the “predetermined time” in S405. In other words, the quotient obtained by dividing the difference between the target size and the cut-out size by the number of unit images between the unit image being reproduced and the unit image reproduced after a predetermined time is one step.

  With the above processing, the cut-out size changes gradually (stepwise), so that a sudden change in the angle of view is suppressed, and the accompanying deterioration in image quality is also suppressed.

  FIG. 8 is a conceptual diagram showing a change in cutout size accompanying a change in the magnitude of shake. The horizontal axis represents time, and the vertical axis represents runout. FIG. 8 shows a change in shake for an image of about 3 minutes. As illustrated in FIG. 8, the cutout size starts to be reduced or enlarged slightly before the time when the large or small shake occurs, and the cutout size gradually changes.

  As described above, according to the present embodiment, the video camera 100 sequentially cuts out images of a predetermined cut-out size from a predetermined cut-out position of the unit image for each of a plurality of unit images constituting the video at the time of video playback. . Then, the video camera 100 moves the cutout position of the unit image so as to correct the image blur. In addition, the video camera 100 changes the cutout size so that the video camera 100 is small when the shake of the video camera 100 is large and large when the shake is small. When changing the cutout size, the video camera 100 changes gradually (stepwise) instead of abruptly. As a result, it is possible to correct blurring during video playback while making it possible to correct large blurring and suppressing deterioration in image quality.

<Second Embodiment>
In the first embodiment, the cutout size of the image when the camera shake is large and when the camera shake is small is constant. In the present embodiment, the enlargement ratio of the video displayed on the display device 224 is changed according to the size of camera shake. Further, the shake detection period is changed between when the image cutout size is being changed and when the image cutout size is not being changed. By changing the cut-out size according to the pre-read camera shake data, unnecessary image enlargement can be avoided, image quality can be improved, and a longer shake detection period should be provided while changing the angle of view. Thus, the change in the angle of view can be made more natural. In addition, it is possible to provide a good reproduced image in which camera shake is sufficiently corrected.

  Since the configuration of the video camera 100 according to the second embodiment of the present invention is the same as that of the first embodiment, detailed description of the configuration is omitted (see FIGS. 1 and 2). Hereinafter, differences from the first embodiment will be described in detail. FIG. 9 is a flowchart showing a flow of video data reproduction processing according to the second embodiment. Similar to the first embodiment, when the video camera 100 starts reproducing the video data, the processing of this flowchart starts.

  In step S <b> 901, the shake data acquisition unit 204 acquires shake data for a predetermined period from the playback start point of the video data via the metadata reading unit 203. In step S902, the cutout size setting unit 205 checks the amplitude of the shake represented by the shake data acquired in step S901. In step S903, the cutout size setting unit 205 sets a cutout size (initial value of the cutout size) corresponding to the amplitude checked in step S902. The cutout size setting unit 205 has a plurality of threshold values therein, and determines an initial value of the cutout size based on each threshold value and the amplitude of shake. The threshold value here is a value obtained by dividing the maximum size that can be cut out to the minimum size, for example, a correction angle conversion of 0.5 to 2 degrees in increments of 0.1 degrees. The cutout size setting unit 205 also sets target size = “cutout size” as in the case of S304 and S305 in FIG.

  In step S <b> 904, the video camera 100 performs video reproduction with blur correction, similar to step S <b> 306 in FIG. 3. Specifically, the cutout position setting unit 202 determines (moves) the cutout position and sets the cutout position in the image processing unit 223 so as to correct the image blur based on the motion vector detected by the motion vector detection unit 201. The image processing unit 223 cuts out the image of the cut-out size set in S903 from the cut-out position where the unit image is set, and outputs the cut-out image to the display device 224.

  In step S <b> 905, the shake data acquisition unit 204 acquires the shake data for a predetermined period again (acquires shake data for a predetermined period from the current playback time via the metadata reading unit 203). The predetermined period is initially a normal period, that is, 0.5 seconds as described above, but changes according to the setting in S909 described later.

  In step S906, the cutout size setting unit 205 checks the amplitude of the shake from the shake data acquired in step S905. In step S907, the cutout size setting unit 205 determines whether or not the video camera 100 is panning. If panning is in progress, the process returns to step S904 (that is, the cutout size is changed as in the first embodiment). Not) If panning is not in progress, the process proceeds to S908. In step S908, the cut-out size setting unit 205 determines a target size based on the amount of shake of the video camera 100 at the time of capturing a unit image that is reproduced after a predetermined time from the unit image being reproduced. This target size determination method is the same as the setting method of the initial value of the cutout size in S903 (that is, the target size most suitable for the current shake amplitude is determined using a plurality of threshold values).

  In step S909, the shake data acquisition unit 204 operates the read address setting unit 207 using the time code setting unit 206 according to the current cut size change status, and changes the predetermined period for acquiring the shake data. A method for changing the predetermined period will be described later with reference to FIG.

  The processing in S910 is exactly the same as the operation in S308 in FIG. 3, that is, the processing in FIG. 5. If the target size does not change in S908, the cutout size gradually changes until the target size is reached.

  FIG. 10 is a flowchart showing details of a predetermined period setting process for acquiring shake data. In step S1001, the shake data acquisition unit 204 determines whether the cutout size is equal to the target size. When the sizes are equal, the shake data acquisition unit 204 sets a predetermined period (data acquisition period) as a normal period in S1002. On the other hand, when the cutout size and the target size are different, the cutout size is changing. In this case, the shake data acquisition unit 204 sets the predetermined period to a long time by the time code setting unit 206 in S1003. The “long time” here is premised on the existence of metadata, and therefore varies depending on the capacity of the memory 222, but it is preferably 5 seconds to 10 seconds, where the reversal of the cutout size is not noticeable. In this way, the predetermined period is set and the processing of this flowchart ends.

  FIG. 11 shows a change in shake data during a predetermined period when the predetermined period is set to “long time” in S1003. As can be seen from this figure, if the predetermined period is long, it is easy to confirm whether or not the shake has suddenly increased during the following period of the shake state. Therefore, it becomes easier to avoid the situation where the cutout size must be suddenly reversed. As a result, it is possible to reduce the probability of occurrence of a change in the angle of view and make it easier to see the reproduced image.

  In FIG. 10, the predetermined period is set to “long time” while the cutout size is changed, and the predetermined period is shortened when the cutout size is not changed. However, when the cutout size is reduced, image vignetting does not occur. Therefore, in addition to the control example shown in FIG. 10, as shown in FIG. 12, the data acquisition period (predetermined period) can be set to “long time” only when the cutout size is increased. This is because when the cutout size is reduced, the possibility of chipping in the video is less than when the cutout size is increased, and the processing load can be reduced by shortening the predetermined period compared to when the cutout size is increased. . In FIG. 12, steps in which the same or similar processes as those in FIG. 10 are performed are denoted by the same reference numerals and description thereof is omitted. In step S1203, the shake data acquisition unit 204 determines whether the cutout size is larger than the target size. If the cutout size is larger than the target size, since the cutout size is currently being reduced, the process proceeds to S1002. On the other hand, if the cut-out size is smaller than the target size, the shake data acquisition unit 204 sets the predetermined period to “long time” in S1204. Thus, the data acquisition period (predetermined period) may be set to “long time” only when the cutout size is increased.

  As described above, according to the present embodiment, the video camera 100 sequentially cuts out images of a predetermined cut-out size from a predetermined cut-out position of the unit image for each of a plurality of unit images constituting the video at the time of video playback. . Then, the video camera 100 moves the cutout position of the unit image so as to correct the image blur. In addition, the video camera 100 changes the cutout size in accordance with the shake size of the video camera 100, and during the change of the cutout size, by monitoring the change in the shake size for a long time in the future, The cutout size can be changed more smoothly. As a result, it is possible to correct blurring during video playback while making it possible to correct large blurring and suppressing deterioration in image quality.

[Other Embodiments]
The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads the program. It is a process to be executed.

Claims (5)

Acquisition means for acquiring video data representing video captured by the imaging device and shake data representing shake of the imaging device at the time of imaging the video;
Replaying means for replaying the video data, replaying means for sequentially cutting out images of a predetermined cutout size from a predetermined cutout position of the unit image for each of a plurality of unit images constituting the video;
Moving means for moving the predetermined cutout position so as to correct blur of the video during playback of the video data by the playback means;
Based on the magnitude of shake of the imaging device at the time of imaging a unit image that is obtained from the shake data and is reproduced after a predetermined time from the unit image being reproduced by the reproduction means, the larger the shake, the smaller Determining means for determining a target size of the cut-out size so that the smaller the shake is,
During playback of the video data by the reproducing means, and changing means for the predetermined clipping size changes the predetermined cut size to brute close to the target size,
Equipped with a,
When the changing means is changing so as to increase the cutout size, the determining means is more preferable than when changing the cutout size and when not changing the cutout size. Set a long time
A video reproducing apparatus characterized by that. The video reproducing apparatus according to claim 1, wherein the determination unit does not determine the next target size while the current cut-out size is larger than the current target size. When the shake data during a period from the time of capturing the unit image being played back by the playback means to the time after the predetermined time indicates that the panning has been performed by the imaging device, the determining means The video playback apparatus according to claim 1, wherein no determination is made. A method for controlling a video playback device, comprising:
An acquisition step in which the acquisition unit acquires video data representing video captured by the imaging device and shake data representing shake of the imaging device during imaging of the video;
A reproduction step of reproducing the video data, wherein a reproduction step of sequentially cutting out images of a predetermined cut-out size from a predetermined cut-out position of the unit image for each of a plurality of unit images constituting the video;
A moving step of moving the predetermined cutout position so as to correct blur of the video during playback of the video data in the playback step;
Based on the magnitude of the shake of the imaging device at the time of capturing the unit image that is obtained from the shake data and is acquired after a predetermined time from the unit image that is being reproduced in the reproduction step. A determination step of determining a target size of the cut-out size so that the larger the smaller and the smaller the shake is,
Change means, the playing of the video data in the regeneration step, and a changing step of the predetermined clipping size changes the predetermined cut size to brute close to the target size,
Equipped with a,
In the determining step, when the cutout size is being changed in the changing step, the cutting size is smaller than when the cutout size is being changed and when the cutout size is not being changed. Set a long time
A control method characterized by that. The program for functioning a computer as each means of the video reproduction apparatus of any one of Claims 1 thru | or 3 .

Images