JP5705027B2 - Image processing apparatus, image processing apparatus control method, program, and recording medium - Google Patents

Description

  The present invention relates to an image processing apparatus that generates a single image by combining a plurality of images obtained by continuous shooting, a control method for the image processing apparatus, a program, and a recording medium.

  When confirming a composite image composed of a plurality of images obtained by continuous shooting, generally, after continuous shooting is finished, an image composition process is performed, and the composite image is displayed on a display device for confirmation. Yes.

  There is a technique for generating a single composite image by combining a plurality of captured images. If the image sensor has high pixels or the process including the image composition process is complicated, the time required for the process is large, and the display (confirmation) of the composite image after the last image to be composited is taken. It takes time. In order to improve this point, there is a technique in which a composite image for display is generated by performing another composite process with a short processing time approximate to the image composite process (Patent Document 1).

  By the way, it is desirable that the synthesized image obtained by the image synthesizing process is an image without so-called subject blur caused by the motion of the subject for each image unless specifically intended.

JP 2002-112103 A

  However, in the method described in Patent Document 1, in order to check subject blur for each image, it is necessary to check the composite image after waiting for the composite image to be displayed as a preview, which takes time. .

In view of the above problems, an object of the present invention is to quickly and easily determine whether or not each of a plurality of photographed images is appropriate as an image used for composition when generating one composite image from a plurality of photographed images. confirmation can image processing apparatus, a control method for an image processing apparatus, and program, as well as a recording medium.

In order to achieve the above object, an image processing apparatus according to the present invention includes an acquisition unit that sequentially acquires a plurality of images, and a first storage unit that sequentially stores images acquired by the acquisition unit in a memory. The first reduction means for reducing the image stored in the first storage means, and the output image from the first storage means and the output image from the first reduction means are selectively selected. A selection means for outputting; a synthesis circuit for synthesizing a plurality of images including the image output from the selection means; a second storage means for storing an image output from the synthesis circuit; and an input image. Display means for displaying, and before the predetermined number of images are acquired by the acquisition means, the first reduction means sequentially reduces the images stored in the first storage means. and it said combining circuit, by the selection means An image reduced at the output to択的 the first reduction unit, said second sequentially combining the stored combined image to the storage unit to generate a composite image, the composite image second memory means stores as a new composite image, said display means, said sequential display unit the image output from the combining circuit, display, after a predetermined number of images have been acquired by the acquisition means, the synthetic The circuit sequentially outputs an image selectively output by the selection unit, stored in the first storage unit and not reduced by the first reduction unit, and a composite image stored in the second storage unit. A main composite image is generated by synthesis, and the main composite image is stored in the second storage unit as a new composite image .

An image processing apparatus control method according to the present invention includes an acquisition unit that acquires an image, a first storage unit that stores an image acquired by the acquisition unit in a memory, and an image stored in the first storage unit. Output from the selection means, a selection means for selectively outputting one of the output image from the first storage means and the output image from the first reduction means, and the selection means that the combining circuit a plurality of image synthesizing processing including an image, a method of controlling an image processing apparatus including second storage means, a storing an image output from the combining circuit, the acquisition means, a plurality An acquisition step for sequentially acquiring images, and the first reduction means sequentially reduces the images stored in the first storage means before a predetermined number of images are acquired by the acquisition means. Reducing step, and Circuit generates a sequentially combined to the composite image and stored synthesized image in the second storage means and the reduced image in the first reduction unit, new the composite image in the second memory means a first synthesis step of storing a composite image, sequentially on the display section the image output from the combining circuit, possess a display step of displaying, a predetermined number of images have been acquired by the acquisition means Later, the composition circuit selectively outputs the image from the selection means, stores it in the first storage means, and does not reduce the image by the first reduction means, and the composition stored in the second storage means. sequentially synthesizing the image generating this composite image, characterized by chromatic and second synthetic step of storing the present composite image as a new composite image in the second storage means.

  According to the present invention, when one composite image is generated from a plurality of photographed images, it is possible to quickly and easily confirm whether or not each of the plurality of photographed images is appropriate as an image used for composition.

1 is a block diagram illustrating an example of an image processing apparatus according to a first embodiment of the present invention. It is a block diagram for demonstrating the structure of the image processing control part shown in FIG. It is a figure for demonstrating the image processing performed by the image processing control part shown in FIG. 2, (A) is a figure which shows the conventional image processing, (B) is the time at the time of performing the image processing shown to (A) The figure which shows an image display, (C) is a figure which shows the image process of an image process control part, (D) is a figure which shows the image display at the time of performing the image process shown to (C). 3 is a flowchart for explaining image composition processing after continuous shooting is started in the image processing control unit shown in FIG. 2. FIG. 3 is a flowchart for explaining image display processing after continuous shooting is started in the image processing control unit shown in FIG. 2. FIG. It is a figure which shows five continuous images obtained as a result of five continuous imaging | photography. It is a figure for demonstrating the image of the image at the time of performing a progress display process about five images shown in FIG. It is a figure for demonstrating the status display displayed on the image display part shown in FIG. 1, and the image of this synthesized image.

  Hereinafter, an example of an image processing apparatus according to an embodiment of the present invention will be described with reference to the drawings. Note that this image processing apparatus is, for example, an imaging apparatus such as a digital camera.

[First Embodiment]
In this embodiment, when generating one composite image from a plurality of captured images, in order to confirm whether or not each captured image is appropriate as an image used for composition, it is performed in parallel with the capturing operation of each captured image. Then, each process for displaying a composite image up to an image for which shooting has been completed is performed. At this time, each process may be a simple process having a faster processing time than the process to be performed on the final composite image to be recorded, but is the same as the circuit (composite circuit) for synthesizing the final composite image. Use a circuit.

  FIG. 1 is a block diagram showing an example of an image processing apparatus according to the first embodiment of the present invention.

  In FIG. 1, an image processing apparatus includes an image input unit 101, an image processing control unit 102 (image composition unit and determination unit), an image display unit (display unit) 103, a format control unit 104, a recording / reading unit 105, a recording medium. 106 and an operation unit 107. The recording medium 106 is detachable from the image processing apparatus.

  The image input unit 101 is, for example, an imaging unit including a plurality of lenses and a CCD (Charge-Coupled Device) or an IF (interface) unit capable of inputting output image data output from an external device. Image (video) data input from the image input unit 101 to the image processing control unit 102 is subjected to image processing in the image processing control unit 102 and displayed on the image display unit 103 as a display image. The image display unit 103 includes, for example, a liquid crystal panel.

  The image data processed by the image processing control unit 102 is converted into a recordable format by the format control unit 104. The format-converted image data is recorded on the recording medium 106 by the recording / reading unit 105.

  The image data recorded on the recording medium 106 is read by the recording / reading unit 105. The image data is converted into a displayable format by the format control unit 104. The image data is subjected to image processing by the image processing control unit 102 and displayed on the image display unit 103.

  In the following description, continuous shooting is performed with low exposure to obtain five image data (hereinafter also simply referred to as images), and one image obtained by synthesizing these five images is recorded on the recording medium 106. Shall be recorded (stored).

  FIG. 2 is a block diagram for explaining the configuration of the image processing control unit 102 shown in FIG.

  Referring to FIG. 2, the image processing control unit 102 includes an image composition processing unit 201, a reduction processing unit 202 (first reduction unit), a reduction processing unit 203 (second reduction unit), and a first image memory 204 ( A first storage means) and a second image memory 205 (second storage means).

  Here, a progress display process will be described in which five images obtained as a result of continuous shooting are sequentially combined from the captured images and the progress of the combining is displayed on the display screen. In the present embodiment, an image obtained as a result of shooting has a resolution of 3840 × 2880, and the resolution of the image display unit 103 is VGA (640 × 480). The first image memory 204 has a capacity for recording a plurality of images with the resolution of 3840 × 2880, and the second image memory 205 records at least one image with the resolution of 3840 × 2880. Suppose there is a capacity that can.

  Each time one image is captured, one image is input from the image input unit 101 to the image processing control unit 102. The input images are sequentially recorded in the first image memory 204 as one image. Here, as described above, five continuous images are taken, and images are input from the image input unit 101 each time images are taken, and a total of five images are recorded in the first image memory 204.

  The image recorded in the first image memory 204 is reduced to the display resolution in the reduction processing unit 202. Since the input resolution is 3840 × 2880 and the resolution of the image display unit 103 is 640 × 480, the reduction processing unit 202 performs 1/6 decimation to extract one pixel every six pixels in the horizontal direction. Further, the reduction processing unit 202 performs 1/6 thinning for extracting one line for every six lines in the vertical direction, and reduces the image to a resolution of 640 × 480 to obtain a reduced processed image.

  The selection unit 202a selects the output of the reduction processing unit 202 during the progress display process. The reduced processing image is given to the image composition processing unit 201, and the image composition processing unit 201 performs image composition processing on the composite image obtained by combining the images captured up to the previous time read from the second image memory 205 and the reduced image. To do. The image composition processing unit 201 records the image after the image composition processing in the second image memory 205 as the current composite image. At this time, the combination ratio of the previous combined image and the reduced processed image is not particularly limited. Finally, it may conform to the composition ratio when the five images are finally combined, or a separate composition ratio may be set for display.

  As described above, the image composition processing unit 201 outputs a composite image obtained by sequentially combining images obtained up to that time as a display image in parallel with continuous photographing.

  When the reduced image input to the image composition processing unit 201 corresponds to the first image obtained as a result of continuous shooting, the image composition processing unit 201 does not perform the image composition processing and performs the reduction processing. The image is recorded as it is in the second image memory 205 as a current composite image.

  The selection unit 203a selects the output of the image composition processing unit 201 during the progress display process. As a result, the composite image output from the image composition processing unit 201 is given to the image display unit 103 and displayed on the image display unit 103.

  When the continuous shooting is finished and the last image is recorded in the first image memory 204, the composition process is started. During this synthesis process, the selection unit 202a selects the output of the first image memory 204. As a result, the images recorded in the first image memory 204 are read one by one and provided to the image composition processing unit 201. As described above, the reduction processing by the reduction processing unit 202 is not performed during the main composition processing.

  The image composition processing unit 201 performs image composition processing on the composite image obtained by combining the images received by the image composition processing unit 201 up to the previous time read from the second image memory 205 and the image output from the current selection unit 202a. Thus, it is recorded in the second image memory 205 as the current composite image.

  If the image input to the image composition processing unit 201 is the first image, the image composition processing unit 201 does not perform the image composition processing and directly stores the image in the second image memory 205. Record as an image.

  When one image composition process is completed, the next image is read from the first image memory 204 and provided to the image composition processing unit 201. Then, the image composition processing unit 201 performs image composition processing in the same manner and records it as a new current composite image in the second image memory 205.

  When all the images for composition are read from the first image memory 204 and the image composition processing by the image composition processing unit 201 is completed, the image composition processing unit 201 sends the final main composite image to the reduction processing unit 203. Output. The reduction processing unit 203 converts the image size of the inputted main composite image into an image size for display in the image display unit 103.

  During the synthesis process, the selection unit 203a selects the output of the reduction processing unit 203. As a result, the reduced composite image is input from the reduction processing unit 203 to the image display unit 103 and displayed on the image display unit 103. Further, the composite image is given to the format control unit 104, and the format control unit 104 performs format conversion processing as described above. Then, the image after the format conversion process is recorded on the recording medium 106 by the recording / reading unit 105.

  Here, image processing performed by the image processing control unit 102 shown in FIG. 2 will be described in comparison with conventional processing.

  FIG. 3 is a diagram for explaining image processing performed by the image processing control unit 102 shown in FIG. FIG. 3A is a diagram showing conventional image processing, and FIG. 3B is a diagram showing image display when the image processing shown in FIG. 3A is performed. FIG. 3C is a diagram showing image processing of the image processing control unit 102, and FIG. 3D is a diagram showing image display when the image processing shown in FIG. 3C is performed.

  In the conventional image processing shown in FIG. 3A, for example, when a camera shutter is pressed, images obtained as a result of continuous shooting are sequentially captured in an image memory (captured image capture). Simultaneously with the end of the continuous shooting, the image composition processing is started (composition processing). Then, when the synthesis process ends, a synthesized image is displayed (display).

  At this time, as shown in FIG. 3B, a black screen is displayed on the image display unit from the time the shutter is pressed until the image composition is completed (that is, from the capture of the captured image to the completion of the composition process). Medium status is displayed. After the image composition is completed, the image is displayed on the image display unit (main composite image), and the user confirms whether the subject blur has occurred and whether the image obtained as a result of continuous shooting is appropriate. It will be.

  On the other hand, in the present embodiment, as shown in FIG. 3C, after the shutter is pressed, images obtained as a result of continuous shooting are sequentially taken into the image memory. Then, every time one image is taken, that is, every time one image is taken, a reduction process is performed on the image, a combination process is performed, and a combined image is displayed on the image display unit 103 (progress display process: reduction) + Compositing process + display).

  When the continuous image shooting is completed, the composition process is started. When the main compositing process ends, the main composite image is resized to a display image size and displayed on the image display unit 103 (display).

  At this time, as shown in FIG. 3D, the composite image is updated and displayed every time one image is taken after the shutter is pressed. By performing such a progress display process, the user can check whether or not the image obtained as a result of continuous shooting is appropriate, such as whether subject blurring occurs during continuous shooting. In other words, before the end of the synthesis process, it is possible to confirm the synthesized image up to the image that has been captured and displayed by the progress display process. When the progress display process ends, the main compositing process is performed, a black screen processing status display is performed on the image display unit 103, and the main composite image is displayed on the image display unit 103 after the main compositing process ends.

  In the following description, the synthesis process and display shown in FIGS. 3A and 3B are referred to as a first synthesis process display function, and the synthesis process and display shown in FIGS. 3C and 3D are shown. Is referred to as a second composition processing display function.

  FIG. 4 is a flowchart for explaining the image composition processing after the continuous shooting is started in the image processing control unit 102 shown in FIG.

  2 and 4, when image processing is started, a control device such as a CPU (not shown) determines whether or not the second composite processing display function is on (step S401). If the second composition processing display function is on (YES in step S401), the CPU notifies the image processing control unit 102 of the fact. As a result, the image processing control unit 102 operates with the second composite processing display function.

  Subsequently, the image processing control unit 102 determines whether one image has been taken (step S402). If no image is captured (NO in step S402), image processing control unit 102 waits. When one image is captured (YES in step S402), the image processing control unit 102 records the captured image in the first image memory 204 (step S403). Then, the reduction processing unit 202 reads this image from the first image memory 204 and performs reduction to reduce the image (step S404).

  In the progress display process, as described above, the selection unit 202a selects the output of the reduction processing unit 202, and the selection unit 203a selects the output of the image composition processing unit 201.

  Next, the image processing control unit 102 determines whether or not the reduced image is the first sheet (step S405). If the reduced image is the first image (YES in step S405), as described above, the image composition processing unit 201 does not perform composition processing, and uses the reduced image as a new (current) composite image. (Step S406). Then, the image composition processing unit 201 records the current composite image in the second image memory 205 (step S407).

  On the other hand, if the reduced image is not the first image (NO in step S405), the image composition processing unit 201 composes a composite of images captured up to the previous time recorded in the second image memory 205. The image is read out and the reduced image and the previous combined image are combined to obtain the current combined image (step S408). Then, the image composition processing unit 201 proceeds to the process of step S <b> 407 and registers the current composite image in the second image memory 205.

  Subsequently, the image processing control unit 102 determines whether or not shooting of all the images to be combined has been completed (step S409). If shooting has not been completed (NO in step S409), the image processing control unit 201 returns to step S402 and repeats the processes in steps S402 to S409.

  On the other hand, if it is determined that shooting has been completed (YES in step S409), the selection unit 202a selects the output of the first image memory 204, and the selection unit 203a selects the output of the reduction processing unit 203. Then, the image composition processing unit 201 reads one image taken from the first image memory (step S410).

  Subsequently, the image composition processing unit 201 determines whether or not the read image is the first image to be composed (step S411). If the read image is the first image (YES in step S411), the image composition processing unit 201 sets the image as the current composite image without performing the composition processing (step S412). The image composition processing unit 201 records the current composite image in the second image memory 205 (step S413).

  On the other hand, if the image read out from the first image memory 204 is not the first image to be synthesized (NO in step S411), the image synthesis processing unit 201 is up to the previous time recorded in the second image memory 205. Next, a combined image obtained by combining the images received by the image combining processing unit 201 is read out. The image composition processing unit 201 performs composition processing of the image read from the first image memory 204 and the previous composite image to obtain the current composite image (step S414). Then, the image composition processing unit 201 proceeds to the process of step S413, and records the current composite image in the second image memory 205 (step S414).

  Next, the image composition processing unit 201 determines whether or not the necessary number of images have been combined (step S415). If the required number of images have not been combined (NO in step S415), the image composition processing unit 201 returns to step S410 and repeats steps S410 to S415.

  On the other hand, when the required number of images have been combined (YES in step S415), the image composition processing unit 201 passes the final composite image, which is a final product, to the reduction processing unit 203. The reduction processing unit 203 performs image reduction processing for converting the image size of the composite image into an image size corresponding to the display resolution of the image display unit 103 (step S416). Then, the image processing control unit 102 ends the process.

  In step S401, if the second composition processing display function is off (NO in step S401), the CPU notifies the image processing control unit 102 of the fact. As a result, the image processing control unit 102 operates with the first composite processing display function.

  In this first composition processing display function, the selection unit 202a selects the output of the first image memory 204, and the selection unit 203a selects the output of the reduction processing unit 203.

  Subsequently, the image processing control unit 102 determines whether one image has been taken (step S417). If no image is captured (NO in step S417), image processing control unit 102 waits. When one image is taken (YES in step S417), the image processing control unit 102 records the taken image in the first image memory 204 (step S418).

  Next, the image processing control unit 102 determines whether or not shooting for the required number of sheets has been completed (step S419). If the required number of images has not been shot (NO in step S419), the image processing control unit 201 returns to the processing in step S417 and repeats the processing in steps S417 to S419.

  On the other hand, if it is determined that shooting has been completed (YES in step S419), the image processing control unit 102 proceeds to the process of step S410 and performs the processes of steps S410 to S416 described above.

  FIG. 5 is a flowchart for explaining the image display processing after the continuous shooting is started in the image processing control unit 102 shown in FIG.

  Referring to FIGS. 2 and 5, first, a control device such as a CPU determines whether or not the second composition processing display function is on (step S501). If the second composite processing display function is on (YES in step S501), the CPU notifies the image processing control unit 102 of that fact. Accordingly, as described above, the image processing control unit 102 operates with the second composite processing display function.

  In the second composition processing display function, the image processing control unit 102 displays a black image on the image display unit 103 (step S502: black display). Subsequently, the image processing control unit 102 determines whether or not the first image has been input to the image composition processing unit 201 (step S503). If the first image has not been input (NO in step S503), the image processing control unit 102 continues the black display.

  If the first image has been input (Yes in step S503), the image output by the image composition processing unit 201 is resized via the reduction processing unit 203 and displayed on the image display unit 103 ( Step S504: Update display image).

  Next, the image processing control unit 102 determines whether or not shooting for the required number of sheets has been completed (step S505). If shooting of the required number of images has not been completed (NO in step S505), the image processing control unit 201 returns to step S502 and repeats the processing of steps S503 to S505. When the second and subsequent images are input to the image composition processing unit 201, it is determined in step S503 whether the image composition processing up to the currently input image has been completed.

  On the other hand, if it is determined that shooting for the required number of images has been completed (YES in step S505), the image processing control unit 102 displays a status indicating that this composition processing is being performed on the image display unit 103 (step S506). Then, the image processing control unit 102 determines whether or not the composition process has been completed (step S507). If the composition process is not completed (NO in step S507), the image processing control unit 102 continues the composition process.

  When the main compositing process is completed (YES in step S507), the image processing control unit 102 resizes the main composite image by the reduction processing unit 203, and then displays the main composite image on the image display unit 103 (step S508). . Then, the image processing control unit 102 ends the image display process.

  If the second composition processing display function is off in step S501 (NO in step S501), the CPU notifies the image processing control unit 102 of that fact. As a result, the image processing control unit 102 operates with the first composite processing display function.

  In the first composition processing display function, the image processing control unit 102 displays a status indicating that continuous shooting is in progress on the image display unit 103 (step S509). Thereafter, the image processing control unit 102 proceeds to step S507, and determines whether or not the present composition processing is completed.

  Here, an image obtained by continuous shooting and an image displayed on the image display unit will be described.

  FIG. 6 is a diagram showing five temporally continuous images obtained as a result of continuous shooting of five images. FIG. 7 is a diagram for explaining images of the images when the synthesis processing is performed on the five images shown in FIG. FIG. 8 is a diagram for explaining the status display and the image of the composite image displayed on the image display unit 103 shown in FIG.

  Assume that continuous shooting is performed and five continuous images shown in FIG. 6 are obtained. First, as described above, these five images are sequentially combined. In FIG. 7, the first display image is an image obtained by resizing the first photographed image shown in FIG. The second display image is obtained as a result of combining the first display image shown in FIG. 6 with the resized image of the second photographed image. The third display image is obtained as a result of combining the second display image shown in FIG. 7 and the resized image of the third photographed image shown in FIG.

  The fourth display image is obtained as a result of combining the third display image shown in FIG. 7 and the resized image of the fourth photographed image shown in FIG. The fifth display image is obtained as a result of combining the fourth display image shown in FIG. 7 and the resized image of the fifth photographed image shown in FIG.

  As can be understood from the above description, in this synthesis process, as shown in FIG. 8, first, black display is performed on the image display unit 103, and subsequently, continuous shooting is indicated on the image display unit 103. The status is displayed. Subsequently, a status indicating that the composition process is in progress is displayed on the image display unit 103, and then the composition image is displayed on the image display unit 103.

  Here, as described with reference to the flowchart of FIG. 4, when the final shooting is completed in the continuous shooting, this composition processing is performed. Therefore, after the fourth display image shown in FIG. 7 is displayed on the image display unit 103, the third image shown in FIG. 8 (status indicating that the composition process is being performed) is displayed on the image display unit 103. Will be. If the capacity of the second image memory 205 permits, the fourth display image may be displayed as it is.

  As described above, in the image processing apparatus according to the first embodiment, the user can confirm whether or not subject blur has occurred in the fourth display image illustrated in FIG. 7 before starting the synthesis process. it can. Thereby, the user can quickly determine whether or not the image obtained as a result of shooting is an image suitable for the main composition process.

  In the first embodiment, in consideration of the reduction of the time required for the completion of the synthesis process, up to the fourth display image shown in FIG. 7 is displayed on the image display unit 103, and then the two images shown in FIG. Although the image shown in the eyes is displayed on the image display unit 103, the fifth display image shown in FIG. 7 may also be displayed on the image display unit 103. At this time, the fifth display image shown in FIG. 7 is performed on the image display unit 103 for a predetermined time, and then the second image shown in FIG. 8 is displayed on the image display unit 103.

  In the present embodiment, in the progress display process, the captured image is resized and reduced in advance in order to shorten the processing time as compared with the image synthesis process performed in the generation of the synthesized image, and the synthesis process is performed. However, the present invention is not limited to this, and the image composition processing unit 201 may perform image composition processing that simplifies the image composition processing that is performed in the generation of the composite image. For example, the generation of this composite image is performed in the state of R (red), G (green), and B (blue) image data (RAW data) resulting from the output of the image sensor, while simple composition. Then, the processing load and the processing speed may be reduced by converting the RAW data into the state of Y (luminance) and UV (color difference) image data (YUV data) and performing the synthesis. In this case, the above-described processing may be performed by using the reduction processing unit 203 as a color conversion unit instead. In addition, for example, in the generation of the composite image, a complicated composition in which the composition method is different for each block or pixel is performed, whereas in a simple composition, a simple addition or an addition average composition is performed. May be. Furthermore, the generation of the composite image is performed by performing gradation processing, color processing, and the like on the pre-combination image or the post-combination image, while part of the procedure is omitted for simple composition. You may do it.

  In the present embodiment, the number of continuously shot images is five, but the number of continuously shot images may be two or more, and the number of images can be arbitrarily set by the user. The number of images to be combined may be smaller than the number of images taken continuously. Here, the image composition ratio in the simple composition process is halved, but the image composition ratio may be arbitrarily set by the user.

  In addition, here, the thinning process is used in the reduction process, but the reduction process may be performed using, for example, an oversampling filter, a linear interpolation filter, or a bicubic filter. Furthermore, during continuous shooting, the second image in FIG. 8 is displayed, but other images may be displayed. The resolution and display resolution of the captured image are 3840 × 2880 and VGA (640 × 480), respectively, but the resolution and display resolution of the captured image are not limited to this.

  Furthermore, the simple synthesis and the synthesis for generating this synthesized image are performed in the same synthesis circuit and in different periods. In addition, after the predetermined number of images are acquired, until the main composite image is generated, the composite image synthesized immediately before the synthesis for generating the main composite image is displayed.

  As mentioned above, although this invention was demonstrated based on embodiment, this invention is not limited to these embodiment, Various forms of the range which does not deviate from the summary of this invention are also contained in this invention. .

  For example, the function of the above embodiment may be used as a control method, and this control method may be executed by the image processing apparatus. At this time, the control method includes at least an acquisition step, a reduction step, a synthesis step, and a display step. The control method may include a simple synthesis step, a first display step, a main synthesis step, and a second display step. In addition, a program in which the functions of the above-described embodiment are described as a procedure may be used as a control program that can be executed by a computer, and the control program may be executed by a computer included in the image processing apparatus. The control program is recorded on a computer-readable recording medium, for example.

  The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various recording media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads the program. It is a process to be executed.

DESCRIPTION OF SYMBOLS 101 Image input part 102 Image processing control part 103 Image display part 104 Format control part 105 Recording / reading part 106 Recording medium 107 Operation part 201 Image composition processing part 202 Reduction processing part 203 Reduction processing part 204,205 Image memory

Claims (9)

An acquisition means for sequentially acquiring a plurality of images;
First storage means for sequentially storing images acquired by the acquisition means in a memory;
First reduction means for reducing an image stored in the first storage means;
Selection means for selectively outputting either an output image from the first storage means or an output image from the first reduction means;
A synthesis circuit for synthesizing a plurality of images including an image output from the selection unit ;
Second storage means for storing an image output from the synthesis circuit ;
Display means for displaying an input image,
Before a predetermined number of images are acquired by the acquisition means,
The first reduction means sequentially reduces the images stored in the first storage means,
The combining circuit, selectively and images reduced in output the first reduction unit, said the stored combined image to the second storage means are sequentially synthesized to generate a synthesized image by the selection means , Storing the composite image as a new composite image in the second storage means,
The display means sequentially displays an image output from the synthesis circuit on a display unit ,
After a predetermined number of images are acquired by the acquisition means,
The combining circuit is selectively output by the selecting unit, stored in the first storage unit and not reduced by the first reduction unit, and a combined image stored in the second storage unit. Are sequentially synthesized to generate a main composite image, and the main composite image is stored in the second storage unit as a new composite image . Second reduction means for reducing the image synthesized by the synthesis circuit ;
Recording means for recording the image synthesized by the synthesis circuit ,
After a predetermined number of images are acquired by the acquisition means,
The synthesizing circuit sequentially synthesizes an image stored in the first storage unit and not reduced by the first reduction unit and a previous composite image stored in the second storage unit, thereby generating a composite image. And the main composite image is stored in the second storage means as a new composite image,
The second reduction means reduces the synthesized image that has been synthesized with the predetermined number of times by the synthesis circuit ,
The display means displays the image output from the second reduction means on the display unit,
The image processing apparatus according to claim 1, wherein the recording unit records the main composite image. The display means immediately after the predetermined number of images are acquired by the acquisition means and before the main composite image is generated by the combining circuit , immediately before the synthesis for generating the main composite image is performed. The image processing apparatus according to claim 2, wherein the synthesized image synthesized is displayed.   4. The image processing apparatus according to claim 1, wherein the first reduction unit reduces an image in accordance with an image size displayed on the display unit. 5. The combining circuit, the generation of the composite image is carried out in the RAW data, to any one of claims 1 to 4, characterized in that for generating the composite image to be displayed on the display unit in the YUV data The image processing apparatus described. Photographing means for photographing the plurality of images;
Imaging apparatus characterized by having an image processing apparatus according to any one of claims 1 to 5. Obtaining means for obtaining an image, and a first reduction unit for reducing the first memory means and the image stored in said first storage means for storing the image acquired by the acquisition unit in the memory, the A selection unit that selectively outputs one of the output image from the first storage unit and the output image from the first reduction unit, and a plurality of images including the image output from the selection unit are combined. A control method for an image processing apparatus, comprising: a synthesis circuit; and a second storage unit that stores an image output from the synthesis circuit ,
An acquisition step in which the acquisition means sequentially acquires a plurality of images;
Before a predetermined number of images are acquired by the acquisition means,
A reduction step in which the first reduction means sequentially reduces the images stored in the first storage means;
The synthesizing circuit sequentially synthesizes the image reduced by the first reduction unit and the synthesized image stored in the second storage unit to generate a synthesized image, and the synthesized image is stored in the second storage unit. A first compositing step for storing as a new composite image;
Sequentially display the image output from the combining circuit, possess a display step of displaying, a,
After a predetermined number of images are acquired by the acquisition means,
An image which is selectively output by the selection means and stored in the first storage means and not reduced by the first reduction means; and a composite image stored in the second storage means; generates a sequentially combined to the combined image a, control of the image processing apparatus characterized by chromatic and second synthetic step of storing the present composite image as a new composite image in the second storage means, Method. A computer-executable program in which a procedure of a control method for an image processing apparatus according to claim 7 is described. A computer-readable recording medium on which a program for causing a computer to execute each step of the control method of the image processing apparatus according to claim 7 is recorded.

Images