JP2011217009A - Image processing apparatus and method, and program - Google Patents

Abstract

An object of the present invention is to generate individual images continuously captured based on data recorded in a memory while preventing the memory capacity from being compressed.
In step S20, still image data corresponding to each difference image data is restored from the top image data and each difference image data with respect to the top image data. That is, a plurality of still image data representing still images in which a difference image exists in the head image is generated by individually synthesizing the head image data and each difference image data. Therefore, if the predetermined number of continuous images is, for example, 30 images, a set of up to 29 difference image data is stored in one file, and therefore up to 29 still image data are generated. The Rukoto. The plurality of images reproduced by the restored plurality of still image data are visually the same images as the plurality of images captured during continuous imaging.
[Selection] Figure 3

Description

  The present invention relates to an image processing apparatus that generates still image data, an image processing control method, and a program.

  As a conventional technique, a technique is known in which a plurality of pieces of image data continuously captured are recorded in a memory as one main image data and a plurality of thumbnail image data (see, for example, Patent Document 1 below). ). Therefore, one main image or a plurality of thumbnail images can be reproduced based on the data recorded in the memory.

JP 2003-283934 A

  However, in the above-described prior art, each image captured continuously is recorded in a memory as it is as one main image data and a plurality of thumbnail image data. Therefore, there is a problem that it is difficult to easily browse only an image desired by the user from a plurality of images captured continuously.

  In addition, the reproducible images are reduced thumbnail images other than the main image. Therefore, it is also impossible to browse only the image desired by the user from the plurality of images captured continuously in the size at the time of imaging.

  The present invention has been made in view of such conventional problems, and allows only a user-desired image to be easily viewed at a size at the time of imaging from a plurality of images that are continuously captured. For the purpose.

  In order to solve the above-described problem, in the image processing apparatus according to the first aspect of the present invention, a plurality of pieces of image data that are continuously captured are converted into one piece of reference image data and a difference image with respect to the reference image data. Recording means for recording as a set consisting of data, or a set consisting of one reference image data and a difference image data of images adjacent to each other, and the difference in the set recorded by the recording means Detection means for detecting an instruction for generating still image data based on image data, and still image data based on the reference image data and the difference image data included in the set in which the instruction is detected by the detection means And generating means for generating.

  In the image processing apparatus according to the second aspect of the invention, the detection unit detects an instruction to generate still image data based on any one of the difference image data recorded in the recording unit. The generating unit generates one piece of still image data based on any difference image data in which the instruction is detected by the detecting unit and the reference image data.

  In the image processing apparatus according to the third aspect of the invention, the detection unit detects an instruction to generate still image data based on all the difference image data in the set recorded in the recording unit. The generation means generates a plurality of still image data corresponding to each difference image data based on all the difference image data and the reference image data.

  Further, in the image processing apparatus according to the invention of claim 4, the reference image data is first image data captured first among the plurality of image data continuously captured. Features.

  In the image processing method according to the fifth aspect of the present invention, a plurality of pieces of image data that are continuously captured are converted into a single reference image data and a difference image that is image data of a difference with respect to the reference image data. A recording step of recording as a set of data, or a set of differential image data that is a difference image data between adjacent images of one reference image data and continuously captured images, and in this recording step A detection step for detecting an instruction to generate still image data based on the difference image data in the recorded set; and the reference image data and the difference image data included in the set in which the instruction is detected by the detection step; And a generation step of generating still image data.

  According to another aspect of the program of the present invention, a computer included in an image processing apparatus includes a plurality of consecutively captured image data, one reference image data, and the reference image data. Recording that records as a set of difference image data that is difference image data, or a set of difference image data that is difference image data of adjacent images of one piece of reference image data and images that are continuously captured Means for detecting an instruction for generating still image data based on the difference image data in the set recorded in the recording means; the reference image data included in the set in which the instruction is detected by the detecting means; Based on the difference image data, it functions as a generation means for generating still image data.

  According to the present invention, it is possible to easily browse only an image desired by a user at a size at the time of imaging from a plurality of images captured continuously.

It is a block block diagram which shows the circuit structure of the digital camera which concerns on one embodiment of this invention. It is a flowchart which shows the process sequence in continuous imaging mode. It is a flowchart which shows the process sequence in the browsing mode of an image. It is a flowchart following FIG.

  Hereinafter, embodiments of the present invention will be described. FIG. 1 is a block configuration diagram showing an outline of an electrical configuration of a digital camera 1 according to an embodiment of the present invention. The digital camera 1 has an AE (Automatic Exposure), AF (Auto Focus) function, and a continuous imaging function, and mainly includes the following parts. That is, the digital camera 1 has an imaging element 9 as an imaging unit that photoelectrically converts an optical image of a subject imaged by the imaging lens 8 and outputs it as an imaging signal. The image sensor 9 is driven by a drive signal based on a timing signal generated by a timing generator (TG) included in the camera control unit 10.

  The imaging lens 8 includes a focus lens and a lens motor for moving the focus lens on the optical axis. The position of the focus lens on the optical axis is controlled by driving the lens motor in accordance with a command from the camera control unit 10.

  The output signal of the image sensor 9 is converted to a digital signal by a signal conversion unit 11 including an A / D (Analog / Digital) converter and the like, and then sent to the camera control unit 10. The camera control unit 10 stores imaging data after A / D conversion in a RAM (Random Access Memory) 12. The signal processing unit 14 performs RGB interpolation processing for generating R (red), G (green), and B (blue) color component data (RGB data) for each pixel in the image data stored in the RAM 12, and RGB data. YUV conversion processing for generating YUV data consisting of a luminance signal (Y) and color difference signals (U, V) for each pixel, and digital signal processing for improving image quality such as auto white balance and edge enhancement are performed.

  When the imaging mode is set, the YUV data stored in the RAM 12 is converted into a video signal by the display control unit 13 every time one frame is accumulated in the RAM 12, and then is displayed as a through image in the display device 4. Displayed on the screen. At the time of imaging, the image data temporarily stored in the RAM 12 is compressed and encoded by the signal processing unit 14 by the JPEG (Joint Photographic Experts Group) method, and then, for example, by various memory cards via the external storage control unit 15. It is recorded as a still image file in the configured external storage device 16.

  The still image file recorded in the external storage device 16 is appropriately read in accordance with the user's selection operation in the reproduction mode, decompressed by the signal processing unit 14 and developed as YUV data in the RAM 12, and then the display control unit 13 Is displayed on the display device 4 as a still image.

  The key input block 17 includes a plurality of keys and buttons such as a menu key, a mode dial, a cursor key, a SET key, and a shutter button. The operation state of each key and button is scanned at any time by a CPU (Central Processing Unit) 18. .

  The shutter button has a half shutter function that can be half-pressed and fully pressed.

  The CPU 18 performs control of each part constituting the digital camera 1, AE control based on luminance information included in the imaging signal, AF control by a contrast detection method, and the like. Various programs for causing the CPU 18 to perform these controls and various data necessary for each control are stored in a ROM (Read Only Memory) 19. The ROM 19 also stores setting flag information related to various functions of the digital camera 1 including flag information for detecting a mode selection operation by the user and storing the result as flag information.

  Note that a USB terminal connection unit is connected to the external I / F (interface) 20.

  In the present embodiment having the above configuration, when the user operates the menu key to display the menu screen on the display device 4 and then selects the continuous imaging mode from the menu screen and operates the SET key, continuous imaging is performed. The mode is set. With this continuous imaging mode set, the digital camera 1 is preferably fixed with a tripod or the like, and the user presses the shutter button. Then, the CPU 18 executes the continuous imaging mode process shown in the flowchart of FIG. 3 based on the program stored in the ROM 19.

  That is, the subject is continuously imaged (step S1), and a plurality of image data obtained by the continuous imaging is written in the RAM 12 (step S2). That is, the camera control unit 10 is controlled to start exposure of the image sensor 9, and image data generated along with the start of exposure is read from the image sensor 9 and written to the RAM 12. This writing operation is performed for a predetermined continuous number of images (for example, a predetermined number in the range of 30 to 60). When a predetermined number of pieces of image data are held in the RAM 12 by this continuous imaging, the CPU 18 advances the process from step S2 to step S3.

  Note that, during continuous imaging, the user captures, for example, only the background at the start of imaging, and continuously captures a subject that operates within the background.

In step S3, as a storage format from the RAM 12 to the memory (external storage device 16),
Option 1: Whether to save the top image data and the difference image data for the top image data as one file (save format (1))
Option 2: Whether to save the top image data and the difference image data next to each other after the continuously captured images as one file (storage format (2))
Inform the user to select one of the following.

  This notification is performed by displaying the storage formats (1) and (2) of the options 1 and 2 on the display device 4. Then, it is determined whether one of the storage formats (1) and (2) displayed on the display device 4 has been selected (step S4).

  As a result of the determination in step S4, if it is determined that one of the storage formats (1) and (2) is selected, then the storage format (1) is selected from the storage formats (1) and (2). Is detected (step S5). If the determination in step S5 is YES and selection of the storage format (1) is detected, the CPU 18 advances the process from step S5 to step S6. Then, in step S6, among the plurality of image data obtained by the continuous imaging, the first image data that is the image data of the first imaged image and the difference image between the first image data and other image data The difference image data as data is written and saved in a memory (external storage device 16) as one file.

  Therefore, if the predetermined number of consecutive images is, for example, 30, when the storage format (1) is selected, one top image data and up to 29 difference image data with respect to the top image data are stored. Are stored in the external storage device 16 as one file. Note that 29 images is the maximum value, and when an image that has no difference from the top image is captured, the difference image data is less than 29 images.

  If the determination in step S5 is NO and the save format (2) is selected, the CPU 18 advances the process from step S5 to step S7. And in this step S7, among the plurality of image data obtained by the continuous imaging, the first image imaged first and the difference image data which is the difference image data next to the continuously imaged image data Are written and saved in the memory (external storage device 16) as one file.

  Therefore, if the predetermined number of consecutive images is, for example, 30 images, even when the storage format (2) is selected, the external storage device 16 stores one head image data and a maximum of 29 images. A set of the difference image data is stored in the external storage device 16 as one file. Note that 29 images is the maximum value, and when images having no difference are continuously captured, the difference image data is less than 29 images.

  3 and 4 are a series of flowcharts showing a processing procedure in the image browsing mode. When the user operates the menu key to display the menu screen on the display device 4 and then selects the viewing mode from the menu screen and operates the SET key, the viewing mode is set. When the viewing mode is set, the CPU 18 displays a list of files stored in the external storage device 16 on the display device 4, and determines whether any file selection is detected from the displayed files. (Step S11).

  If selection of any file is detected, the file in which the selection is detected is a file of continuously captured images, that is, whether the file is in the storage format (1) or the storage format (2). Is determined (step S12). When the selected file is a file other than the file in the storage format (1) or the storage format (2), the process proceeds to another process (step S13), and the image data included in the file is converted to the image data. A process of reproducing the image based on the image and displaying the image on the display device 4 is executed.

  If the selected file is a file in the storage format (1) or the storage format (2), a notification is made as to whether or not to restore a still image from the difference image of the continuous images (step S14). This notification is performed by displaying “execution of restoration” and “cancellation of restoration” on the display device 4 as options, for example. Then, it is determined whether selection of “execution of restoration” is detected among “execution of restoration” and “cancellation of restoration” displayed on the display device 4 (step S15).

When selection of “execution of restoration” is detected, the following restoration formats (A) and (B) are displayed on the display device 4 (step S16).
Restore format (A): Restore all images Restore format (B): Restore one specified image

  Then, it is determined whether one of the storage formats (A) and (B) displayed on the display device 4 has been selected (step S17).

  As a result of the determination in step S17, if it is determined that one of the storage formats (A) and (B) has been selected, then the restoration format (A) is selected from the restoration formats (A) and (B). It is determined whether or not has been detected (step S18). Restoration format (A): When restoration of all images is detected, the CPU 19 advances the process from step S18 to step S19, and determines whether or not the file selected in step S11 is the saving format (1). to decide.

  As a result of the determination in step S19, when the selected file is not in the storage format (1) but in the storage format (2), that is, the difference between the top image data and the adjacent difference image data of the continuously captured images. Are stored as one file, the process proceeds from step S19 to step S20.

  In step S20, the still image data corresponding to each difference image data is restored from the top image data and each difference image data adjacent to the successively captured images. That is, a plurality of still image data representing still images in which a difference image exists in the head image is generated by individually synthesizing the head image data and each difference image data. Therefore, if the predetermined number of consecutive images is, for example, 30 images, a maximum of 29 sets of difference image data are stored in the external storage device 16 as one file as described above. 29 still image data are generated.

  Next, these still image data are written and stored in the memory (external storage device 16) (step S22).

  At this time, all the still image data may be written in the external storage device 16 as one file, or each still image data may be written in the external storage device 16 as a separate file. In any file format, when the user selects the file written in step S22 to play back (step S11 → YES), the selected file is not a file of continuously picked up images. The determination in step S12 is NO. Therefore, as described above, the process proceeds from step S12 to step S13, and an image based on the still image data included in the selected file is reproduced on the display device 4. Therefore, the user can easily browse an image desired by the user from a plurality of images captured continuously in the size at the time of imaging.

  On the other hand, if the result of determination in step S19 is that the selected file is in the storage format (1), that is, a file in which the top image data and the difference image data for the top image data are stored as one file. If there is, the process proceeds from step S19 to step S21.

  In step S21, still image data corresponding to each difference image data is restored from the top image data and each difference image data with respect to the top image data. That is, a plurality of still image data representing still images in which a difference image exists in the head image is generated by individually synthesizing the head image data and each difference image data. Therefore, if the predetermined number of consecutive images is, for example, 30 images, a maximum of 29 sets of difference image data are stored in the external storage device 16 as one file as described above. 29 still image data are generated.

  Next, these still image data are written and stored in the memory (external storage device 16) (step S22).

  At this time, as described above, all the still image data may be written in the external storage device 16 as one file, or each still image data may be written in the external storage device 16 as a separate file. Regardless of the file format, when the user selects to reproduce the file written in step S22, the determination in step S12 is NO. Therefore, as described above, the process proceeds from step S12 to step S13, and an image based on still image data included in the file can be reproduced and viewed by the user.

  On the other hand, if it is detected in step S18 that the restoration format (B): restoration of one designated image is detected, the CPU 19 advances the process from step S18 to step S23. Then, continuously picked-up thumbnail image data is generated from the top image data and the difference image data, and the thumbnail images are displayed as a list on the display device 4 (step S23).

  That is, first, the head image data and each difference image data are individually combined to generate a plurality of still image data representing still images in which a difference image exists in the head image. Thereafter, the plurality of still image data are reduced to generate a plurality of thumbnail image data, and a plurality of thumbnail images based on the plurality of thumbnail images are displayed on the display device 4. Therefore, if the predetermined number of consecutive images is, for example, 30, for example, as described above, a set of up to 29 difference image data is stored in the external storage device 16 as one file. A maximum of 29 thumbnail image data is generated, and a maximum of 29 thumbnail images are displayed on the display device 4.

  Next, it is determined whether any one of the plurality of thumbnail images displayed as a list on the display device 4 has been selected (step S24). If any one thumbnail image is selected, the CPU 18 advances the process from step S24 to step S25 in FIG. Then, it is determined whether or not the file selected in step S11 is in the storage format (1) (step S25).

  As a result of the determination in step S25, when the selected file is not in the storage format (1) but in the storage format (2), that is, the difference between the first image data and the adjacent image data that is adjacent to the continuously captured image. Are stored as one file, the CPU 18 advances the process from step S25 to step S26.

  In step S26, the still image data corresponding to the selected thumbnail image is restored from the top image data and the difference image data adjacent to the images successively captured. That is, by combining the top image data and the difference image data corresponding to the selected thumbnail image, still image data representing a still image in which the difference image exists in the top image, and the selected thumbnail image and Still image data representing a similar image is generated.

  Therefore, for example, if the selected thumbnail image is an image having a difference image of the image taken at the tenth image, for example, still image data representing a still image in which the difference image exists in the head image is restored.

  In step S28 following step S26, the restored still image data is a separate file from the continuously captured image file, that is, a file separate from the storage format (1) and the storage format (2). , And write to the memory (external storage device 16). When the user selects the file written in step S28 to reproduce (step S11 → YES), the selected file is not a file of continuously picked up images, so the determination in the next step S12 is NO. . Therefore, as described above, the process proceeds from step S12 to step S13, and an image based on the still image data included in the selected file is reproduced on the display device 4.

  Therefore, the user can easily browse only the image desired by the user at the size at the time of imaging from the plurality of images captured continuously.

  If the selected file is in the storage format (1) as a result of the determination in step S25, that is, the first image data and the difference image data for the first image data are stored as one file. In that case, the CPU 18 advances the process from step S25 to step S27.

  In step S27, the still image data corresponding to the selected thumbnail image is restored from the top image data, the top image data, and the difference image data with respect to the top image data. That is, by combining the top image data and the difference image data corresponding to the selected thumbnail image, still image data representing a still image in which the difference image exists in the top image, and the selected thumbnail image and Still image data representing a similar image is generated.

  Therefore, for example, if the selected thumbnail image is an image having a difference image of the image taken at the tenth image, for example, still image data representing a still image in which the difference image exists in the head image is restored.

  Then, in step S28 following step S26, the restored still image data is a separate file from the continuously captured image files, that is, files in the saving format (1) and saving format (2), as described above. Is written in a memory (external storage device 16) as a separate file. When the user selects the file written in step S28 to reproduce (step S11 → YES), the selected file is not a file of continuously picked up images, so the determination in the next step S12 is NO. . Therefore, as described above, the process proceeds from step S12 to step S13, and an image based on the still image data included in the selected file is reproduced on the display device 4.

  Therefore, the user can easily browse only the image desired by the user at the size at the time of imaging from the plurality of images captured continuously.

  In addition, the image data of continuously captured images is not recorded as it is in the external storage device 16, but the difference image data is recorded except for the top image data. Therefore, the capacity of the external storage device 16 is not compressed. As a result, it is possible to reproduce and display individual images continuously captured based on the data recorded in the memory while preventing compression of the capacity of the external storage device 16 (memory).

  Further, in the present embodiment, of the plurality of image data obtained by continuous imaging, the difference between the first image data that is the image data of the first captured image and the other image data with respect to the first image data. Since the difference image data, which is image data, and the external storage device 16 are recorded, the user captures a reference image (reference image) at the start of imaging, and subsequently selects a subject that operates in the reference image. What is necessary is just to image. Therefore, the user can easily perform continuous imaging capable of reproducing individual images captured continuously based on the data recorded in the memory.

  In the present embodiment, the head image data is used as reference image data, and the reference image data and difference image data that is the difference between the reference image data are recorded. The image data may be used as reference image data. For example, the last imaged image data may be used as the reference image data, and a predetermined number of image data may be used as the reference image data. That is, any image data may be used as long as it is one of the continuously captured image data.

  In the embodiment, in step S23, thumbnail images representing the entire image are generated from the first image data and the difference image data and displayed in a list so that an image to be restored is designated. However, instead of generating a thumbnail image representing the entire image, thumbnail images representing only the difference image may be generated based on the difference image data and displayed as a list. In this way, in the thumbnail image list display in step S22, the synthesis of the head image data and the difference image data can be omitted, and the processing can be simplified.

DESCRIPTION OF SYMBOLS 1 Digital camera 4 Display apparatus 9 Image pick-up element 10 Camera control part 11 Signal conversion part 12 RAM
13 Display Control Unit 14 Signal Processing Unit 15 External Storage Device 16 External Storage Device 17 Key Input Block 18 CPU
19 ROM

Claims (6)

A plurality of consecutively captured image data, a set of one reference image data and a difference image data with respect to the reference image data, or an image adjacent to one reference image data and an image continuously captured Recording means for recording as a set of image data of the difference between,
Detecting means for detecting an instruction to generate still image data based on the difference image data in the set recorded by the recording means;
Generating means for generating still image data based on the reference image data and the difference image data included in the set in which the instruction is detected by the detecting means;
An image processing apparatus comprising: The detection means detects an instruction to generate still image data based on any difference image data in the set recorded in the recording means,
2. The image according to claim 1, wherein the generation unit generates one piece of still image data based on any one of the difference image data in which the instruction is detected by the detection unit and the reference image data. Processing equipment. The detecting means detects an instruction to generate still image data based on all the difference image data in the set recorded in the recording means;
The image processing apparatus according to claim 1, wherein the generation unit generates a plurality of still image data corresponding to each difference image data based on all the difference image data and the reference image data.   4. The image processing apparatus according to claim 1, wherein the reference image data is first image data captured first among the plurality of image data captured continuously. 5. A plurality of pieces of image data that have been continuously imaged are a set of one reference image data and a difference image data that is a difference image data with respect to the reference image data, or a single reference image data. A recording step of recording as a set of difference image data which is image data of a difference between images adjacent to each other;
A detection step for detecting an instruction to generate still image data based on the difference image data in the set recorded in the recording step;
A generation step of generating still image data based on the reference image data and the difference image data included in the set in which the instruction is detected by the detection step;
An image processing method comprising: A computer having a device for processing images;
A plurality of pieces of image data that have been continuously imaged are a set of one reference image data and a difference image data that is a difference image data with respect to the reference image data, or a single reference image data. Recording means for recording as a set of difference image data which is image data of the difference between images adjacent to each other;
Detecting means for detecting an instruction to generate still image data based on the difference image data in the set recorded in the recording means;
Generating means for generating still image data based on the reference image data and the difference image data included in the set in which the instruction is detected by the detecting means;
A program characterized by functioning as

Images