JP2001268435A - Image processing method, recording medium for image processing and image processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing method for specifying and processing an object image even when a special processing such as a multiple image processing is not set as unified specifications, a recording medium having a program for executing the image processing method recorded thereon and an image processor. SOLUTION: In this image processing method for performing an image processing by using the plural images recorded in the recording medium, information regarding the acquisition time of the respective images is identified and the object image to be subjected to the image processing is specified corresponding to the identified result. Thus, among plural recorded images, the one whose information regarding the acquisition time is the same or close are decided as the same processing object image and the special processing is performed.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to an image processing method applied to a digital camera, a computer having an imaging unit, a recording medium storing an image processing program, and an image processing apparatus.

[0002]

2. Description of the Related Art Hitherto, for example, there has been known a digital camera capable of performing photographing in a mode called a multi-image photographing mode (for example, Japanese Patent Application Laid-Open No. Hei 6-1).
05218).

[0003] Such a multiple image photographing mode is a photographing mode performed for the purpose of obtaining a super-resolution image, controlling the depth of the image, controlling the gradation, or sealing the blur, for example. This is a shooting mode for synthesizing a plurality of continuously shot images to generate an image that cannot be obtained by a single shooting.

[0004]

By the way, recently,
With the spread of personal computers (hereinafter, referred to as personal computers), the use of personal computers for synthesizing the above-described multiple shot images by digital cameras is becoming widespread.

However, since such a process of synthesizing multiple shot images is a special process, unified specifications for multiple shot image processing are set between a digital camera and an image processing apparatus such as a personal computer. Is not easy.

That is, a photographer records a plurality of images continuously photographed by using a digital camera having no function of processing multiple photographed images in a recording device (also referred to as a recording medium),
Even if an image recorded on this recording medium is read out on the personal computer side to perform multiplexed image processing, if a unified processing specification is not set, a plurality of target images (original images) required for multiplexed image processing on the personal computer side Image) cannot be recognized and specified, and the processing may not be performed.

SUMMARY OF THE INVENTION The present invention has been made in view of the above circumstances, and provides an image processing method capable of specifying a target image and performing processing even if special processing such as multiplex image processing is not set as a unified specification. It is an object to provide a method, a recording medium recording a program for executing the image processing method, and an image processing apparatus.

[0008]

An object of the present invention is to provide an image processing method for performing image processing using a plurality of images recorded on a recording medium, wherein information relating to the acquisition time of each image is identified. The image processing method is characterized in that a target image to be subjected to image processing is specified accordingly.

According to the present invention, the image to be subjected to the image processing is specified according to the information about the image acquisition time. Therefore, among the plurality of recorded images, the same or approximate information about the acquisition time is the same. The image is determined as a processing target image, and special processing such as multiplex image processing can be executed without any problem.

Further, since a series of target images can be automatically recognized from the time information, the user does not need to confirm each photographed image at the time of image processing.
There is an advantage that the trouble of confirming the target image can be omitted. Further, even if there is a plurality of a series of target image groups having different information on the image acquisition time, the image groups can be identified.

In the above processing method, an image capturing step of capturing an image of a subject, a recording step of recording the captured image and the image capturing time thereof, and identifying the recorded image capturing time,
In the case where a selection step for specifying a target image to be subjected to image processing and a processing step for processing the selected image are provided according to the identification result, the imaging times taken by a digital camera or the like are the same or close. It is presumed that these images are original images of the same subject, so that these images can be used as a series of target images to perform multiplex image processing by a personal computer or the like.

[0012] Further, the object is to identify information relating to the image acquisition time in an image in which information relating to the image acquisition time is recorded, and to select an image to be subjected to image processing according to the identification result; The present invention is also solved by a recording medium that records a program for causing a computer to execute the processing steps of processing the processed image.

According to this recording medium, in a personal computer or a digital camera with a built-in computer, an image to be processed can be specified based on information relating to the image acquisition time, and image processing such as multiplex image processing can be performed. Become.

[0014] Further, the object is to provide an image pickup means for picking up an image of a subject, a recording means for recording the picked-up image and its image pickup time, and to identify the recorded image pickup time and to perform image processing according to the identification result. The present invention is also solved by an image processing apparatus comprising: a selection unit that specifies a target image; and a processing unit that processes the selected image.

According to this image processing apparatus, the processes from image pickup to image processing can be easily executed by a digital camera alone or a system combined with a personal computer or the like.

[0016]

DESCRIPTION OF THE PREFERRED EMBODIMENTS One embodiment of the present invention will be described below with reference to the drawings.

FIGS. 1 to 3 show a digital camera capable of taking multiple images for implementing an image processing method according to an embodiment of the present invention.

1 to 3, a digital camera 1 is shown.
Is composed of a box-shaped camera body 2 and a rectangular parallelepiped imaging unit 3. The imaging unit 3 is detachably attached to the right side of the camera body 2 when viewed from the front (the front side in FIG. 1), and is rotatably mounted in a plane parallel to the right side.

The image pickup section 3 includes a photographing lens 301 having a macro zoom and a CCD (Charge) shown in FIG.
It has an image pickup device including a photoelectric conversion element such as a Coupled Device (303), and converts an optical image of a subject into a CCD3.
The image data is converted into an image composed of charge signals photoelectrically converted by the respective pixels 03 and taken in.

On the other hand, the camera body 2 is an LCD (Liq
A display unit 10 made of a liquid crystal display (UID), a mounting unit 17 for a memory card (also referred to as a recording medium) 8, and a connection terminal 13 to which a personal computer or the like is externally connected. After performing predetermined signal processing, the LCD display unit 1
Processing such as display to 0, recording to the memory card 8, and transfer to a network-connected device (FIG. 4) 19 such as a personal computer are performed.

A photographing lens 301 is provided inside the image pickup section 3, and a C
An imaging circuit unit including a CD color area sensor (shown in FIG. 4) 303 is provided. In addition, a dimming circuit (shown in FIG. 4) 304 including a dimming sensor 305 that receives the reflected light of the flash light from the subject is provided at an appropriate position in the imaging unit 3.

As shown in FIG. 1, on the front surface of the camera body 2, a grip 4 is provided at an appropriate position at the left end, and a built-in flash 5 is provided at an appropriate upper portion at the right end. As shown in FIG. 1, on the upper surface of the camera body 2, switches 6 and 7 for frame advance when reproducing a recorded image are provided substantially at the center. The switch 6 is used to advance the recorded image in the direction in which the frame number increases (the direction of the photographing order) (hereinafter referred to as the Up key). (Hereinafter referred to as Down key). Also, when viewed from the back side (the front side in FIG. 2), Dow
An erase switch D for erasing an image recorded on the memory card 8 is provided on the left side of the n key 7, and a shutter button 9 is provided on the right side of the Up key 6.

As shown in FIG. 2, a liquid crystal display for displaying a monitor (corresponding to a viewfinder) of a photographed image and reproducing and displaying a recorded image is provided substantially at the center of the left end of the camera body 2, as shown in FIG. (Hereinafter referred to as LCD display unit) 10
Is provided. A compression rate setting slide switch 12 for switching and setting a compression rate K of the image data recorded on the memory card 8 is provided below the LCD display section 10. A switch PS is provided. The connection terminal 13 is provided on a side surface of the camera body 2 on the imaging unit 3 side.

The digital camera 1 has a flash (hereinafter, flash is sometimes referred to as FL) flash mode, an "auto flash mode" in which the built-in flash 5 is automatically flashed in accordance with the subject brightness, and a subject brightness mode. The flash mode is provided forcing the built-in flash 5 irrespective of the “flash mode” and the “flash prohibited mode” for prohibiting the flash of the built-in flash 5. Each time the key 11 is pressed, “auto flash”, “forced flash” and “flash disabled”
Are cyclically switched, and one of the modes is selectively set.

The digital camera 1 has 1/8 and 1 /
For example, when the compression ratio setting switch 12 is slid to the right, the compression ratio K is set to 1/8, and when it is slid to the left, the compression ratio K is set.
= 1/20 is set.

Further, a mode setting switch 14 for switching between a "normal (general) photographing mode" and a "continuous photographing mode" is provided at the upper right end of the rear surface of the camera body 2. The normal photographing mode is a mode for performing normal photographing, and the continuous photographing mode is a mode for continuously photographing a plurality of images. The mode setting switch 14 also includes a two-contact slide switch. For example, when slid to the right, the normal shooting mode is set, and when slid to the left,
The continuous shooting mode is set.

On the bottom of the camera body 2, a battery loading chamber 1 is provided.
8 and a card loading chamber 17 for the memory card 8 are provided.
The loading ports of the loading chambers 17 and 18 are closed by a clamshell type lid 15. The digital camera 1 in this embodiment uses a power supply battery formed by connecting four AA batteries in series as a drive source.

FIG. 4 is a block diagram showing a control system of the digital camera 1.

In the image pickup section 3, the CCD 303
Transforms an optical image of a subject formed by the macro zoom lens 301 into image signals of R (red), G (green), and B (blue) color components (from a signal train of pixel signals received by each pixel). ) And output. The timing generator 314 generates various timing pulses for controlling driving of the CCD 303.

The exposure control in the imaging unit 3 is performed by adjusting the exposure amount of the CCD 303, that is, the charge accumulation time of the CCD 303 corresponding to the shutter speed, since the aperture is a fixed aperture. If the appropriate shutter speed cannot be set when the subject brightness is low,
By adjusting the level of the image signal output from D303, improper exposure due to insufficient exposure is corrected.

The signal processing circuit 313 performs predetermined analog signal processing on an image signal (analog signal) output from the CCD 303.

In the camera body 2, the A / D converter 205 converts each pixel signal of the image signal into a 10-bit digital signal. The A / D converter 205 is
Each pixel signal (analog signal) is converted into a 10-bit digital signal based on an A / D conversion clock.

In the camera body 2, a timing control circuit 202 for generating a reference clock, a timing generator 314, and a clock for the A / D converter 205 is provided. The timing control circuit 202 is controlled by the overall control unit 211.

In the shooting standby state, each pixel data of the image picked up by the image pickup unit 3 every 1/30 (second) is
After being subjected to predetermined signal processing by the A / D converters 205 to γ correction circuit 208, the signals are stored in the image memory 209, transferred to the VRAM 210 via the overall control unit 211, and displayed on the LCD display unit 10. You. This allows the photographer to visually recognize the subject image from the image displayed on the LCD display unit 10. In the reproduction mode, after the image read from the memory card 8 is subjected to predetermined signal processing by the overall control unit 211, the VRAM 21
0 and is reproduced and displayed on the LCD display unit 10.

The card I / F 212 is an interface for writing image data to the memory card 8 and reading image data. Also, communication I / F2
Reference numeral 13 denotes an interface for externally connecting the digital camera 1 to a network connection medium 19 such as a personal computer so that the digital camera 1 can communicate with the network connection medium 13. The interface 13 complies with, for example, the USB standard.

The RTC 219 is a clock circuit for managing the shooting date and time, and is driven by another power source (not shown).
The RTC 219 specifies the date and time of capturing the captured image.

The operation unit 250 includes the Up key 6,
It comprises a Down key 7, a shutter button 9, an FL mode setting key 11, a compression ratio setting switch 12, a mode setting switch 14, and the like.

The overall control unit 211 is composed of a microcomputer, and includes the inside of the image pickup unit 3 and the camera main unit 2 described above.
Digital camera 1 by organically controlling the driving of each member in the
Is a general control of the photographing operation.

FIG. 5 is a block diagram showing the configuration of the overall control unit 211. The recording image generation unit 211g reads pixel data from the image memory 209 and generates a thumbnail image and a compressed image to be recorded on the memory card 8.
The recording image generation unit 211g reads pixel data for every eight pixels in both the horizontal direction and the vertical direction while scanning from the image memory 209 in the raster scanning direction, and sequentially transfers the pixel data to the memory card 8, thereby obtaining the thumbnail image. Is recorded on the memory card 8 while generating.

The recording image generation unit 211g reads out all pixel data from the image memory 209 and converts these pixel data into JPE data such as two-dimensional DCT transform and Huffman coding.
A predetermined compression process according to the G method is performed to generate image data of a compressed image, and the compressed image data is recorded in the main image area of the memory card 8.

An image picked up by the digital camera 1 is recorded on a memory card 8. As shown in FIG.
The memory card 8 can store 40 frames of images at a compression ratio of 1/20.
High-resolution image data compressed in the PEG format (640
× 480 pixels) and image data for thumbnail display (80 pixels)
× 60 pixels) is recorded. For example, each frame can be handled as an image file in the EXIF format.

When the photographing is instructed by the shutter button 9 in the normal photographing mode, the overall control unit 211
A thumbnail image of the image taken into the image memory 209 after the photographing instruction and a compressed image compressed by the JPEG method using the compression ratio K set by the compression ratio setting switch 12 are generated, and tag information (frame number, frame number, Exposure value, shutter speed, compression ratio K, shooting date, shooting time,
Flash on / off data during shooting, scene information,
Both images are stored in the memory card 8 together with information such as image determination results).

When the continuous photographing mode (multiple photographing mode) is selected, if photographing is instructed by the shutter button 9 in the same manner as described above, after acquiring N images in the image memory 209, A thumbnail image of the image fetched into the image memory 209 and a compressed image compressed by the JPEG method using the compression ratio K set by the compression ratio setting switch 12 are generated, and tag information (frame number, exposure value , Shutter speed, compression ratio K, photographing date, photographing time, focal position information, flash ON / OFF data at photographing, scene information, image determination result, etc.), and memory cards for both images. 8 is repeated N times.

FIG. 7 shows an example of a multiplex image processing apparatus for generating one high-quality image from a plurality of images photographed by the digital camera 1 in the continuous photographing mode.

In FIG. 7, reference numeral 100 denotes a computer system, which includes a computer main body 102 and a display 10.
1 and a keyboard 103 and a mouse 104 as input devices.

A plurality of images photographed in the continuous photographing mode are recorded in the memory card 8, and are stored in the memory card 8.
Is inserted into the computer main body 102, so that the image on the memory card 8 is read by the computer main body 102.

In this embodiment, an image taken by the digital camera 1 is written in the memory card 8 and is read by the computer main body 102. However, as another method, an image (not shown) is temporarily displayed. After the image in the memory card 8 is processed by the processing device and recorded on the floppy disk 105 as a recording medium, the floppy disk 10 is
5 may be read. Further, only the imaging unit 3 of the digital camera 1 is separated, and the imaging unit and the computer main body 102 are connected.
The image captured by the imaging unit 3 may be recorded on a recording medium of the computer main body 102.

By the way, the image captured by the digital camera 1 is generally provided with tag information for each image as described above. If the format recorded in the tag information is not unified, image data captured in the mode intended by the user can be stored in, for example, the computer system 1.
When it is desired to perform post-processing using 00, desired image processing may not be executed in the computer system 100.

As described above, the tag information includes information relating to the image acquisition time such as the image capturing date and the image capturing time, and information relating to the image capturing conditions.

Therefore, as an image processing method, when performing image processing using a plurality of pieces of image information recorded on the memory card 8 (or the floppy disk 105) as a recording medium, the computer system 100 is used. The information relating to the acquisition time of each image is recognized from the plurality of tag information, and the target image to be subjected to the image processing is determined according to the recognition result.

This processing method is, as shown in FIG. 8, recorded on an image pickup means (CCD) 3 for picking up an image of a subject and on a memory card 8 (105) which is a recording means for recording the picked-up image and the image pickup time. An image processing apparatus (computer system) including a selecting unit 120 for identifying the image capturing time and specifying a target image to be subjected to image processing according to the identification result, and a processing unit 121 for processing the selected image 100 is performed. Selection means 120
And the processing means 121 for processing the selected image are constituted by the computer system 100.

According to such an image processing method, even if the image data is obtained by the digital camera 1 having no multiplex image processing function, the image capturing time, which is general image information recorded in the tag information, A plurality of original images required for processing can be specified from the information, whereby special processing such as multiplex image processing of images can be executed without any problem.

Of course, the digital camera 1 may be provided with a multiplex image processing function so that the digital camera 1 performs multiplex image processing.

Here, multiplex image processing for synthesizing a single image from a plurality of images using the information on the imaging time included in the tag information will be described.

Multiple image processing for synthesizing a single image using a plurality of images of the same subject is performed for various purposes. (1) Method of Obtaining a Super-Resolution Image A plurality of images are shot for the same subject with the shooting positions slightly shifted. From the plurality of images having different sampling phases, one image with increased resolution is obtained. (2) Depth control Changes the depth of field without actually operating the aperture.
When the subject has a distance distribution, for example, in the case of a foreground and a background, shooting is performed with hints in the foreground and the background. From these two images, an image in which both the foreground and the background are in focus (omnifocal image), an image in which the background blur is emphasized, and the like are obtained. (3) Gradation control An image taken twice with different exposure levels is synthesized to widen the apparent dynamic range. By manipulating the tone characteristics (γ curve) of the synthesized image, the tone reproducibility is optimized for the scene. (4) Shake Sealing The appropriate shutter speed is S seconds, and if camera shake is likely to occur under these conditions, if the camera shake is likely to occur, N shots will be taken with shutter speed T seconds sufficient to prevent camera shake (T × N = S). Then, by combining those images, an image without camera shake is obtained.

In any of the above cases, it is ideal that the photographing interval of a plurality of images is infinitely close to zero. When the shooting interval becomes large, the relative position of the subject shifts,
Image processing becomes difficult. In recent digital cameras, the above-mentioned shooting interval has been shortened, but actually, the CCD
Transfer of data from the memory 303 and data to the image memory 209
Thus, an image having a time lag of about several milliseconds is obtained by writing data, controlling the camera body 2, and the like. The shooting time written in the tag information of such a plurality of images is only a few seconds apart.

As described above, an image in which the recorded photographing times are the same or only a few seconds apart can be presumed to be a plurality of images intentionally obtained by the photographer.
That is, if the shooting time is confirmed, it is possible to determine whether or not the image is a multiple image processing image without special tag information indicating a series of continuous images.

Next, the flow chart of FIG. 9 for the image pickup processing will be described.

In the following description and drawings, the step is abbreviated as S, and the YE
S and NO are described as Y and N, respectively.

First, an initial setting of the image pickup apparatus is performed in S101. The imaging device in this embodiment is a digital camera 1
It is. When the initial setting is completed, a mode setting is accepted in S102. The mode setting here includes a light emission mode of the built-in flash 5, a compression ratio which is switched by operating the compression ratio setting switch 12, and a mode setting switch 14.
All of the various settings required for imaging by the digital camera 1, such as a shooting mode that is switched by the operation, are included.

When the mode setting is completed, it is determined in S103 whether or not the shutter button 9 is ON. That is,
The shutter button 9 enters a standby state (ready state) for pressing. When the shutter button 9 is pressed (YES in S103), the imaging is started. If the shutter button 9 has not been pressed (NO in S103), the process returns to S102. That is, the mode setting process is repeated until the shutter button 9 is pressed. Next, in S104, imaging conditions are set before the start of imaging. The imaging conditions include focus position (autofocus) control, exposure control, shutter speed control, and the like.

When imaging conditions are set and imaging is started, a display indicating that imaging is being performed is performed in S105, and imaging is performed in S106. When the imaging is completed, in S107, the imaging conditions are temporarily recorded in the image memory 209 as a RAM, and in S108, the imaging data is recorded in the image memory 209.

In S109, it is determined whether or not the continuous imaging mode is set. If the continuous imaging mode is set in S102 (YES in S109).
The processing from S104 is repeated until the required number of images are obtained. When the normal imaging mode is selected and when all images are acquired in the continuous imaging mode (NO in S109), the image memory 2 is read in S110.
The image recorded in 09 is subjected to processing such as compression, and this image is recorded in the memory card 8 as a recording medium in S111. At the same time, in S112, tag information such as the image capturing time (including the image capturing date) and the image capturing condition is also recorded in the memory card 8.

Next, image processing for an image recorded on the memory card 8 will be described with reference to the flowchart of FIG.

This image processing may be performed by the digital camera 1 or by the computer system 100. In any case, this image processing procedure is executed based on a program recorded on a hard disk, CD-ROM, or other recording medium.

When image processing is started in accordance with the program in S2, initial settings are performed in S201. When the initial setting is completed, the mode is set in S202. The mode here means the mode of image processing. More specifically, a super-resolution mode for creating a super-resolution image from a plurality of images, a depth control mode for synthesizing an image with an adjusted depth of field from a plurality of images, and a large-scale mode for expanding the dynamic range of imaging. This is a gradation mode and a blur sealing mode in which a plurality of images are combined to create a blur-free image. The combination of these modes or the setting of various parameters is performed in the mode setting process.

When the mode setting is completed, it is determined in S203 whether or not the processing has been started. The processing may be started by an instruction using the keyboard 103 or the mouse 104 as various input means, or by pressing the shutter button 9. When the processing is started (the determination in S203 is YE
S), the tag information is confirmed in S204. By confirming the tag information, it is possible to set various processing parameters in various modes. If the process has not been started (NO in S203), the process returns to S202.

In S205, images to be processed at the same time are selected. As the images to be processed at the same time, those having the same recorded imaging time or those having consecutive imaging times in the minimum unit are selected. This processing will be described later.

Here, if necessary, a thumbnail of the selected image may be displayed on the screen. Further, unnecessary images can be selected during thumbnail display, and the selected unnecessary images can be prevented from being used in various modes.

When images necessary for various modes are determined, S2
At 06, these images are read, and at S207, it is determined whether the reading is completed. If the reading has not been completed (NO in S207), the process returns to S206. That is, reading is repeated until all necessary images are read.

When the reading is completed (the determination in S207 is Y
ES), in S208, various modes are applied to the read image.
In step S209, the processed image is recorded on a recording medium such as the memory card 8, the floppy disk 105, or the hard disk, and displayed as an image.

Next, it is determined in S210 whether or not the processing has been completed. If the processing has not been completed (NO in S210), the process returns to S206, and if the processing has been completed (S210).
The determination at 210 is YES), and the process returns to S202. That is,
The above series of operations is repeated a specified number of times. By specifying the number of times, when there are a plurality of continuous image groups to be processed, it is possible to specify how many of the image groups are to be subjected to the multiplex image processing. The designation of the number of times also includes a case where all the images recorded on the memory card 8 as the recording medium are processed. By setting the number of times so that the above operation is repeated until all the images in the memory card 8 are processed, the multiplex image processing can be automatically performed on a series of image groups without an instruction from the operator. it can.

S in the flowchart shown in FIG.
The contents of the tag information confirmation processing of step 204 are shown in the flowchart of FIG.

In this process, first, initial settings are made in S2041, and in S2042, tag information of each image described above recorded on the memory card 8 is read.
Next, in S2043, the read tag information is written to the internal memory. Then, in S2044, it is determined whether reading and writing of tag information have been performed for all the images recorded on the memory card 8, and if all the images have been read (YES in S2044), the process returns. If all of the images have not been performed (NO in S2044), the process returns to S2042, and reading and writing of tag information are performed until the processing is completed for all images.

S in the flowchart shown in FIG.
FIG. 12 is a flowchart showing the content of the read image selection process 205.

In this processing, first, initial setting is performed in S2051, and the initial value of the frame number n is set to 1 and the initial value of the group number m is set to 1.

Next, referring to the tag information written in S2043 of FIG. 11, the tag information of the n-th frame is confirmed in S2052. Then, in S2053, it is determined whether or not the image of the n-th frame should be a group to be subjected to simultaneous processing. This determination is made, for example, when the recorded imaging time is (n-1).
Whether it is the same as the imaging time of the frame, or (n-1)
It may be determined whether the imaging time of the frame, the imaging time of the nth frame, and the imaging time of the (n + 1) th frame are continuous.

If the images are to be processed simultaneously (YES in S2053), the image of the n-th frame is registered in the m-th group in S2055, and the next image to be determined is stored in the n + 1-th frame in S2056. Up to the image of S2
At 057, it is determined whether there is a next image. If there is a next image (YES in step S2057), that is, if there is an image of the (n + 1) th frame, the process returns to step S2052 to return to steps S2052 to S2.
Step 057 is repeated. If there is no next image (S20
(NO at 57), and returns. In this way, a series of image groups to be processed simultaneously is registered in the same group.

On the other hand, if the result of determination in S2053 is that the image of the n-th frame is not an image to be simultaneously processed (S205
(NO at 3), after incrementing the group number by one at S2054, proceed to S2055. Therefore, different groupings are made for images that should not be processed simultaneously.

As described above, each image is sequentially confirmed, and an image group to be subjected to the same processing is specified.

Here, a specific example is as follows.
(1) At 15:15:10 on November 15, 1999, three images A1, A2, and A3 are acquired for super-resolution processing, and (2) at 11:30:10 on November 15, 1999. The image A4 is acquired in the normal mode every second, and (3) January 1999
At 20:20:20 on January 15, 2
Assume that images A5 and A6 have been obtained. These images are recorded on the recording medium 8.

Although the number of images recorded on the recording medium 8 is six, they are recognized as three groups from the respective photographing times. That is, images A1 to A3 and image A4
And images A5 and A6. Recognition of these three groups can be performed only with tag information called imaging time. Also,
All the images in the recording medium 8 can be specially processed at once without the operator confirming the images.

Next, the step (S208 in FIG. 10) of performing multiplex image processing on images selected as the same processing target will be described in detail with reference to the flowchart shown in FIG.

When the selected image processing starts in S208, the imaging conditions of the selected image are confirmed in S220 based on the tag information. Thereafter, in S221, it is determined whether or not there are a plurality of selected images, and if there are a plurality of images (S221
Is YES), in S222, it is determined whether or not the in-focus position is different. If there are no multiple images (S
If the determination in 221 is NO), it is determined that the image is not to be subjected to the multiple image processing, and the process proceeds to other processing in S203.

If the in-focus positions are different (S22
2 is YES), since the image is in the depth control mode, the depth control process is performed in S223, and it is determined in S224 whether the exposure level is different.
If the in-focus positions are not different (NO in S224), since the image is not in the depth control mode, S2
Proceed to 24.

In S224, if the exposure levels are different (the determination in S224 is YES), the image is in the large gradation processing mode. Therefore, after performing the large gradation processing in S225, the underexposed image is determined in S226. Is determined. If the exposure levels are not different (S22
4 is NO), the process proceeds to S226 because the image is not in the large gradation processing mode.

If it is determined in S226 that the image is an underexposed image (YES in S226), the image is in the blur sealing mode. It is determined whether it does not correspond to. If any of these conditions is satisfied (NO in S228), one of the depth control process, the large gradation process, and the blur sealing process has already been performed, so other processes were performed in S230. Then return. If none of the above applies (the determination in S228 is YES), those images are determined to be images to be subjected to super-resolution processing, super-resolution processing is performed in S229, and other processing is performed in S230. And return.

More specifically, the recording medium 8
Are first recognized as a group in S206. First, the images A1 to A3 are recognized as one group, and are read in S207. The read images A1 to A3 are compared with each other for tag information.

Here, since the images A1 to A3 are for super-resolution processing, there are no particular differences in the imaging conditions, and the imaging positions are only slightly shifted due to camera shake or the like. In this case, each determination of S222, S224, and S226 is “NO”, and “YE
S ", and super-resolution processing is performed.

The image created by the super-resolution processing is S
At 209, it is stored in the recording medium. Since the images A4 to A6 still remain in the memory card 8, S206
Proceed to.

Since the next group consists of only one image A4, the process proceeds to S208. In S221, all the special processes for a plurality of images are canceled, and normal image processing is performed. Stored on media.

Similarly, the next group consists of two images A5 and A6, which have different exposure levels due to the large gradation processing, so that "YES" is obtained in S224 of FIG.
In S225, large gradation processing is performed, and the result is stored in a recording medium.

When the processing up to the image A6 is completed, S210
Ends the process (YES), returns to S202, and waits for the mode setting.

In the above embodiment, after extracting images having substantially the same imaging time, the in-focus position,
It has been described that the imaging conditions such as the exposure level are checked, and multiplex image processing such as depth control, large gradation, blurring, and the like are performed to obtain a single composite image, but the imaging conditions are fixed in advance. In such a case, predetermined special processing may be performed without confirming the imaging conditions.

In the above embodiment, a plurality of captured images are stored in the memory card 8 (or the floppy disk 105).
However, the present invention is not limited to this, and the recording may be performed in a fixed recording unit such as a built-in memory of the digital camera 1 or a hard disk of the computer system 100.

Further, the digital camera 1 is directly connected to the computer main body 102, and an image captured by the digital camera 1 and recorded in the image memory 209 is transferred to the computer main body 102 for image processing. You may make it.

Further, the computer system 100
It is also possible to adopt a configuration in which the above-described processing is performed in the digital camera 1 without using the digital camera. In this case, the overall control unit 211 of the digital camera controls the image selecting unit and the image processing unit, but these dedicated units may be separately provided.

[0098]

According to the first aspect of the present invention, the image processing is performed in accordance with the information on the recorded image acquisition time, so that the information on the acquisition time among the plurality of recorded images is the same or approximate. Are determined as the same processing target image, and special processing such as multiplex image processing can be executed without any problem.

In addition, a series of target images and a group of images can be automatically identified from the time information, and the photographer does not need to confirm each photographed image during image processing.

According to the second aspect of the present invention, images captured at the same or close times by a digital camera or the like are presumed to be original images of the same subject. Multiple image processing by a personal computer or the like can be performed as a series of target images.

According to the invention of claim 3, in a personal computer or a digital camera incorporating a computer,
An image to be processed can be specified based on the information about the image acquisition time, and image processing such as multiplex image processing can be executed.

According to the fourth aspect of the present invention, there is provided an image processing apparatus of a digital camera alone or an image processing apparatus of a combination of a digital camera and a personal computer which can easily execute from imaging to image processing. be able to.

[Brief description of the drawings]

FIG. 1 is a front view showing a digital camera in which an image processing method according to an embodiment of the present invention is operated.

FIG. 2 is a rear view showing the same digital camera.

FIG. 3 is a bottom view showing the digital camera.

FIG. 4 is a block diagram showing a control system of the digital camera.

FIG. 5 is a block diagram showing an overall control unit of FIG. 4;

FIG. 6 is an explanatory diagram of an image storage structure in a memory card.

FIG. 7 is an external view illustrating a computer system as an image processing apparatus.

FIG. 8 is a block diagram illustrating a main part of the image processing apparatus.

FIG. 9 is a flowchart illustrating an imaging process performed by the imaging apparatus.

FIG. 10 is a flowchart illustrating image processing of a captured image.

11 is a flowchart showing the contents of the tag information confirmation processing in S204 in the flowchart of FIG. 10;

FIG. 12 is a flowchart showing the read image selection processing content of S205 in the flowchart of FIG. 10;

FIG. 13 is a flowchart showing details of processing of a selected image in S208 in the flowchart of FIG. 10;

[Explanation of symbols]

100 (1) ······· Computer system (image processing device) ······ Image pickup unit 8, 105 ······ Recording means (recording medium) 120 (211) ... selecting means 121 (211) ... processing means

 ────────────────────────────────────────────────── ─── Continued on the front page F term (reference) 5B057 AA20 BA02 CA12 CB12 CC01 CE08 5C022 AA13 AB68 5C023 AA11 AA34 AA37 AA38 BA11 CA01 DA04 DA08 5C053 FA07 FA08 FA27 GB06 HA29 JA24 KA04 KA24 LA14

Claims (4)

[Claims] 1. An image processing method for performing image processing using a plurality of images recorded on a recording medium, wherein information on an acquisition time of each image is identified, and an image processing target is identified according to the identification result. An image processing method characterized by specifying an image. 2. An image capturing step of capturing an image of a subject, a recording step of recording the captured image and its capturing time, identifying the recorded capturing time, and according to the identification result,
The image processing method according to claim 1, further comprising: a selection step of specifying a target image to be subjected to image processing; and a processing step of processing the selected image. 3. Identifying information on the image acquisition time in an image in which information on the image acquisition time is recorded,
A recording medium storing a program for causing a computer to execute a selection step of specifying a target image to be subjected to image processing according to the identification result, and a processing step of processing the selected image. 4. An image pickup means for picking up an image of a subject, a recording means for recording a picked-up image and its pick-up time, and identifying the recorded pick-up time.
An image processing apparatus comprising: a selection unit that specifies a target image to be subjected to image processing; and a processing unit that processes the selected image.