WO2012147368A1

WO2012147368A1 - Image capturing apparatus

Info

Publication number: WO2012147368A1
Application number: PCT/JP2012/002934
Authority: WO
Inventors: 史孝小松
Original assignee: パナソニック株式会社
Priority date: 2011-04-28
Filing date: 2012-04-27
Publication date: 2012-11-01
Also published as: JP2012235257A

Abstract

Provided is an image capturing apparatus equipped with: an imaging data storing unit (12) for storing imaging data of a captured subject acquired by an imaging unit (11); a motion detection unit (14) for detecting a motion of the image capturing apparatus; a color distribution identification unit (13) for identifying a color distribution of the imaging data; and an unnecessary image determination g unit (15). Based on image parameters of a plurality of imaging data acquired while the image capturing apparatus is in motion, when an approximately identical color distribution exists in an approximately identical region in the imaging data, said unnecessary image determination unit (15) determines that this region is an unnecessary image region containing an unnecessary image due to a finger being captured within an image.

Description

Imaging device

The present invention relates to a photographing apparatus, and more particularly, to a photographing apparatus in which a user of a digital camera, an electronic device with a camera function, or the like grips a casing to photograph a subject.

Electronic devices with photographing functions such as digital cameras and electronic devices with camera functions are widely used. As an example of an electronic device with a camera function, a mobile communication terminal such as a mobile phone device or a smartphone is also generally equipped with a camera function.

This type of photographing apparatus has been reduced in size in order to improve portability, and there is a problem that a so-called “finger photographing” is likely to occur in which a user's finger appears in a photographed image at the time of photographing. Depending on the photographic device, if you try to hold the lens so that your finger does not touch it, you may not be able to hold the device housing firmly and it will be easy to shake. In addition, in a smartphone or the like, since the thickness of the housing is thin, a finger is likely to turn around to the lens side when trying to hold it firmly, and finger shooting is likely to occur because the lens is located at the end of the terminal.

In order to solve the problem of image capture, Patent Document 1 discloses that an unnecessary image is captured by comparing a focus evaluation value, a signal level of a color component, and a signal level of a luminance component in an unnecessary image detection region and a non-detection region. An imaging device is disclosed that warns a photographer when it is determined that the camera is busy. Further, in Patent Document 2, when both a moving area and a non-moving low-luminance area exist based on a temporal change in the position of a predetermined low-luminance area in a plurality of live view images, the photographer's finger is An imaging apparatus that determines that the image capturing target area is included in the imaging target area is disclosed.

Japanese Patent No. 4462305 Japanese Unexamined Patent Publication No. 2004-040712

In the conventional example of Patent Document 1, it is necessary to acquire the focus evaluation value by moving the lens from the infinite end to the macro end. The conventional example of Patent Document 2 requires information on temporal change of the position of the low luminance region in the captured image. Since these affect the shooting response, there is a problem that it takes time to take a picture while determining the presence or absence of fingering.

Also, depending on the shooting situation, if a low-luminance region in the shot image is continuously present at a predetermined position, finger shooting may be erroneously determined. For example, assuming a case where a photographing device is placed on a desk for fixed-point photography, the desk in the lower part of the photographed image exists at a close distance from the photographing device, so that the contrast value of the photographed image increases on the macro side. Also, the desk position does not change over time. In the conventional example, in such a case, the desk is erroneously determined to be a finger.

The present invention has been made in view of the above circumstances, and an object of the present invention is to provide an imaging apparatus capable of accurately determining finger exposure in a short time.

The imaging device of the present invention includes an imaging unit that captures a subject image, an imaging data storage unit that stores imaging data of the subject acquired by the imaging unit, a motion detection unit that detects a motion of the imaging device, and the imaging Based on the image parameter identification unit for identifying the distribution of the image parameters of the data and the image parameters of the plurality of imaging data acquired in a state where the imaging apparatus is in motion, substantially the same image in substantially the same region in the imaging data When there is a parameter distribution, an unnecessary image determination unit that determines that the region is an unnecessary image region including an unnecessary image, and a notification unit that notifies that the unnecessary image region has been detected are provided.

According to the present invention, it is possible to accurately determine finger exposure in a short time in the photographing apparatus.

1 is a block diagram showing a configuration of a main part of a photographing apparatus according to a first embodiment of the present invention. 6 is a flowchart showing an operation procedure of the photographing apparatus according to the first embodiment. The block diagram which shows the structure of the principal part of the imaging device which concerns on the 2nd Embodiment of this invention. (A) to (C) Schematic diagram for explaining the operation of the photographing apparatus according to the second embodiment. 7 is a flowchart showing an operation procedure of the photographing apparatus according to the second embodiment. (A) to (C) Schematic diagram for explaining the operation of the photographing apparatus according to the third embodiment. 7 is a flowchart showing an operation procedure of the photographing apparatus according to the third embodiment. The block diagram which shows the structure of the principal part of the imaging device which concerns on the 4th Embodiment of this invention. (A) to (C) Schematic diagrams for explaining the operation of the photographing apparatus according to the fourth embodiment. (A), (B) Schematic diagram for explaining the operation of the photographing apparatus according to the fifth embodiment (A), (B) Schematic diagram for explaining the operation of the photographing apparatus according to the fifth embodiment 9 is a flowchart showing an operation procedure of the photographing apparatus according to the fifth embodiment.

In this embodiment, a configuration example applied to an electronic device having a shooting function, such as a digital camera, a mobile phone device, or a mobile terminal with a camera function such as a smartphone, is shown as an example of a shooting device.

(First embodiment)
FIG. 1 is a block diagram showing the configuration of the main part of the photographing apparatus according to the first embodiment of the present invention.

The imaging apparatus includes an imaging unit 11, an imaging data storage unit 12, a color distribution recognition unit 13, a motion detection unit 14, an unnecessary image determination unit 15, a display unit 16, a control unit 17, and an operation unit 18.

The imaging unit 11 includes an imaging optical system having one or a plurality of lenses and an imaging element such as a CMOS image sensor or a CCD image sensor, and captures a subject image formed by the imaging optical system. And photoelectrically convert the image data of the subject.

The imaging data storage unit 12 includes a memory, and stores imaging data acquired by the imaging unit 11. The imaging data storage unit 12 stores, as imaging data, image data of a moving image or a still image in a preview image before shooting, image data of a still image or a moving image shot by a user's shooting operation, and the like. .

The color distribution recognizing unit 13 functions as an example of an image parameter recognizing unit, and recognizes the color distribution in the image with respect to the imaging data stored in the imaging data storage unit 12. In the present embodiment, the color distribution recognizing unit 13 recognizes the color distribution of the captured image data of the preview image before photographing when the motion detecting unit 14 detects the motion of the photographing apparatus.

The motion detection unit 14 includes an acceleration sensor, a gyroscope, and the like, and detects the motion of the photographing apparatus. Note that the motion detection unit 14 is not limited to the one that directly detects the movement of the photographing apparatus main body, but may be one that detects the movement of the photographing data indirectly by detecting the movement in the image of the imaging data. is there.

The unnecessary image determination unit 15 determines whether or not an unnecessary image exists in the image to be captured based on the recognition result of the color distribution of the imaging data at the time of motion detection by the color distribution recognition unit 13. In the present embodiment, the unnecessary image determination unit 15 has a region where the color distribution is the same (substantially the same) in the moving image of the preview image during motion detection, that is, although the photographing apparatus is moving. If the same (substantially the same) color distribution continues at the same (substantially the same) position in the image, it is determined that an unnecessary image exists in the corresponding area. Since this unnecessary image is considered to be a finger of a user holding the photographing apparatus, it is determined that a finger image has occurred.

In addition to the color distribution, various image parameters can be used as information for determining an unnecessary image in the unnecessary image determination unit 15. For example, using RGB, YCbCr, L ^* a ^* b ^* , XYZ, L ^* u ^* v ^* , HSV, etc. as image parameters, the distribution of image data such as color (including hue, color difference, etc.), brightness, etc. It is possible to recognize an unnecessary image in the image based on the recognition result.

The display unit 16 functions as an example of a notification unit, and includes a liquid crystal display, an LED, a lamp, and the like, and displays a determination result of an unnecessary image to notify the user of the presence of the unnecessary image.

The control unit 17 controls the operation of each unit of the photographing apparatus, and particularly controls the operation of the imaging unit 11, the color distribution recognition unit 13, and the unnecessary image determination unit 15. The operation unit 18 is configured by an operation device including a switch having an operation member such as a push button or a touch panel, and performs various operation inputs in the photographing apparatus based on user operation instructions.

The color distribution recognition unit 13, the unnecessary image determination unit 15, and the control unit 17 execute a predetermined program in a processing unit including a computer having a processor and a memory that perform various information processing, and the like. Functions of each part are realized.

Next, the operation of the photographing apparatus in the first embodiment will be described. FIG. 2 is a flowchart showing an operation procedure of the photographing apparatus according to the first embodiment.

The color distribution recognizing unit 13 determines whether or not the movement of the photographing apparatus is detected by the movement detecting unit 14 (step S11). If the movement is detected, the two frames immediately before the moving image of the preview image are detected. The imaging data of the image is read from the imaging data storage unit 12 (step S12). The number of frames to be read may be any number as long as it is a plurality of frames of two or more. Subsequently, the color distribution recognition unit 13 recognizes the color distribution of the imaging data of each frame (step S13).

Next, the unnecessary image determination unit 15 determines whether there is a region having the same color distribution (substantially the same region) in the imaging data of a plurality of frames based on the recognition result of the color distribution by the color distribution recognition unit 13, that is, images of different frames. It is determined whether the same color distribution (substantially the same color distribution) exists in the same position (substantially the same position) (step S14). Here, if there are regions having the same color distribution in two frames (YES in step S14), it is determined that an unnecessary image exists. In this case, the unnecessary image determination unit 15 outputs a signal including control information, display information, and the like to the display unit 16 to display that the unnecessary image is detected on the display unit 16 (step S15). On the other hand, if it is determined in step S14 that there is no region having the same color distribution in the imaging data of a plurality of frames (NO in step S14), it is determined that there is no unnecessary image, and the present process is terminated.

In the first embodiment, when a plurality of frames of captured image data of a preview image acquired while detecting the movement of the photographing apparatus are compared, there is a specific color region whose position does not change with respect to the movement of the photographing apparatus In addition, it is determined that there is an unnecessary image due to fingering. Thereby, the presence or absence of an unnecessary image can be determined immediately, and the determination of a finger image can be made in a short time. In addition, since the determination is performed only when there is a movement of the photographing apparatus, it is possible to prevent erroneous determination when, for example, the photographing apparatus is placed on a desk and fixed point photographing is performed.

(Second Embodiment)
FIG. 3 is a block diagram showing the configuration of the main part of the photographing apparatus according to the second embodiment of the present invention.

The second embodiment is an example of a photographing apparatus having a monocular 3D photographing function of sequentially photographing two images (left eye image and right eye image) having parallax with one photographing optical system. The imaging apparatus includes an imaging unit 21, an imaging data storage unit 22, a luminance distribution recognition unit 23, a luminance distribution storage unit 24, an unnecessary image determination unit 25, a display unit 26, a control unit 27, and an operation unit 28.

When performing stereoscopic shooting by monocular 3D shooting, after shooting one of the left-eye image and the right-eye image at an arbitrary position (first image shooting location), the user moves the shooting device in a horizontal direction by a predetermined amount, The other image is taken at a position having the parallax (second photo shooting location). In the following, a case will be described in which the left eye image is taken as the first image and the right eye image is taken as the second image.

The imaging data storage unit 22 sequentially stores image data of a preview image before shooting as imaging data acquired by the imaging unit 21, and stores image data of a left eye image and a right eye image at the time of stereoscopic shooting.

The luminance distribution recognizing unit 23 functions as an example of an image parameter recognizing unit, and recognizes the luminance distribution in the image with respect to the imaging data stored in the imaging data storage unit 22. In the present embodiment, the luminance distribution recognizing unit 23 captures both the captured left-eye image and the preview image before capturing the right-eye image or the captured right-eye image when stereoscopic imaging by monocular 3D imaging is performed. Recognize the luminance distribution. In monocular 3D shooting, the user moves the imaging device in a horizontal direction by a predetermined amount to capture two images with parallax. Therefore, the imaging device detects a state in which movement is occurring in the imaging device by recognizing the state of the monocular 3D imaging mode.

The luminance distribution storage unit 24 stores the luminance distribution of the imaging data recognized by the luminance distribution recognition unit 23. In the present embodiment, the luminance distribution of the imaging data of the left-eye image previously captured is stored. In addition, you may memorize | store the luminance distribution of the imaging data of both the left eye image and the right eye image.

The unnecessary image determination unit 25 determines whether or not an unnecessary image exists in the image to be captured based on the recognition result of the luminance distribution of the imaging data by the luminance distribution recognition unit 23. In the present embodiment, the unnecessary image determination unit 25 compares the luminance distributions of both the captured left-eye image and the captured image of the preview image before capturing the right-eye image or the captured right-eye image, and the same position (substantially the same position). ), It is determined that an unnecessary image exists in the corresponding area. That is, it is determined that there is an unnecessary image when there is a low-luminance region at the same position in the image despite the movement of the imaging device for monocular 3D imaging. Since the unnecessary image in the low brightness area is considered to be a finger of a user holding the photographing apparatus, it is determined that a finger image is generated.

As information for determining an unnecessary image in the unnecessary image determination unit 25, a color distribution may be used in the same manner as in the first embodiment, instead of the luminance distribution. Various image parameters can also be used. For example, using RGB, YCbCr, L ^* a ^* b ^* , XYZ, L ^* u ^* v ^* , HSV, etc. as image parameters, the distribution of image data such as color (including hue, color difference, etc.), brightness, etc. It is possible to recognize an unnecessary image in the image based on the recognition result.

The display unit 26 functions as an example of a notification unit, and includes a liquid crystal display, an LED, a lamp, and the like, and displays a determination result of an unnecessary image to notify the user of the presence of the unnecessary image.

The control unit 27 controls the operation of each unit of the photographing apparatus, and in particular controls the operation of the imaging unit 21, the luminance distribution recognition unit 23, and the unnecessary image determination unit 25. The operation unit 28 includes a switch having an operation member such as a push button, or an operation device including a touch panel, and performs various operation inputs in the photographing apparatus based on user operation instructions.

The luminance distribution recognition unit 23, the luminance distribution storage unit 24, the unnecessary image determination unit 25, and the control unit 27 are a predetermined program in a processing unit that includes a processor that performs various types of information processing, a memory, and the like. By executing the above, the function of each unit is realized.

Next, the operation of the photographing apparatus in the second embodiment will be described. 4A to 4C are schematic views for explaining the operation of the photographing apparatus according to the second embodiment. 4A is an external view of a monocular 3D photographing camera, FIG. 4B is a diagram illustrating the position of the camera with respect to a subject, and FIG. 4C is an example of a left-eye image and a right-eye image with and without fingering. FIG.

As shown in FIG. 4A, a camera 30 having a monocular 3D photographing function has a lens 31 of one photographing optical system. As shown in FIG. 4B, in the case of performing stereoscopic shooting by monocular 3D shooting, after shooting the left eye image of the subject, the camera 30 is moved by a predetermined amount in the horizontal right direction so that a predetermined parallax is obtained. Take a picture.

As shown in the upper part of FIG. 4C, when there is no finger, a low luminance area does not exist at the same position in the first left eye image and the second right eye image. For this reason, it is possible to generate a stereoscopic image from two captured images that do not have a low luminance area at the same position having a predetermined parallax. As shown in the lower part of FIG. 4C, when a user's finger is applied to a part of the lens of the camera and there is a finger shot, in both the first left-eye image and the second right-eye image, A low luminance region exists at the same position. If the camera position relative to the subject has moved to give parallax between the two images, but there is a low luminance area at the same position, it can be determined that the low luminance area is an unnecessary image due to fingering.

FIG. 5 is a flowchart showing an operation procedure of the photographing apparatus according to the second embodiment.

The luminance distribution recognition unit 23 reads the imaging data of the left eye image from the imaging data storage unit 22 (step S21), and recognizes the luminance distribution of the left eye image (step S22). Then, the luminance distribution recognition unit 23 stores the recognized luminance distribution of the left eye image in the luminance distribution storage unit 24 (step S23).

Subsequently, the luminance distribution recognition unit 23 reads the imaging data of the right eye image from the imaging data storage unit 22 (step S24), and recognizes the luminance distribution of the right eye image (step S25). Note that instead of the imaging data of the right eye image, the luminance distribution of the preview image before the right eye image is captured may be recognized. Further, the luminance distribution of the right eye image may be stored in the luminance distribution storage unit 24 as in the case of the left eye image.

Next, the unnecessary image determination unit 25 is reduced to the same position (substantially the same position) in the luminance distribution of the imaging data of both the left eye image and the right eye image based on the result of the luminance distribution recognition by the luminance distribution recognition unit 23. It is determined whether there is a luminance area (step S26). Here, if there is a low luminance area at the same position of the two images (YES in step S26), it is determined that an unnecessary image exists. In this case, the unnecessary image determination unit 25 outputs a signal including control information, display information, and the like to the display unit 26, and displays that the unnecessary image has been detected on the display unit 26 (step S27). On the other hand, if it is determined in step S26 that there is no low luminance area at the same position in the imaging data of the left eye image and the right eye image (NO in step S26), it is determined that there is no unnecessary image, and this process is performed as it is. finish.

In the second embodiment, when performing stereoscopic imaging by monocular 3D imaging, the imaging data of the left eye image and the right eye image are compared, and if there is a low luminance area at the same position with respect to the movement of the imaging device, It is determined that an unnecessary image exists. As a result, the presence / absence of an unnecessary image can be determined immediately and easily, and the finger image can be determined in a short time without error.

(Third embodiment)
The third embodiment is an example of a photographing apparatus having a compound eye 3D photographing function for simultaneously photographing two images (a left-eye image and a right-eye image) having parallax by two photographing optical systems. The configuration of the photographing apparatus of the third embodiment is the same as that of the second embodiment, and some functions are different from those of the second embodiment. A description will be given centering on differences from the second embodiment.

FIGS. 6A to 6C are schematic diagrams for explaining the operation of the photographing apparatus according to the third embodiment. 6A is an external view of a compound-eye 3D shooting camera, FIG. 6B is a diagram illustrating the position of the camera with respect to the subject, and FIG. 6C is an example of a left-eye image and a right-eye image with and without fingering. FIG.

As shown in FIG. 6A, a camera 40 having a compound-eye 3D imaging function has two imaging

optical system lenses

41 and 42. As shown in FIG. 6B, in the case of performing stereoscopic imaging by compound eye 3D imaging, the left eye image and the right eye image of the subject are simultaneously captured by the two

lenses

41 and 42, respectively.

As shown in the upper part of FIG. 6 (C), when there is no finger image, there is no low luminance area in only one of the left eye image and the right eye image. For this reason, a stereoscopic image can be generated from two captured images in which only one image having a predetermined parallax does not have a low luminance area. As shown in the lower part of FIG. 6 (C), when there is finger shooting, the user's finger is usually applied to a part of one lens of the camera, so that either the left eye image or the right eye image has low brightness. An area exists. When only one image has a low-luminance area, it can be determined that the low-luminance area is an unnecessary image due to fingering.

FIG. 7 is a flowchart showing an operation procedure of the photographing apparatus according to the third embodiment. When performing stereoscopic imaging by compound eye 3D imaging, the imaging data of the left eye image and the right eye image are simultaneously acquired and stored in the imaging data storage unit 22 respectively.

The luminance distribution recognition unit 23 reads the imaging data of the left eye image from the imaging data storage unit 22 (step S31), and recognizes the luminance distribution of the left eye image (step S32). Then, the luminance distribution recognition unit 23 stores the recognized luminance distribution of the left eye image in the luminance distribution storage unit 24 (step S33).

Subsequently, the luminance distribution recognition unit 23 reads the imaging data of the right eye image from the imaging data storage unit 22 (step S34), and recognizes the luminance distribution of the right eye image (step S35). Note that the luminance distribution of the right eye image may be stored in the luminance distribution storage unit 24 as in the case of the left eye image.

Next, the unnecessary image determination unit 25 has a low luminance region in only one image in the luminance distribution of the imaging data of both the left eye image and the right eye image based on the result of the luminance distribution recognition by the luminance distribution recognition unit 23. Is determined (step S36). Here, if only one image has a low-luminance region (YES in step S36), it is determined that an unnecessary image exists. In this case, the unnecessary image determination unit 25 outputs a signal including control information, display information, and the like to the display unit 26, and displays that the unnecessary image is detected on the display unit 26 (step S37). On the other hand, if it is determined in step S36 that the low-luminance area does not exist in both the left-eye image and the right-eye image, or if the low-luminance area exists in both, it is determined that no unnecessary image exists, The process ends.

Note that, in the imaging device of the third embodiment, as in the first embodiment, when the movement of the imaging device is detected, the color distribution of the imaging data is recognized and the position in the image does not change. By detecting this, it is also possible to determine the presence or absence of unnecessary images.

In the third embodiment, when performing stereoscopic imaging by compound eye 3D imaging, the imaging data of the left eye image and the right eye image are compared, and if only one of the images has a low luminance area, there is an unnecessary image due to fingering. It is determined that As a result, the presence / absence of an unnecessary image can be determined immediately and easily, and the finger image can be determined in a short time without error.

(Fourth embodiment)
As a fourth embodiment, a first example of an image correction operation for an unnecessary image region by finger shooting in a captured image will be described.

FIG. 8 is a block diagram showing the configuration of the main part of the photographing apparatus according to the fourth embodiment of the present invention. The imaging apparatus of the fourth embodiment includes an image processing unit 51 that performs image processing on a captured image, and an image storage unit 52 that stores image data after image processing. Others are the same as those of the first embodiment shown in FIG. 1, and here, the description will focus on differences from the first embodiment. It should be noted that the fourth embodiment can be combined with the second embodiment or the third embodiment.

When the image data stored in the image data storage unit 12 includes an unnecessary image, the image processing unit 51 corrects the captured image so as to eliminate the unnecessary image by performing an unnecessary image region complementing process or the like. The image storage unit 52 stores the image data of the captured image after the image processing by the image processing unit 51. Note that the captured image after image processing can be displayed on the display unit 16.

FIGS. 9A to 9C are schematic diagrams for explaining the operation of the photographing apparatus according to the fourth embodiment. 9, (A) is a diagram showing image data of a plurality of frames of a moving image, (B) is a diagram showing an example of image correction using image data of other frames, and (C) is an image of the image data. It is a figure explaining the calculation method of these motion vectors.

As shown in FIG. 9A, in the imaging data storage unit 12, a moving image in which the same color distribution area exists in the N−1th frame, the Nth frame, the N + 1th frame, the N + 2th frame,. It is assumed that the imaging data is stored. In this case, the color distribution recognition unit 13 and the unnecessary image determination unit 15 determine that there is an unnecessary image. The imaging data corresponds to image data at the time of moving image shooting or image data at the time of preview display.

The image processing unit 51 performs an unnecessary image region complementing process using the imaging data of two or more frames. In the example shown in FIG. 9B, using the image data of the (N−1) th frame and the Nth frame, the pixels in the unnecessary image area are complemented with image data of other frames as shown on the right side. At this time, as shown in FIG. 9C, the image processing unit 51 extracts feature points P1, P2, and P3 common to the images of the two frames, and calculates a motion vector of the feature points. From this motion vector, the amount of motion in the area corresponding to the unnecessary image area is known. In order to complement the unnecessary image region S ′ of the Nth frame, the corresponding region S of the (N−1) th frame is obtained from the unnecessary image region S ′ by the inverse vector of the calculated motion vector of the feature point. By applying the pixel data of the corresponding area S to the unnecessary image area S ′, the image of the subject portion hidden in the unnecessary image area S ′ can be restored.

Note that the imaging data used for the correction process of the unnecessary image area may be a frame of a captured image being recorded at the time of shooting or a frame of a preview image. Further, the present invention can be applied not only to moving image imaging data but also to still image imaging data. The imaging data used for pixel complementation may use not only the previous frame of the correction target frame but also the subsequent frame, or both the front and rear frames.

According to the fourth embodiment, when finger copying occurs, image correction can be performed by appropriately complementing the pixels in the unnecessary image area, and the influence of finger shooting on the captured image can be eliminated. Further, since it is not necessary to perform trimming of an unnecessary image area or the like in image correction, it is possible to prevent a problem that the angle of view of the captured image is narrowed.

(Fifth embodiment)
As a fifth embodiment, a second example of an image correction operation for an unnecessary image region by finger shooting in a captured image will be described. The configuration of the photographing apparatus of the fifth embodiment is the same as that of the fourth embodiment, and shows another example of the image correction operation.

FIGS. 10A and 10B and FIGS. 11A and 11B are schematic diagrams for explaining the operation of the photographing apparatus according to the fifth embodiment. 10A is a diagram illustrating a state in which an unnecessary image region is designated, and FIG. 10B is a diagram illustrating imaging data of a plurality of frames of a moving image. 11A and 11B are diagrams illustrating a plurality of examples of image correction. FIG. 11A is a diagram illustrating an example of an image when completion is completed, and FIG. 11B is a diagram illustrating an example of a clipping process when completion is not completed.

As shown in FIG. 10A, at the time of shooting, on the finder screen of the display unit 16 of the shooting apparatus, the user designates an area where a finger is captured or an area where there is a high possibility of finger capture as an unnecessary image area 61. . Depending on the shape and size of the photographing apparatus, the layout of the operation unit, and the like, an area where finger shooting occurs and an area where there is a high possibility of finger shooting may be specified. In this embodiment, assuming such a case, an unnecessary image area is set in advance and image correction of the unnecessary image area is performed, or an image of another area is cut out without using the unnecessary image area. Is generated.

FIG. 12 is a flowchart showing an operation procedure of the photographing apparatus according to the fifth embodiment. When the user operates the operation unit 18 (a touch panel in the example of FIG. 10A) and designates a finger capture area that is an unnecessary image area, the control unit 17 performs image processing on the area information of the specified unnecessary image area. The data is transferred to the unit 51 (step S41). The image processing unit 51 stores area information of unnecessary image areas. Here, the operation unit 18 and the control unit 17 realize the function of the unnecessary image region setting unit.

Next, the image processing unit 51 specifies an area that needs to be complemented in the imaging data stored in the imaging data storage unit 12 (step S42). As shown in FIG. 10B, the imaging data storage unit 12 stores imaging data of a plurality of frames of moving images such as the (N−1) th frame, the Nth frame, the (N + 1) th frame, the (N + 2) th frame,. It shall be. The imaging data corresponds to image data at the time of moving image shooting or image data at the time of preview display. As in the fourth embodiment, the image processing unit 51 performs a complementing process when the unnecessary image region can be complemented using image data of other frames. In the processing example of FIG. 12, the image processing unit 51 complements unnecessary image regions in the preview image (step S43). At this time, in order to obtain complementary imaging data, it is also possible to notify the user of a display or a voice prompting the user to move the imaging device. Thereby, imaging data of a plurality of frames in a state where there is a motion can be acquired.

Thereafter, when the user depresses the shutter button of the operation unit 18 to instruct execution of shooting, the image processing unit 51 uses the imaging data stored in the imaging data storage unit 12 based on the instruction from the control unit 17. Then, a captured image of the subject is generated (step S44).

The image processing unit 51 determines whether or not the complementing process in step S43 is normally completed (step S45). If the complementing process is normally completed, a captured image with a full angle of view is generated, and the image storage unit 52, It outputs to the display part 16 (step S46). As shown in FIG. 11A, for the image data of the image 71 at the time of completion of complementation, the image processing unit 51 generates a captured image with a full angle of view as it is.

On the other hand, if the complement processing has not been completed normally, the image processing unit 51 generates a captured image by cutting out a non-fingerprint region in the image so as to exclude the region including the unnecessary image region, and the image storage unit 52. And output to the display unit 16 (step S47). As shown in FIG. 11B, with respect to the image data of the image 72 when the complement is not completed, the image processing unit 51 cuts out an area excluding the unnecessary image area and generates a captured image. As a method for extracting the non-fingerprint region, there are two methods as illustrated. In the first method, a photographed image is generated by cutting out a non-fingerprinted region as it is like a region 73 indicated by a broken line frame. In the second method, as in a region 74 indicated by a one-dot chain line, the aspect ratio of the original image is adjusted in the horizontal and vertical directions, and the non-fingerprinted region is cut out to generate a captured image. .

According to the fifth embodiment, the user can intentionally correct the unnecessary image region by setting the region where the finger image is generated or the region having high possibility as the unnecessary image region in advance and performing image correction. In this way, it is possible to eliminate the influence of finger shooting on the photographed image. In addition, the unnecessary image area is corrected by complementing the pixels. If the complement cannot be performed, the unnecessary image area is appropriately trimmed to obtain a photographed image without fingering.

The following are included as various aspects of the embodiment according to the present invention.

An imaging unit that captures a subject image, an imaging data storage unit that stores imaging data of the subject acquired by the imaging unit, a motion detection unit that detects movement of the imaging device, and an image parameter distribution of the imaging data Based on the image parameter identification unit for identifying and image parameters of a plurality of imaging data acquired in a state where the imaging device is in motion, when there is a distribution of substantially the same image parameters in substantially the same region in the imaging data, An imaging apparatus comprising: an unnecessary image determination unit that determines that the region is an unnecessary image region including an unnecessary image; and a notification unit that notifies that the unnecessary image region has been detected.
With the above configuration, image parameter distributions such as color distribution and luminance distribution are recognized for a plurality of imaging data acquired in a moving state in the imaging apparatus such as a preview image before imaging, and substantially the same in substantially the same region. When there is an image parameter distribution, it can be determined that the image area is an unnecessary image area. Therefore, it is possible to determine an unnecessary image area due to finger shooting in a short time, and to improve the shooting response. Further, when there is no movement in the photographing apparatus, an unnecessary image area is not determined, so that erroneous determination at the time of fixed-point shooting can be suppressed.

The imaging apparatus, wherein the image parameter identification unit recognizes a color distribution of imaging data as the image parameter.
With the configuration described above, it is possible to recognize the non-moving substantially identical color distribution region in a plurality of imaging data in a state of motion using the color distribution of the imaging data and determine the presence or absence of an unnecessary image region.

In the above imaging device, the unnecessary image determination unit is an unnecessary image region in which unnecessary images are included when there are regions having substantially the same color distribution in the color distribution of the plurality of imaging data. An imaging device that determines that
With the configuration described above, it is possible to recognize the non-moving substantially identical color distribution region in a plurality of imaging data in a state of motion using the color distribution of the imaging data and determine the presence or absence of an unnecessary image region.

The imaging apparatus, wherein the image parameter identification unit recognizes a luminance distribution of imaging data as the image parameter.
With the above-described configuration, it is possible to recognize the non-moving low-luminance region in the plurality of imaging data in a state of motion using the luminance distribution of the imaging data and determine the presence or absence of an unnecessary image region.

In the above imaging device, the imaging unit can perform monocular 3D imaging in which two images with parallax are sequentially captured by a single imaging optical system, and the image parameter identification unit captures the image as the image parameter. Recognizing the luminance distribution of the data, the unnecessary image determination unit, when there is a low luminance region at substantially the same position in both of the image data of the two images, the unnecessary image including the unnecessary image in the region An imaging device that determines to be an area.
With the above configuration, when performing monocular 3D imaging, it is possible to determine an unnecessary image area by recognizing a low-luminance area at approximately the same position in two pieces of imaging data with parallax acquired sequentially by moving the imaging apparatus. .

In the above-described imaging device, the imaging unit can perform compound eye 3D imaging in which two images with parallax are simultaneously captured by two imaging optical systems, and the image parameter identification unit captures an image as the image parameter. Recognizing the luminance distribution of the data, the unnecessary image determination unit determines that the area is an unnecessary image area including an unnecessary image when only one of the image data of the two images has a low luminance area. Shooting device to do.
With the above configuration, when performing compound eye 3D shooting, an unnecessary image region can be determined by recognizing a low-luminance region in only one of two imaging data having parallax acquired simultaneously.

The imaging apparatus includes an image processing unit that performs image processing on the imaging data, and the image processing unit stores other imaging data stored in the imaging data storage unit for imaging data including the unnecessary image region. An imaging apparatus that calculates a motion vector of an image of a subject using data and complements pixels in the unnecessary image area from the other imaging data according to the motion vector.
With the configuration described above, the unnecessary image area is complemented using other imaging data, so that the captured image can be prevented from being affected even if finger capture occurs. Further, since the unnecessary image area is not trimmed, it is possible to prevent the angle of view from being narrowed.

An imaging apparatus comprising: an unnecessary image area setting unit that presets an area that is likely to be the unnecessary image area.
With the configuration described above, by setting the unnecessary image area in advance, it is possible to intentionally and effectively cause countermeasures against finger image capturing such as image correction related to the unnecessary image area.

The imaging apparatus, wherein the image processing unit captures an image including the unnecessary image area when the image data including the unnecessary image area cannot be complemented with pixels from the other imaging data. An imaging device that cuts out data and generates a captured image.
With the above configuration, when the unnecessary image area cannot be complemented using other imaging data, the captured image can be generated by cutting out the imaging data not including the unnecessary image area.

An imaging method in an imaging device including an imaging unit that captures a subject image, the step of storing imaging data of the subject acquired by the imaging unit, the step of detecting movement of the imaging device, and an image of the imaging data When there is substantially the same image parameter distribution in substantially the same region in the imaging data based on the step of identifying the parameter distribution and the image parameters of the plurality of imaging data acquired in a state where the imaging device is in motion And a step of determining that the area is an unnecessary image area including an unnecessary image and a step of notifying that the unnecessary image area has been detected.

A program that causes a computer to execute each procedure in the above photographing method.

The present invention is intended to be variously modified and applied by those skilled in the art based on the description in the specification and well-known techniques without departing from the spirit and scope of the present invention. Included in the scope for protection. In addition, the constituent elements in the above embodiment may be arbitrarily combined without departing from the spirit of the invention.

This application is based on a Japanese patent application filed on April 28, 2011 (Japanese Patent Application No. 2011-101617), the contents of which are incorporated herein by reference.

INDUSTRIAL APPLICABILITY The present invention has an effect of enabling fingering judgment to be accurately performed in a short time in a photographing apparatus. For example, a user of a digital camera, an electronic device with a camera function, etc. It is useful as a photographing device that performs the above photographing.

DESCRIPTION OF

SYMBOLS

11, 21

Imaging part

12, 22 Imaging data storage part 13 Color distribution recognition part 14

Motion detection part

15, 25 Unnecessary

image determination part

16, 26

Display part

17, 27

Control part

18, 28 Operation part 23 Luminance distribution recognition part 24 Luminance Distribution storage unit 51 Image processing unit 52 Image storage unit

Claims

An imaging unit that captures a subject image;
An imaging data storage unit for storing imaging data of the subject acquired by the imaging unit;
A motion detector for detecting the motion of the imaging device;
An image parameter identification unit for identifying an image parameter distribution of the imaging data;
Based on image parameters of a plurality of imaging data acquired in a state where the photographing apparatus is in motion, if there is a distribution of substantially the same image parameters in substantially the same area in the imaging data, the area includes unnecessary images. An unnecessary image determination unit that determines that the area is an unnecessary image area;
A notification unit for notifying that the unnecessary image area has been detected;
An imaging device comprising:
The imaging device according to claim 1,
The image parameter identifying unit is a photographing apparatus that recognizes a color distribution of image data as the image parameter.
The imaging device according to claim 2,
In the color distribution of the plurality of imaging data, the unnecessary image determination unit determines that the region is an unnecessary image region including an unnecessary image when there is a region having substantially the same color distribution.
The imaging device according to claim 1,
The image parameter identifying unit is a photographing device that recognizes a luminance distribution of image data as the image parameter.
The imaging device according to claim 1,
The imaging unit is capable of monocular 3D imaging in which two images with parallax are sequentially captured by one imaging optical system,
The image parameter identification unit recognizes a luminance distribution of imaging data as the image parameter,
The unnecessary image determination unit determines that the area is an unnecessary image area including an unnecessary image when a low-luminance area exists at substantially the same position in both of the imaging data of the two images. .
The imaging device according to claim 1,
The imaging unit is capable of compound-eye 3D imaging in which two images with parallax are simultaneously captured by two imaging optical systems,
The image parameter identification unit recognizes a luminance distribution of imaging data as the image parameter,
The unnecessary image determination unit determines that the area is an unnecessary image area including an unnecessary image when a low luminance area exists in only one of the imaging data of the two images.
The imaging device according to claim 1,
An image processing unit that performs image processing of the imaging data;
The image processing unit calculates a motion vector of an image of a subject using other imaging data stored in the imaging data storage unit for imaging data including the unnecessary image region, and determines the other according to the motion vector. An imaging device that complements the pixels of the unnecessary image area from the imaging data of the image.
The photographing apparatus according to claim 7,
An imaging apparatus comprising an unnecessary image area setting unit that presets an area that is likely to be the unnecessary image area.
The photographing apparatus according to claim 7 or 8,
When the image data including the unnecessary image area cannot be complemented with pixels from the other image data, the image processing unit generates a captured image by cutting out the image data so as to exclude the area including the unnecessary image area. A shooting device.
An imaging method in an imaging device including an imaging unit that captures a subject image,
Storing imaging data of the subject acquired by the imaging unit;
Detecting the movement of the imaging device;
Identifying a distribution of image parameters of the imaging data;
Based on image parameters of a plurality of imaging data acquired in a state where the photographing apparatus is in motion, if there is a distribution of substantially the same image parameters in substantially the same area in the imaging data, the area includes unnecessary images. Determining that it is an unnecessary image area;
Notifying that the unnecessary image area has been detected;
A photographing method comprising:
A program for causing a computer to execute each procedure in the photographing method according to claim 10.