JP6165706B2 - Imaging apparatus, method, and program - Google Patents

Description

  The present invention relates to an imaging apparatus, method, and program, and more particularly, to an image storage technique in the imaging apparatus.

  Recent advances in digital technology have been remarkable, and imaging devices such as digital cameras and digital video cameras have become smaller, more functional, and higher in image quality. For this reason, an increasing number of mobile phones have an imaging function. In addition, although the number of pixels per image has increased with the increase in the number of pixels of the camera, a large-capacity recording medium for storing captured images has been developed. Therefore, the user can record the captured image without worrying about the number of stored images.

  As the capacity of recording media increases, a large number of images can be stored on the recording media. On the other hand, as the number of stored images increases, when looking back at a recorded image, the user may not find the image he wants to see, or when it takes time to search.

  Patent Document 1 describes a technique in which a large number of images recorded on a recording medium are grouped for each person in the image and stored again. In the technique described in the patent document, when a user specifies an image of a person on the screen, face recognition means extracts the feature point of the person from the image. Next, the search means extracts an image including a person having the feature point from the other plurality of images. The extracted image is re-saved in a folder prepared for the person. Further, in this patent document, when a display image on the touch panel of a person who is currently shooting is touched in a specific shooting mode, a number of images including the same person that has been recorded at that time and the same person already recorded are recorded. It is also described that the image is re-saved in one folder.

JP 2007-310813 A

  The technique described in Patent Document 1 is a technique for collecting and re-storing a large number of captured images in one folder according to user settings. With this technique, images of the same person cannot be combined into one folder unless the user intends to re-save and performs processing for that purpose. However, the process of re-recording an existing image is complicated for the user.

  The present invention has been made in view of the above circumstances, and an imaging apparatus, method, and method that can record an image taken by a user so that the user can easily find a desired subject image without burdening the user. The purpose is to provide a program.

In order to achieve the above object, the present invention provides an image capturing unit that captures a subject and generates a subject image, a feature point extracting unit that extracts a feature point from the image, a feature point in the subject image, and a storage in advance. by comparing the feature points of the registered image which is, a determination unit configured to determine whether feature points in both images coincide, the subject image determined with the determination means match records in the same folder If an imaging apparatus including an image recording means you, the, by said judging means, the target image having a feature point that matches the feature points in the registration image is determined to be more present in the subject image, The image recording unit further includes a selection unit that selects one target image based on the priority order determined for each target image, and the image recording unit selects the one target image selected by the selection unit , The one subject Recorded in the same folder corresponding to the registered image with the feature points is determined to have a feature point where the image matches the image recording unit, the subject image is the determination it is determined that the determination means does not match An imaging device for recording in a folder created each time is provided.

The present invention also includes a step of photographing a subject to generate a subject image, a step of extracting feature points from the image, a feature point in the subject image, and a feature point in a registered image stored in advance. in comparison, determining whether feature points in both images coincide, the object image is determined to match said step of determining the photographed image with the steps you recorded in the same folder In the recording method, when it is determined in the determining step that there are a plurality of target images having feature points that match feature points in the registered image, the target image is determined for each target image. based on priority, and selecting one of the target image of which the object image of the selected the one, the feature point is determined to have characteristic points the one of the target image matches Wherein the step of recording the same folder corresponding to the registered image, an object image is determined not to match the determining the recording method of the photographic image, further comprising the step of recording the folders created each time of the determination that I will provide a.

The present invention further includes processing for photographing a subject to generate a subject image on a computer, processing for extracting feature points from the image, feature points in the subject image, and features in a pre-stored registered image. by comparing the point, the process of determining whether feature points in both images coincide, the object image is determined to match the determining process and processing you recorded in the same folder, the determination When it is determined that there are a plurality of target images having feature points that match the feature points in the registered image in the processing to be performed, based on the priority order determined for each target image, A process of selecting one target image , and the same one corresponding to the registered image having the feature point determined to have the selected one target image having a matching feature point. Mark in folder A process of the subject image is determined not to match the determining process provides a program for executing the processing for recording in the folder that is created each time of the determination.

  According to the imaging apparatus, method, and program of the present invention, it is possible to record a photograph taken by a user so that the user can easily find a desired subject image without imposing a burden on the user.

1 is a block diagram of an imaging apparatus according to a first embodiment of the present invention. 2 is a flowchart showing processing of the imaging apparatus in FIG. 1. The block diagram of the imaging device which concerns on the 2nd Embodiment of this invention. The block diagram which shows the folder structure of a recording medium. FIG. 4 is a flowchart illustrating processing of the imaging apparatus in FIG. 3. FIG.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 is a block diagram of an imaging apparatus according to the first embodiment of the present invention. The imaging apparatus 10 of the present embodiment includes an imaging unit 11 that shoots a subject and generates a subject image, a feature point extraction unit 12 that extracts a feature point from the image, a feature point in the subject image, and a registered image storage in advance. The feature point in the registered image stored in the unit 16 is compared to determine whether or not the feature points in both images match, and when the determination unit 13 determines that they match, the subject Image recording means 14 for recording an image in a folder of the recording medium 15 corresponding to the registered image. Each of the above means is constituted by a computer and a computer program, and the imaging means 11 includes hardware such as a lens (not shown).

  The imaging apparatus 10 of the above embodiment can store the image of the subject photographed by the imaging means 11 in a desired folder of the recording medium 15 without imposing a burden on the user by the function of the apparatus itself. For this reason, when the user later retrieves and reproduces an image of a desired subject from the recording medium 15, the subject image can be easily searched.

  FIG. 2 is a flowchart illustrating processing of the imaging apparatus 10 according to the embodiment. The method performed by the imaging apparatus 10 includes a step of shooting a subject to generate a subject image (S1), a step of extracting a feature point from the image (S2), a feature point in the subject image, and a prestored feature point. Compare the feature points in the registered image and determine whether the feature points in both images match (S3). If it is determined that the feature points match in the determination step, the subject image corresponds to the registered image. Recording in a folder (S4).

  The computer of the imaging apparatus 10 according to the embodiment includes a process for capturing a subject to generate a subject image, a process for extracting a feature point from the image, a feature point in the subject image, and a pre-stored registered image. The feature point is compared with each other to determine whether or not the feature points in both images match, and when it is determined to match in the determination processing, the subject image is recorded in the folder corresponding to the registered image And controlled by a program including:

  FIG. 3 shows an imaging apparatus according to the second embodiment of the present invention. The imaging device 20 of the present embodiment includes a camera 21, an A / D conversion unit 22, an image processing unit 23, a display device 24, a face recognition unit 25, a registered image storage unit 26, a determination unit 27, A selection unit 28, an image recording unit 29, and a recording medium 30 are included. On the recording medium 30, images are divided into folders A to E and recorded.

  The camera 21 generates an image of the subject and gives it to the A / D converter 22 before the shutter is pressed. The image of the subject converted into digital data by the A / D conversion unit 22 is given to the image processing unit 23. The image processing unit 23 performs necessary image processing on the input image and displays it on the display device 24 as a preview screen. The image processing unit 23 also gives the processed image of the subject to the face recognition unit 25 constituting the feature point extraction unit. The face recognizing unit 25 extracts a person image portion from the preview image of the subject, extracts a feature point from the extracted person image portion, and supplies the feature point to the determination unit 27. The face recognizing unit 25 extracts the feature points from the person images in the registered images registered in the registered image storage unit 26 in advance prior to photographing the subject, and provides them to the determining unit 27. .

  The determination unit 27 stores the feature points of the registered image input in advance from the face recognition unit 25, compares the feature points of the person image in the input preview image with the feature points of the registered image, and the feature points. It is determined whether or not. If the determination unit 27 determines that there are a plurality of person images having matching feature points in the preview image, the determination unit 27 gives the selection unit 28 IDs of the plurality of persons having the matching feature points. The selection means 28 internally stores the priority order assigned to each person having the ID, and when the determination means 27 detects matching of feature points for a plurality of person images, one of them is determined according to the priority order. Select one person image. The selection result is returned to the determination means 27. The determination means 27 uses the ID of one person whose feature points match in the preview image or the ID of one person selected by the selection means 28 as the determination result.

  The determination result of the determination unit 27 is given to the image recording unit 29. The image recording unit 29 waits for the shutter of the camera to be pressed, and displays an image showing the person determined by the determining unit 27 as the feature point match in the folder A of the recording medium 30 associated with the ID of the person. Save to ~ D. An image in which the person image for which the determination unit 27 determines that the feature points match is not present in the preview image is stored in the other holder E. It should be noted that the temporal order of the determination result by the pressing of the shutter and the determination means 27 does not matter. The image recording unit 29 records the photographed image in a predetermined folder of the recording medium 30 after both the pressing of the shutter and the determination result by the determination unit 27 occur.

  FIG. 4 illustrates the folder structure of the recording medium 30. Folder A, folder B, folder C, and folder D are provided for a specific person or corresponding to a specific group, respectively. The folder E is a folder for images in which only persons who do not belong to any of them are copied. Inside each folder, one or more reference face images are designated by the user by the user, and the designated face images are registered in the registered image storage unit 26, and the person image of the subject is specified. Used for comparison. The registered images may be taken for that purpose, or one or more of the registered images may be selected from existing images.

  FIG. 5 is a flowchart illustrating processing of the imaging device 20 according to the second embodiment. When shooting by the camera 21 starts, the imaging device 20 starts in the shooting mode set by the user in the previous shooting, for example, in the auto mode (step S11). An image of the subject photographed by the camera 21 is displayed as a preview on the display device 24 (step S12). Next, the imaging device 20 receives a change in the setting mode (step S13). If the setting mode is changed and setting change A is selected, the user can select an image storage destination (step S14). If setting change B is selected, the user selects a shooting mode (step S15). If the setting mode is not changed in step S13, the process proceeds to step S16 as it is with the auto mode setting.

  In step S16, when the auto mode is selected, the face recognition unit (face recognition system) 25 is activated. The face recognition unit 25 compares the currently previewed image with the registered image, and determines whether or not a pre-registered person's face image exists in the displayed image (step). S17). Next, assume that the shutter is pressed in step S18. In step S19, when the user confirms the photographed image and is satisfied with the photographed image and selects registration thereof, the process proceeds to step S20. If the user is not satisfied with the captured image and determines that re-imaging is necessary, the process returns to step S16.

  In step S20, the determination result by the face recognition unit 25 is checked. If the registered image is not included in the captured image, the process proceeds to step S22, the image is registered in the folder E, and the process ends. If a registered image is included, the process proceeds to step S21, and it is determined whether or not a plurality of registered images exist. If there is only one registered image, the process proceeds to step S24, where the image recording means 29 registers the photographed image in the designated folders A to D and ends the process. When there are a plurality of registered images in the photographed image in step S21, the determination unit 27 requests the selection unit 28 to select based on the priority order, and the selection unit 28 selects one of them. (Step S23). The image recording unit 29 registers the image in the folder corresponding to the selected registered image (step S24), and ends the process.

  In the second embodiment, similarly to the first embodiment, the user can save the captured image in a desired folder by the function of the imaging device 20 without specifying the storage destination. Further, in the second embodiment, even in the case of an image having a plurality of registered face images, it can be stored in a desired folder by setting priorities in advance. Therefore, the imaging device 20 can store images in an appropriate folder without imposing a burden on the user each time shooting is performed. An image including a plurality of persons having the same priority order or an image including a plurality of persons having a priority order equal to or higher than a predetermined value may be stored in each folder.

  In each of the above embodiments, an example in which a user designates a face image has been described. However, designation or registration itself by a user is not necessarily required. For example, face recognition is performed every time it is saved from the start of use of the imaging device 20, and if an image with a matching feature point is captured in the same folder, a folder is created each time an image with no matching feature point is taken. Is possible. In any case, at the time when shooting of one image is completed, the shot image is stored so that the user can easily find it later.

  In each of the above embodiments, an example in which a person image is registered has been described. However, the present invention is not necessarily limited to a person image. For example, images such as dishes, flowers, and night views may be automatically identified and a storage folder may be allocated. In either case, the captured image is stored so that the user can easily find the target image when the user reproduces or prints the image later.

  For example, when searching for a desired image taken in the past, the user usually searches for images by browsing the images in order from the newest or the oldest of the stored images. It is. At this time, in the case of the newest image or an image close to the oldest image, the burden on the user is small. However, it is not easy to search for a desired image when the number of stored images becomes hundreds as the capacity of the recording medium increases. Even in such a case, the image pickup apparatus of the present invention records a photographed image so that the user can easily find a desired image without the need for image arrangement by the user.

  Although the invention has been particularly shown and described with reference to illustrative embodiments, the invention is not limited to these embodiments and variations thereof. It will be apparent to those skilled in the art that various modifications can be made to the present invention without departing from the spirit and scope of the invention as defined in the appended claims.

DESCRIPTION OF SYMBOLS 10 Image pick-up device 11 Image pick-up means 12 Feature point extraction means 13 Judgment means 14 Image recording means 15 Recording medium 16 Registered image storage part 20 Image pick-up device 21 Camera 22 A / D conversion part 23 Image processing part 24 Display apparatus 25 Face recognition part 26 Registration Image storage unit 27 determination unit 28 selection unit 29 image recording unit 30 recording medium

Claims (4)

Imaging means for photographing a subject and generating a subject image;
Feature point extraction means for extracting feature points from the image;
A determination unit that compares the feature points in the subject image with the feature points in the registered image stored in advance and determines whether or not the feature points in both images match;
Wherein the determined object image and the determination means match an imaging apparatus and an image recording unit you recorded in the same folder,
When it is determined by the determination means that there are a plurality of target images having feature points that match the feature points in the registered image, based on the priority order determined for each target image, A selection means for selecting one of the target images of
The image recording unit includes the same folder corresponding to the registered image having the feature point determined to have the feature point that the one target image matches the one target image selected by the selection unit. Recorded in
The image recording unit is an image pickup apparatus that records a subject image determined by the determination unit as not matching in a folder created every time the determination is made .   The imaging apparatus according to claim 1, wherein the feature point extraction unit includes a face recognition system. Shooting a subject to generate a subject image;
Extracting feature points from the image;
Comparing feature points in the subject image with feature points in a pre-stored registered image to determine whether the feature points in both images match;
Subject image determined to match at the determining step is a method comprising the steps you recorded in the same folder,
In the determining step, when it is determined that there are a plurality of target images having feature points that match the feature points in the registered image, based on the priority order determined for each target image, Selecting one of the target images,
Recording the selected one target image in the same folder corresponding to the registered image having the feature point determined to have the matching feature point of the one target image ;
Recording a subject image determined to be inconsistent in the determining step in a folder created each time the determination is made . On the computer,
Processing to shoot a subject and generate a subject image;
Processing to extract feature points from the image;
A process of comparing the feature points in the subject image with the feature points in the pre-stored registered image to determine whether the feature points in both images match;
Subject image is determined to match the determining process and processing you recorded in the same folder,
In the determination process, when it is determined that there are a plurality of target images having feature points that match the feature points in the registered image, based on the priority order determined for each target image, A process of selecting one of the target images,
A process of recording the selected one target image in the same folder corresponding to the registered image having the feature point determined to have the feature point that the one target image matches ;
A program for executing a process of recording subject images determined to be inconsistent in the determination process in a folder created each time the determination is made .

Images