JP3982132B2 - Information output control method and information display device - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a password collation technique used for security of information equipment, and more particularly to an information output control method and an information display apparatus based on image collation for collating a registered image as a secret key.
[0002]
[Prior art]
The secret key function that prevents others from seeing or stealing information stored in information devices including personal computers (hereinafter referred to as personal computers) is mainly based on passwords using alphanumeric characters. A combination of alphanumeric characters is registered as a password (password), a character string is required to access the information device, and access to the information device is permitted when the entered character string matches or does not match the password. / The method of determining non-permission (that is, whether or not the secret key can be released) is mainly used.
[0003]
[Problems to be solved by the invention]
However, in the method using the password as described above, if the combination of alphanumeric characters matches the password, the secret key is released and the information device can be accessed. Also, since the user must remember the password, it is often set to his / her own phone number, birthday or name, etc., which is easy to remember, and passwords for others who know the user's phone number, birthday or name etc. There was a problem that deciphering became easy.
[0004]
SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and an object of the present invention is to provide an information output control method and an information display apparatus based on image collation using an image as a secret key (password).
[0005]
[Means for Solving the Problems]
  First to solve the above problemsThe invention is an information output control method for outputting information from a memory for storing information stored in a plurality of items, the memory storing a display limit rank for each of the plurality of items, and an imaging step. A collation step for collating the image captured in this imaging step with the image stored in the memory;Matched by this matching stepA ranking step for ranking according to the matching rate obtained as a result, a comparison step for comparing the rank given in the ranking step with the display limit rank stored in the memory, and a comparison step And a control step for controlling the output of the information stored in the memory by restricting the display of the item information based on the comparison result.It is characterized by.
[0006]
  Further, the information display device of the second invention is a display means for displaying information, and this information.Divide into multiple items and store display limit rank for each itemStorage means, imaging means, images taken by the imaging means, and the storage meansRemembered imageAnd a matching means for matching with the matching meansThe ranking means for ranking according to the matching rate obtained as a result, the comparison means for comparing the rank given by the ranking means with the display limit rank stored in the storage means, and the comparison means The display of the item information is limited based on the comparison result, and the information stored in the memory is displayed on the display means.And a control means for controlling.
[0007]
  The third invention is the second invention.In the invention, if the rank given by the ranking means is equal to or higher than the display restriction rank as a result of the comparison by the comparison means, the control means displays information on items corresponding to the display restriction rank. Control to displayIt is characterized by.
[0008]
  The fourth invention is the above2nd or 3rd invention WHEREIN: The imaging target discrimination means which discriminate | determines whether the imaging target of the image imaged by the said imaging means is printed matter was further provided.It is characterized by.
[0009]
  The fifth invention isIn the fourth aspect of the invention, it further comprises focusing means and distance acquisition means for acquiring a plurality of distances between the subject included in the image and the apparatus based on the focusing operation by the focusing means,The imaging object determining means includesBased on a plurality of distances obtained by the distance acquisition meansThe imaging target is discriminated.
[0010]
  The sixth invention is the above-mentionedIn a fourth aspect of the present invention, the apparatus further comprises illuminance measuring means for measuring the illuminance of the imaging target by external light, and the imaging target determining means determines the imaging target based on the measurement value obtained by the illuminance measuring means.It is characterized by that.
[0013]
DETAILED DESCRIPTION OF THE INVENTION
FIG. 1 is an external view of a wristwatch type digital camera (hereinafter referred to as a digital camera) that can be carried by being worn on a user's arm as an embodiment of the information display device of the present invention. FIG. FIG. 1 (b) shows the appearance viewed from the A direction. FIG. 2 is a block diagram showing an example of the circuit configuration.
In FIG. 1, a display unit (liquid crystal screen) 7 is provided on the upper part of the main body of the wristwatch type digital camera 100, and the imaging lens 1a of the camera module 1 and the Ir (infrared) communication module 10 are arranged on the side viewed from the A direction. An infrared transmission / reception unit 10a is provided, and switches S1 to S5 and a shutter key F0 are provided on the other side. Further, as described later, an illuminance detection unit (illuminance sensor) may be provided as a part of the camera module on the imaging lens side.
[0014]
In FIG. 2, a wristwatch type digital camera 100 includes a camera module 1, a control unit 2, a system ROM 3, a work memory (RAM) 4, a storage memory (flash memory) 51, an interface 52, a display driver 6, and a display unit (liquid crystal screen). 7, a shutter key 8 (F0), a key input unit 9 (switches S1 to S5), and an Ir (infrared) communication module 10. An acoustic output unit may be provided.
[0015]
The camera module 1 includes an imaging unit including an imaging lens, a lens driving unit, a signal conversion unit, and a signal processing unit, captures a subject image at the time of shooting and converts it into image data, and the image data (hereinafter simply referred to as an image). Is stored in the work memory 4. When the shutter key 8 is operated, the image stored in the work memory 4 is subjected to compression processing or the like and then stored in the storage memory 51 via the control unit 2. Further, as described above, an illuminance detection unit (illuminance sensor) may be provided.
[0016]
The control unit 2 includes a CPU (not shown), a clock 21, a time correction circuit 22, and an image recognition processing unit 23. The CPU is connected to the above-described modules, circuits, memories, keys, etc. via a bus line, and controls the wristwatch type digital camera 100 as a whole by a control program stored in the system ROM 3, as well as the shutter key 8, In response to a signal received from the key input unit 9, an image photographing / reproducing processing program stored in the system ROM 3, an image collation program based on the present invention, a secret information display program, etc. Execution control etc. are performed. Further, the image recognition processing unit 23 executes image collation processing based on the present invention under the control of the CPU.
[0017]
The system ROM 3 is a memory for storing constants, icons, menu data, and the like in addition to various programs such as the control program, the image capturing / reproduction processing program, and the image collation program.
[0018]
The work memory 4 is composed of a volatile memory such as a RAM (DRAM). In the “image collation mode”, the captured image (collation image) is temporarily stored and the secret key image (compressed image data) taken out from the storage memory 51 is stored. It is used as a memory for temporary storage of the expanded and reproduced secret key image, temporary storage of personal information displayed on the display unit 7, and other temporary storage of intermediate results.
In other modes, for example, the “time display mode”, it is used as a working memory for time information and its update information.
[0019]
The storage memory 51 is configured by a non-volatile memory such as a flash memory, and is detachable from the interface 52. Then, as shown in the example of FIG. 3B, the secret key image (password image) taken and specific information (for example, personal information as shown in the example of FIG. 4) are stored in association with each other. . The information associated with the secret key image (hereinafter referred to as secret information) is not limited to personal information (for example, the image may be a product, and product information such as price, standard, quality,... It may be an image or sound information, or a specific code may be associated with the image). That is, the storage memory 51 stores and stores the secret information associated with the image together with the image.
[0020]
The display driver 6 converts display data such as an image and secret information sent from the control unit 2 into a bitmap image, develops it in an image memory (VRAM), and displays it on the display unit 7. When the secret information is acoustic information, the acoustic data (digital data) is converted into an acoustic signal (analog signal) by an acoustic signal converter and output from the acoustic output device.
[0021]
The key input unit 9 includes switches S1 to S5. When these switches are operated, a status signal is sent to the CPU of the control unit 2. The switches S1 to S5 are assigned specific processing designation functions such as [information display], “image playback”, “secret key image registration”, and “secret key image registration cancellation”, respectively, under the “image collation mode”. It has been. Further, for example, a function switching function is assigned to the switch S5 so that a menu is displayed on the display unit 7 each time the switch S5 is pressed, and the switches S1 to S1 when the menu display is switched to the “clock mode”. The functions assigned to S4 may be “time display”, “date setting”, “day setting”, “time setting”, and the like.
[0022]
When the menu display is “information registration mode”, alphanumeric characters can be input by a combination of the switches S1 to S5. When the mode display is “external information input”, information (data) from the Ir communication module 10 can be input and stored in the storage memory 51. In addition, alphanumeric characters, katakana, and kana-kanji characters can be input by a combination operation of the switches S1 to S5 (when kana-kanji input is enabled, a storage memory storing a kana-kanji dictionary is provided).
[0023]
[Embodiment (1)]
FIG. 3 is an explanatory diagram of a secret key image. FIG. 3A shows a subject 30 (a bear stuffed animal in this example) as a secret key image candidate. Note that the subject to be a secret key image is not limited to a doll. That is, any object that can be photographed as a still image such as an object, a figure, or a person may be used. Further, (b) shows the secret key image 31 registered (stored and stored) in the wristwatch type digital camera 100.
[0024]
FIG. 4 is an explanatory diagram of the secret information stored in the storage memory 51 of the wristwatch type digital camera 100 in association with the secret key image. In this example, the personal information 40 of the user as shown is stored in the storage memory 51. And is associated with the secret key image 31.
The secret information corresponding to the secret key image can be directly input by a combination of the switches (S1 to S5) of the key input unit 9, but secret information created in advance by an external device or the like is stored in the Ir communication module 10. And stored (registered) in the storage memory 51. Since the storage memory 51 is configured to be detachable from the wristwatch-type digital camera 100, the secret key image and the secret information can be associated in advance. A storage memory 51 that is additionally stored may be attached. Further, the timing of storing (registering) the secret information to be associated with the secret key image in the storage memory 51 is preferably before the storage of the secret key image to be associated with the storage memory 51, but the secret key image to be associated is described later. It may be performed after storing and storing.
[0025]
(Register secret key image)
FIG. 5 is a flowchart showing one embodiment of the secret key image registration operation.
Step T1: (Shooting a subject as a secret key image)
In the “secret key image registration mode”, when the subject 30 of the secret key image candidate as shown in FIG. 3A is photographed with the wristwatch-type digital camera 100 (the shutter key 8 is pressed), it is taken into the camera module 1. The subject image is converted into an image (image data) and stored in the work memory 4.
[0026]
Step T2: (Display photographed image)
The image stored in the work memory 4 is sent to the display driver 6 and converted into an image to be displayed as a still image on the display unit 7 (liquid crystal screen). At this time, a message prompting the user to confirm whether or not to register as a secret key image is superimposed on the still image.
[0027]
Step T3: (Confirmation of secret key image registration availability)
The user may look at the image displayed on the display unit 7 in step T2 and the message and check the image appearance (angle, color, size, etc.) of the displayed image and register it as a secret key image. In this case, the user presses the OK key (for example, button S1), and presses the NG key (for example, button S2) if he / she thinks it is better to take a picture again.
The control unit 2 (CPU) examines the status signal from the key input unit 9, transitions to T4 when the OK key (for example, button S1) is pressed, and the NG key (for example, button S2) is pressed. In this case, control is returned to T1 for re-shooting.
[0028]
Step T4: (Confirmation of secret information)
The control unit 2 (CPU) checks whether or not the secret information corresponding to the secret key image (that is, information protected by the secret key image) has already been stored (registered) in the storage memory 51. Transition to T5, otherwise transition to T6.
[0029]
Step T5: (Register secret key image)
The control unit 2 (CPU) performs a compression process (for example, JPEG compression) on the image stored in the work memory 4, and the secret information stored in the storage memory 51 using the compressed image (compressed image data) as a secret key image. Are registered (stored and stored) in the storage memory 51 in association with
The secret key image and the secret information are associated with each other by, for example, storing a code indicating the secret key image on the secret key image side, the start address (pointer) of the secret information and the data size thereof, and the secret key on the secret information side. This can be done by storing the image number of the image.
At this time, in the embodiment, the image recognition processing unit 23 performs the length and width in the vertical direction of the image (the length of the line segment perpendicular to the top and bottom through the focal point (center) and stopped at the edge of the subject image) and The feature of the secret image (for example, the tip position (coordinates of the head, ears, limbs when taking a person or animal as an example)) is registered in the storage memory 51 in association with the secret key image (FIG. 7 ( a)). It should be noted that color combinations and color arrangements may be added to the elements for feature extraction.
A plurality of pieces of secret information may be associated with one secret key image (for example, the personal information of each person and the personal information of each family member may be associated with one secret key image). In this case, a code indicating the secret key image, the head address (pointer) of each secret information, and its data size are stored on the secret key image side. Conversely, a plurality of secret key images may be associated with one secret information. In this case, the image number of the secret key image is stored on each secret information side.
[0030]
Step T6: (Secret key image temporary registration confirmation, etc.)
The control unit 2 (CPU) displays on the display unit 7 a message that the secret information is not registered and a message that prompts confirmation of whether or not to temporarily register the secret key image. Further, the state signal from the key input unit 9 is checked, and if an OK key (for example, button S1) is pressed, the process proceeds to T7 for temporary registration, and an NG key (for example, button S2) is pressed. In this case, the secret key image registration process is terminated.
[0031]
Step T7: (Tentative registration of secret key image)
The control unit 2 (CPU) performs compression processing (for example, JPEG compression) on the image stored in the work memory 4, and temporarily registers (stores and stores) the compressed image (compressed image data) in the storage memory 51 as a secret key image. To do. In this case, a code indicating a secret key image is registered in the image to be stored and stored, and a dummy code (space or “00000” or the like) is written in a portion where the top address (pointer) and the data size of the secret information are registered.
At this time, in the embodiment, the image recognition processing unit 23 performs the length and width in the vertical direction of the secret key image and the characteristics of the secret key image (for example, a protruding portion (for example, a person, an animal, a head, an ear, The front end position (coordinates) of the limb) is registered in the storage memory 51 in association with the secret key image to be temporarily registered (see FIG. 7A). It should be noted that color combinations and color arrangements may be added to the elements for feature extraction.
[0032]
(Release secret)
FIG. 6 is an explanatory diagram of the secret key image collation operation, and FIG. 7 is a flowchart showing an embodiment of the secret key image collation and information display operation by the wristwatch type digital camera 100.
[0033]
When the user wants to read the secret information stored in the wristwatch type digital camera 100, the user needs to input an image (a matching image) that matches the secret key image. The collation image is input by photographing a subject as a collation image using the wristwatch type digital camera 100.
[0034]
Step U1: (photographing a subject as a verification image)
In FIG. 7, when the user photographs the subject 32 (or 32 ′) of the key image candidate as shown in FIG. 6B or 6B ′ with the wristwatch type digital camera 100 (presses the shutter key 8), the camera The subject image captured by the module 1 is converted into an image (image data) and stored in the work memory 4.
[0035]
Step U2: (Display photographed image)
The image stored in the work memory 4 is sent to the display driver 6 and converted into an image to be displayed as a still image on the display unit 7 (liquid crystal screen). At this time, a message that prompts the user to confirm whether or not to use a collation image for collation is superimposed and displayed on the still image.
[0036]
Step U3: (Confirmation of availability of photographed image)
The user looks at the image displayed on the display unit 7 and the message at step U2 and checks the image appearance (angle, hue, size, etc.) of the displayed image, and is suitable as a verification image for verification with the secret key image. Press the OK key (for example, button S1), and press the NG key (for example, button S2) if you think that it is better to take a picture again.
The control unit 2 (CPU) examines the status signal from the key input unit 9, transitions to U4 when an OK key (for example, button S1) is pressed, and an NG key (for example, button S2) is pressed. In this case, control is returned to U1 for re-shooting.
[0037]
Step U4: (Image alignment processing of photographed images)
The image recognition processing unit 23 performs matching processing as shown in FIG. 7B on the photographed image to obtain a matching image for matching with the registered secret key image. It should be noted that the alignment processing is performed in order to align the inclination and size with the secret key image because the inclination and size of the captured image usually do not match the inclination and size of the registered secret key image in many cases.
[0038]
Step U5: (Verification of secret key image and verification image (image comparison))
The image recognition processing unit 23 compares the verification image obtained in step U4 with the secret key image (FIG. 6 (a)), and if they match (FIG. 6 (b)), the image recognition processing unit 23 proceeds to U9 to cancel the secret. If a transition is made and the images do not match (FIG. 6 (b ′)), the transition is made to U6. Note that image matching in this case means matching within a predetermined threshold range for the shape (and color). That is, the probability that images captured at different times completely match is not high due to light conditions, vibration due to vibration, change in pixel density due to expansion and contraction processing (U4-6) of the captured image, and so on. For example, when the matching rate is 99.5% or more (in this case, the threshold = 0.5%), it is regarded as matching.
[0039]
Step U6: (feature extraction of matching image)
The image recognition processing unit 23 extracts the characteristics of the image for collation (for example, the tip position (coordinate) of the protruding portion (head, ear, limb when taking a person or animal as an example)). It should be noted that color combinations and color arrangements may be added to the elements for feature extraction.
[0040]
Step U7: (feature matching)
Next, the image recognition processing unit 23 compares the feature of the secret image stored in the storage memory 51 with the feature of the matching image extracted in step U6. If they match, the image recognition processing unit 23 returns to U9 to release the secret. If there is a transition and the images do not match, the process transitions to U8. That is, a characteristic portion in the whole image and its positional relationship (for example, the position of the ear of the image for comparison, the position of the foot, the position of the ear of the secret image, the position of the foot) are determined (that is, the image for verification). And whether it is similar or not (determining the overall feature and its overall ratio).
[0041]
Step U8: (Secret release impossible display)
The control unit 2 (CPU) displays a message on the display unit 7 via the display driver 6 that the secret cannot be canceled because the captured images are different, and ends the process.
[0042]
Step U9: (secret release)
The control unit 2 (CPU) can display a processing menu on the display unit 7 by releasing secret, for example, “button S1 → secret information display”, “button S2 → secret key image registration change”, “button S3 → secret key image registration”. Cancel "and" Button S4 → Secret information input ") are displayed to prompt the user to select a process.
[0043]
Step U10: (determination of selection menu)
The control unit 2 (CPU) examines the status signal from the key input unit 9, transitions to U11 when the switch S1 is pressed, transitions to U12 when the switch S2 is pressed, and the switch S3 When it is pressed, the process proceeds to U13, and when the switch S4 is pressed, the process proceeds to U14.
[0044]
Step U11: (secret information display processing, etc.)
When the button S1 is selected in the above step U10, the control unit 2 (CPU) retrieves secret information (for example, personal information in FIG. 4) corresponding to the secret key image that matches the verification image from the storage memory 51 and works. After being temporarily stored in the memory 4, it is displayed on the display unit 7 via the display driver 6, and when the user presses an end button (for example, S5), the display is ended.
In the case of a secret key image (see FIG. 5 (step T7)) in which the secret key image that matches the verification image is temporarily registered, a message indicating that fact is displayed on the display unit 7. A message (for example, yes → button S4, no → button S5) for selecting whether or not to add secret information to the user is displayed. When the user presses the button S4, the process transits to U13, and the button S5 is pressed. And the process ends.
[0045]
Step U12: (Secret key image registration change process)
When the button S2 is selected in step U10, the control unit 2 (CPU) performs steps T1 (“photographing”), T2 (“photographed image display”), and T3 (photographed images) of the secret image registration processing operation in FIG. ) Is executed, the confirmed captured image is replaced with a secret key image that matches the verification image (that is, the current secret key image is overwritten with the captured image), and stored in the storage memory 51. Then, the process ends. In this case, a code meaning the secret key image is stored in the image to be stored and stored, and the head address (pointer) of the secret information and the data size thereof are stored (if the secret key image temporarily registered is changed, the secret key image is stored). A dummy code (a space or “00000” or the like) is written in a portion where the head address (pointer) of the information and the data size thereof are registered. At this time, in the embodiment, the image recognition processing unit 23 performs the vertical length and width of the image and the characteristics of the secret key image (for example, a protruding portion (a head, an ear, a limb, for example, a person or an animal)). Is registered in the storage memory 51 in association with the secret key image. It should be noted that color combinations and color arrangements may be added to the elements for feature extraction.
[0046]
Step U13: (Secret key image registration cancellation process)
When the button S3 is selected in step U10, the control unit 2 (CPU) displays a secret key image and a cancel confirmation message, and when the user performs a cancel confirmation operation (for example, presses the button S4), the secret key is displayed. The information about the secret key image to be canceled, such as the image, the vertical and horizontal sizes of the secret key image, the pointer of the secret information corresponding to the secret key image and the data size thereof, is deleted. Also, the image number associated with the secret information side corresponding to the secret key image is cleared, and the process ends.
[0047]
Step U14: (Addition of secret information)
When the button S4 is selected in step U10, the control unit 2 (CPU) can input the secret information directly from the key input unit 9 or the external information processing apparatus via the Ir communication module 10. To do. Then, the input secret information is temporarily stored in the work memory 4. When the input is completed, the secret information is displayed on the display unit 7 to request the user's confirmation. When the user operates a confirmation button (for example, button S5), the work is performed. The secret information stored in the memory 4 is stored in the storage memory 51. At this time, the secret key image side stores the image number of the secret key image, the corresponding secret key information side stores a code indicating the secret key image, and the top address (pointer) of the secret information and its data The size is stored and the process ends.
[0048]
In the example of FIG. 7A, the processing menu is displayed together with the display of the secret cancellation message in step U9, and the secret information display, the secret key registration change, etc. are selected. However, the present invention is not limited to this. Not displayed (for example, the processing menu is displayed at the beginning of the processing (before the step U1), and secret information display, secret key registration change, etc. are selected, and after the processing selection message is displayed after the secret is released in step U9. The processing selected immediately before the step U1 may be performed.
In the example of FIG. 7 (a), after the matching process in step U4, either the image comparison process in step U5 or the feature extraction / comparison process in steps U6 and U7 is performed. Only the U5 image comparison process is performed. If they match, the process proceeds to “secret release” (U9) and subsequent processes. Otherwise, the process proceeds to “secret release impossible message display” (U8). Alternatively, only the feature extraction / comparison processing in steps U6 and U7 may be performed, and if they match, the process proceeds to the process after U9, and if not, the process may transition to U8 (note that step U6) (If only the feature extraction / feature comparison process at U7 is performed, the image alignment process at step U4 may be omitted).
[0049]
・ "Consistency processing"
Hereinafter, an example of the alignment processing operation by the image recognition processing unit 23 in step U4 in FIG. 7A will be described with reference to FIG. 7B.
Step U4-1: (Acquisition of vertical and horizontal length of photographed image)
The image recognition processing unit 23 examines the vertical length and the horizontal width of the captured image (subject) and stores these lengths in the work memory 4.
[0050]
Step U4-2: (Comparison of length and width of secret key image and captured image)
The image recognition processing unit 23 extracts the length and width of the secret key image and the vertical method of the captured image registered in the storage memory 51 in association with the secret key image, and acquires the captured image acquired in step U4-1. The vertical length and the horizontal width of each are compared, and if both match, the captured image is changed to U5 (FIG. 7A) as a verification image without performing the subsequent operation. If the length and width in the vertical direction do not match, the process proceeds to U4-3.
[0051]
Step U4-3: (Calculation of aspect ratio of secret key image and captured image)
The image recognition processing unit 23 compares the length of the secret key image with the height and width of the secret image when the vertical length of the secret key image is H1, the horizontal width is W1, the vertical length of the captured image is H2, and the horizontal width is W2. (K1 = H1 / H2, K2 = W1 / W2) is calculated.
[0052]
Step U4-4: (Similarity determination)
Next, the image recognition processing unit 23 compares K1 and K2, and determines that the secret key image and the captured image are not similar if they do not match within the range of the effective digits, and the process proceeds to U4-5. If K1 and K2 match within the range of the number of significant digits, it is determined that they are similar and the process proceeds to U4-6.
[0053]
Step U4-5: (Slight rotation of captured image)
If the tilt of the captured image (subject image) does not match the tilt of the secret key image due to the angle of view at the time of shooting, the vertical and horizontal widths of the subject image are actually equal (or Actually, even if K1 = K2, the length becomes different in the step U4-2. Therefore, it is not possible to obtain the coincidence determination in the step U4-2 or the similarity determination in the step U4-4.
Accordingly, the image recognition processing unit 23 sets the captured image within a predetermined angle θ range (that is, 0 to θ, 0 to −θ) within a predetermined angle δ (0 <δ << θ, −θ << δ <. 0), when Σδ> θ, return to 0 and repeat U4-1 to U4-5 until Σδ <−θ (that is, until | Σδ |> θ, and when Σδ <−θ, U5 (see FIG. 7 (a)).
[0054]
Step U4-6: (Expansion / contraction of photographed image)
The image recognition processing unit 23 calculates the similarity M (= the size of the captured image / the size of the secret key image = K2 / K1) in order to align the size of the captured image and the secret key image, and the captured image is (1 / M). A doubled image is generated, temporarily stored in the work memory 4 as a verification image, and the process proceeds to U5 (FIG. 7A).
7A and 7B, the length and width of the secret key image registered in the storage memory 51 in step T5 or T7 of FIG. 5 and the features of the secret key image are shown. 7 (b) used for the image coincidence determination in step U4-2 and the similarity determination in step U4-4. In step T5 or T7 in FIG. 5, the length and width in the vertical direction of the secret key image are acquired. And the feature extraction of the secret key image is not performed, and the length and width in the vertical direction of the secret key image are acquired together with the length and width in the vertical direction of the photographed image in step U4-1 in FIG. In step U4-3, feature extraction of the secret key image may be performed together with feature extraction of the captured image.
[0055]
[Embodiment (2)]
FIG. 8 is an explanatory diagram of an embodiment of subject discrimination, and FIG. 9 is a flowchart showing an embodiment of subject discrimination operation when a secret key image is collated by the wristwatch type digital camera 100.
[0056]
The subject to be a secret key image may be any subject as long as it can capture the same image whenever it is captured at the same angle of view, but is preferably as unique as possible. Accordingly, in the case of a printed matter such as a photograph, since the same thing as the secret key image may be duplicated, it is not desirable as a contrast with the secret key image. The present invention provides a method for determining whether or not a subject to be photographed as a collation image for canceling a secret is a photograph.
[0057]
For this purpose, an autofocus function is added to the wristwatch-type digital camera 100 of FIG. 2, and two points (the center 81 (81 ′) of the subject 30 (30 ′) and two points before shooting are added as shown in FIG. The side portion (background portion) 82 (82 ') is focused and focused, and it is determined whether or not the subject 30 is a photograph based on the focal length obtained by focusing.
That is, as shown in FIG. 8A, when the subject 30 is not a photograph, the center 81 of the subject (the stuffed bear) 30, the camera distance r1 and the distance r2 between the side portions 81 are shown in FIG. 8A '. (R1 <r2 in the example of FIG. 8 (a '), but r1> r2 may also be used).
However, when the subject 30 ′ is a photograph (print of a stuffed bear) as shown in FIG. 8B, the distance r2 between the center point 81 ′ of the subject 30 ′, the camera distance r1 and the side portion 82 ′. Substantially coincide with each other as shown in FIG. Therefore, by automatically focusing on two points before photographing by the auto-focus function, it is possible to know whether or not the image is a photograph by examining the distance between the two points and the camera based on the focal length obtained by focusing.
[0058]
(Subject discrimination operation)
In other words, in order to determine whether or not the subject is a photograph, either before the secret key image collating operation (step U1) in FIG. 7 (when displaying a through image) or before the secret key image registering operation (step T1) in FIG. The following steps V1 to V6 are provided (FIG. 9).
Step V1: (Focus instruction out of focus frame, etc.)
When the user selects “image collation processing” or “secret key image registration processing” in “image mode”, the control unit 2 (CPU) locks the shutter key 8 and then, as shown in FIG. A subject image captured from the camera module 1 is displayed on the display unit 7 as a through image (viewfinder display), and a focus frame 80 centered on the center 81 ″ of the display screen 7 is displayed in a superimposed manner. Is instructed to focus on a portion 82 ″ that is a predetermined distance away from the focus frame 80.
[0059]
Step V2: (Automatic focus and distance acquisition)
The camera module 1 performs an automatic focusing operation on the instructed portion 82 ″. The control unit 2 (CPU) subjects the subject that is the portion 82 ″ instructed to the camera (imaging lens) from the focal length obtained by focusing. And a distance R2 from the background or the background is calculated and stored in the work memory 4.
[0060]
Step V3: (Focus instruction to the center of the focus frame)
Next, the control unit 2 (CPU) sends a control signal to the camera module 1 to instruct to focus on the center 81 ″ of the focus frame 80.
[0061]
Step V4: (Automatic focusing and acquisition of distance R)
The camera module 1 performs an automatic focusing operation on the center 81 ″ (that is, the center of the subject) of the focus frame. The control unit 2 (CPU) determines the camera (imaging lens) and the focus frame from the focal length obtained by focusing. The distance R1 to the subject portion that is the center 81 ″ of the image is calculated and stored in the work memory 4.
[0062]
Step V5: (Determination of whether or not it is a photograph)
The control unit 2 (CPU) compares the distances R2 and R1 obtained in the above steps V2 and V3, and if R2 = R1, the subject is determined to be a photograph and transitions to V6, and if R2 ≠ R1, it is not a photograph. Then, the shutter key 8 is unlocked and the image can be taken (that is, transition is made to U1 in FIG. 7 (or T1 in FIG. 5)).
[0063]
Step V6: (determination result and message display)
The control unit 2 (CPU) displays a message that “a photograph cannot be used as an image for verification” on the display unit 7, and ends the “image verification process” (or “secret key image registration process”).
In the examples of FIGS. 8 and 9, the subject (imaging target) is determined based on the two focal points, but the present invention is not limited to this.
[0064]
[Embodiment (3)] Discrimination of subject (2)
FIG. 10 is an explanatory diagram of another embodiment of subject discrimination, and FIG. 11 is a flowchart showing another embodiment of subject discrimination operation when a secret key image is collated by the wristwatch type digital camera 100.
[0065]
In the present invention, it is determined whether or not the subject to be photographed as the collation image for canceling the secret is a photograph, as in the second embodiment.
For this reason, the wristwatch type digital camera 100 of FIG. 2 (for example, the vicinity of the camera module 1 of FIG. 2B) is provided with an illuminance sensor for detecting the illuminance of the subject due to external light, and shooting is performed as shown in FIG. Before, the illuminance of the subject 30 (30 ′) is checked to determine whether or not the subject 30 (30 ′) is a photograph.
That is, when the subject 30 is not a photograph as shown in FIG. 10A, the illuminance distribution inside the outline 91 and the outside 92 of the subject 30 is usually non-uniform as shown in FIG. However, when the subject 30 ′ is a photograph, the illuminance distribution in the interiors 91 ′ and 92 ′ for the subject (photo) 30 ′ is flat is usually uniform by the width w of the photograph as shown in FIG. 10 (b ′). become. Therefore, it is possible to know whether or not the subject is a photograph by examining the illuminance distribution of the subject by the illuminance detection means before photographing.
[0066]
(Subject discrimination operation by illuminance)
In other words, in order to determine whether or not the subject is a photograph, the preceding stage of the secret key image collating operation (step U1) in FIG. 7 (when displaying a through image) or the preceding stage of the secret key image registering operation (step T1) in FIG. Are provided with the following steps W1 to W3 (FIG. 11).
[0067]
Step W1: (Illuminance measurement)
When the user selects “image verification processing” or “secret key image registration processing” in “image mode”, the control unit 2 (CPU) locks the shutter key 8 and sends a control signal to the camera module 1 to illuminate the subject. Instruct measurement. The camera module 1 measures the illuminance within the angle of view by the illuminance sensor, that is, the illuminance of the subject due to external light, and sends the measured value to the control unit 2 (CPU).
[0068]
Step W2: (Determination of whether or not it is a photograph)
The control unit 2 (CPU) stores the illuminance measurement value sent from the camera module 1 in the work memory 4, examines the distribution state in the X direction and / or Y direction, and the length of the uniform distribution portion is a predetermined value. If there is the above part, the subject is determined to be a photograph and the process proceeds to W3. If not (if the distribution is nonuniform), it is determined that the subject is not a photograph and the shutter key 8 is unlocked, and the image Shooting is possible (that is, transition is made to U1 in FIG. 7 (or T1 in FIG. 5)).
[0069]
Step W3: (determination result and message display)
The control unit 2 (CPU) displays a message that “a photograph cannot be used as an image for verification” on the display unit 7, and ends the “image verification process” (or “secret key image registration process”).
[0070]
In the above description, the discrimination of the photograph is taken as an example, but the discrimination target is not limited to the photo (that is, it can be discriminated if the imaging target is a photo or a printed matter).
[0071]
[Embodiment (4)] Information disclosure restriction by secret key match rate
FIG. 12 is a diagram showing an example of secret information with an information display restriction rank based on the matching rate (matching degree). FIG. 13 is a flowchart showing an embodiment of an information display operation based on the degree of coincidence of secret key images by the wristwatch type digital camera 100.
[0072]
In the embodiment (1), whether the photographed image for comparison matches the registered secret key image (FIG. 7: U5), or if the features match (U7), the entire secret information (FIG. 4) is displayed. The secret information is divided into a plurality of items and stored for each display restriction rank as shown in FIG. 12, and the secret information to be displayed is restricted according to the matching degree (matching rate). You may make it (FIG. 13 (a), (b)).
[0073]
For example, in the example of the personal information 120 in FIG. 12, a rank storage field 123 for ranking item data (display contents 122) is provided for each personal information item 121, and the item data is matched with the personal information item according to the matching rate. And rank (A to D in this example) for storage.
For example, when the information item of rank A is the matching rate category with the highest matching degree of matching (for example, the matching rate is 99.5% or higher), the rank B is the next highest matching rate category (for example, the matching rate is 90% or higher and 95%). Less than), rank C is the next match rate category (for example, match rate 85% to 90%), rank D is the lowest match rate category for secret cancellation (for example, 80% to less than 85%) Correspond and limit the display of information items according to the rank of the match rate (that is, if the rank is high, you can display all information items with a lower rank, but if the rank is lower, rank higher than the corresponding rank Information items cannot be displayed.)
That is, the coincidence determination operation in steps U5 to (U7) in FIG. 7 is replaced with the operation in steps X1 to X6 in FIG. 13A, and the secret image display operation in step U11 is further changed to step Y1 in FIG. Replace with Y2.
[0074]
(Acquisition of matching and acquisition of matching rate)
Step X1: (Matching secret key image and matching image (image comparison)) The image recognition processing unit 23 compares the matching image obtained in step U4 with the secret key image 31 (FIG. 6A). If the degree of coincidence (coincidence rate) is greater than or equal to a threshold value (for example, 80%), the process proceeds to X2 as coincidence, and if it is less than the threshold, the process proceeds to X3.
[0075]
Step X2: (Acquiring and maintaining rank)
The control unit 2 (CPU) examines the coincidence rate of the images obtained in the above step X1 and ranks them according to a predetermined category (for example, 4 ranks (ranks A to D) and ranks when the coincidence rate is 95% or more. A, rank B when the match rate is 90% or more and less than 95%, rank C when the match rate is 85% to 90%, and rank D when the match rate is 80% or more and less than 85%), and the obtained rank The data is held in the work memory 4 and the process proceeds to U9 (FIG. 7).
[0076]
Step X3: (feature extraction of matching image)
In FIG. 13A, the image recognition processing unit 23 extracts the characteristics of the image for verification (for example, the tip position (coordinate) of the protruding portion (head, ear, limb when taking a person or animal as an example)). . It should be noted that color combinations and color arrangements may be added to the elements for feature extraction.
[0077]
Step X4: (feature matching)
Next, the image recognition processing unit 23 compares the characteristics of the secret image 31 stored in the storage memory 51 with the characteristics of the matching image extracted in step X3, and the degree of matching (matching rate) is a threshold (for example, , 85%) or more, the transition is made to coincide with X5, and if it is less than the threshold, the transition is made to U8 (FIG. 7). That is, a characteristic portion in the whole image and its positional relationship (for example, the position of the ear of the image for comparison, the position of the foot, the position of the ear of the secret image, the position of the foot) are determined (that is, the image for verification). And whether it is similar or not (determining the overall feature and its overall ratio).
[0078]
Step X5: (Rank acquisition and retention)
The control unit 2 (CPU) examines the coincidence rate of the features obtained in step X4 and ranks it according to a predetermined category (for example, 4 ranks (ranks A to D), and the coincidence rate is 99.5% or more. Rank A, rank B if the match rate is 95% or more and less than 99.5%, rank C if the match rate is 90% to 95%, rank D if the match rate is 85% or more and less than 90%), The determined rank is held in the work memory 4 and the process proceeds to U9 (FIG. 7).
[0079]
(Secret image restriction display operation)
Step Y1: (Reading secret information)
In FIG. 13B, when the button S1 is selected in step U10 in FIG. 7, the control unit 2 (CPU) secret information corresponding to the secret key image that matches the verification image (for example, the individual in FIG. 12). The information 120) is taken out from the storage memory 51 and temporarily stored in the work memory 4.
[0080]
Step Y2: (rank comparison and display of information according to rank)
Next, the rank stored (ranked) in step X2 or X5 of FIG. 13A and the rank stored in the rank storage column of secret information (rank storage column 123 in the example of FIG. 12) for each information item. When the rank acquired in step X2 or X5 is equal to or higher than the rank stored in the rank storage column, the information content of the information item corresponding to the rank is displayed on the display unit 7 via the display driver 6. (For example, in the example of FIG. 12, when the acquired rank is A, all items are displayed, and when the acquired rank is C, name, telephone number (company), and e-mail address (company)). The telephone number (individual) is displayed. When the acquired rank is D, only the name, telephone number (company), and mail address (company) are displayed).
[0081]
With the configuration of the above embodiment (4), the information to be displayed (provided) can be differentiated depending on the qualification of the person who intends to use the information (for example, secret information stored and stored in a personal computer can be used) It represents the shape of a batch with personal qualifications attached to each individual's collar, and a personal computer (information device) equipped with a photographing function can photograph the batch and determine the range of accessible information).
[0082]
In the example of FIG. 13A, after the alignment process in step U4 in FIG. 7, the image comparison process and rank acquisition in steps X1 and X2, and the feature extraction / comparison process and rank acquisition in steps X3 to X5 are performed. Either one is performed, but only the image comparison process and the rank acquisition in steps X1 and X2 are performed, and the process proceeds to the process after “secret release” (U9). If not, “secret cancellation impossible message display” is displayed. You may make it change to (U8), or perform only the feature extraction / feature comparison process and rank acquisition of steps X3 to X5, and if they match, the process moves to U9 and later, otherwise You may make it change to U8 (In addition, when performing only step X3-X5, you may abbreviate | omit the image matching process of step U4).
[0083]
As mentioned above, although one Example of this invention was described, this invention is not limited to the said Example, It cannot be overemphasized that various deformation | transformation implementation is possible. Although the present invention has been described by taking a wristwatch type digital camera as an example, the apparatus to which the present invention is applied is not limited to a digital camera (that is, any information apparatus having an imaging function and an output device such as an information display device may be used). .
[0084]
Further, in the present embodiment, the storage memory 51 is composed of a non-volatile memory such as a flash memory that can be attached to and detached from the wristwatch-type digital camera 100. However, the present invention is not limited to this, and a commercial transaction such as a credit number or bank account number. It may be an IC card that stores personal authentication data related to.
[0085]
【The invention's effect】
  As explained above,According to the present invention, information is divided into a plurality of items, a display limit rank is stored for each item, and ranking is performed according to a matching rate obtained as a result of matching with an image. Since the display of the item information is limited based on the result of the comparison and the information stored in the memory is displayed, the information to be displayed (provided) can be differentiated.
[Brief description of the drawings]
FIG. 1 is an external view of a wristwatch type digital camera as an embodiment of an information display device of the present invention.
FIG. 2 is a block diagram illustrating a circuit configuration example of a wristwatch type digital camera.
FIG. 3 is an explanatory diagram of an image registered as a secret key image.
FIG. 4 is a diagram illustrating an example of secret information stored in a storage memory in association with a secret key image.
FIG. 5 is a flowchart showing an embodiment of a secret key image registration operation.
FIG. 6 is an explanatory diagram of a secret key image collating operation.
FIG. 7 is a flowchart showing an embodiment of secret key image collation and information display operation.
FIG. 8 is an explanatory diagram of an embodiment of subject determination.
FIG. 9 is a flowchart illustrating an example of a subject determination operation when a secret key image is collated.
FIG. 10 is an explanatory diagram of another example of subject determination.
FIG. 11 is a flowchart illustrating another example of the subject determination operation when collating a secret key image.
FIG. 12 is a diagram illustrating an example of secret information with an information display restriction rank based on the degree of coincidence.
FIG. 13 is a flowchart showing an embodiment of an information display operation based on the matching rate.
[Explanation of symbols]
1 Camera module (imaging means)
2 Control unit (CPU) (control means, imaging object discrimination means, means for limiting display)
7 Display section (display means)
23 Image recognition processing unit (collation means)
30 'photo (printed)
31 Secret key image (image, image stored and stored)
32, 32 'captured image, verification image (captured image)
40, 120 Personal information (information)
51 Storage memory (storage means)
100 Watch-type digital camera (information display device)

Claims (6)

An information output control method for outputting information from a memory for storing information stored in a plurality of items,
The memory stores a display limit rank for each of the plurality of items,
Imaging step;
A collation step for collating the image captured in this imaging step with the image stored in the memory;
A ranking step that ranks according to the match rate obtained as a result of matching in this matching step ;
A comparison step for comparing the rank given in this ranking step with the display limit rank stored in the memory;
A control step for controlling the display of item information based on the result of the comparison in the comparison step and outputting the information stored in the memory;
An information output control method comprising: Display means for displaying information;
Storage means for dividing this information into a plurality of items and storing a display limit rank for each of these items ;
Imaging means;
Collation means for collating the image captured by the imaging means with the image stored in the storage means;
Ranking means for ranking according to the matching rate obtained as a result of matching by the matching means;
A comparison means for comparing the rank given by the ranking means with the display limit rank stored in the storage means;
Control means for restricting display of item information based on the result of comparison by the comparison means and controlling the information stored in the memory to be displayed on the display means, Information display device. The control means displays the information of the item corresponding to the display restriction rank when the rank given by the ranking means is equal to or higher than the display restriction rank as a result of the comparison by the comparison means. information display device according to claim 2, characterized in that control. The information display apparatus according to claim 2 , further comprising an imaging target determination unit that determines whether an imaging target of an image captured by the imaging unit is a printed matter. A focusing unit; and a distance acquisition unit that acquires a plurality of distances between the subject included in the image and the apparatus based on a focusing operation by the focusing unit, and the imaging target determination unit includes the distance acquisition unit The information display apparatus according to claim 4, wherein the imaging target is determined based on a plurality of distances obtained by the means . Further comprising an illuminance measurement means for measuring the illuminance of the imaging object due to external light, the imaging target discriminating means, according to claim 4, characterized in that to determine the imaging target based on the measurement values obtained by said illuminance measurement means The information display device described.

Images