JPH11347016A - Imaging device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging device which is structured simply and never gives excessive psychological burdens on a subject. SOLUTION: A reflected image of infrared light from an eyeball 10 of a subject is inputted in the imaging part of this device. A cold mirror 20, which transmits infrared light but reflects visible light, is attached to the front surface of a lens 19. So the cold mirror 20 transmits the reflected infrared light to the eyeball 10, but reflects the reflected visible light to the subject. In determining the imaging position, the subject can confirm that the position is correctly set when the subject looks at his/her own eyeball 10 reflected in the cold mirror 20 wholly without being eclipsed.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to an imaging apparatus for photographing an eyeprint such as an iris and a retina.

[0002]

2. Description of the Related Art Today, there is an eyeball imaging apparatus for photographing human eyes for use in individual identification processing and the like. As such a technique, for example, there is a technique described in Japanese Patent Publication No. 5-84166.

[0003] In the above technique, the eye is positioned by utilizing the lack of an image of a target located outside the optical axis of the camera on the retina of the subject by a beam splitting surface located near the optical axis of the camera. ing. The beam splitting surface is a transparent thin plate such as glass, on which a mirror is formed to reflect an image of a target. The reflected light from the iris passes through the transparent area of the dividing plane surrounding the mirror and enters the camera.

[0004]

However, in the above-mentioned prior art, since the reflected image of the iris is put into the camera, the target on the beam splitting surface is structurally limited to a very small one. For this reason, the subject has to gaze at a minute target, and even if the subject is slightly deviated from the optical axis of the camera, the subject may be missed, thereby imposing a great psychological burden on the subject. In addition, since the target is projected on the camera optical axis, very high precision is required in the arrangement of the beam splitting surface, which not only requires the production and maintenance of the device, but also requires an imaging system to project the target. Therefore, there is a problem that the photographing apparatus itself becomes large.

[0005] In view of the above, there has been a demand for an imaging apparatus capable of photographing a subject with a simple device configuration and without imposing an excessive psychological burden on the subject.

[0006]

The present invention employs the following structure to solve the above-mentioned problems. <Structure of Claim 1> An imaging device that irradiates a subject with invisible light and captures a reflected image of the subject with an imaging unit has a wavelength selection characteristic of transmitting invisible light and reflecting visible light,
A subject, wherein an invisible light transmitting mirror for performing photographing alignment by viewing the subject's own image projected on the surface thereof is arranged between the imaging unit and the subject. Device.

<Explanation of Claim 1> The invisible light is, for example, infrared light, but may be any light having a wavelength other than visible light. An invisible light transmitting mirror is, for example, a cold mirror that transmits infrared light that is invisible light and reflects visible light, but has a wavelength selection characteristic that transmits invisible light and reflects visible light. Any type may be used. Further, it is desirable that the invisible light transmitting mirror is disposed so as to be in contact with the imaging unit, but it may be slightly separated.

According to the first aspect of the present invention, the photographing position is adjusted by the subject viewing his / her own image reflected on the invisible light transmitting mirror having the wavelength selection characteristic. For example, the subject's own image is an image of the eyeball, and the photographing position adjustment is determined based on whether or not the image of the eyeball is reflected on the non-visible light transmitting mirror without missing. The image of the subject is not limited to the eyeball, but can be applied to the face or the whole body of the subject.

According to the first aspect of the present invention, by providing such a configuration, it is possible to realize a simple configuration as an imaging apparatus and to significantly reduce a burden on a subject.

<Structure of Claim 2> In Claim 1, the invisible light transmitting mirror is arranged so that its surface is perpendicular to the optical axis of the image pickup unit, and at a location different from the invisible light transmitting mirror. A positioning mirror, and each mirror is arranged such that a perpendicular to the surface of the positioning mirror and a perpendicular to the surface of the invisible light transmitting mirror intersect at a focal position of the imaging unit. is there.

<Explanation of Claim 2> In the invention of claim 2, in addition to the invention of claim 1, a positioning mirror is provided. The subject confirms that the subject's own image shown on the positioning mirror and the own image shown on the invisible light transmitting mirror are intact without being lost, and that the subject matches the optimum photographing position. Therefore, according to the second aspect of the invention, there is an effect that the subject can accurately perform the positioning without being affected by, for example, the size of the eyeball.

<Structure of claim 3> In the image pickup apparatus according to claim 2, the positioning mirror is provided as a non-visible light transmitting mirror in front of a light source for irradiating the non-visible light, and the light of the light source is provided. The imaging apparatus is characterized in that the axis is arranged so as to intersect the optical axis of the imaging unit at the focal position of the imaging unit.

<Explanation of Claim 3> In the invention of claim 3, the positioning mirror is an invisible light transmitting mirror, which is provided on the front surface of a light source for irradiating the invisible light. Thereby, the operation of the imaging position adjustment performed by the subject is the same as the case of the invention of claim 2, but the installation space of the invisible light irradiation unit and the mirror for positioning is small, and
This has the effect of contributing to downsizing of the device.

[0014] According to a fourth aspect of the present invention, in the imaging apparatus according to the second aspect, an area that reflects only a part of the wavelength of visible light is formed in a part of the invisible light transmitting mirror and the positioning mirror, The imaging apparatus is characterized in that this area is used as a gaze mark which is a target of the photographing position alignment for the subject himself.

<Explanation of Claim 4> In the invention of claim 4, a gaze mark formed of an area reflecting only a part of the wavelength of visible light is provided on each mirror. Here, the part of the wavelength of the visible light is the wavelength of the red light, but may be any wavelength. According to the fourth aspect of the present invention, when the imaging target is an eyeball, the subject holds the center of the eyeball image reflected on the invisible light transmitting mirror or the positioning mirror on the mark. By doing so, alignment can be performed easily.

According to a fifth aspect of the present invention, in the imaging device according to the second or fourth aspect, an area that reflects only a part of the wavelength of visible light is formed in a part of the invisible light transmitting mirror and the positioning mirror. The image pickup apparatus is characterized in that this area is set as a target position mark which is a target of the photographing range for the subject.

<Explanation of Claim 5> In the invention of claim 5, a target position mark is provided on a part of the invisible light transmitting mirror and the positioning mirror. Here, the target position mark is, for example, when the imaging target is an eyeball image such as an iris or a retina in the eyes, the positions of the upper and lower eyelids indicating the required eye opening amount, and the outline of the iris outside. Mark. The target position mark can be applied not only to the eyeball image but also to the subject's face and fingers. Since the invention of claim 5 has such a configuration, the subject can easily know the target imaging range.

<Structure of claim 6> In the image pickup apparatus according to claim 3, an area that reflects only a part of the wavelength of visible light is formed in a part of the invisible light transmitting mirror, and this area is formed by:
An imaging apparatus characterized in that the gaze mark is used as a target of the imaging position alignment for the subject himself.

<Explanation of Claim 6> According to the invention of claim 6, in the configuration in which the positioning mirror is a non-visible light transmitting mirror, a gaze mark is provided on both the non-visible light transmitting mirrors. Thereby, in addition to the effect of the third aspect, an effect that the photographing position can be easily adjusted is obtained.

<Structure of claim 7> In the image pickup apparatus according to claim 3 or 6, a part of the invisible light transmitting mirror includes:
An imaging apparatus characterized by forming an area that reflects only a part of the wavelength of visible light, and using this area as a target position mark that is a target of an imaging range for the subject himself.

<Explanation of Claim 7> In the invention of claim 7, in a configuration in which the positioning mirror is an invisible light transmitting mirror, target position marks are provided on both the invisible light transmitting mirrors. . Thereby, in addition to the effect of the third or sixth aspect, an effect is obtained that the subject can easily know the target imaging range.

<Configuration of Claim 8> In the imaging device according to any one of Claims 4 to 7, the invisible light is infrared light, and a part of the wavelength of visible light is the wavelength of red light. An imaging apparatus characterized in that:

<Explanation of Claim 8> According to the invention of claim 8, in an imaging apparatus for photographing a reflection image of a subject by infrared light, a gaze mark and a target position mark are formed in an area reflecting only red. It was made. This allows
Even in an imaging unit having a slight sensitivity to the red portion, a good image can be obtained because red light does not enter the imaging unit.

According to a ninth aspect of the present invention, in an imaging device for irradiating a subject with invisible light and capturing a reflected image of the subject with an imaging unit, a display unit for displaying an image captured by the imaging unit, and a transmission unit for transmitting the invisible light In addition, it has a wavelength selection characteristic of reflecting visible light, reflects an image displayed on the display unit, and uses the non-visible light for aligning the photographing position by viewing the reflected image of the subject himself. An imaging apparatus, wherein a transmission mirror is disposed between an imaging unit and a subject.

<Explanation of Claim 9> According to the ninth aspect of the present invention, there is provided a display unit for displaying an image photographed by the imaging unit, and an image of the subject displayed on the display unit is displayed between the imaging unit and the subject. The light is reflected by an invisible light transmitting mirror arranged in the camera so that the subject can visually recognize the reflected light. Here, the positional relationship between the invisible light transmitting mirror and the display unit may be any setting angle and the like as long as the subject can visually recognize the image on the display unit via the invisible light transmitting mirror. Is also good.

According to the ninth aspect of the present invention, since the subject is positioned while viewing the subject's own image projected on the surface of the invisible light transmitting mirror, the subject is positioned by a simple mechanism. It can be performed. Also,
Since the image projected on the surface of the invisible light transmitting mirror is an image captured by the imaging unit, there is an effect that the subject can confirm the actual captured image.

In the imaging device according to the ninth aspect, the central axis of the display unit and the central axis of the imaging unit are arranged to intersect perpendicularly, and the intersection of the invisible light transmitting mirror is provided at the intersection. An imaging apparatus characterized by disposing a center.

<Explanation of Claim 10> In the invention of claim 10, the center of the image of the display unit projected on the invisible light transmitting mirror is made to be the same as the center axis of the imaging unit. Thus, there is an effect that the subject can surely visually recognize the image on the display unit without moving his / her eyes during shooting.

<Structure of Claim 11> Claim 9 or 10
In the imaging device described in the above, the subject can be visually recognized as a reflection image of the invisible light transmitting mirror at any position between the display unit surface and the invisible light transmitting mirror surface, and the subject himself or herself adjusts the imaging position. An imaging apparatus characterized in that it is a gaze mark for setting a target.

<Explanation of Claim 11> According to an eleventh aspect of the present invention, in the configuration in which the image on the display unit is projected onto the invisible light transmitting mirror, the subject can visually recognize the gaze mark via the invisible light transmitting mirror. It was done. Here, the position of the gaze mark may be set on the surface of the display unit, between the invisible light transmitting mirror, or on the invisible light transmitting mirror if the subject can confirm the mark on the invisible light transmitting mirror. May be provided. With such a configuration,
There is an effect that the subject can easily perform his / her own alignment.

<Structure of Claim 12> In the imaging device according to any one of Claims 9 to 11, the subject may be positioned at a position between the surface of the display unit and the surface of the invisible light transmitting mirror. An imaging apparatus characterized in that a target position mark that can be visually recognized as a reflection image of a transmission mirror and is a target of an imaging range for a subject is provided.

<Explanation of Claim 12> According to a twelfth aspect of the present invention, in the configuration in which the image on the display unit is projected onto the invisible light transmitting mirror, the subject can visually recognize the target position mark via the invisible light transmitting mirror. It was made. here,
The target position mark can be installed on the surface of the display, between the mirror and the non-visible light transmission mirror, or on the non-visible light transmission mirror if the subject can check the mark on the non-visible light transmission mirror. It may be. With such a configuration, there is an effect that the subject can easily know the imaging range required by the apparatus.

<Structure of Claim 13> Claim 9 or 10
The imaging device according to the above, provided with a marked image generating unit that superimposes information indicating a gaze mark to be a target of the imaging position on the video signal to be displayed on the display unit, the marked image generating unit An image pickup apparatus characterized in that an output video signal is displayed on the display unit.

According to a thirteenth aspect of the present invention, in a configuration in which an image on a display unit is projected onto an invisible light transmitting mirror, information indicating a gaze mark is superimposed on a video signal to be displayed on the display unit. It is something to do. Thereby, while having the same effect as the invention of claim 11,
There is an effect that the gaze mark can be easily changed.

In the imaging device according to the thirteenth aspect, the subject may be provided with a reflection image of the non-visible light transmitting mirror at any position between the surface of the display unit and the surface of the non-visible light transmitting mirror. An imaging apparatus characterized in that a target position mark that is visually recognizable as a target and serves as a target of an imaging range for a subject is provided.

<Explanation of Claim 14> According to a fourteenth aspect of the present invention, in the configuration in which the image on the display unit is projected onto the invisible light transmitting mirror, the gaze mark is displayed so as to be superimposed on the video signal.
On the other hand, the target position mark is provided between the display unit surface and the invisible light transmitting mirror. Thereby, in addition to the effect of the thirteenth aspect, there is an effect that the subject can easily know the imaging range required by the apparatus.

<Structure of claim 15> In the image pickup apparatus according to any one of claims 9 to 11, the video signal to be displayed on the display unit includes information indicating a target position mark where the subject is a target of the photographing range. And a video signal output by the marked image generating unit is displayed on the display unit.

<Explanation of Claim 15> According to the invention of claim 15, in the configuration in which the image on the display section is projected on the invisible light transmitting mirror, the target position mark is displayed so as to be superimposed on the video signal. is there. If such a configuration is applied to, for example, the invention of claim 11, the target position mark is displayed on the display unit, while the gaze mark is provided between the display unit surface and the invisible light transmitting mirror surface. Configuration. Since the invention of claim 15 is configured as described above, the subject can easily know the photographing range required by the apparatus, and can easily change the target position mark. There is an effect that can be.

<Structure of Claim 16> Claim 9 or 10
In the imaging device according to the above, a mark that superimposes information indicating a gaze mark that is a target of a shooting position by the subject and a target position mark that is a target of the shooting range by the subject, on a video signal to be displayed on the display unit. Equipped with an image generation unit,
An image pickup apparatus characterized in that a video signal output by a marked image generation unit is displayed on a display unit.

<Explanation of Claim 16> According to the invention of claim 16, in the configuration in which the image of the display section is projected onto the invisible light transmitting mirror, both the gaze mark and the target position mark are superimposed on the video signal. Things. Thus, there is an effect that the gaze mark and the target position mark can be easily changed.

<Structure of Claim 17> Claim 15 or 1
6. The imaging device according to 6, wherein a personal information output unit that holds information on a target position mark for each subject, and a marked image generation unit that superimposes the target position mark for each subject output from the personal information output unit on a video signal. An imaging device comprising:

According to a seventeenth aspect of the present invention, there is provided an image processing apparatus which projects an image on a display unit onto an invisible light transmitting mirror and superimposes information of a target position mark on a video signal. The information on the target position mark for each subject is stored, and the target position mark for each subject is displayed based on this information. This has the effect of displaying a target position that is reasonable for the subject.

<Structure of claim 18> In the image pickup apparatus according to any one of claims 13 to 17, a personal identification section for performing individual identification of a subject using an image from the imaging section, and an identification result in the personal identification section. And an image generation unit with a mark for superimposing information indicating video information on a video signal.

<Explanation of Claim 18> According to the invention of claim 18, an image of a display section is projected on an invisible light transmitting mirror and an image generating section with a mark is provided, and an individual of a subject is identified. The result is displayed. With such a configuration, there is an effect that the subject can know the personal identification result within the field of view for imaging.

<Structure of claim 19> The image pickup apparatus according to any one of claims 1 to 8, further comprising a display section for displaying an image taken by the image pickup section and allowing the subject to directly view the display image. An imaging apparatus characterized in that:

<Explanation of Claim 19> According to the invention of claim 19, in a configuration in which an invisible light transmitting mirror is installed between the imaging section and the subject, the subject directly looks at the display section for displaying the image of the imaging section. It is arranged as possible. The installation position of the display unit is, for example, provided so as to be adjacent to the invisible light transmitting mirror. However, the installation position can be arbitrarily selected as long as the subject can directly look. With such a configuration, in addition to the effect of any one of the first to eighth aspects, there is an effect that the subject can confirm an image actually photographed by the imaging unit.

<Structure of claim 20> In the image pickup apparatus according to any one of claims 1 to 3, an image photographed by the image pickup section is displayed.
And, a display unit that allows the subject to directly view the display image, a video signal to be displayed on the display unit, a gaze mark that is a target of the subject to be photographed, and a target position mark that is a target of the subject to be photographed. An image pickup apparatus comprising: a marked image generating unit that superimposes information indicating the image signal; and a video signal output by the marked image generating unit is displayed on a display unit.

<Explanation of Claim 20> According to a twentieth aspect of the present invention, in the configuration in which an invisible light transmitting mirror is installed between the imaging unit and the subject and a display unit that allows the subject to directly view is provided, The gaze mark and the target position mark are superimposed on the video signal to be displayed on the display unit, and these marks are displayed. Thus, there is an effect that the subject can easily perform positioning for photographing and confirmation of the photographing range.

<Structure of claim 21> In the imaging apparatus according to claim 20, a personal information output unit for holding a target position mark for each subject, and a target position mark for each subject output from the personal information output unit are stored in a memory. An image pickup apparatus comprising: a marked image generating unit that is superimposed on a video signal.

<Explanation of Claim 21> In the invention of claim 21, in addition to the invention of claim 20, the target position mark to be displayed is a target position mark stored for each subject. This has the effect of displaying a target position that is reasonable for the subject.

<Structure of Claim 22> Claim 20 or 2
1. The imaging apparatus according to 1, further comprising: a personal identification unit that performs individual identification of the subject using a video from the imaging unit; and a marked image generation unit that superimposes information indicating a result of identification in the personal identification unit on a video signal. An imaging apparatus characterized in that:

<Explanation of Claim 22> In the invention of claim 22, in addition to the invention of claim 20 or 21, the personal identification result is displayed. Thus, there is an effect that the subject can easily know his or her personal identification result.

<Structures of Claims 23 and 24> The invention of claims 23 and 24 is the imaging apparatus according to claims 9 and 10, wherein an invisible light reflecting mirror is used in place of the invisible light transmitting mirror. It is.

<Structure of claim 25> The imaging device according to claims 23 and 24, wherein the invisible light reflecting mirror is arranged obliquely with respect to the imaging unit.

<Structures of Claims 26 to 29>
According to a twenty-ninth aspect of the present invention, the invisible light transmitting mirror is replaced with an invisible light reflecting mirror and the reflected image of the invisible light transmitting mirror is replaced with the transmitted image of the invisible light reflecting mirror. An imaging apparatus characterized by the following.

<Structure of Claims 30 to 33> Claims 30 to 33
An invention according to a thirty-third aspect is the imaging apparatus according to claims 15 to 18, wherein a non-visible light reflecting mirror is used instead of the non-visible light transmitting mirror.

<Structures of Claims 34 and 35> According to the inventions of Claims 34 and 35, the invisible light reflecting mirror reflects a part of the invisible light. An imaging device characterized by transmitting a part of invisible light. <Structure of Claim 36> Claims 1 to 7 and 9 to 35
In the imaging device according to any one of the above, the invisible light is infrared light.

<Explanation of Claim 36> The invention of claim 36 is one wherein the non-visible light is infrared light. Therefore, the invisible light transmitting mirror is a cold mirror that transmits infrared light, and the reflection image captured by the imaging unit is a reflection image due to irradiation of infrared light.

<Structure of Claim 37> In the image pickup apparatus according to any one of claims 1 to 33, the image of the subject is an image of an eyeball portion.

<Explanation of Claim 37> In the invention of claim 37, the object to be imaged is an eyeball. As a result, the effects of reducing the burden on the subject and simplifying the configuration of the apparatus can be obtained even when imaging an eyeball part in which the imaging area is small and the imaging position is difficult to adjust.

[0061]

Embodiments of the present invention will be described below in detail with reference to the drawings. Embodiment 1 <Configuration and Operation> FIG. 1 is an explanatory diagram showing the principle of an eyeball imaging apparatus as Embodiment 1 of the present invention. In the figure, an eyeball (a part of a subject) 10 is placed on an optical axis 12 of a camera 11 for photographing an eye, and an eyeprint is illuminated from the periphery by a visible light source 13 and an infrared light source 14. ing. As a result, the visible light and the infrared light pass through the cornea 15, the iris 16, and the pupil 17 on the surface of the eyeball, and are scattered at various parts of the retina 18. Part of the scattered visible light and infrared light is reflected and proceeds toward the camera 11.

The camera 11 has a CCD for sensing infrared wavelengths inside, and a lens 19 for collecting light and a cold mirror 20 for reflecting and transmitting light according to wavelength are arranged on the front surface of the camera 11. The cold mirror (invisible light transmitting mirror) 20 is disposed perpendicular to the optical axis 12,
Light is selected according to the wavelength of the incident light. It is desirable that the cold mirror 20 be the same size as the lens 19 or larger than the lens 19. Also, cold mirror 2
It is desirable that the lens 0 and the lens 19 are in contact with each other, but they may be separated to some extent. The camera 11 and the lens 19 form an imaging unit.

FIG. 2 is an explanatory diagram showing wavelength selection by a cold mirror. As shown, the cold mirror is
It has a wavelength selection characteristic that reflects visible light and transmits infrared light. For this reason, the surface of the cold mirror looks like a mirror to human eyes. Further, by transmitting the infrared light, the camera 11 is provided with the eyeball 10 by the infrared light source 14.
Only the reflected light from the camera is imaged, and light from other visible light sources such as the visible light source 13 and the interior light is not imaged. FIG.
In the configuration described above, another visible light source such as an indoor light is present, and the visible light source 13 is not necessary if the intensity is such that the image of the eyes can be visually recognized on the cold mirror 20.

If the eyeball 10 is located on the optical axis 12 of the camera 11, the scattered light of the eyeball 10 reflected by the cold mirror 20 travels in the direction of the eyeball 10 again, and a part thereof passes through the pupil 17. Then, an image is formed on the retina 18. Therefore,
When the eyeball 10 is the eye of the subject of the imaging device, the subject sees his or her own eyeball image on the surface of the cold mirror 20.

Here, when the eyeball 10 is located at the focal point 21 of the lens 19 on the optical axis 12, the size of the cold mirror 20 and the focal length of the lens 19 are adjusted so that the entire eyeball image is displayed on the cold mirror 20. If set, the subject can perform optimal positioning for imaging simply by moving his or her eyes to a place where his or her eyeball image can be seen throughout the cold mirror 20.

FIG. 3 is an explanatory diagram of the positioning. In the figure,
(A) is a case where there is no displacement, (b) is a case where the optical axis is misaligned, and (c) is a case where there is a defocus. In this case, the camera is located at an optimal location for shooting. On the other hand, when the eyeball 10 is far from the optical axis 12 or is located farther than the focal length, the subject receives the cold mirror 20 in the state shown in (b) and (c), respectively. Observed above. That is, FIG.
As shown in (a), (b), and (c), the subject can easily correct the displacement in the same visual field only by looking at the size and position of the own eyeball image.

When the lens 19 has an autofocus function or a zoom function, since the focusing is performed on the camera 11 side, the subject need only place the eyeball 10 on the optical axis 12.

In the above description, the visible light source 13 and the infrared light source 14 are provided separately. However, if a light source capable of emitting both infrared light and visible light is used, these visible light sources 13 And the infrared light source 14 can be integrated into one light source. With such a configuration, it is also possible to confirm a reflection spot generated when the subject is a spectacle wearer.

That is, when the subject is a spectacle wearer, the light from the light source is reflected by the spectacle lens and the frame, so that the reflected spot may overlap the eyeball image. In this case, the subject can see the reflection spot on the cold mirror 20.

Therefore, if the subject tilts his or her head while keeping his line of sight, the relative positions of the light source, the spectacle lens, and the frame change, so that the reflection spot can be moved out of the field of view of the camera. As described above, even when the reflection spot overlaps the eyeball image, the reflection spot can be excluded by the subject's own movement.

FIG. 4 is a block diagram showing a practical example of the first embodiment of the eyeball imaging apparatus according to the present invention. In the figure, 100 is a subject, and when the subject 100 stands (or sits) in front of the cold mirror 20,
The own eyeball image is displayed on the cold mirror 20 in front. The subject 100 observed the eyeball image with the camera 1
The position of the eyeball may be moved so as to be on one optical axis 12 and to be at the focal point 21 of the lens.

In the above configuration, the lens 19, C
Since the principle of an image sensor such as a CD is already known, the description is omitted here.

<Effects> As described above, according to the first embodiment, since the cold mirror 20 is provided on the front surface of the camera 11 for imaging the eyeball, the subject can view his or her own eyeball image on the surface of the cold mirror 20. It is sufficient to perform positioning while
Therefore, a simple configuration can be realized as the eyeball imaging apparatus, and the burden on the subject can be significantly reduced.

<< Specific Example 2 >> In the specific example 2, the above specific example 1
In addition to the configuration described above, a mirror is further added, and this mirror is arranged in a state of being inclined toward the focal point of the lens 19, so that an eyeball image is projected on both mirrors to perform positioning. . That is, in the specific example 1, as shown in FIG. 3, the positioning on the optical axis 12 is performed according to the size of the own eyeball image displayed on the cold mirror 20. However, the size of the eyeball is not necessarily the same for each subject, and for example, there is a possibility that an error occurs in the alignment between an adult and a child. Therefore, in specific example 2,
When the eyeball of the subject 100 is shown in each of the two mirrors, the positioning is performed by utilizing the fact that the mirror is located at the focal point 21.

<Structure and Operation> FIG.
FIG. 2 is a configuration diagram of an eyeball imaging apparatus of FIG. In the illustrated device, a positioning mirror 31 is newly arranged in addition to the configuration of the specific example 1 described with reference to FIG. The positioning mirror 31 has a surface perpendicular to the focal point 21 of the lens 19 and the camera optical axis 12.
It is arranged so that it may cross near the intersection with. Although the positioning mirror 31 uses a material that reflects visible light, its function is unrelated to the reflection and transmission of infrared light. There is no need to use a cold mirror, except. Less than,
The principle of Example 2 will be described.

FIG. 6 is an explanatory diagram of the principle of the second embodiment.
In the figure, it is assumed that the eyeball 10 is located at the focal point 21 on the optical axis 12 of the lens 19 as shown in the specific example 1 above. However, the line of sight 32 is directed in a direction (perpendicular direction) perpendicular to the surface of the positioning mirror 31 (state shown). At this time, the visible light emitted from the visible light source 13 is reflected by the eyeball 10 in each direction, and a part of the light is directed toward the positioning mirror 31.

The positioning mirror 31 reflects light from the eyeball 10, a part of which passes through the pupil 17 and reaches the retina 18. At this time, the subject 100 can see his or her own eyeball image on the positioning mirror 31 as shown in FIG. Again, the subject 100 looks at the gaze of the eyeball 10 with the camera 1
Turning to the first side, the subject 100 can see the eyeball image of FIG. Therefore, the subject 100 puts his or her own eyeball on the camera 11 in the following procedure.
Can be positioned at the focal point 21.

FIG. 3 shows almost the center of the cold mirror 20.
If the eyeball image as shown in FIG.
The 0 eyeball 10 is on the optical axis 12 of the camera 11. Therefore, the subject 100 sometimes moves the line of sight to the positioning mirror 3.
While moving toward 1, it is moved back and forth on the optical axis 12. If both the cold mirror 20 and the positioning mirror 31 can see an eyeball image substantially at the center, the eyeball 10 of the subject 100 is located at the focal point 21. Eyeball 1
0 is located at the focal point 21 and the line of sight is the cold mirror 2
When the camera is oriented in the 0 direction, the camera 11 can form an eyeball image by infrared light on its CCD, and can obtain a good eyeball image without blur.

In particular, by arranging the positioning mirror 31 so as to increase the angle between the camera 11 and the optical axis 12, the subject 100 can be accurately positioned.

In the above configuration, a cold mirror that reflects visible light and transmits infrared light can be used instead of the positioning mirror 31. In this case, it is also possible to arrange the second cold mirror 33 in front of the infrared light source 14.

FIG. 7 is a configuration diagram when a cold mirror is arranged in front of the infrared light source. FIG. 8 is an explanatory diagram of the principle in the case of FIG.

As shown in these figures, the second cold mirror 33 is arranged such that its perpendicular and the optical axis of the infrared light source 14 are located on the same line. In addition, subject 10
The method of aligning 0 is to move the eyeball to a position where an eyeball image can be viewed on both the first cold mirror 20 and the second cold mirror 33, as in the above example.

As described above, if the second cold mirror 33 is provided on the front surface of the infrared light source 14, the installation space between the infrared light irradiating section and the mirror for positioning can be reduced. This can contribute to downsizing of the device. In particular, the infrared light source 14 and the second cold mirror 33
If these are configured as an integrated unit, it is possible to obtain the effect that the size of the device can be further reduced and the production and maintenance thereof can be easily performed.

Note that, in the configuration of FIGS. 5 and 7 described above, the positions of the positioning mirror 31 and the second cold mirror 33 show an example in the case where the focus is directed from the lateral direction of the camera 11. Specific examples are not limited to this,
Positioning mirror 31 and second cold mirror 33
May be arranged so as to face the focal point 21 from above, below, or obliquely to the camera 11.

<Effects> As described above, according to the specific example 2, in addition to the cold mirror 20 on the front of the camera 11, the positioning mirror 31 and the second cold mirror 33 are separately provided.
Is provided, the subject 100 moves his / her gaze,
The eyeball 10 can be located at the focal point 21. Therefore, the subject is not affected by the size of the eyeball, etc.
Accurate positioning can be performed.

<< Example 3 >> In Example 3, in addition to the configuration of the cold mirror 20 and the positioning mirror 31 in Example 2, a gaze mark for the subject 100 to be a target for alignment is provided. It is. That is, in the specific example 3, the subject 100 brings the center of the eyeball image reflected on the cold mirror 20 and the positioning mirror 31 onto the mark, thereby enabling easy positioning.

<Structure and Operation> FIG. 9 is an explanatory view of a cold mirror with a gaze mark. In this example, the gaze mark 4 in the cold mirror 40 with the gaze mark
As an example of 0a, the case of a cross cursor (+) is shown.
0a can be used or used together.

The cold mirror 40 with the gaze mark shown in FIG. 9 is composed of two regions having different light reflection, transmission or absorption characteristics. That is, the gaze mark 40
A region of the characteristic B, which is a portion (a portion of +), and a region of the other characteristic A. Here, the characteristic A has the characteristic of a normal cold mirror that reflects visible light and transmits infrared light as shown in FIG. On the other hand, the characteristic B is the same as the characteristic A in transmitting infrared light, but is different in transmission and reflection of visible light. That is, in the characteristic B, the reflection and transmission characteristics of visible light are changed by selecting the wavelength.

FIG. 10 is an explanatory diagram showing wavelength selection of the characteristic B. As shown in the drawing, the characteristic B reflects only red light of visible light and transmits other visible light in the same manner as infrared light. Thereby, the subject 100 can see the red gaze mark 40a on the cold mirror,
The gaze mark 40a can be positioned so as to bring the center of the eye.

The wavelength of the light to be reflected among the visible lights can be selected for each color. However, reflecting the red light has the following advantages. That is, in this specific example, it is assumed that the camera 11 captures an eyeball image using infrared light, so that the wavelength sensitivity of the camera 11 is set to be higher in the infrared band.

FIG. 11 is an explanatory diagram of the wavelength sensitivity characteristics of the camera 11. Visible light is broadly classified into blue, green, and red in order of shorter wavelength, and infrared light is present as light having a longer wavelength than visible light. Since the camera 11 senses infrared light, it is ideal to eliminate the sensitivity of visible light and increase the sensitivity of only infrared light. However, since red light and infrared light of visible light are adjacent, Has a slight but sensitive sensitivity in the red part. Therefore, when the red light from the visible light source 13 passes through the cold mirror and enters the camera 11, the captured image includes the reflection image from the visible light source 13, and a good infrared eyeball image is obtained. Disappears. Even if blue or green light enters the camera 11, there is no sensitivity on the camera 11 side.
The effects can be ignored.

FIG. 12 is a configuration diagram of an eyeball imaging apparatus according to the third embodiment. In the illustrated example, the cold mirror 20 and the positioning mirror 31 of the specific example 2 described above are replaced with a cold mirror 40 with a gaze mark and a positioning mirror 41 with a gaze mark, respectively.

The cold mirror 40 with the gazing mark is arranged on the front surface of the lens 19 of the camera 11.
The center of the cross cursor (+ mark) a is disposed so as to overlap the optical axis 12 of the camera 11. The positioning mirror 41 with the fixation mark is arranged such that the center of the cross cursor (+ mark), which is the fixation mark 41a, overlaps the line of sight 32.

The positioning mirror 41 with the gaze mark
Is the gaze mark 41a because there is no camera behind
It is not necessary to limit the visible light reflection characteristic of the region to red. However, in a region other than the gaze mark 41a, it is necessary to reflect visible light, similarly to the positioning mirror 31 in the specific example 2. When the positioning mirror 41 with the gaze mark is arranged in front of the infrared light source 14, it is necessary to have a characteristic of transmitting infrared light in addition to the above-described visible characteristics.

Also, in this embodiment, similarly to Embodiment 2, the positioning mirror 41 with the gaze mark is not limited to the side of the camera 11 as long as it faces the focal direction. It can also be arranged vertically and diagonally.

<Effects> As described above, according to the third embodiment, since the gaze mark as a target to be watched by the subject is provided on the cold mirror and the positioning mirror, the subject can easily focus his or her eyeball on the focal position. Can be.

The cold mirror 40 with the gaze mark provided in the third embodiment can be applied to the first embodiment. In addition, such a cold mirror 40 with a gaze mark is applicable not only to an eyeball imaging device, but also to a case in which a gaze point is indicated when capturing a reflected image of infrared light such as a face or a whole body. If the cross cursor (+
The position of the mark is not limited to the optical axis 12 of the camera 11.

<< Specific Example 4 >> When photographing an eyeball image, there are individual differences in the degree of opening of the eyelids. In the case of fine eyes, most of the surface of the eyeball is hidden by the eyelids and eyelashes, and the eyeball image cannot be photographed well. For example, when performing individual identification using an eyeprint such as an iris and a retina, a feature amount is drastically reduced, which causes an identification error.

Therefore, in Example 4, the required degree of opening of the eyelids is presented to the subject, and the subject is allowed to open his / her eyes to the required size, so that the eyeball image can be photographed well. Things. That is, in the specific example 4, in addition to the configuration of the specific example 3, a target position mark (eye opening amount mark) is provided so that the subject becomes a target of the eye opening amount.

<Structure and Operation> FIGS. 13 and 1
FIG. 4 is an explanatory view of a cold mirror with a target position mark. Cold mirror 5 with target position mark shown in FIG.
0 is an example in which marks parallel to the positions of the upper and lower eyelids are provided as the target position marks 50a. FIG.
The cold mirror 50 with the target position mark shown in FIG. 4 is an example in which a hexagonal mark almost matching the boundary of the iris is provided as the target position mark 50b.

The target position marks 50a and 50b are
Similarly to the gaze mark 40a of the specific example 3, infrared light is transmitted, only a specific wavelength in visible light (for example, the wavelength of red light) is reflected, and other visible light is transmitted similarly to infrared light. It has such characteristics.

FIG. 15 is a configuration diagram of an eyeball imaging apparatus according to the fourth embodiment. In the illustrated example, the cold mirror 40 with the gaze mark and the positioning mirror 41 with the gaze mark in the eyeball imaging apparatus of the specific example 3 shown in FIG.
This is changed to a positioning mirror 51 with a target position mark.

The operation of the eyeball imaging apparatus of Embodiment 4 configured as described above is basically the same as that of Embodiment 3, but the subject 100 determines the degree of opening of the eyelids using the target position mark 50a as a guide. . As a result, the eyeprint portion becomes a clear image as the eyeball image of the subject 100 input to the camera 11, and the individual identification and the like can be performed accurately.

In the example of FIG. 15, the cold mirror 50 with the target position mark is a mirror of the target position mark 50a indicating the position of the upper and lower eyelids. However, the target position mark 50b having a hexagonal mark is used. The same operation is performed for the cold mirror 50 with a mark.

<Effects> As described above, according to the fourth embodiment,
In addition to the configuration of the third example of the cold mirror and the positioning mirror, the subject provided the target position mark that is the target of the degree of opening of the eyelid, so that the subject can easily adjust the eyeball to the focal position, and There is an effect that the subject can easily obtain a target such as how much should be opened.

In the fourth embodiment, the cold mirror 50 with the target position mark can be applied to the first embodiment. In addition, such a cold mirror 50 with a target position mark is not only an eyeball imaging device,
The present invention is also applicable to a case in which an indication of a target position when capturing a reflected image of infrared light such as a face or a whole body is given. Here, the target position in the case other than the eyeball is, for example, an ear position when the imaging target is a face, and a target position such as both end positions when the imaging target is a lip. Further, in addition to the face, for example, in the case of a fingerprint, the present invention can be applied to indicate the position of the finger as the target position.

<< Embodiment 5 >> Embodiment 5 includes a display unit for displaying an image taken by the camera 11, and
The cold mirror is arranged obliquely with respect to the optical axis 12, and the image displayed on the display unit is reflected by the cold mirror so that the subject 100 can check the eyeball image.
It should be noted that all the specific examples after the specific example 5 are examples provided with a display unit together with a mirror.

<Structure and Operation> FIG. 16 is an explanatory view showing the principle of an eyeball imaging apparatus which is Embodiment 5 of the present invention. In the figure, eyeball 10, camera 11, optical axis 12, infrared light source 14, cornea 15, iris 16, pupil 17, retina 1
Since the lens 8 and the lens 19 are the same as those in the first embodiment, the description is omitted here.

The cold mirror 20a is a mirror that reflects visible light and transmits infrared light in the same manner as the cold mirrors 20 of Examples 1 to 4, but transmits infrared light in an oblique direction and It has the characteristic of reflecting visible light in the direction (this is referred to as characteristic C).

FIG. 17 is an explanatory diagram of the wavelength selection characteristic C of the cold mirror 20a. As illustrated, the cold mirror 20a transmits infrared light and reflects visible light. In addition, even if the infrared light is oblique to the surface of the cold mirror 20a, the infrared light is transmitted similarly to the perpendicular infrared light, and the oblique visible light is reflected.

The cold mirror 20a of this example is arranged obliquely with respect to the optical axis 12, and is set so that the subject can see the image on the display unit 60 reflected by the cold mirror 20a.

The display section 60 is a display for displaying an image taken by the camera 11. This display section 6
Numeral 0 is composed of a liquid crystal display or the like, and is disposed so that a straight line 23 passing through the center thereof intersects perpendicularly with the optical axis 12 and passes through an intersection 22 between the cold mirror 20a and the optical axis 12.

With this configuration, the display unit 60 emits visible light, and the eyeball image displayed on the display unit 60 depends on the positional relationship between the cold mirror 20a and the display unit 60.
The subject is reflected on the surface of the cold mirror 20a, and the subject views his or her own eyeball image on the cold mirror 20a.
At this time, the display unit 60 is arranged so that the subject can see a left-right inverted image of the image acquired by the camera 11.
That is, if the camera image is displayed on the display unit 60 as it is, the left and right sides are reversed when viewed from the subject 100, so that the display image on the display unit 60 is displayed in a state where the image is left and right reversed in advance. Such a left-right inversion operation can be realized by a known image processing technique.

Assuming that the eyeball 10 is located on the optical axis 12 of the camera 11, the cold mirror 20a
The image of the eyeball 10 (image of the display unit 60) reflected by
It again advances toward the eyeball 10, part of which passes through the pupil 17 and is imaged on the retina 18. Therefore, when the eyeball 10 is the eye of the subject 100, the subject 100
Will be viewed on the surface of the cold mirror 20a.

Here, when the eyeball 10 is located at the focal point 21 of the lens 19 on the optical axis 12, the cold mirror 20a is displayed so that the entire eyeball image is displayed on the cold mirror 20a.
If the size of the lens and the focal length of the lens 19 are set, the subject 100
a) Optimal positioning for photographing can be performed only by moving the eyes to a place where the entire image can be seen.

FIG. 18 is an explanatory diagram of positioning. FIG.
In the above, the mirror used for positioning may be either a cold mirror used in this example or a hot mirror used in example 15. In this specific example, an eyeball image is projected on the cold mirror 20a. In the figure,
(A) shows the case where there is no positional shift, (b) shows the case where the optical axis shifts, and (c) shows the case where the reflection spot of the eyeglasses overlaps the eyeball image.

In the figure, if the eyeball image of the subject himself is made to be visible on the entire cold mirror 20a as shown in (a), the subject is located at an optimum location for photographing. On the other hand, if the eyeball 10 is not located on the optical axis 12, the subject knows that the eyeball image is misaligned as shown in FIG. At this time, since the subject looks at the mirror image of the image displayed on the display unit 60, if the position of the eyeball on the cold mirror 20a is shifted to the left, the subject moves to the opposite right to change the eyeball image. It can be brought to the center position. Further, the eyeball 10 has an optical axis 12
Whether the subject is located at the focal point 21 of the upper lens 19 can be determined by the subject himself / herself looking at the eyeball image. That is, by moving the head back and forth, the optimum focus position with the least blur can be detected with the eyes of the user.

When the subject is a spectacle wearer, the light from the infrared light source 14 is reflected by the spectacle lens and frame, and the reflected spot may overlap the eyeball image (c). In this case, the subject can see the reflection spot on the cold mirror 20a. Here, when the head is tilted while keeping the line of sight, the infrared light source 14 and the spectacle lens,
Since the relative position with respect to the frame changes, the reflection spot can be moved out of the field of view of the camera. As described above, even when the reflection spot overlaps the eyeball image, the reflection spot can be excluded by the subject's own movement.

When the lens 19 has an autofocus function or a zoom function, the focusing is performed on the camera 11 side, so that the subject only needs to place the eyeball 10 on the optical axis 12.

<Effects> As described above, according to the fifth embodiment,
Since the positioning is performed while observing the subject's own eyeball image projected on the surface of the cold mirror 20a, the eyeball image can be photographed with a simple mechanism. In addition, since the eyeball image projected on the surface of the cold mirror 20a is an eyeball image that is actually reflected by the camera 11 and reflects infrared light, the subject can check the actual captured image without moving his / her eyes. effective.

<< Specific Example 6 >> In the specific example 5 described above, the subject examined the cold mirror 2 as shown in FIGS.
Positioning was performed using the subject's own eyeball image from the display unit 60 reflected at 0a. But Cold Mirror 2
A certain amount of experience is required to accurately position the own eyeball image at the center of 0a. Therefore, in the specific example 6, the gazing point is further displayed on the cold mirror 20a, and the subject performs positioning by looking at the gazing point.

FIG. 19 is an explanatory diagram of the principle of Embodiment 6 of the image pickup apparatus of the present invention. In the specific example 6, in addition to the configuration of the specific example 5, a fixation mark 61 indicating a fixation point is arranged at the center on the display unit 60. The gaze mark 61 is installed on the screen of the display unit 60 or in a space above the display unit 60 (a space between the display unit 60 and the cold mirror 20a), and an image thereof is displayed on the intersection 22 between the cold mirror 20a and the optical axis 12. It is configured to be projected.

FIG. 20 is an explanatory diagram showing an example of the gaze mark 61. In FIG. 20, the mirror on which the gaze mark is projected may be either a cold mirror used in this specific example or a hot mirror used in specific example 16. This specific example is an example of the gaze mark 61 projected on the cold mirror 20a. In the illustrated example, a square gaze mark 61 is shown.
However, other shapes such as a circle and a triangle may be used. Further, each color of the gaze mark 61 can be selected. Furthermore, the size can be variously selected within a range that does not hinder the subject from seeing the eyeball image. Basically, if the mark reflects or emits only the visible light component, the image is reflected toward the subject on the cold mirror 20a, and does not block the reflected image of the eyeball by the infrared light captured by the camera 11. Unlike the conventional example in which the central portion of the eyeball image cannot be photographed, in this specific example, the entire eyeball image can be photographed.

Therefore, the subject can easily place his or her own eyeball on the optical axis 12 simply by looking at the gaze mark 61 reflected on the cold mirror 20a.

<Effects> As described above, according to the sixth embodiment,
Since the fixation point can be presented on the cold mirror in front of the camera, the subject can easily place the eyeball on the optical axis. In addition, as in the specific example 5, the eyeball image projected on the surface of the cold mirror 20a is an eyeball image actually reflected by the camera 11 reflecting the infrared light. There is an effect that it can be confirmed without moving the.

Although the specific example 6 shows the case where the gaze mark 61 is arranged on the display unit 60, the infrared light is transmitted on the cold mirror 20a and only the specific wavelength in the visible light is transmitted. If an absorbing or reflecting material is attached by vapor deposition or the like, the same effect as that of the present embodiment can be obtained. That is, the gaze mark may be provided on the cold mirror 20a side.

<< Embodiment 7 >> The embodiment 7 is different from the embodiment 4 in that the target position marks 50a and 50b provided on the cold mirror are provided.
Is provided on the display unit 60 side.

<Structure and Operation> FIG. 21 is a view for explaining the principle of the seventh embodiment. In the specific example 7, in addition to the configuration of the specific example 6, a target position mark 62 indicating the amount of opening of the eyes is arranged around the gaze mark 61 on the display unit 60. The target position mark 62 is set on the surface of the display unit 60 or in a space above the same as the gaze mark 61, and an image thereof is projected on the cold mirror 20a.

FIG. 22 is an explanatory diagram showing an example of the target position mark 62. In FIG. 22, the mirror onto which the target position mark is projected may be either a cold mirror used in this example or a hot mirror used in example 17.
This specific example is an example of the target position mark 62 projected on the cold mirror 20a. (A) in the figure is a case where the required amount of eye opening is shown by the positions of the upper and lower eyelids, and (b) in the figure is a case where it is shown by the boundary line of the iris. Each color of the target position mark 62 can be selected similarly to the case of the gaze mark 61. In addition, the target position mark 62
Can be variously selected within a range that does not hinder the subject from seeing the eyeball image.

With such a configuration, the subject can easily know the degree of opening of the eyes required for imaging simply by looking at the target position mark 62 reflected on the cold mirror 20a.

<Effects> As described above, according to the specific example 7, the degree of eye opening can be presented to the cold mirror.
The subject can easily know the required degree of eye opening. Further, as in the specific examples 5 and 6, the eyeball image projected on the surface of the cold mirror 20a is an eyeball image actually reflected by the camera 11 that reflects infrared light. This has the effect of allowing the user to confirm without moving his / her eyes.

Although the specific example 7 shows the case where the target position mark 62 is arranged on the display section 60, infrared light is transmitted through the cold mirror 20a and only the specific wavelength in the visible light is transmitted. If a material that transmits, absorbs or reflects light is attached by vapor deposition or the like, the same effect as that of the specific example can be obtained.
That is, the gaze mark and the target position mark may be provided on the cold mirror 20a side.

<< Specific Example 8 >> In the specific example 7, the display unit 6
A good eyeball image can be taken by setting a mark for designating the point of gaze or the degree of opening of the eye on 0. However, when it is desired to change the position, color, brightness, shape, and the like of the mark, it takes time and effort to change the mark installed on the display unit 60. In view of this, in Example 8, such inconvenience is eliminated by performing image processing on the video signal from the camera 11 and displaying the mark position superimposed on the eyeball image.

<Structure and Operation> FIG. 23 is an explanatory diagram showing the principle structure of Embodiment 8 of the present invention. In the specific example 8, instead of the mark on the display unit 60 in the specific example 7,
A / D converter 71, image memory 72, D / A converter 7
3. A marked image generating unit 70 including a drawing unit 74 is provided.

The A / D converter 71 digitizes the analog video signal of the eyeball image output from the camera 11 and stores it in the image memory 72. Then, the stored digital data of the eyeball image in the image memory 72 is sent to the drawing unit 74. The drawing unit 74 replaces the pixel value of the pixel corresponding to the mark portion in the image data with another value. For example, when coloring the mark portion, the image memory 72 is prepared for each of the RGB elements, and the color is expressed by changing the ratio of the pixel values. By using such a configuration, a mark equivalent to the mark shown in FIG. 22 of the specific example 7 is displayed on the display unit 60.

Further, by sequentially changing the pixel value of the mark portion with respect to the image data sent in time series, for example, it is possible to blink the gaze mark or change the color and shape. . With such a configuration, the mark portion is more easily noticed by the subject.

The digital data whose pixel values have been changed by the drawing section 74 are stored in the image memory 72 and are stored in the D / A conversion section 73.
Is converted into an analog video signal. The converted signal is displayed on the display unit 60, reflected on the cold mirror 20a, and projected on the subject.

<Effects> As described above, according to the eighth embodiment,
As in the specific examples 5 to 7, the effect that the subject can check the actual photographed image without moving his / her eyes is provided, and the shape, color, and brightness of the mark can be sequentially changed and blinked. This has the effect that the subject can more easily find the mark portion.

<< Specific Example 9 >> In the specific examples 7 and 8, the mark indicating the required eye opening is set or displayed. However, there are individual differences in the maximum opening amount of the eyes due to the size of the eyeball, the shape of the eyelids, and the like. For example, if a subject who does not open their eyes wide even with an effort requires an excessively wide eye, it may cause mental distress to the subject. Further, even with the same eye opening amount, the positions of the upper and lower eyelids with respect to the gazing point such as upper eye contact and lower eye contact are different for each individual.

In order to solve such a problem, a specific example 9 will be described.
Then, the position of the eyelid for each individual is displayed. More specifically, the eye opening amount for each individual is registered in the database in advance, and the opening amount of each eye is displayed on the display unit 60 when the eyeball is imaged again. As a result, the eyeball can be imaged in a form that is natural for the subject.

<Structure and Operation> FIG. 24 is an explanatory diagram showing the principle structure of the ninth embodiment. In Example 9, in addition to the configuration of Example 8, a personal information output unit 80 including a personal ID input unit 81, a target position database 82, and a personal data selection unit 83 is provided.

In the target position database 82, the amount of eye opening for each individual is registered in advance in association with personal ID information. For example, the position of the upper and lower eyelids of the eyeball image or the position of the outer contour of the iris is used as the eye opening amount.

FIG. 25 is an explanatory diagram of a display example of the eye opening amount. In FIG. 25, the mirror used to display the amount of eye opening may be either a cold mirror used in this specific example or a hot mirror used in specific example 19. This specific example is an example in which the degree of eye opening is displayed on the cold mirror 20a. The marks shown by bold lines in the figure are target position marks indicating the amount of eye opening, (a) and (b) show examples of the positions of the upper and lower eyelids of the eyeball image, and (c) show the outline of the iris outer contour. It is an example showing a position. The center area is the gaze mark 6.
1a.

The eye opening can be measured by a known image processing method such as an edge detection filter. Individual I
The D input unit 81 inputs information for identifying a subject. For example, information such as an ID number and a subject name is input from a keyboard (not shown) or the like. Alternatively, the subject's ID information may be input by a personal identification device using biological characteristics such as an iris, retina, fingerprint, face, and signature.

The personal data selection unit 83 selects the eye opening amount of the corresponding individual from the target position database 82 based on the subject ID information input by the personal ID input unit 81, and renders this data to the drawing unit. Send to 74. The drawing unit 74 changes the value of the specific pixel corresponding to the opening amount in the image data and sends it to the image memory 72, as in the specific example 8. Other operations such as the D / A conversion unit 73 and the display unit 60 thereafter are the same as those of the eighth embodiment.

<Effects> As described above, according to the ninth embodiment,
As in the specific examples 5 to 8, it has the effect that the subject can check the actual photographed image without moving his / her eyes, and since the amount of opening of the eyes can be changed for each subject, the eyeball image can be formed in a natural form for the subject. There is an effect that shooting can be performed.

<< Specific Example 10 >> In the above specific example 9, a mark indicating the amount of eye opening required for each subject is displayed, and an eyeball image is photographed. The iris or retinal eyeprint included in the eyeball image differs for each individual. By registering these eye prints in advance, it is possible to identify who the subject is by comparing the eye prints obtained at the time of imaging the eyeball, that is, to identify the individual.

At this time, if the information of the result of the personal identification is displayed on the display unit 60, the subject can receive the identification result or the instruction information such as the line of sight and the movement without distracting the line of sight. Therefore, in the specific example 10, the identification result information from the personal identification unit is superimposed on the image from the camera 11 by the drawing unit 74, and this is displayed on the display unit 60.

<Structure and Operation> FIG. 26 is an explanatory diagram showing the principle structure of Embodiment 10 of the present invention. Example 1
At 0, a personal identification unit 84 is provided in addition to the configuration of the ninth embodiment. The personal identification unit 84 obtains image data of an eyeball from the image memory 72. Note that this image data is image data sent from the camera 11,
Is data before some of the pixel values are changed.
Then, the personal identification unit 84 converts the iris or retinal eyeprint into data according to a predetermined procedure. A known method is used for the method of data conversion.

On the other hand, in the personal ID input section 81, ID information such as the ID number and name of the subject is obtained. In the personal identification unit 84, the eyeprint data is registered in advance in association with the personal ID information (hereinafter, this data will be referred to as registration data), so the registration data corresponding to the personal ID information obtained by the personal ID input unit 81 Is compared with the eye print data obtained from the eyeball image, and it is determined whether or not the subject is the corresponding individual. The determination result is sent to the drawing unit 74, and the value of the image data is changed according to a predetermined display method.

Since the result is displayed on the display section 60, the subject can know the identification result in the same visual field where the eyeball image is viewed.

FIG. 27 is an explanatory diagram showing an example of a method of displaying the identification result. In FIG. 27, the mirror used to display the identification result may be either a cold mirror used in this example or a hot mirror used in example 20. In this specific example, the identification result is displayed on the cold mirror 20a. (A) in the figure shows a result display window provided in a part of the screen of the display unit 60, and a character (in the case of successful identification: A
This shows a case where characters of “ccept, identification failure: Reject) are displayed. The position and size of the result display window are not limited to this. For example, if the result display window is displayed on the gaze mark 61a at the center of the screen, the subject can see the result with almost no change in the line of sight. (B) in the figure is
The example of notifying by changing the pattern of the determination result is shown. In (b), the result is displayed by changing the pattern of the gaze mark 61a.

The specific example 10 can be changed as follows. That is, in the configuration shown in FIG. 26, first, the personal ID information is specified by the personal ID input unit, and only the registered data corresponding to the individual is compared with the eye print data of the subject by the personal identification unit 84. (1: 1 collation). In this case, the personal identification only determines whether or not the subject corresponds to the ID information.

However, another form of personal identification exists. That is, the eyeprint data obtained from the subject is compared with all the registered data, and only the personal ID information exceeding the predetermined threshold value and having the smallest difference is extracted (1: N).
Collation). In this case, the personal ID input unit 81, the target position database 82, and the personal data selection unit 83 become unnecessary. At this time, personal ID information such as name and ID number is displayed in the result display window shown in FIG.

Further, it is possible to display other information. Since the personal identification unit 84 analyzes the eyeball image, in the processing process, it is possible to extract additional information such as image quality such as defocus and noise, line of sight, and eye opening. Therefore, based on these information, for example,
Move your head closer (or away), stand still, look at the center (point of interest), open your eyes more, have spectacle lens reflections (tilt your head), eyeglasses (contact lenses)
Is displayed on the display unit 60 to notify the user that the user has removed the camera and that the glasses are dirty. This makes it easier for the subject to position the eyes, and enables accurate individual identification.

<Effects> As described above, according to the tenth embodiment, since information such as a result of personal identification determination and a positioning instruction can be displayed in the field of view to the subject, the eyeball image can be photographed without giving the subject a sense of restraint. And personal identification.

Further, the configuration provided with the display unit 60 in the above specific examples 5 to 10 corresponds to the lens 19 in the specific examples 1 to 4.
The present invention can be applied to a configuration in which the cold mirror 20 is provided on the entire surface. Hereinafter, these specific examples will be described.

<< Embodiment 11 >> Embodiment 11 is a combination of the configurations of the display unit 60 in Embodiments 1 and 5.

<Structure and Operation> FIG. 28 is an explanatory diagram showing the principle structure of the eleventh embodiment. Example 11
In the example, a display unit 60 is provided adjacent to the cold mirror 20. The display unit 60 is the same as the display unit 60 of the specific example 5.
This is the same configuration as. That is, it is a display for displaying a video signal from the camera 11. However, the displayed image is the same as the direction of the cold mirror 20,
Display an image with the left and right reversed. That is, display is performed such that the right side of the subject is the right side of the displayed image.

With such a configuration, the subject can perform focusing and positioning using the cold mirror 20, and can confirm an actually photographed image from the image displayed on the display unit 60. That is, the image shown on the cold mirror 20 is based on visible light, whereas the image displayed on the display unit 60 is based on infrared light for actually taking a picture.

Accordingly, for example, when the subject is a spectacle wearer and the light from the infrared light source 14 is reflected by the spectacle lens and the frame, and the reflected spot overlaps the eyeball image, a specific example is used. As in the case of 5, the state can be confirmed, so that the reflection spot can be excluded by the subject's own movement.

<Effects> As described above, according to the eleventh embodiment, since the cold mirror 20 and the display unit 60 are provided,
In addition to the effect that the subject can check the actual photographed image, there is an effect that the positional relationship between the cold mirror 20 and the display unit 60 does not require much accuracy compared to the specific example 5.

Further, the display unit 60 in the above specific example 11
May be applied to the configurations of the specific examples 2 to 4. In such a case, in addition to the effects of the specific examples 2 to 4, similarly to the specific example 11, there is an effect that the subject can check the actual captured image.

Furthermore, in the above specific examples 11 to 14,
Although the video signal from the camera 11 is configured to be displayed as a moving image on the display unit 60 as it is, a still image at a certain point in time captured by the camera 11 may be displayed according to an instruction from the subject. That is, the configuration is such that the image at the time when the subject is considered to be suitable as the eyeball image is monitored on the display unit 60. This allows the subject to check the image actually recorded as the eyeball image.
In this case, a configuration in which the display unit 60 is provided adjacent to the cold mirror 20 is not necessarily required, and the display unit 60 may be provided at a position distant from the camera 11 to some extent.

On the other hand, the display unit 6 of the specific example 6 or 7
The configuration of 0 may be applied to the first embodiment. That is, a configuration in which the gaze mark 61 and the target position mark 62 are provided on the display unit 60 of the specific example 11 shown in FIG. 28 can be realized. Thereby, similarly to the specific example 6 or the specific example 7, the effect that the subject can easily perform the alignment is exerted, and
Compared to the specific examples 6 and 7, there is an effect that the positional relationship between the cold mirror 20 and the display unit 60 does not require much accuracy.

In addition, the configuration of image processing and the configuration of personal identification in the specific examples 8 to 10 may be applied to the specific example 1. When these specific examples 8 to 10 are applied to the specific example 1, respectively, Specific examples 12 to 14 shown in FIG.

<< Example 12 >> Example 12 is an example in which the configurations of the marked image generating unit 70 and the display unit 60 of Example 8 are applied to Example 1.

<Structure and Operation> FIG.
FIG. 2 is an explanatory diagram showing a principle configuration in FIG. In the figure,
A configuration different from the specific example 11 shown in FIG. 28 is that a marked image generation unit 70 is provided. The marked image generation unit 70 is configured to execute A
It comprises a / D converter 71 to a D / A converter 73.

With this configuration, in the twelfth embodiment,
An image to which a gaze mark and a target position mark are added is displayed on the screen of the display unit 60 in the configuration of the specific example 11.

<Effects> As described above, according to Embodiment 12, the cold mirror 20 and the display unit 60 are provided,
Since the mark is superimposed on the image, in addition to the effect of the specific example 11, there is an effect that the mark can be easily changed even when the mark is changed. Further, as compared with the specific example 8, there is an effect that the positional relationship between the cold mirror 20 and the display unit 60 does not require much accuracy.

Further, the configuration of the marked image generating section 70 and the display section 60 in the specific example 12 may be applied to the configuration of the specific example 2. That is, together with the cold mirror 20,
The present invention may be applied to a configuration having the positioning mirror 31.

<< Thirteenth Embodiment >> A thirteenth embodiment is an example in which the configurations of the display unit 60, the marked image generation unit 70 and the personal information output unit 80 shown in the ninth embodiment are applied to the first embodiment.

<Structure and Operation> FIG.
FIG. 3 is an explanatory diagram showing a principle configuration in FIG. In the figure,
The configuration different from the specific example 12 shown in FIG.
The personal information output unit 80 is provided. This personal information output unit 80 is a personal ID shown in FIG.
It comprises an input unit 81 to a personal data selection unit 83.

With this configuration, in Example 13,
On the screen of the display unit 60 in the configuration of the specific example 11, an image provided with a gaze mark and a target position mark corresponding to the subject is displayed.

<Effects> As described above, according to Embodiment 13, the cold mirror 20 and the display unit 60 are provided, and
Since the mark corresponding to the subject is superimposed on the image, there is an effect that a mark suitable for the subject can be displayed in addition to the effect of the specific example 11. Further, as compared with the ninth embodiment, there is an effect that the positional relationship between the cold mirror 20 and the display unit 60 does not require much accuracy.

Further, the personal information output unit 80, the marked image generation unit 70, and the display unit 60 in the specific example 13 are described.
May be applied to the configuration of the specific example 2. That is, the present invention may be applied to a configuration having the positioning mirror 31 together with the cold mirror 20.

<< Specific Example 14 >> The specific example 14 corresponds to the specific example 10.
The configuration of the display unit 60, the marked image generation unit 70, the personal information output unit 80, and the personal identification unit 84 shown in FIG.
This is an example applied to

<Structure and Operation> FIG.
FIG. 4 is an explanatory diagram showing a principle configuration in FIG. In the figure,
The configuration different from the specific example 13 shown in FIG. 30 is that a personal identification unit 84 is further provided.

With this configuration, in the specific example 14,
On the screen of the display unit 60 in the configuration of the specific example 11, a video with a gaze mark and a target position mark corresponding to the subject is displayed, and the personal identification result is also displayed.

<Effects> As described above, according to Embodiment 14, the cold mirror 20 and the display unit 60 are provided, and
Since the mark corresponding to the subject and the personal identification result are added to the image, in addition to the effect of the specific example 11, there is an effect that the subject can easily know the personal identification result. Further, as compared with the specific example 10, there is an effect that the positional relationship between the cold mirror 20 and the display unit 60 does not require much accuracy.

The personal identification section 84, the personal information output section 80, and the marked image generation section 70 in the specific example 14 are also used.
The configuration of the display unit 60 may be applied to the configuration of the specific example 2. That is, the present invention may be applied to a configuration having the positioning mirror 31 together with the cold mirror 20.

In Examples 1 to 14 of the present invention,
In order to select light according to the wavelength of incident light, a cold mirror having wavelength selection characteristics is used. Although this cold mirror has a plurality of wavelength selection characteristics, in the specific examples 1 to 14, the cold mirror having the following characteristics among the plurality of wavelength selection characteristics is used.

1. A cold mirror having a characteristic A for reflecting visible light and transmitting infrared light as shown in FIG. 2. FIG.
A cold mirror with a mark B having a characteristic B that reflects only red light out of visible light and transmits other visible light and red light, as shown in FIG. 3. As shown in FIG. 17, visible light is reflected and infrared light is transmitted, and even if the infrared light is oblique to the surface of the cold mirror, it is transmitted in the same manner as infrared light perpendicular to the cold mirror surface and visible A cold mirror used to reflect an image on a display unit having a characteristic C that reflects light.

The following description of the specific examples 15 to 20 is directed to the configuration using the hot mirror instead of the cold mirror in the specific examples 5 to 10. The hot mirror has a wavelength selection characteristic of reflecting infrared light and transmitting visible light. In accordance with the wavelength selection characteristics of the hot mirror, by replacing the positions of the camera and the display unit described in the specific examples 5 to 10, it is possible to achieve the same effect as when using the code mirror. it can.

<Example 15> Example 15 is different from Example 5 in that the positions of the camera and the display unit are switched by using a hot mirror. A display unit for displaying an image captured by the camera 11 is provided, and a hot mirror is disposed obliquely with respect to the optical axis 12, an eyeball image of the subject 100 is reflected by the hot mirror, and captured by the camera 11, The captured eyeball image is displayed on the display unit so that the subject 100 can check the eyeball image.

<Structure and Operation> FIG. 36 is an explanatory diagram showing the principle of an eyeball imaging apparatus which is Embodiment 5 of the present invention. In the figure, an eyeball 10, an optical axis 12, an infrared light source 14,
Cornea 15, iris 16, pupil 17, retina 18, lens 1
9 is the same as in the first embodiment, and the description is omitted here.

The hot mirror 20b is a mirror that reflects infrared light and transmits visible light. The hot mirror 20b transmits obliquely visible light and reflects obliquely infrared light. G).

FIG. 37 is an explanatory diagram of the wavelength selection characteristic G of the hot mirror 20b. As shown, hot mirror 2
Ob transmits visible light and reflects infrared light. Also, it is assumed that even visible light oblique to the surface of the hot mirror 20b is transmitted as well as visible light perpendicular to the surface of the hot mirror 20b, and infrared light obliquely is reflected.

The hot mirror 20b of the present embodiment has the optical axis 1
2 and is set so that the subject can see the image on the display unit 60 on the hot mirror 20b.

The display section 60 is a display for displaying an image photographed by the camera 11. This display section 6
Reference numeral 0 denotes a liquid crystal display or the like, and a hot mirror b is disposed on the front of the display unit 60. The camera 11
A CCD 19 for sensing infrared wavelengths is provided inside, and a lens 19 for collecting light is arranged on the front of the camera 11. The camera 11 is arranged so that a straight line 23 passing through the center of the camera crosses the optical axis 12 perpendicularly and passes through an intersection 22 between the hot mirror 20b and the optical axis 12.

With such a configuration, the eyeball image is reflected on the surface of the hot mirror 20b and captured by the camera 11. The captured eyeball image is displayed on the display unit 60. Since the display unit 60 emits visible light, the display unit 60
Is transmitted through the hot mirror 20b.
Therefore, the subject puts his own eyeball image on the hot mirror 20.
b.

Now, assuming that the eyeball 10 is located on the optical axis 12, the image of the eyeball 10 (the image of the display unit 60) transmitted through the hot mirror 20b advances toward the eyeball 10 again, and A part passes through the pupil 17 and is imaged on the retina 18. Therefore, when the eyeball 10 is set as the eyes of the subject 100, the subject 100 sees the image of the subject's own eyeball captured by the camera 11 on the surface of the hot mirror 20b.

Here, when the eyeball 10 is located at the focal point 21 of the lens 19 on the optical axis 12, the size of the hot mirror 20b and the focal length of the lens 19 are adjusted so that the entire eyeball image is displayed on the hot mirror 20b. If the setting is made, the subject 100 can perform optimal positioning for photographing only by moving his / her eyes to a position where the eyeball image of the subject 100 can be seen on the entire hot mirror 20b.

FIG. 18 is an explanatory diagram of positioning. In this specific example, an eyeball image is projected on the hot mirror 20b. In the figure, (a) shows the case where there is no displacement, (b) shows the case where the optical axis is misaligned, and (c) shows the case where the reflection spot of the eyeglasses overlaps the eyeball image.

In the figure, if the eyeball image of the subject himself is made visible over the entire hot mirror 20b as shown in (a), the subject is located at an optimal location for photographing. on the other hand,
If the eyeball 10 is not located on the optical axis 12, the subject can know that the eyeball image is misaligned as shown in FIG. At this time, since the subject looks at the mirror image of the image displayed on the display unit 60, if the position of the eyeball on the hot mirror 20b is shifted to the left, the subject moves to the opposite right to change the eyeball image. It can be brought to the center position. Furthermore, whether or not the eyeball 10 is located at the focal point 21 of the lens 19 on the optical axis 12 can be determined by the subject himself / herself looking at the eyeball image. That is, by moving the head back and forth, the optimum focus position with the least blur can be detected with the eyes of the user.

When the subject is a spectacle wearer, the light from the infrared light source 14 is reflected by the spectacle lens and frame, so that the reflected spot may overlap the eyeball image (c). In this case, the subject can see the reflection spot on the hot mirror 20b. Here, if the head is tilted while keeping the line of sight, the relative position between the infrared light source 14, the spectacle lens, and the frame changes, so that the reflection spot can be moved out of the camera field of view. As described above, even when the reflection spot overlaps the eyeball image, the reflection spot can be excluded by the subject's own movement.

When the lens 19 has an auto-focus function or a zoom function, focusing is performed on the camera 11 side, so that the subject need only place the eyeball 10 on the optical axis 12.

<Effects> As described above, according to the fifteenth embodiment, since the positioning is performed while viewing the subject's own eyeball image projected on the surface of the hot mirror 20b, the eyeball image can be photographed with a simple mechanism. Further, since the eyeball image projected on the surface of the hot mirror 20b is an eyeball image that is actually reflected by the camera 11 and reflects infrared light, the subject can confirm an actual captured image without moving his / her eyes. There is. In addition, since the position of the display unit and the camera is changed by using the hot mirror, when the camera is vertically long, there is an effect that the entire imaging device can be made thin because the camera is oriented horizontally.

<< Example 16 >> Example 16 is different from Example 6 in that the positions of the camera and the display unit are switched by using a hot mirror. In the above specific example 15, the subject performs the positioning of the eyeball image by viewing the subject's own eyeball image from the display unit 60 on the hot mirror 20b as shown in FIGS. Was. However, a certain amount of experience is required to accurately position the own eyeball image at the center of the hot mirror 20b. Therefore, in the specific example 16, the gazing point is further displayed on the hot mirror 20b, and the subject performs positioning by looking at the gazing point.

FIG. 38 shows a specific example 16 of the image pickup apparatus of the present invention.
FIG. 4 is an explanatory view of the principle of FIG. In the specific example 16, the above specific example 1
In addition to the configuration of FIG. 5, a gaze mark 61 indicating a gaze point is arranged at the center on the display unit 60. This gaze mark 61
Is on the screen of the display unit 60 or the space above it (display unit 6
0 and the hot mirror 20b).
The image is projected on the intersection 22 between the hot mirror 20b and the optical axis 12.

FIG. 20 is an explanatory diagram showing an example of the gaze mark 61. This specific example is an example of the gaze mark 61 projected on the hot mirror 20b. In the illustrated example, a square gaze mark 61 is shown as an example, but other shapes such as a circle and a triangle may be used. Further, each color of the gaze mark 61 can be selected. Furthermore, the size can be variously selected within a range that does not hinder the subject from seeing the eyeball image. Basically, when the mark reflects or emits only the visible light component, the image is displayed on the subject side on the hot mirror 20b, and does not block the reflection image of the eyeball by the infrared light captured by the camera 11. Unlike the conventional example in which the central portion of the eyeball image cannot be photographed, in this specific example, the entire eyeball image can be photographed.

Therefore, the subject can easily place his or her own eyeball on the optical axis 12 simply by looking at the gaze mark 61 reflected on the hot mirror 20b.

<Effects> As described above, according to the sixteenth embodiment, since the point of gaze can be presented on the hot mirror on the front of the display unit, the subject can easily arrange the eyeball on the optical axis. Further, as in the specific example 15, the eyeball image projected on the surface of the hot mirror 20b is an eyeball image actually reflected by the camera 11 that reflects infrared light. There is an effect that it can be confirmed without moving the.

Although the specific example 16 shows the case where the gaze mark 61 is arranged on the display section 60, the hot mirror 20b reflects infrared light and transmits only a specific wavelength in visible light. If an absorbing or reflecting material is attached by vapor deposition or the like, the same effect as that of the present embodiment can be obtained. That is, the gaze mark may be provided on the hot mirror 20b side.

<< Embodiment 17 >> Embodiment 17 is different from Embodiment 7 in that the positions of the camera and the display unit are switched by using a hot mirror. Specific example 17 is specific example 4
Now, target position marks 50a, 50 provided on the hot mirror
This is an example in which b is provided on the display unit 60 side.

<Structure and Operation> FIG. 39 is an explanatory view of the principle of the seventeenth embodiment. The specific example 17 corresponds to the specific example 1 described above.
In addition to the configuration of No. 6, a target position mark 62 indicating the amount of eye opening is arranged around the gaze mark 61 on the display unit 60. The target position mark 62 is placed on the surface of the display unit 60 or in a space above the same as the gaze mark 61, and an image thereof is projected on the hot mirror 20b.

FIG. 22 is an explanatory diagram showing an example of the target position mark 62. This specific example is an example of the target position mark 62 projected on the hot mirror 20b. (A) in the figure is a case where the required amount of eye opening is shown by the positions of the upper and lower eyelids, and (b) in the figure is a case where it is shown by the boundary line of the iris. Each color of the target position mark 62 can be selected similarly to the case of the gaze mark 61. Also, the size of the target position mark 62 can be variously selected within a range that does not hinder the subject from seeing the eyeball image.

With such a configuration, the subject can easily know the degree of opening of the eyes required for imaging simply by looking at the target position mark 62 displaying the image from the display unit 60 on the hot mirror 20b. It is.

<Effects> As described above, according to the seventeenth embodiment, the degree of eye opening can be presented to the hot mirror, so that the subject can easily know the required degree of eye opening. Further, as in the specific examples 15 and 16, the eyeball image projected on the surface of the hot mirror 20b is an eyeball image actually reflected by the camera 11 that reflects infrared light. This has the effect of allowing the user to confirm without moving his / her eyes.

[0210] In the specific example 17, the case where the target position mark 62 is arranged on the display unit 60 has been described.
If a material that reflects infrared light and transmits, absorbs, or reflects only a specific wavelength in visible light is attached to the hot mirror 20b by vapor deposition or the like, the same effect as that of this specific example can be obtained.
That is, the gaze mark and the target position mark may be provided on the hot mirror 20b side.

<< Embodiment 18 >> Embodiment 18 is different from Embodiment 8 in that the positions of the camera and the display section are switched by using a hot mirror. In the specific example 17, the display unit 6
A good eyeball image can be taken by setting a mark for designating the point of gaze or the degree of opening of the eye on 0. However, when it is desired to change the position, color, brightness, shape, and the like of the mark, it takes time and effort to change the mark installed on the display unit 60. In view of this, in the specific example 18, the image signal from the camera 11 is subjected to image processing, and the mark position is superimposed on the eyeball image and displayed, thereby eliminating such inconvenience.

<Structure and Operation> FIG. 40 is an explanatory diagram showing the principle structure of Embodiment 18 of the present invention. Example 1
8, a marked image generating unit 70 including an A / D converter 71, an image memory 72, a D / A converter 73, and a drawing unit 74 is provided instead of the mark on the display unit 60 in the specific example 7. .

The A / D converter 71 digitizes the analog video signal of the eyeball image output from the camera 11 and stores it in the image memory 72. Then, the stored digital data of the eyeball image in the image memory 72 is sent to the drawing unit 74. The drawing unit 74 replaces the pixel value of the pixel corresponding to the mark portion in the image data with another value. For example, when coloring the mark portion, the image memory 72 is prepared for each of the RGB elements, and the color is expressed by changing the ratio of the pixel values. By using such a configuration, a mark equivalent to the mark as shown in FIG. 22 of the specific example 17 is displayed on the display unit 60.

Further, by sequentially changing the pixel value of the mark portion with respect to the image data sent in time series, for example, it is possible to blink the gaze mark or change the color and shape. . With such a configuration, the mark portion is more easily noticed by the subject.

The digital data whose pixel values have been changed by the drawing section 74 are stored in the image memory 72 and are stored in the D / A conversion section 73.
Is converted into an analog video signal. The converted signal is displayed on the display unit 60, and the hot mirror 2 that transmits visible light is used.
0b is projected on the surface of the subject.

<Effects> As described above, according to the specific example 18, similarly to the specific examples 15 to 17, there is an effect that the subject can confirm the actual photographed image without moving his / her eyes, and the shape of the mark, Since the color and brightness can be sequentially changed and blinked, it is possible for the subject to find the mark portion more easily.

<< Example 19 >> In Example 19, the position of the camera and the display section was changed using the hot mirror in Example 9. In the specific examples 17 and 18, the mark indicating the required eye opening is set or displayed. However, there are individual differences in the maximum opening amount of the eyes due to the size of the eyeball, the shape of the eyelids, and the like. For example, if a subject who does not open their eyes wide even with an effort requires an excessively wide eye, it may cause mental distress to the subject. Further, even with the same eye opening amount, the positions of the upper and lower eyelids with respect to the gazing point such as upper eye contact and lower eye contact are different for each individual.

To solve such a problem, specific example 1
In No. 9, the position of the eyelid for each individual is displayed.
More specifically, the eye opening amount for each individual is registered in the database in advance, and the opening amount of each eye is displayed on the display unit 60 when the eyeball is imaged again. As a result, the eyeball can be imaged in a form that is natural for the subject.

<Structure and Operation> FIG. 41 is an explanatory diagram showing the principle structure of the embodiment 19. In specific example 19,
In addition to the configuration of the specific example 18, a personal information output unit 80 including a personal ID input unit 81, a target position database 82, and a personal data selection unit 83 is provided.

[0220] In the target position database 82, the amount of eye opening for each individual is registered in advance in association with personal ID information. For example, the position of the upper and lower eyelids of the eyeball image or the position of the outer contour of the iris is used as the eye opening amount.

FIG. 25 is an explanatory diagram of a display example of the eye opening amount. This specific example is an example in which the degree of eye opening is displayed on the hot mirror 20b. A mark shown by a bold line in the figure is a target position mark indicating the amount of eye opening, and (a),
(B) is an example showing the position of the upper and lower eyelids of the eyeball image, and (c) is an example showing the position of the outer contour of the iris. The area at the center is the gaze mark 61a.

[0222] These eye opening amounts can be measured by a known image processing method such as an edge detection filter. Individual I
The D input unit 81 inputs information for identifying a subject. For example, information such as an ID number and a subject name is input from a keyboard (not shown) or the like. Alternatively, the subject's ID information may be input by a personal identification device using biological characteristics such as an iris, retina, fingerprint, face, and signature.

[0223] The personal data selection section 83 selects the eye opening amount of the corresponding individual from the target position database 82 based on the subject ID information input in the personal ID input section 81, and renders this data in the drawing section. Send to 74. The drawing unit 74 changes the value of the specific pixel corresponding to the opening amount in the image data and sends it to the image memory 72, as in the specific example 8. Other operations such as the D / A conversion unit 73 and the display unit 60 thereafter are the same as those of the eighth embodiment.

<Effects> As described above, according to the specific example 19, similarly to the specific examples 15 to 18, the effect that the subject can confirm the actual photographed image without moving his / her eyes is obtained. Since the opening amount of the eyeball can be changed, there is an effect that the eyeball image can be photographed in a natural manner for the subject.

<< Specific Example 20 >> The specific example 20 corresponds to the specific example 10.
, A hot mirror is used, and the positions of the camera and the display unit are interchanged. In the specific example 19, a mark indicating the amount of eye opening required for each subject is displayed, and an eyeball image is shot. The iris or retinal eyeprint included in the eyeball image differs for each individual. By registering these eye prints in advance, it is possible to identify who the subject is by comparing the eye prints obtained at the time of imaging the eyeball, that is, to identify the individual.

At this time, if the information of the result of the personal identification is displayed on the display unit 60, the subject can receive the identification result or the instruction information such as the line of sight and the movement without distracting the line of sight. Therefore, in the specific example 10, the identification result information from the personal identification unit is superimposed on the image from the camera 11 by the drawing unit 74, and this is displayed on the display unit 60.

<Structure and Operation> FIG. 42 is an explanatory diagram showing the principle structure of Embodiment 20 of the present invention. Example 2
At 0, a personal identification unit 84 is provided in addition to the configuration of the specific example 19. The personal identification section 84 is provided in the image memory 72.
More eyeball image data is acquired. Note that this image data is image data sent from the camera 11,
9 is data before some pixel values are changed. Then, the personal identification unit 84 converts the iris or retinal eyeprint into data according to a predetermined procedure. A known method is used for the method of data conversion.

On the other hand, in the personal ID input section 81, ID information such as the ID number and name of the subject can be obtained. In the personal identification unit 84, the eyeprint data is registered in advance in association with the personal ID information (hereinafter, this data will be referred to as registration data), so the registration data corresponding to the personal ID information obtained by the personal ID input unit 81 Is compared with the eye print data obtained from the eyeball image, and it is determined whether or not the subject is the corresponding individual. The determination result is sent to the drawing unit 74, and the value of the image data is changed according to a predetermined display method.

Since the result is displayed on the display section 60, the subject can know the identification result in the same visual field where the eyeball image is viewed.

FIG. 27 is an explanatory diagram showing an example of a method of displaying the identification result. In this specific example, an identification result is displayed on the hot mirror 20b. (A) of FIG.
A result display window is provided in a part of the screen of “0”, and a character is displayed in the result display window (when identification succeeds: Accept, when identification fails: Reject).
Is displayed. The position and size of the result display window are not limited to this. For example, if the result display window is displayed on the gaze mark 61a at the center of the screen, the subject can see the result with almost no change in the line of sight. (B) in the figure shows an example of notifying by changing the pattern of the determination result. At (b), the gaze mark 61
The result is displayed by changing the pattern of a.

The specific example 20 can be changed as follows. That is, in the configuration shown in FIG. 41, first, the personal ID information is specified by the personal ID input unit, and the personal identification unit 84 compares only the registered data corresponding to the individual with the eye print data of the subject. (1: 1 collation). In this case, the personal identification only determines whether or not the subject corresponds to the ID information.

However, there is another form of personal identification. That is, the eyeprint data obtained from the subject is compared with all the registered data, and only the personal ID information exceeding the predetermined threshold value and having the smallest difference is extracted (1: N).
Collation). In this case, the personal ID input unit 81, the target position database 82, and the personal data selection unit 83 become unnecessary. At this time, personal ID information such as name and ID number is displayed in the result display window shown in FIG.

Further, it is possible to display other information. Since the personal identification unit 84 analyzes the eyeball image, in the processing process, it is possible to extract additional information such as image quality such as defocus and noise, line of sight, and eye opening. Therefore, based on these information, for example,
Move your head closer (or away), stand still, look at the center (point of interest), open your eyes more, have spectacle lens reflections (tilt your head), eyeglasses (contact lenses)
Is displayed on the display unit 60 to notify the user that the user has removed the camera and that the glasses are dirty. This makes it easier for the subject to position the eyes, and enables accurate individual identification.

<Effects> As described above, according to the twentieth example, since information such as a result of personal identification determination and a positioning instruction can be displayed in the field of view to the subject, the photographing of the eyeball image without giving the subject a sense of restraint And personal identification.

As the wavelength selection characteristics of the cold mirror and the hot mirror, other characteristics than those described in the above specific examples can be applied, and these will be described as other specific examples.

<< Other Specific Examples >><Structure> For example, as a wavelength selection characteristic of a cold mirror, a characteristic is that red light existing in infrared light and visible light is transmitted and light other than red light in visible light is reflected. A cold mirror with D can be used.

FIG. 32 is an explanatory diagram of wavelength selection of the characteristic D. The cold mirror having the characteristic D corresponds to the cold mirror 20 described with reference to FIG. While the cold mirror 20 shown in FIG. 2 is configured to transmit only infrared light, the cold mirror shown in FIG. 32 transmits infrared light and red light and the other visible light (blue and green). Mirror.

FIG. 33 is an explanatory diagram of the wavelength selection characteristic E when used for a marked cold mirror. The cold mirror having the characteristic E corresponds to the cold mirror described with reference to FIG. This cold mirror is a mirror having a characteristic of transmitting blue light in addition to infrared light and red light and reflecting other visible green light. This allows the subject to see the green mark on the cold mirror. In the illustrated example, the configuration is such that green light is reflected. However, a cold mirror having a characteristic of transmitting red light and green light existing in infrared light and visible light and reflecting blue light may be used. . In this case, the subject can see the blue mark on the cold mirror.

FIG. 34 is an explanatory diagram of a wavelength selection characteristic F when an image on the display section is reflected. The cold mirror having the characteristic F corresponds to the cold mirror described with reference to FIG. 17, and transmits infrared light and red light in oblique directions in the same manner as in the vertical direction, and transmits visible light (blue and green) in other oblique directions. ) Is a mirror having a characteristic of reflecting light in the same manner as in the vertical direction.

As a wavelength selection characteristic of the hot mirror, a hot mirror having a characteristic H that reflects red light existing in infrared light and visible light and transmits light other than red light in visible light can be used. it can.

FIG. 43 is an explanatory diagram of the wavelength selection characteristic H when the image on the display unit is transmitted and the eyeball image is reflected by a hot mirror and imaged by a camera. The hot mirror having the characteristic H is equivalent to the cold mirror described with reference to FIG. 17, and reflects infrared light and red light in oblique directions in the same manner as in the vertical direction, and emits visible light (blue and green) in other oblique directions. ) Is a mirror having a characteristic of transmitting light in the same manner as in the vertical direction.

When the cold mirrors having the characteristics D, E, and F and the hot mirror having the characteristic H are used, it is assumed that an eyeball image is captured by a camera using red light and infrared light included in visible light. Therefore, the wavelength sensitivity of the camera is set to be high in a band including the red light and the infrared light so as to detect the red light and the infrared light included in the visible light.

FIG. 35 shows the wavelength sensitivity characteristics of a camera when a cold mirror having characteristics D, E, and F and a hot mirror having characteristics H are used. The wavelength sensitivity of the camera is set to increase the sensitivity including the red light, while the specific examples 1 to 20 are set to increase the sensitivity only for the infrared light. Thereby, an image of a reflection image of the subject due to the red light included in the visible light can be obtained.

<Effects> The cold mirror having the characteristics D, E, and F can be obtained by using the above-described specific examples 1 to 14.
When the hot mirror having the characteristic H is applied to the specific examples 15 to 20 described above, the following effects are obtained.

For example, body objects such as a face include a retina, an iris,
The ratio of reflection, absorption, and transmission differs depending on the wavelength of the irradiated light, not limited to each part of the eye such as the cornea. Therefore, if the wavelength of the light to be irradiated is different, the reflected image will be different even if the subject is the same.

Therefore, if a cold mirror having characteristics D, E and F and a hot mirror having characteristics H are used,
Since the camera can obtain not only infrared light but also a reflected image of red light, it is possible to photograph a pattern different from infrared light.

[Brief description of the drawings]

FIG. 1 is an explanatory diagram illustrating the principle of a specific example 1 of an imaging device of the present invention.

FIG. 2 is an explanatory diagram of wavelength selection by a cold mirror in a specific example 1 of the imaging apparatus of the present invention.

FIG. 3 is an explanatory diagram of positioning in a specific example 1 of the imaging apparatus of the present invention.

FIG. 4 is a configuration diagram of a specific example 1 of the imaging apparatus of the present invention.

FIG. 5 is a configuration diagram of a specific example 2 of the imaging apparatus of the present invention.

FIG. 6 is an explanatory diagram of the principle of a specific example 2 of the imaging device of the present invention.

FIG. 7 is a configuration diagram when a cold mirror is arranged in front of an infrared light source in a specific example 2 of the imaging apparatus of the present invention.

8 is an explanatory diagram of the principle in the case of FIG. 7 in the specific example 2 of the imaging apparatus of the present invention.

FIG. 9 is an explanatory diagram of a cold mirror with a gaze mark in a specific example 3 of the imaging apparatus of the present invention.

FIG. 10 shows a characteristic B in the specific example 3 of the imaging apparatus of the present invention.
FIG. 4 is an explanatory diagram of wavelength selection.

FIG. 11 is an explanatory diagram of a wavelength sensitivity characteristic of a camera in a specific example 3 of the imaging apparatus of the present invention.

FIG. 12 is a configuration diagram of Example 3 of the imaging apparatus of the present invention.

FIG. 13 is an explanatory diagram showing a cold mirror with a target position mark in Example 4 of the imaging apparatus of the present invention.

FIG. 14 is an explanatory view showing another example of the cold mirror with the target position mark in the specific example 4 of the imaging apparatus of the present invention.

FIG. 15 is a configuration diagram of Example 4 of the imaging apparatus of the present invention.

FIG. 16 is an explanatory diagram of a principle of a specific example 5 of the imaging apparatus of the present invention.

FIG. 17 is an explanatory diagram of a wavelength selection characteristic C of a cold mirror in a specific example 5 of the imaging apparatus of the present invention.

FIG. 18 is an explanatory diagram of positioning in a specific example 5 of the imaging apparatus of the present invention.

FIG. 19 is an explanatory diagram of the principle of Embodiment 6 of the imaging apparatus of the present invention.

FIG. 20 is an explanatory diagram showing an example of a gaze mark projected on a cold mirror in a specific example 6 of the imaging apparatus of the present invention.

FIG. 21 is an explanatory diagram of the principle of Example 7 of the imaging apparatus of the present invention.

FIG. 22 is an explanatory diagram showing an example of a target position mark projected on a cold mirror in a specific example 7 of the imaging apparatus of the present invention.

FIG. 23 is an explanatory diagram of the principle of Embodiment 8 of the imaging apparatus of the present invention.

FIG. 24 is an explanatory diagram of the principle of Embodiment 9 of the imaging apparatus of the present invention.

FIG. 25 is an explanatory diagram of a display example of an eye opening amount in the specific example 9 of the imaging apparatus of the present invention.

FIG. 26 is an explanatory diagram of the principle of Embodiment 10 of the imaging apparatus of the present invention.

FIG. 27 is an explanatory diagram of a display example of the identification result in the specific example 10 of the imaging device of the present invention.

FIG. 28 is an explanatory diagram of the principle of Embodiment 11 of the imaging apparatus of the present invention.

FIG. 29 is an explanatory diagram of the principle of Example 12 of the imaging apparatus of the present invention.

FIG. 30 is an explanatory diagram of the principle of Example 13 of the imaging apparatus of the present invention.

FIG. 31 is an explanatory diagram of the principle of Example 14 of the imaging apparatus of the present invention.

FIG. 32 is an explanatory diagram of a wavelength selection characteristic D by a cold mirror in another specific example of the imaging device of the present invention.

FIG. 33 is an explanatory diagram of a wavelength selection characteristic E by a cold mirror in another specific example of the imaging device of the present invention.

FIG. 34 is an explanatory diagram of a wavelength selection characteristic F by a cold mirror in another specific example of the imaging device of the present invention.

FIG. 35 is an explanatory diagram of a wavelength sensitivity characteristic of a camera when a cold mirror having characteristics D, E, and F is used in another specific example of the imaging apparatus of the present invention.

FIG. 36 is an explanatory diagram of the principle of Embodiment 15 of the imaging device of the present invention.

FIG. 37 is an explanatory diagram of a wavelength selection characteristic G of a hot mirror in Embodiment 15 of the imaging apparatus of the present invention.

FIG. 38 is an explanatory diagram of the principle of Example 16 of the imaging apparatus of the present invention.

FIG. 39 is an explanatory diagram of the principle of Embodiment 17 of the imaging apparatus of the present invention.

FIG. 40 is an explanatory diagram of the principle of Embodiment 18 of the imaging apparatus of the present invention.

FIG. 41 is an explanatory diagram of the principle of Embodiment 19 of the imaging apparatus of the present invention.

FIG. 42 is an explanatory diagram of the principle of a specific example 20 of the imaging apparatus of the present invention.

FIG. 43 is an explanatory diagram of a wavelength selection characteristic H by a hot mirror in another specific example of the imaging device of the present invention.

[Explanation of symbols]

 Reference Signs List 10 eyeball (part of subject) 11 camera 12 optical axis 13 visible light source 14 infrared light source 19 lens 20, 20a cold mirror (invisible light transmitting mirror) 20b hot mirror (invisible light reflecting mirror) 21 focus 31 positioning mirror 33 Second cold mirror 40 Cold mirror 40 gaze mark 40 a, 41 a gaze mark 41 positioning mirror gaze mark 50 cold mirror 50 g, target position mark target position mark 60 display unit 61 gaze mark 62 target position mark 70 marked image Generation unit 80 Personal information output unit 84 Personal identification unit

Claims (37)

[Claims] 1. An imaging device that irradiates a subject with invisible light and captures a reflected image of the subject with an imaging unit, wherein the imaging device has a wavelength selection characteristic of transmitting the invisible light and reflecting visible light, A subject, wherein an invisible light transmitting mirror for performing photographing alignment by viewing the subject's own image projected on the surface thereof is arranged between the imaging unit and the subject. apparatus. 2. The non-visible light transmitting mirror according to claim 1, wherein the non-visible light transmitting mirror is disposed so that its surface is perpendicular to the optical axis of the imaging unit, and is positioned at a position different from the non-visible light transmitting mirror. An imaging apparatus comprising: a mirror; and each mirror is arranged such that a perpendicular to the surface of the positioning mirror and a perpendicular to the surface of the invisible light transmitting mirror intersect at a focal position of the imaging unit. 3. The imaging device according to claim 2, wherein the positioning mirror is provided as a non-visible light transmitting mirror on a front surface of a light source for irradiating the non-visible light, and an optical axis of the light source is an optical axis of the imaging unit. An imaging apparatus, wherein the imaging apparatus is arranged to intersect an optical axis at a focal position of the imaging unit. 4. The imaging device according to claim 2, wherein the invisible light transmitting mirror and a part of the positioning mirror include:
An imaging apparatus, wherein an area that reflects only a part of the wavelength of visible light is formed, and this area is used as a gaze mark that is a target of the imaging position alignment for the subject himself. 5. The imaging device according to claim 2, wherein the invisible light transmitting mirror and a part of the positioning mirror include:
An imaging apparatus, wherein an area that reflects only a part of the wavelength of visible light is formed, and this area is used as a target position mark that is a target of an imaging range for the subject himself. 6. The imaging apparatus according to claim 3, wherein an area that reflects only a part of the wavelength of visible light is formed in a part of the invisible light transmitting mirror, and this area is set as a photographing position for the subject himself. An imaging apparatus, wherein a gaze mark is used as a target for alignment. 7. The imaging device according to claim 3, wherein a region that reflects only a part of the wavelength of visible light is formed in a part of the invisible light transmitting mirror, and this region is formed by the subject himself / herself. An imaging apparatus, wherein a target position mark serving as a target of a shooting range is set. 8. The imaging apparatus according to claim 4, wherein the invisible light is infrared light, and a part of the wavelength of visible light is a wavelength of red light. Imaging device. 9. An imaging device that irradiates a subject with invisible light and captures a reflection image of the subject with an imaging unit, a display unit that displays an image captured by the imaging unit, and that transmits the invisible light, and A non-visible light transmitting mirror for reflecting an image displayed on the display unit and having a wavelength selection characteristic of reflecting visible light, and performing a photographing alignment by allowing the subject to view the reflected image of the subject himself / herself Is arranged between the imaging unit and a subject. 10. The imaging apparatus according to claim 9, wherein the display unit and the imaging unit are arranged so that the central axis thereof intersects perpendicularly, and the center of the invisible light transmitting mirror is arranged at the intersection. An imaging device characterized by the above-mentioned. 11. The imaging apparatus according to claim 9, wherein a subject visually recognizes a reflection image of the invisible light transmitting mirror at any position between the surface of the display unit and the surface of the invisible light transmitting mirror. An imaging apparatus, wherein a gaze mark is provided that is possible and that the subject himself / herself sets a target of a shooting position alignment. 12. The imaging device according to claim 9, wherein the subject reflects the non-visible light transmitting mirror at any position between the display unit surface and the non-visible light transmitting mirror surface. An imaging apparatus characterized in that a target position mark that is visually recognizable as an image and is a target of an imaging range for the subject is provided. 13. The image-capturing device according to claim 9, wherein a subject is superimposed with information indicating a gaze mark that is a target of a photographing position on a video signal to be displayed on a display unit. And an image signal output by the image generating unit with a mark, the image signal being displayed on the display unit. 14. The imaging device according to claim 13, wherein a subject can be visually recognized as a reflection image of the invisible light transmitting mirror at any position between the surface of the display unit and the surface of the invisible light transmitting mirror. And a target position mark serving as a target of a photographing range for the subject. 15. The imaging apparatus according to claim 9, wherein a mark is provided to superimpose information indicating a target position mark that is a target of the imaging range on the video signal to be displayed on the display unit. An image pickup apparatus comprising: an image generating unit; and a video signal output by the marked image generating unit is displayed on the display unit. 16. The imaging device according to claim 9, wherein the video signal to be displayed on the display unit includes a gaze mark at which a subject is a target of a shooting position and a target at which the subject is a target of a shooting range. An image pickup apparatus, comprising: a marked image generating unit that superimposes information indicating a position mark, wherein a video signal output by the marked image generating unit is displayed on the display unit. 17. The imaging apparatus according to claim 15, wherein a personal information output unit that holds target position mark information for each subject, and a target position mark for each subject output from the personal information output unit. An image pickup apparatus comprising: a marked image generating unit that is superimposed on a video signal. 18. The imaging device according to claim 13, wherein: a personal identification unit that performs individual identification of a subject using a video from an imaging unit; and information indicating an identification result in the personal identification unit. An image pickup apparatus comprising: a marked image generating unit that is superimposed on a video signal. 19. The imaging device according to claim 1, further comprising a display unit that displays an image captured by the imaging unit and allows the subject to directly view the display image. Imaging device. 20. The imaging apparatus according to claim 1, further comprising: a display unit configured to display an image captured by the imaging unit, and to display the display image on the display unit so that a subject can directly view the display image. In the video signal, the subject is provided with a marked image generating unit that superimposes information indicating a gaze mark that is a target of the imaging position alignment and a target position mark that the subject is a target of the imaging range. An image pickup apparatus, wherein an output video signal is displayed on the display unit. 21. The imaging apparatus according to claim 20, wherein a personal information output unit for holding a target position mark for each subject, and a target position mark for each subject output from the personal information output unit are superimposed on a video signal. An image pickup apparatus, comprising: a marked image generating unit. 22. The imaging device according to claim 20, wherein a personal identification unit that performs individual identification of a subject using an image from an imaging unit, and information indicating an identification result in the personal identification unit is converted into a video signal. An image pickup apparatus comprising: an image generation unit with a mark to be superimposed. 23. An imaging device that irradiates a subject with invisible light and captures a reflected image of the subject with an imaging unit, a display unit that displays an image captured by the imaging unit, and that reflects the invisible light, and A non-visible light reflecting mirror that has a wavelength selection characteristic of transmitting visible light, transmits an image displayed on the display unit, and adjusts a photographing position by allowing the subject to view the transmitted image of the subject himself / herself. Is arranged between the imaging unit and a subject. 24. The imaging device according to claim 23, wherein the imaging unit is disposed such that a central axis thereof intersects perpendicularly with a central axis of the imaging unit, and the center of the invisible light reflecting mirror is located at the intersection. An imaging device characterized by being arranged. 25. The imaging device according to claim 23, wherein the invisible light reflecting mirror has an angle such that a surface of the invisible light reflecting mirror located on the subject side is imaged by the imaging unit. An imaging device, which is arranged obliquely. 26. The imaging device according to claim 23, wherein a subject transmits the invisible light reflecting mirror to a position between the surface of the display unit and the surface of the invisible light reflecting mirror. An imaging apparatus characterized in that the subject is provided with a gaze mark that is visually recognizable as an image and that the subject himself / herself sets a target for imaging position alignment. 27. The imaging device according to claim 23, wherein a subject transmits the invisible light reflecting mirror to a position between the surface of the display unit and the surface of the invisible light reflecting mirror. An imaging apparatus characterized in that a target position mark that is visually recognizable as an image and is a target of an imaging range for the subject is provided. 28. The image-capturing device according to claim 23, wherein the subject is superimposed with information indicating a gaze mark that is a target of the photographing position adjustment on the video signal to be displayed on the display unit. And an image signal output by the image generating unit with a mark, the image signal being displayed on the display unit. 29. The imaging device according to claim 28, wherein a subject can be visually recognized as a transmission image of the invisible light reflecting mirror at any position between the surface of the display unit and the surface of the invisible light reflecting mirror. And a target position mark serving as a target of a photographing range for the subject. 30. The image-capturing device according to claim 23, wherein a subject is superimposed with information indicating a target position mark that is a target of a photographing range on a video signal to be displayed on a display unit. And an image signal output by the image generating unit with a mark, the image signal being displayed on the display unit. 31. The imaging device according to claim 23, wherein the video signal to be displayed on the display unit includes a gaze mark at which the subject is a target of the shooting position and a target at which the subject is the target of the shooting range. An image pickup apparatus, comprising: a marked image generating unit that superimposes information indicating a position mark, wherein a video signal output by the marked image generating unit is displayed on the display unit. 32. The imaging device according to claim 30, wherein a personal information output unit that holds information on a target position mark for each subject, and a target position mark for each subject output from the personal information output unit. An image pickup apparatus comprising: a marked image generating unit that is superimposed on a video signal. 33. The imaging device according to claim 28, wherein: a personal identification unit that performs individual identification of the subject using an image from the imaging unit; and information indicating an identification result in the personal identification unit. An image pickup apparatus comprising: a marked image generating unit that is superimposed on a video signal. 34. The imaging device according to claim 23, wherein the invisible light reflecting mirror reflects a part of the invisible light and visible light, and a part of the reflected visible light. An imaging apparatus having a characteristic of transmitting a part of different visible light. 35. The non-visible light transmitting mirror transmits the non-visible light and a part of the visible light, and the visible light is different from the part of the visible light transmitted therethrough. An image pickup device having a characteristic of reflecting a part of the image. 36. The imaging device according to claim 1, wherein the invisible light is infrared light. 37. The imaging device according to claim 1, wherein the image of the subject is an image of an eyeball portion.