WO2015193953A1

WO2015193953A1 - Image display device and optical device

Info

Publication number: WO2015193953A1
Application number: PCT/JP2014/065929
Authority: WO
Inventors: 竜志鵜飼; 佑哉大木; 大内　敏; 俊輝中村; 瀬尾　欣穂
Original assignee: 日立マクセル株式会社
Priority date: 2014-06-16
Filing date: 2014-06-16
Publication date: 2015-12-23

Abstract

In the present invention, an image display device having an imaging function that captures an image for performing biometric processing using an eye has increased compactness compared to conventional devices. The present invention is characterized by containing a light source unit that outputs light and an optical processing unit that performs an image display process for displaying an image using light output from the light source unit and an image capture process that captures a recognition subject for performing biometric processing using an eye, the optical processing unit capturing the recognition subject by means of receiving light resulting from light of the displayed image being reflected by the eye of a user.

Description

Image display apparatus and optical device

The present invention relates to an image display apparatus and an optical device.

There is JP 2008-241822 (Patent Document 1) as background art in this technical field. In this publication, “the visible light reflecting infrared light transmitting mirror 2-a or the visible light transmitting infrared light reflecting mirror 2-b is used to minimize the loss of light and to display two images, namely, image display and iris imaging. Provides a means of assembling functions on one optical system. "

JP2008-241822

2. Description of the Related Art Conventionally, an image display device such as a head mounted display (Head Mounted Display, hereinafter abbreviated as HMD) that a user wears on his / her head is known. The user can acquire various types of information by visually recognizing images such as images and still images displayed by the HMD.

The HMD can possess or display not only non-confidential information disclosed to the whole world but also confidential information disclosed only to specific individuals. Therefore, it is desirable that the HMD has a function of identifying a user and presents an image only to a regular user who has a use authority.

In order to solve such a problem, for example, in Patent Document 1, an image display function that includes a visible light source, an infrared light source, and an imaging device and displays an image with a visible light source, and biometric authentication processing using the eyes are performed. In addition, an image display apparatus having an imaging function of imaging infrared light emitted from an infrared light source from the retina or iris of the infrared light with an imaging device is disclosed.

However, the apparatus disclosed in Patent Document 1 has a problem that an infrared light source for capturing a retinal image or the like is arranged separately from the optical system for image display, and the optical system becomes enlarged. .

The present invention has been made in order to solve such a problem, and an image display device having an imaging function for imaging an authentication target for performing biometric authentication processing using eyes is made smaller than before. With the goal.

In order to solve the above problems, the present invention performs an image display process for displaying an image using light output from a light source unit and an imaging process for imaging an authentication target for performing a biometric authentication process using eyes. An optical processing unit, wherein the optical processing unit captures the authentication object by receiving reflected light of the displayed image reflected by a user's eyes.

According to the present invention, an image display device having an imaging function for imaging an authentication target for performing biometric authentication processing using eyes can be made smaller than before.

It is a figure which illustrates the structure of the optical part of the video display apparatus which concerns on the 1st Embodiment of this invention. It is a figure which illustrates the structure of the light source part and illumination optical part which concern on embodiment of this invention. It is a figure which illustrates the structure of the other form of the illumination optical part which concerns on embodiment of this invention. It is a figure which illustrates the structure of the other form of the light source part which concerns on embodiment of this invention, and an illumination optical part. It is a figure which shows an example of the cross section of the integrated liquid crystal display element and imaging device which concerns on embodiment of this invention. It is a figure which illustrates the structure of the projection optical part which concerns on embodiment of this invention. It is a figure which illustrates the plane mirror which concerns on embodiment of this invention, and a user's eyeball from a user's right side viewpoint. It is a figure which illustrates the image for retinal authentication preparation and the image for retinal authentication which concern on embodiment of this invention. It is a figure which illustrates the retina picked-up image which the image processing part which concerns on embodiment of this invention acquired. It is a figure which shows another example of the retinal captured image which the image process part which concerns on embodiment of this invention acquired. It is a figure which illustrates the relationship between the sharpness of the retina captured image which concerns on embodiment of this invention, and the brightness of a display image. It is a figure which illustrates the relationship between the moving amount | distance of the retinal captured image which concerns on embodiment of this invention, and the brightness of a display image. It is a figure which illustrates the structure of the light source part which concerns on the 2nd Embodiment of this invention. The figure which illustrates the structure of the optical processing part which concerns on the 3rd Embodiment of this invention. It is a figure which illustrates the structure of the optical process part which concerns on the 4th Embodiment of this invention. It is a figure which shows an example of the fiber polarization beam splitter which concerns on the 4th Embodiment of this invention. It is a figure which shows an example of the fiber scanning element which concerns on the 4th Embodiment of this invention. It is a figure which illustrates the structure of the optical part of the video display apparatus concerning the 5th Embodiment of this invention. It is a figure which illustrates the structure of the optical processing part which concerns on the 5th Embodiment of this invention. It is a figure which illustrates the image for iris authentication preparation which concerns on the 5th Embodiment of this invention. It is a figure which shows another example of the cross section of the integrated liquid crystal display element and image pick-up element which concerns on embodiment of this invention. It is a flowchart which illustrates the retina authentication process which concerns on embodiment of this invention. 1 is a block diagram illustrating a functional configuration of a video display device according to an embodiment of the invention. It is a figure which illustrates the operation | use form of the video display system which concerns on embodiment of this invention. It is a figure which illustrates the structure of the projection optical part which concerns on the 5th Embodiment of this invention. It is a figure which illustrates the structure of the curved surface beam splitter which concerns on the 5th Embodiment of this invention. It is a block diagram which illustrates the hardware constitutions of the video display apparatus which concerns on embodiment of this invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In addition, the following description is for describing one embodiment of the present invention, and does not limit the scope of the present invention. Accordingly, those skilled in the art can employ embodiments in which each of these elements or all of the elements are replaced with equivalent ones, and these embodiments are also included in the scope of the present invention.

[Example 1]
Embodiment 1 of the present invention will be described below. FIG. 23 is a block diagram illustrating a functional configuration of the video display device (apparatus) 10 according to the embodiment of the invention. The video display apparatus 10 includes an optical unit 200, a control unit 201, an image processing unit 202, an information storage unit 203, a communication processing unit 204, and a communication input / output unit 205. In the following, in the present embodiment, the video display device 10 will be described as an example. However, the image display device 10 may include not only a video image that is a moving image but also a still image display.

The control unit 201 plays a role of controlling each unit included in the video display device 10 and gives a command to each unit included in the video display device 10. The information storage unit 203 stores a video that the video display device 10 presents to the user, an image necessary for biometric authentication using eyes such as a retina image or an iris image, and the like. Hereinafter, “biometric authentication using an eye such as a retina image or iris image” is referred to as “biometric authentication”.

The image processing unit 202 acquires a video, an image necessary for biometric authentication, and the like from the information storage unit 203 in accordance with an instruction from the control unit 201, and outputs them to the optical unit 200. In addition, the image processing unit 202 acquires a captured image generated by being captured by the optical unit 200, and performs determination based on a captured image acquired by a determination unit (not illustrated) in the image processing unit 202. The image processing unit 202 outputs the determination result to the control unit 201.

The optical unit 200 presents the video or image received from the image processing unit 202 to the user in accordance with an instruction from the control unit 201. In addition, the optical unit 200 performs imaging in accordance with a command from the control unit 201.

FIG. 24 is a diagram illustrating an operation mode of the video display system according to the embodiment of the present invention. As shown in FIG. 24, the video display device 10 can communicate with an information processing device 212 different from the video display device 10. Communication processing with the information processing device 212 is performed by the communication processing unit 204 in accordance with an instruction from the control unit 201. Communication with the information processing apparatus 212 is performed via the communication input / output unit 205 and the Internet 211.

The optical unit 200, the control unit 201, the image processing unit 202, the information storage unit 203, and the communication processing unit 204 described in the above embodiment are realized by a combination of software and hardware in the video display device 10. Hereinafter, a hardware configuration of the video display apparatus 10 that realizes each component according to the present embodiment will be described with reference to FIG.

FIG. 27 is a block diagram illustrating a hardware configuration of the video display apparatus 10 according to the present embodiment. As shown in FIG. 2, the video display apparatus 10 according to the present embodiment includes the same configuration as a general server, a PC (Personal Computer), or the like. That is, the video display device 10 according to the present embodiment includes a CPU (Central Processing Unit) 11, a RAM (Random Access Memory) 20, a ROM (Read Only Memory) 30, an HDD (Hard Disk Drive) 40, and an I / F 50. 80 is connected. A display unit 60 and an operation unit 70 are connected to the I / F 50.

The CPU 11 is a calculation means and controls the entire operation of the video display device 10. The RAM 20 is a volatile storage medium capable of reading and writing information at high speed, and is used as a work area when the CPU 11 processes information. The ROM 30 is a read-only nonvolatile storage medium and stores a program such as firmware. The HDD 40 is a non-volatile storage medium that can read and write information, and stores an OS (Operating System), various control programs, application programs, and the like. In addition to the HDD, a semiconductor storage device such as an SSD (Solid State Drive) may be used.

The I / F 50 connects and controls the bus 80 and various hardware and networks. The display unit 60 is a visual user interface for the user to check the state of the video display device 10. The operation unit 70 is a user interface for the user to input information to the video display device 10 such as various hard buttons and a touch panel.

In such a hardware configuration, a program stored in a storage medium such as the ROM 30, the HDD 40, or an optical disk (not shown) is read into the RAM 20, and the software control unit is configured by the CPU 11 performing calculations according to those programs. . A functional block that realizes the function of the video display apparatus 10 according to the present embodiment is configured by a combination of the software control unit configured as described above and hardware.

Next, the configuration of the optical unit 200 according to the present embodiment will be described. FIG. 1 is a diagram illustrating the configuration of an optical unit 200 according to this embodiment. As shown in FIG. 1, the optical unit 200 according to the present embodiment includes an optical processing unit 3 that combines a light source unit 1, an illumination optical unit 2, a video generation unit (image generation unit), and a retinal imaging unit, A projection optical unit 4 including an element that changes the traveling direction of light. Further, as shown in FIG. 1, the light emitted from the projection optical unit 4 reaches the user's eyeball 6, and the light emitted from the user's eyeball 6 enters the projection optical unit 4.

The light emitted from the light source unit 1 reaches the user's retina 7 through the illumination optical unit 2, the optical processing unit 3, the projection optical unit 4, and the user's crystalline lens 8. The light reaching the retina 7 is scattered by the retina 7, and a part of the scattered light reaches the optical processing unit 3 through the crystalline lens 8 and the projection optical unit 4.

Hereinafter, the function of displaying the image of the optical unit 200 will be described first. The light source unit 1 emits visible light for presenting an image to the user. The light source unit 1 includes a light source that emits white light or a plurality of light sources that emit light of different colors.

The illumination optical unit 2 adjusts the illuminance distribution of the light emitted from the light source unit 1 so that the image generation unit in the optical processing unit 3 is illuminated with substantially the same illuminance without excess or deficiency. When the light source unit 1 includes a plurality of light sources, the illumination optical unit 2 also plays a role of combining light emitted from the plurality of light sources that constitute the light source unit 1. Hereinafter, a case where the light source unit 1 includes a plurality of light sources will be described as an example.

FIG. 2 is a diagram illustrating the configuration of the light source unit 1 and the illumination optical unit 2 according to this embodiment. The light source unit 1 includes, for example, a light source 1A, a light source 1B, and a light source 1C. The light sources 1A to 1C emit light of any one color among red light, green light, and blue light. As long as the three colors of light are emitted by the three light sources without any shortage, any light source may emit any color of light. Each of the light sources 1A to 1C may be mounted in an independent package, or two or more light sources may be integrated and mounted in one package.

The illumination optical unit 2 includes, for example, a light tunnel 21A and a lens 21B. The light emitted from the light source unit 1 enters the light tunnel 21 A of the illumination optical unit 2. Since the light incident on the light tunnel 21A is reflected a plurality of times by the inner wall of the light tunnel 21A, the illuminance distribution of the light emitted from the light tunnel 21A becomes substantially uniform. The light emitted from the light tunnel 21A passes through the lens 21B.

The lens 21B collects the divergent light emitted from the light tunnel 21A. Accordingly, the illumination optical unit 2 has a function of combining the light emitted from the light source unit 1 and illuminating the image generation unit in the optical processing unit 3 with a substantially uniform illuminance distribution.

Instead of collecting the diverging light emitted from the light tunnel 21A with one lens 21B, it is possible to use a plurality of lenses. By using a plurality of lenses, it is possible to illuminate the image generation unit in the optical processing unit 3 with a more uniform illuminance distribution than in the case of using a single lens.

FIG. 3 is a diagram illustrating another configuration of the illumination optical unit 2. The light emitted from the light source unit 1 enters the diffusion plate 22A, diffuses, and exits the diffusion plate 22A. Accordingly, the illumination optical unit 2 has a function of combining the light emitted from the light source unit 1 and illuminating the image generation unit in the optical processing unit 3 with a substantially uniform illuminance distribution.

FIG. 4 is a configuration diagram of another embodiment of the light source unit 1 and the illumination optical unit 2 of the present embodiment. The light source unit 1 includes, for example, a light source 1A that emits red light, a light source 1B that emits green light, and a light source 1C that emits blue light.

For example, the illumination optical unit 2 transmits

lenses

23A, 23B, and 23C, a dichroic mirror 23D that transmits red light and reflects green light, a relay lens 23H, and transmits red light and green light. And a dichroic mirror 23E that reflects blue light, a microlens array 23F, and a lens 23G.

The red light emitted from the light source 1A is transmitted through the lens 23A. The lens 23A serves to make the divergent light emitted from the light source 1A substantially parallel light. The light transmitted through the lens 23A travels toward the dichroic mirror 23D and enters the dichroic mirror 23D at an incident angle of approximately 45 degrees.

Similarly, the green light emitted from the light source 1B is transmitted through the lens 23B. The lens 23B plays a role of making divergent light emitted from the light source 1B substantially parallel light. The light transmitted through the lens 23B travels toward the dichroic mirror 23D and enters the dichroic mirror 23D at an incident angle of approximately 45 degrees.

The red light emitted from the light source 1A and the green light emitted from the light source 1B are substantially orthogonal to each other, and the transmitted light of the dichroic mirror 23D of red light and the reflected light of the dichroic mirror 23D of green light are substantially the same. The light source 1A, the light source 1B, and the dichroic mirror 23D are arranged so as to travel in the same direction along the optical axis.

The light that has passed through the dichroic mirror 23D passes through the relay lens 23H, travels toward the dichroic mirror 23E, and enters the dichroic mirror 23E at an incident angle of approximately 45 degrees. The relay lens 23H plays a role of correcting a difference in light spread caused by a difference between an optical path length from the

light sources

1A and 1B to the dichroic mirror 23E and an optical path length from the light source 1C to the dichroic mirror 23E.

Blue light emitted from the light source 1C is transmitted through the lens 23C. The lens 23C serves to make the divergent light emitted from the light source 1C substantially parallel light. The light transmitted through the lens 23C travels toward the dichroic mirror 23E and enters the dichroic mirror 23E at an incident angle of approximately 45 degrees.

The light that has passed through the dichroic mirror 23D and the blue light emitted from the light source 1C are substantially orthogonal, and further, the light that has passed through the dichroic mirror 23D, the transmitted light of the dichroic mirror 23E, and the reflected light of the blue light dichroic mirror 23E The light source 1C and the dichroic mirror 23E are arranged so that the light beams travel in the same direction with substantially the same optical axis.

In addition, although the case where the light source 1A, the light source 1B, and the light source 1C each emit red light, green light, and blue light has been described as an example, any combination of light emitted by each light source may be used. However, when changing the combination of the light emitted by each light source, the reflection / transmission characteristics of the dichroic mirror 23D and the dichroic mirror 23E are appropriately set so that the light emitted from the dichroic mirror 23E travels in the same direction along substantially the same optical axis. Need to change.

The light emitted from the dichroic mirror 23E is transmitted through the microlens array 23F and the lens 23G. Using each incident cell of the microlens array 23F as an object, this object is imaged on the optical processing unit 3, and the size of the image formed is approximately equal to the size of the image generation unit in the optical processing unit 3. The micro lens array 23F and the lens 23G are designed and arranged. Accordingly, the illumination optical unit 2 has a function of combining the light emitted from the light source unit 1 and illuminating the image generation unit in the optical processing unit 3 with a substantially uniform illuminance distribution.

The optical processing unit 3 includes a video generation unit having a function of performing video generation processing for generating a video by intensity-modulating incident light, and a retinal imaging unit having a function of performing imaging processing of capturing a retina. An optical device. As the optical processing unit 3, for example, an integrated liquid crystal display element / image sensor 31 including a transmissive monochrome liquid crystal display element and an image sensor can be used. The configuration of the optical processing unit 3 described below is one of the gist according to the present embodiment.

In addition, the generation of an image by the optical processing unit 3 according to the present embodiment means that an image is displayed using the light output from the light source unit 1. Therefore, it can be said that a video generation unit having a function of performing video generation processing is a video display generation unit having a function of performing video display processing. The same applies to a case where not only a moving image but also an image including a still image is targeted. In that case, the optical processing unit 3 includes an image display unit having a function of performing an image display process. It will be. The following embodiments will be described as video generation processing.

FIG. 5 is an example of a schematic diagram of a cross section of the integrated liquid crystal display element / imaging element 31. The integrated liquid crystal display element / imaging element 31 includes a polarizing plate 3A, a pixel electrode 3B, a photodiode 3C, a liquid crystal layer 3D, a counter electrode 3E, and a polarizing plate 3F.

The photodiode 3C receives at least one of red light, green light, and blue light traveling in the direction from the polarizing plate 3F to the photodiode 3C, and proceeds in the direction from the polarizing plate 3A to the photodiode 3C. It is configured not to receive the light to be received. Therefore, the photodiode 3C has no role in the function of displaying the image of the optical unit 200.

The integrated liquid crystal display element / imaging element 31 operates as a liquid crystal panel with respect to light traveling in the direction from the polarizing plate 3A to the polarizing plate 3F. First, the light emitted from the light source unit 1 and passed through the illumination optical unit 2 enters the polarizing plate 3A in the direction from the polarizing plate 3A to the polarizing plate 3F. Since the polarizing plate 3A transmits light having a specific direction of polarization, the transmitted light of the polarizing plate 3A has a specific direction of polarization.

Next, the light transmitted through the polarizing plate 3A enters the liquid crystal layer 3D. The liquid crystal layer 3D is sandwiched between the pixel electrode 3B and the counter electrode 3E, and changes the orientation of the liquid crystal molecules according to the voltage applied between the pixel electrode 3B and the counter electrode 3E. The light incident on the liquid crystal layer 3D is rotated in polarization according to the orientation of the liquid crystal molecules in the liquid crystal layer 3D, and exits the liquid crystal layer 3D.

Then, the light emitted from the liquid crystal layer 3D enters the polarizing plate 3F. Light polarized in the same direction as the polarization axis of the polarizing plate 3F is transmitted through the polarizing plate 3F. By controlling an electric signal applied between the pixel electrode 3 B and the counter electrode 3 E, the integrated liquid crystal display element / imaging element 31 can detect the light incident on the integrated liquid crystal display element / imaging element 31 from the light source unit 1. Intensity modulation can be given.

The optical unit 200 can generate an image by driving the light source unit 1 and the integrated liquid crystal display element / imaging element 31 in synchronization. Hereinafter, an example of such driving will be described.

The frequency for updating the full color image is defined as the refresh rate, for example, 60 Hz. In the present embodiment, a red image, a green image, and a blue image are displayed in order within 1/60 seconds. Since switching between images of different colors is faster than the temporal resolution of the user's eyes, the user cannot distinguish between images of different colors and perceives them as full-color images.

First, the optical unit 200 displays a red image. Among the light sources constituting the light source unit 1, the red light source is turned on, and the green light source and the blue light source are turned off. The RGB value is obtained for each pixel of the image to be displayed, and the voltage between the pixel electrode 3B and the counter electrode 3E corresponding to the pixel is set according to the value of R. Thereby, the transmitted light of the integrated liquid crystal display element / imaging element 31 becomes an image composed only of the red component of the image to be displayed.

Next, the optical unit 200 displays a green image. Among the light sources constituting the light source unit 1, the green light source is turned on, and the red light source and the blue light source are turned off. The RGB value is obtained for each pixel of the image to be displayed, and the voltage between the pixel electrode 3B and the counter electrode 3E corresponding to the pixel is set according to the G value. Thereby, the transmitted light of the integrated liquid crystal display element / image pickup element 31 becomes an image composed only of the green component of the image to be displayed.

Next, the optical unit 200 displays a blue image. Among the light sources constituting the light source unit 1, the blue light source is turned on, and the red light source and the green light source are turned off. The RGB value is obtained for each pixel of the image to be displayed, and the voltage between the pixel electrode 3B and the counter electrode 3E corresponding to the pixel is set according to the value of B. Thereby, the transmitted light of the integrated liquid crystal display element / imaging element 31 becomes an image composed only of the blue component of the image to be displayed.

Display of one full-color image is completed by displaying the red, green, and blue images. When the next full color image is displayed, the red, green, and blue images may be displayed according to the image to be displayed. In the above-described video generation, display is performed in the order of red, green, and blue images, but the order is not limited thereto. For example, it is possible to display in a different order such as red, blue, and green.

In the above embodiment, the light source unit 1 includes a plurality of light sources, and the optical processing unit 3 is described as an example including a transmission type monochrome liquid crystal display element and an image sensor. However, this is only an example, and the light source unit 1 may include a white light source, and the optical processing unit 3 may include a transmissive color liquid crystal display element and an image sensor.

FIG. 21 is an example of a schematic diagram of a cross section of an integrated liquid crystal display element / image pickup device 35 including a transmissive color liquid crystal display device and an image pickup device. The integrated liquid crystal display element / image pickup device 35 includes a polarizing plate 3A, a pixel electrode 3B, a photodiode 3C, a liquid crystal layer 3D, a counter electrode 3E, a polarizing plate 3F,

color filters

3L, 3M, and 3N. A light shielding film 3P.

The color filter 3L transmits only red light, the color filter 3M transmits only green light, and the color filter 3N transmits only blue light. The optical unit 200 turns on the white light source that constitutes the light source unit 1, and according to the RGB value of the pixel of the image presented by the optical unit 200, between the pixel electrode 3B and the counter electrode 3E corresponding to each RGB of the pixel. By setting the voltage, an image can be generated.

The light emitted from the optical processing unit 3 enters the projection optical unit 4. The projection optical unit 4 plays a role of generating a virtual image perceived by the user from the video generated by the optical processing unit 3, and the light incident on the projection optical unit 4 from the optical processing unit 3 is incident on the user's eyeball. And serving as a light direction changing unit that changes the traveling direction of light.

FIG. 6A is a diagram illustrating the configuration of the projection optical unit 4 according to this embodiment. The projection optical unit 4 includes, for example, a convex lens 41A and a plane mirror 41B. The convex lens 41A is arranged such that the distance a (> 0) between the optical processing unit 3 and the convex lens 41A is shorter than the focal length f (> 0) of the convex lens 41A.

In such a case, the image generated by the convex lens 41A of the image generated by the optical processing unit 3 is a virtual image, and the size of the virtual image is f / (fa) times that of the image generated by the optical processing unit 3. Since f / (fa)> 1, the projection optical unit 4 can generate a virtual image larger than the image generated by the optical processing unit 3.

The flat mirror 41B changes the traveling direction of the light emitted from the convex lens 41A. The light reflected from the plane mirror 41B enters the user's eyeball 6.

FIG. 7 is a diagram showing the plane mirror 41B and the user's eyeball 6 from the viewpoint on the right side of the user. As shown in FIG. 7, the height h of the flat mirror 41B is smaller than the diameter of the user's pupil, which is a range in which an object such as the object 9 can be perceived visually (for example, 2 mm). Therefore, the light rays emitted from the object 9 that is the object on the extension line between the center of the crystalline lens 8 and the center of the plane mirror 41B pass through the top and bottom of the plane mirror 41B like the

light rays

91A and 91B, and the retina of the user. 7 can be reached. Thereby, the user can perceive the object 9 visually and can ensure see-through property.

As another form of the projection optical unit 4, the projection optical unit 4 may include a plurality of convex lenses or concave lenses and a plane mirror. By using a plurality of convex lenses or concave lenses, it is possible to reduce aberration caused by the lenses.

FIG. 6B is another configuration diagram of the projection optical unit 4 according to the present embodiment. For example, as shown in FIG. 6B, the projection optical unit 4 may include at least one lens and a triangular prism 41 C having an incident surface, a reflective surface, and an output surface. The incident surface, reflecting surface, and emitting surface are all flat. The height of the triangular prism 41C is smaller than the diameter of the user's pupil (for example, 2 mm). Thereby, see-through property can be secured. Note that the triangular prism 41C may have another shape such as a cube prism.

FIG. 6C is another configuration diagram of the projection optical unit 4 according to the present embodiment. For example, as shown in FIG. 6C, the projection optical unit 4 may be configured by a curved mirror 41D. The curved mirror 41D plays a role of generating a virtual image perceived by the user from an image generated by the optical processing unit 3, and so that light incident on the projection optical unit 4 from the optical processing unit 3 enters the user's eyeball. It plays both roles of changing the traveling direction of light. The height of the curved mirror 41D is smaller than the diameter of the user's pupil (for example, 2 mm). Thereby, see-through property can be secured.

As another form of the projection optical unit 4, the projection optical unit 4 may be configured by a prism having an incident surface, a reflection surface, and an output surface. At least one of the incident surface, reflecting surface, and emitting surface is a curved surface. The prism plays a role of generating a virtual image perceived by the user from the image generated by the optical processing unit 3, and the light incident on the user's eyeball from the optical processing unit 3 to the projection optical unit 4. It plays both roles of changing the direction of travel. The height of the prism is smaller than the diameter of the user's pupil (for example, 2 mm). Thereby, see-through property can be secured.

FIG. 6D is another configuration diagram of the projection optical unit 4 according to the present embodiment. As another means for ensuring the see-through property, it is possible to use a planar beam splitter 41E having a reflectance of 20% or more as shown in FIG. 6D, for example. When using the planar beam splitter 41E, even if the height of the planar beam splitter 41E is larger than the diameter of the pupil of the user, a part of the light beam emitted from the object on the extension line of the planar beam splitter 41E is transmitted. The user's retina 7 can be reached. Even with such a configuration, the user can visually perceive an object and can ensure see-through.

Also, as a means for securing another see-through property, it is possible to use a prism having a reflectance of 20% or more on the reflecting surface. When such a prism is used, even if the height of the prism is larger than the diameter of the pupil of the user, a part of the light beam emitted from the object on the extension line of the prism is transmitted. Can reach. Even with such a configuration, the user can visually perceive the object 9 and can ensure see-through.

In addition, it cannot be overemphasized that the structure of the projection optical part 4 which concerns on this embodiment is not limited to the said form, The form which combined the component of the said form may be sufficient. For example, the projection optical unit 4 may have other forms such as a single lens and a prism in which at least one of the entrance surface, the reflection surface, and the exit surface is a curved surface.

In FIG. 1, the light emitted from the projection optical unit 4 enters the user's eyeball 6 and then reaches the retina 7. The user perceives the light reaching the retina 7. At this time, the user perceives the video as if the virtual image exists in front of the eyes.

Next, acquisition of a captured image used for biometric authentication will be described. Hereinafter, the function of imaging the retina by the optical unit 200 will be described with reference to an example of performing retina authentication using a retina captured image.

In the function of displaying the video described above, a part of the light reaching the user's retina 7 from the light source unit 1 is scattered by the retina 7. Part of the scattered light enters the optical processing unit 3 through the crystalline lens 8 and the projection optical unit 4.

When the integrated liquid crystal display element / imaging element 31 described above with reference to FIG. 5 is used as the optical processing unit 3, the light incident on the integrated liquid crystal display element / imaging element 31 includes a polarizing plate 3F, a counter electrode 3E, and a liquid crystal layer. The light passes through 3D and enters the photodiode 3C. The light incident on the photodiode 3C is detected by the photodiode 3C because it travels in the direction from the polarizing plate 3F to the photodiode 3C.

As described above, in the video display device 10 according to the present embodiment, the optical processing unit 3 displays an image using the light output from the light source unit 1, and the light of the displayed image is the user's eyes. By receiving the reflected light reflected by, the retina that is an authentication target for performing biometric authentication processing using the eyes is imaged. With this configuration, the optical path is shared between the light for image (image) display and the light for retinal imaging, and the light source for image (image) display and the light source for retinal imaging of the optical unit 200 are used as the light source unit. Therefore, it is possible to reduce the size of an image display apparatus having an imaging function for imaging an authentication target for performing biometric authentication processing using eyes.

In addition, the projection optical unit 4 includes an element that changes the traveling direction of light so that light incident on the projection optical unit 4 from the optical processing unit 3 enters the user's eyeball. An attached video display device can be provided. However, the configuration in which the projection optical unit 4 includes an element that changes the traveling direction of light is not essential, and the projection optical unit 4 has a configuration in which light incident from the optical processing unit 3 is directly incident on the user's eyeball. Also good.

In the integrated liquid crystal display element / imaging element 31 according to the above embodiment, the case where the pixel electrode 3B and the photodiode 3C are integrally arranged as shown in FIG. 5 has been described as an example. With such a configuration, there is no need to consider an appropriate combination according to the performance of the pixel electrode 3B and the photodiode 3C, and the integrated liquid crystal display element / image pickup element 31 using the pixel electrode 3B and the photodiode 3C combined in advance. Can be configured easily. However, such a configuration is not essential, and the pixel electrode 3B and the photodiode 3C may be disposed apart from each other as long as the photodiode 3C is within the focal depth so that an image of the retina can be captured.

Next, with reference to FIG. 8 and FIG. 22, the retina authentication processing by the image processing unit 202 will be described. FIG. 8 is a diagram illustrating a retina authentication preparation image and a retina authentication image. FIG. 22 is a flowchart illustrating retinal authentication processing by the image processing unit 202.

As shown in FIG. 22, when the image processing unit 202 receives an instruction to start retinal authentication from the control unit 201, the image processing unit 202 acquires the retinal authentication preparation image 71A shown in FIG. The work image 71A is output to the optical unit 200 (S2201). The optical unit 200 presents the retina authentication preparation image 71A acquired from the image processing unit 202 to the user.

The retina authentication preparation image 71A is a predetermined image that gives an instruction to the user so that the user intentionally looks at a specific part of the video, and is stored in the information storage unit 203 in advance. . Specifically, for example, as shown in FIG. 8, the retina authentication preparation image 71 A includes a mark 71 B that serves as a guide for the user's eye-gaze position, and instructions 71 C such as “Look here. Line-of-sight guidance information for guiding the line of sight to a predetermined position is included.

The reason why such a retina authentication preparation image 71A is displayed is that the optical processing unit 3 acquires a clear captured image of the retina 7 of the user. In order to acquire a clear captured image of the user's retina 7, the lens 8 is formed so that the displayed image is formed on the retina 7 by intentionally viewing the displayed image. Therefore, the retina 7 and the optical processing unit 3 need to have a relationship between the image plane and the object plane. Therefore, the image processing unit 202 displays such a retina authentication preparation image 71A and guides the user to intentionally view the video.

The image processing unit 202 that has output the retina preparation image 71A to the optical unit 200 waits until a predetermined time elapses after the retina preparation image 71A is output (S2202 / YES). The predetermined time is sufficient time for the user to read the displayed instruction sentence 71C and move his / her line of sight to the mark 71B, for example, several seconds.

When a predetermined time has elapsed (S2202 / YES), the image processing unit 202 acquires the retina authentication image 72 shown in FIG. 8 from the information storage unit 203 and outputs it to the optical unit 200 (S2203). The optical unit 200 presents the retinal authentication image 72 acquired from the image processing unit 202 to the user.

The retina authentication image 72 is, for example, an image whose entire surface has the same color or a uniform intensity distribution on the retina, and is stored in advance in the information storage unit 203. Specifically, for example, as shown in FIG. 8, the entire surface is the same color image (indicated by dot hatching in FIG. 8). However, this is an example, and the retina authentication image 72 may be entirely white, or may be another color that is optimal for retina authentication.

The image processing unit 202 that has output the retina authentication image to the optical unit 200 acquires a captured image of the user's retina 7 captured by the optical processing unit 3 (S2204). In the processing of S2201, the retina authentication preparation image 71A is output to the optical unit 200 and presented to the user, so that the user intentionally sees a specific part of the video presented by the optical unit 200. State. Therefore, the retina 7 and the retinal imaging unit in the optical processing unit 3 have a relationship between the image plane and the object plane, and the captured image is an image of the retina.

FIG. 9 is an example of a retinal captured image acquired by the image processing unit 202. As shown in FIG. 9, a blood vessel pattern 73A on the retina is captured as a retinal captured image. The optical unit 200 outputs such a retinal captured image to the image processing unit 202.

FIG. 10 is another example of the retinal captured image acquired by the image processing unit 202. The blood vessel pattern on the retina differs depending on the individual, and the captured image of the image of the retina for another individual is, for example, a blood vessel pattern 73B different from the blood vessel pattern 73A as shown in FIG.

The image processing unit 202 determines whether or not the characteristics of the blood vessel pattern 73A of the acquired retinal captured image match the characteristics of the blood vessel pattern of the normal user stored in advance in the information storage unit 203 (S2205). When the characteristic of the blood vessel pattern 73A captured by the optical unit 200 matches the characteristic of the blood vessel pattern of the authorized user acquired from the information storage unit 203 (S2205 / YES), the retina authentication determination unit (not shown) in the image processing unit 202 Determines that the user is a regular user and authentication is successful, and outputs the determination result to the control unit 201 (S2206).

Also, the image processing unit 202 acquires an authentication success presentation image for presenting the authentication success from the information storage unit 203 and outputs the authentication success presentation image to the optical unit 200. The optical unit 200 presents the authentication success presentation image acquired from the image processing unit 202 to the user.

The image processing unit 202 that has output the determination result of the authentication success to the control unit 201 displays the browsing-limited information that is information that can be browsed by successful authentication in accordance with the command from the control unit 201 that has received the determination result. The information is acquired from the information storage unit 203 and output to the optical unit 200 (S2207). The optical unit 200 presents the browsing-limited information acquired from the image processing unit 202 to the user.

In the above-described embodiment, the image processing unit 202 has been described as an example in which the browsing restriction information is acquired from the information storage unit 203. In addition, the image processing unit 202 may acquire the browsing restriction information from the information processing apparatus 212 illustrated in FIG. In this case, the communication processing unit 204 acquires the browsing restriction information from the information processing device 212 in accordance with a command from the control unit 201 that has received the authentication success determination result, and outputs it to the control unit 201. The control unit 201 outputs the browsing-limited image acquired from the communication processing unit 204 to the image processing unit 202.

On the other hand, when the characteristic of the blood vessel pattern captured by the optical unit 200 does not match the characteristic of the blood vessel pattern of the authorized user acquired from the information storage unit 203 (S2205 / NO), the image processing unit 202 starts retinal authentication. Then, it is determined whether or not the predetermined number of times has been implemented (S2208). When the number of authentications is less than the predetermined number (S2208 / NO), the image processing unit 202 outputs the retina authentication preparation image 71A to the optical unit 200 again (S2201), and performs authentication again.

The retina image may be acquired differently depending on the user's line of sight at the time of retinal imaging, and depending on the acquired retinal imaging image, the captured blood vessel pattern may be obtained despite being a regular user. It may be determined that the image does not match the characteristics of the blood vessel pattern stored in the information storage unit 203. As described above, when the number of times of authentication is less than the predetermined number, by re-authenticating, it is possible to increase opportunities to match the line of retinal authentication correctly.

On the other hand, when the number of authentications is a predetermined number (S2208 / YES), the retina authentication determination unit of the image processing unit 202 determines that the user is not a regular user but has failed, and the determination result is sent to the control unit 201. It outputs (S2209). Further, the image processing unit 202 acquires an authentication failure presentation image for presenting an authentication failure from the information storage unit 203 and transmits the authentication failure presentation image to the optical unit 200. The optical unit 200 presents the authentication failure presentation image acquired from the image processing unit 202 to the user.

Note that it is desirable that the RGB values of, for example, 80% or more pixels of the retina authentication preparation image 71A are substantially the same as the RGB values of the same pixels of the retina authentication image 72. As a result, the burden on the user's eyes when switching between the retina authentication preparation image 71A and the retina authentication image 72 can be reduced, and at the same time, light / dark adaptation can be suppressed.

Further, in the above embodiment, as an example, a retinal authentication determination unit (not shown) included in the image processing unit 202 performs a retinal authentication process based on the characteristics of the blood vessel pattern of the user acquired from the information storage unit 203. explained. However, this is only an example, and the video display apparatus 10 may perform the retina authentication processing by acquiring the characteristics of the blood vessel pattern of the user stored in the information processing apparatus 212.

In addition, the video display apparatus 10 transmits the captured characteristics of the blood vessel pattern of the user to the information processing apparatus 212. The retinal authentication process may be performed by comparing the characteristics of the blood vessel pattern of the user received from the video display device 10 and the authentication result may be transmitted to the video display device 10.

Further, the video display device 10 according to the present embodiment can realize other functions using the captured image of the retina in addition to the retina authentication processing by appropriately capturing the retina. For example, a video viewing determination unit (not shown) in the image processing unit 202 determines whether or not the user is viewing the video presented by the optical unit 200 using the retinal image captured by the optical unit 200. It is also possible to control the brightness of the video presented by the optical unit 200 according to the determination result received by the control unit 201 from the image processing unit 202.

FIG. 11 is a diagram illustrating the relationship between the sharpness of the retina captured image and the brightness of the display image. When the user is viewing an image, the integrated liquid crystal display element / imaging element 31 and the retina 7 are in the relationship between the image plane and the object plane. Therefore, as shown in FIG. The blood vessel pattern of the image is a clear blood vessel pattern 73A.

On the other hand, when the user is not viewing the image and is looking farther or closer than the image, the integrated liquid crystal display element / imaging element 31 and the retina 7 are not in a relationship between the image plane and the object plane. 11, the blood vessel pattern of the retinal image captured by the optical unit 200 is a blurred blood vessel pattern 74 (indicated by a dotted line in FIG. 11).

From this, the image processing unit 202 quantifies the sharpness of the blood vessel pattern of the retinal image captured by the optical unit 200, and if the blood vessel pattern is clear beyond a certain threshold, the image viewing determination unit It is determined that the user is watching the video, and the determination result is output to the control unit 201.

On the other hand, when the blood vessel pattern is not clear, the image processing unit 202 determines that the video viewing determination unit does not view the video, and outputs the determination result to the control unit 201. .

In accordance with the determination result received from the image processing unit 202, the control unit 201 presents a bright image 75 when the user is viewing the video, and dark image 76 when the user is not viewing the image. Is issued to the optical unit 200. The optical unit 200 changes the brightness of the video presented by the optical unit 200 in accordance with the command received from the control unit 201. Thereby, when the user is not watching the video, it is possible to reduce the disturbance of the user's vision due to the video.

Note that the above-described video visibility determination unit has been described as an example in which it is determined whether or not the user is viewing the video based on the clearness of the blood vessel pattern of the retinal image captured by the optical unit 200. In addition, the video viewing determination unit can also determine whether the user is watching the video based on the movement of the blood vessel pattern.

FIG. 12 is a diagram illustrating another relationship between the amount of movement of the retina captured image and the brightness of the display image. For example, as shown in FIG. 12, the blood vessel pattern of the retinal image captured by the optical unit 200 when the user is looking at the top and bottom or left and right backgrounds of the video and is not looking at the video, When compared with the blood vessel pattern 73A of the retinal image captured by the optical unit 200, the blood vessel pattern 77 is shifted vertically or horizontally.

From this, the video viewing determination unit first obtains the blood vessel pattern or its feature when the user is viewing the video from the information storage unit 203 that is stored in advance as a reference blood vessel pattern. Then, the image viewing determination unit determines that the blood vessel pattern of the retinal captured image captured by the optical unit 200 or the feature thereof has not moved beyond a certain threshold value compared to the acquired reference blood vessel pattern or the feature thereof. , It is determined that the user is watching the video, and the determination result is output to the control unit 201.

On the other hand, when the blood vessel pattern of the retinal captured image captured by the optical unit 200 or a feature thereof moves beyond a certain threshold value compared to the acquired reference blood vessel pattern or the feature thereof, the video visual recognition determining unit moves. Then, it is determined that the user is not watching the video, and the determination result is output to the control unit 201. Thereby, the image viewing determination unit can determine whether the user is viewing the image based on the movement amount of the blood vessel pattern.

Note that the optical unit 200 not only changes the brightness of the displayed image in a binary manner, but also changes it in two or more steps according to the sharpness of the retina captured image or the movement amount of the blood vessel pattern and its features. It is also possible.

In addition, the video display apparatus 10 according to the present embodiment can obtain a user's gaze point on the video based on the movement amount of the blood vessel pattern of the retinal image captured by the optical unit 200, and serves as a pointing device. It can also be implemented. For example, the image processing unit 202 calculates the amount of movement of the mouse pointer from the amount of movement of the blood vessel pattern of the captured retinal image or its feature, and moves the mouse pointer on the video.

In addition, when the retina photographing is interrupted twice within one second by the user's blink, or when it is continuously interrupted for one second or more, for example, the image processing unit 202 causes the user to move the mouse. It is determined that the button has been clicked. Thereby, the role of a pointing device can be implemented without adding a new element.

In addition, the video display device 10 according to the present embodiment can also realize an automatic focus adjustment function when the user views video based on the clearness of the blood vessel pattern of the retinal image captured by the optical unit 200. is there. In this case, at least one part or all of the optical processing unit 3 and the projection optical unit 4 includes a movable unit.

The image processing unit 202 quantifies the sharpness of the blood vessel pattern in the retinal image captured by the optical unit 200 and outputs the result to the control unit 201. When the blood vessel pattern is unclear, the control unit 201 instructs the optical unit 200 to drive the movable unit. Thereby, an automatic focus adjustment function can be realized.

[Example 2]
Embodiment 2 of the present invention will be described below. In the second embodiment, the light source unit 1 includes a light source that emits visible light and a light source that emits infrared light. The point which images a retina by detecting is different from Example 1. By capturing the retina using infrared light, a clearer retina image can be acquired than when capturing the retina using visible light.

Hereinafter, a second embodiment of the present invention will be described with reference to FIGS. 5 and 13. In addition, the same code | symbol shall be attached | subjected to what has the same structure and function as Example 1, and the detailed description shall be abbreviate | omitted. Further, detailed description of the same procedure as that of the first embodiment is omitted.

Hereinafter, the function of displaying the image of the optical unit 200 will be described first. FIG. 13 is a diagram illustrating the configuration of the light source unit 1 according to the second embodiment of the invention. As shown in FIG. 13, the light source unit 1 according to the second embodiment of the present invention includes a light source 1A, a light source 1B, a light source 1C, and a light source 1D. The light sources 1A to 1D emit any one of red light, green light, blue light, and infrared light. Any light source may emit any light as long as the four lights are emitted by the four light sources without any shortage.

An example of a schematic diagram of the optical processing unit 3 of the present embodiment is represented in FIG. 5 which is the same as that of the first embodiment of the present invention. However, the photodiode 3C is configured to receive infrared light traveling in the direction of the photodiode 3C from the polarizing plate 3F and not to receive light traveling in the direction of the photodiode 3C from the polarizing plate 3A.

The light source in the optical unit 200 according to the second embodiment of the present invention lights up as follows when the refresh rate is set to 60 Hz, for example. During 1/60 seconds, the red light source, the green light source, the blue light source, and the infrared light source are turned on in order and exclusively. The light from the red light source, the green light source, and the blue light source is used to present an image to the user, and the light from the infrared light source is used to image the retina.

Here, in 1/60 seconds, the red light source, the green light source, the blue light source, and the infrared light source are turned on in order, but the infrared light source is not always turned on when the retina is not imaged. A red light source, a green light source, and a blue light source may be turned on in order. Thereby, the brightness of the image can be improved.

In addition, instead of the red light source, the green light source, the blue light source, and the infrared light source turning on in order within 1/60 seconds, the red light source, the green light source, and the blue light source are captured when the retina is imaged. The light source may not always be lit and the infrared light source may be lit constantly. Thereby, the time average intensity | strength of infrared light can be improved.

Furthermore, in 1/60 seconds, instead of the red light source, the green light source, the blue light source, and the infrared light source turning on in order, the infrared light source is always on, and the red light source, the green light source, The blue light source may be turned on in order. Thereby, the brightness of the said image | video and the time average intensity | strength of infrared light can be improved.

Next, the function of imaging the retina of the optical unit 200 will be described by taking as an example the case of performing retina authentication with a retina captured image. In the function of displaying the video, a part of the infrared light reaching the user's retina 7 from the light source unit 1 is scattered by the retina 7. Part of the scattered light passes through the crystalline lens 8 and the projection optical unit 4 and enters the photodiode 3 C in the integrated liquid crystal display element / image sensor 31. Since the light incident on the photodiode 3C is infrared light traveling in the direction from the polarizing plate 3F to the photodiode 3C, the photodiode 3C detects this infrared light.

Next, the light source at the time of retina authentication will be described. When the optical unit 200 presents the retina authentication preparation image 71A shown in FIG. 8, since the optical unit 200 does not capture the retina, only the visible light source is turned on and the infrared light source is not required to be turned on. .

When the optical unit 200 images the retina 7 of the user, the infrared light source is turned on. At that time, the red light source, the green light source, and the blue light source may not be turned on. The retinal imaging unit in the optical processing unit 3 can acquire a captured image of the retina by receiving the return light from the retina of the infrared light emitted from the infrared light source.

When the optical unit 200 images the retina 7 of the user, not only the infrared light source but also the visible light source may be turned on. Since light incident on the optical processing unit 3 from the infrared light source is subjected to intensity modulation by the optical processing unit 3 in the same manner as light incident on the optical processing unit 3 from other visible light sources, the image processing unit 202 displays the displayed image. Based on this information, a process for correcting the intensity modulation may be performed on the captured retinal image.

As in the first embodiment, the video display apparatus 10 according to the present embodiment can realize other functions using the retina captured image besides the retina authentication using the retina captured image. In addition, according to the present embodiment, it is possible to acquire a clear retinal captured image by performing retinal imaging using infrared light, compared to retinal imaging using visible light.

[Example 3]
Embodiment 3 of the present invention will be described below. In the third embodiment, an optical processing unit 32 having a configuration different from that of the first and second embodiments is used. According to this embodiment, it is possible to expand the choices of elements.

Hereinafter, a third embodiment of the present invention will be described with reference to FIG. In addition, the same code | symbol shall be attached | subjected to what has the structure and function same as Example 1 and Example 2, and the detailed description shall be abbreviate | omitted. Also, detailed description of the same procedures as those in the first and second embodiments will be omitted.

FIG. 14 is a diagram illustrating the configuration of the optical processing unit 32 according to the third embodiment of the present invention. As shown in FIG. 14, the optical processing unit 32 according to the third embodiment of the present invention includes a polarizing plate 32A, a polarizing beam splitter 32B, a liquid crystal display element 32C, a wave plate 32D, an image sensor 32E, It has.

The light emitted from the light source unit 1 and passed through the illumination optical unit 2 enters the polarizing plate 32A. Since the polarizing plate 32A transmits light having polarized light in a specific direction, the transmitted light of the polarizing plate 32A has polarized light A in a specific direction. The light transmitted through the polarizing plate 32A having the polarization A enters the polarization beam splitter 32B.

The reflection / transmission surface 32F of the polarization beam splitter reflects the light having the polarization A and transmits the light having the polarization B orthogonal to the polarization A. For this reason, the transmitted light of the polarizing plate 32A having the polarization A incident on the polarization beam splitter 32B is reflected by the reflection / transmission surface 32F and enters the liquid crystal display element 32C.

The liquid crystal display element 32C modulates the intensity of the light incident on the liquid crystal display element 32C based on a video signal presented by the optical unit 200. The light subjected to the intensity modulation is emitted from the liquid crystal display element 32C in the opposite direction to the incident direction after the polarization is changed from the polarization A to the polarization B. That is, the liquid crystal display element 32 C outputs light of an image (image) displayed by the optical unit 200.

The light emitted from the liquid crystal display element 32C is incident on the polarization beam splitter 32B. However, since the light emitted from the liquid crystal display element 32C has the polarization B, the light is transmitted through the reflection / transmission surface 32F of the polarization beam splitter 32B, and the wave plate 32D. Is incident on. The light transmitted through the wave plate 32D reaches the user's retina 7 through the projection optical unit 4 and the user's crystal 8.

Part of the light that reaches the user's retina 7 is scattered by the retina 7. Part of the scattered light enters the wave plate 32D through the user's crystalline lens 8 and the projection optical unit 4, and exits the wave plate 32D. The light emitted from the wave plate 32D is incident on the polarization beam splitter 32B. The wave plate 32D is configured such that the polarized light of the light emitted from the wave plate 32D and incident on the polarization beam splitter 32B becomes the polarization A.

Thus, the light emitted from the wave plate 32D and incident on the polarization beam splitter 32B is reflected by the reflection / transmission surface 32F and incident on the image sensor 32E. That is, the wave plate 32D changes the polarization of the light from the liquid crystal display element 32C to the user's retina 7 and the light from the user's retina 7 to the image sensor 32E. The polarization beam splitter 32B separates the optical path from the liquid crystal display element 32C to the user's retina 7 and the optical path from the user's retina 7 to the imaging element 32E. With such a configuration, the optical unit 200 can obtain a captured image of the retina from light received by the image sensor 32E.

According to the present embodiment, the liquid crystal display element 32C and the image pickup element 32E can independently select an optimum element, and the choice of elements can be expanded.

The light source unit 1 according to the present embodiment may be configured by a light source that emits visible light as in the first embodiment. Moreover, you may be comprised from the light source which discharge | releases visible light or infrared light like Example 2. FIG. When the light source unit 1 is composed of a light source that emits visible light, the imaging element 32E receives visible light. When the light source unit 1 is composed of a light source that emits visible light or infrared light, the imaging element 32E receives infrared light.

[Example 4]
Next, a fourth embodiment of the present invention will be described. The fourth embodiment is different from the first to third embodiments in that an optical processing unit 33 including a fiber scanning element 33B is used. According to the present embodiment, the video display device 10 with a retinal imaging function using the fiber scanning element 33B can be realized.

Hereinafter, a fourth embodiment of the present invention will be described with reference to FIGS. 15 to 17. In addition, the same code | symbol shall be attached | subjected to what has the same structure and function as Example 1 thru | or Example 3, and the detailed description shall be abbreviate | omitted. Further, detailed description of the same procedures as those in the first to third embodiments will be omitted.

The light source unit 1 according to the fourth embodiment of the present invention includes a light source 1A that emits red light, a light source 1B that emits green light, and a light source 1C that emits blue light. Here, each of the light source 1A, the light source 1B, and the light source 1C is a laser light source, and emits a light beam having the polarization A. The illumination optical unit 2 according to the present embodiment combines the light emitted from the light source and adjusts the illuminance distribution of the light so that the combined light is input to the optical processing unit as efficiently as possible.

FIG. 15 is a diagram illustrating the configuration of an optical processing unit 33 according to the fourth embodiment of the present invention. As shown in FIG. 15, the optical processing unit 33 according to the fourth embodiment of the present invention includes a fiber polarization beam splitter 33A, a fiber scanning element 33B, a wavelength plate 33C, and a light intensity measuring element 33D. ing.

FIG. 16 is a diagram illustrating an example of a fiber polarization beam splitter 33A. As shown in FIG. 16, the fiber polarization beam splitter 33A has optical input / output terminals of a terminal 33F, a terminal 33G, and a terminal 33H, and is orthogonal to the polarized light A when the polarized light A is input to the terminal 33F. When polarized light B is input to the terminal 33G, the light is emitted from the terminal 33H.

On the other hand, when polarized light A is input to the terminal 33H, the light is emitted from the terminal 33F, and when polarized light B is input to the terminal 33H, the light is emitted from the terminal 33G. Note that the polarization does not change when light passes through the fiber polarization beam splitter 33A.

The light emitted from the light source unit 1 enters the terminal 33F of the polarization beam splitter 33A. Since the light incident on the terminal 33F has the polarization A, it is emitted from the terminal 33H. The light emitted from the terminal 33H enters the fiber scanning element 33B.

FIG. 17 is a diagram illustrating an example of the fiber scanning element 33B. The light emitted from the terminal 33H enters the terminal 33M shown in FIG. The fiber scanning element 33B has a movable part (not shown), and scans the fiber terminal 33N in two axial directions substantially orthogonal to the traveling direction of light in the fiber, as indicated by an arrow 33L in FIG. The light incident on the fiber scanning element 33B is emitted from the terminal 33N.

The optical unit 200 can generate an image at the position of the virtual screen 33Q by driving the light source unit 1 and the fiber scanning element 33B in synchronization. Hereinafter, an example of such driving will be described.

The refresh rate is set to 60 Hz, for example. The fiber scanning element 33B has a fiber terminal 33N so that the emitted light 33P of the fiber scanning element 33B irradiates all the pixels of the image generated at the position of the virtual screen 33Q within 1/60 seconds. Scan.

The optical unit 200 changes the intensity of light emitted by the light source 1A, the light source 1B, and the light source 1C according to the color of the pixel irradiated with the emitted light 33P in the image presented by the optical unit 200.

The light emitted from the fiber scanning element 33B passes through the wave plate 33C. Here, the wavelength plate 33C changes the polarization of light. Details of the function of the wavelength plate 33C will be described later. The light transmitted through the wave plate 33 C reaches the user's retina 7 through the projection optical unit 4 and the user's crystal 8. At this time, the user perceives the virtual image generated by the projection optical unit 4 of the image generated by the fiber scanning element 33B at the position of the virtual screen 33Q as existing in front of the eyes.

The optical unit 200 according to the present embodiment can acquire an image of the retina as follows. A part of the light reaching the user's retina 7 is scattered by the retina 7. A part of the scattered light enters the wave plate 33C through the user's crystal 8 and the projection optical unit 4, and exits the wave plate 33C. The wave plate 33 C is configured such that the polarized light of the light emitted from the wave plate 33 C through the user's crystal 8 becomes the polarization B. The light emitted from the wave plate 33C reaches the position of the virtual screen 33Q.

When the user is viewing the video presented by the optical unit 200, the user's retina 7 and the virtual screen 33Q are in the relationship between the object plane and the image plane. An image of the retina 7 is formed on the virtual screen 33Q.

The light that has reached the position of the virtual screen 33Q is incident on the terminal 33N of the fiber scanning element 33B shown in FIG. The light incident on the fiber scanning element 33B from the terminal 33N exits from the terminal 33M and enters the terminal 33H of the fiber polarization beam splitter 33A shown in FIG.

Since the light incident on the terminal 33H has the polarization B, it is emitted from the terminal 33G and enters the light intensity measuring element 33D shown in FIG. The light intensity measuring element 33D measures the intensity of incident light. The intensity of the light obtained by the light intensity measuring element 33D is processed in synchronization with the scanning of the fiber terminal 33N shown in FIG. 17, whereby the intensity of each pixel of the image of the retina 7 on the virtual screen 33Q. Means. Accordingly, the optical unit 200 can acquire an image of the retina by forming an image from the light intensity measured by the light intensity measuring element 33D in synchronization with the scanning of the terminal 33N.

That is, the fiber scanning element 33B outputs image light, and the wave plate 33C includes light from the fiber scanning element 33B to the user's retina 7 and light from the user's retina 7 to the light intensity measuring element 33D. The polarization is changed, and the fiber polarization beam splitter 33A separates the optical path from the fiber scanning element 33B to the user's retina 7 and the optical path from the user's retina 7 to the light intensity measurement element 33D. According to the present embodiment, a video display device with a retinal imaging function using the fiber scanning element 33B can be realized.

[Example 5]
Next, a fifth embodiment of the present invention will be described. The fifth embodiment is different from the first to fourth embodiments in that an iris is imaged. Hereinafter, a fifth embodiment of the present invention will be described with reference to FIGS. In addition, the same code | symbol shall be attached | subjected to what has the same structure and function as Example 1 and Example 4, and the detailed description shall be abbreviate | omitted. Also, detailed description of the same procedures as those in the first and fourth embodiments will be omitted.

FIG. 18 is a diagram illustrating the configuration of the optical unit 200 of the video display apparatus 10 according to the fifth embodiment of the invention. As shown in FIG. 18, the optical unit 200 according to this embodiment includes a light source unit 1, an illumination optical unit 2, an optical processing unit 34 that combines an image generation unit and an iris imaging unit, and a projection optical unit 4. It is equipped with. At least one of the optical processing unit 34 and the projection optical unit 4 includes an adjustment unit that is a mechanism for adjusting the projection relationship so that an iris image is formed by the iris imaging unit.

Further, as shown in FIG. 18, the light emitted from the projection optical unit 4 reaches the user's eyeball 6, and the light emitted from the user's eyeball 6 enters the projection optical unit 4. At that time, the optical unit 200 according to the present embodiment acquires a captured image of the user's iris 101.

The light source unit 1 according to the present embodiment may be composed of a light source that emits visible light as in the first embodiment. Moreover, you may be comprised from the light source which discharge | releases visible light or infrared light like Example 2. FIG. The light emitted from the light source unit 1 enters the optical processing unit 34 through the illumination optical unit 2.

For example, as shown in FIG. 4D, the projection optical unit 4 includes a lens 41A and a planar beam splitter 41E having a reflectance of 20% or more.

FIG. 19 is a configuration diagram of the optical processing unit 34 according to the fifth embodiment of the present invention. As shown in FIG. 19, the optical processing unit 34 includes a polarizing plate 32A, a polarizing beam splitter 32B, a liquid crystal display element 32C, a wave plate 34D, an imaging element 32E, and a lens 34G.

The light emitted from the optical processing unit 34 reaches the user's eyeball 6 via the projection optical unit 4. Part of the light reaching the user's eyeball 6 passes through the user's crystalline lens 8, and another part of the light reaching the user's eyeball 6 reaches the user's iris 101.

The light that reaches the user's crystalline lens 8 passes through the user's crystalline lens 8 and reaches the user's retina 7. The user perceives the light reaching the user's retina 7. A part of the light reaching the user's iris 101 is scattered by the user's iris 101 and enters the wave plate 34D of the optical processing unit 34 through the projection optical unit 4.

The light emitted from the wave plate 34D enters the polarization beam splitter 32B. Here, the wave plate 34 D is configured such that the polarized light of the emitted light is polarized light A. Thus, the light that exits the wave plate 32D and enters the polarization beam splitter 32B is reflected by the reflection / transmission surface 32F. The light reflected by the reflection / transmission surface 32F passes through the lens 34G and enters the image sensor 32E.

When the user is viewing the video presented by the optical unit 200, the user's retina 7 and the image sensor 32E have a relationship between the object plane and the image plane. In this embodiment, the user's iris It is necessary to image 101 clearly. Therefore, the lens 34G serves as an adjustment unit that adjusts the projection relationship so that the user's iris 101 and the image sensor 32E have a relationship between the object plane and the image plane. Thereby, the image pick-up element 32E can image the user's iris 101 clearly.

In the above-described embodiment, the projection optical unit 4 has been described by taking the configuration shown in FIG. 4D as an example, but this is an example, and another form may be employed. FIG. 25 is a diagram illustrating the configuration of the projection optical unit 4 according to the fifth embodiment of the invention. As shown in FIG. 25, the projection optical unit 4 may include a lens 41A and a curved beam splitter 41F having a reflectance of 20% or more.

FIG. 26 shows a reflection surface of the curved beam splitter 41F. The light that has reached the central portion 41G of the curved beam splitter 41F from the optical processing portion 34 reaches the user's crystalline lens 8. The light reaching the outer peripheral portion 41H of the curved beam splitter 41F from the optical processing portion 34 reaches the user's iris 101. The outer peripheral portion 41H of the curved beam splitter 41F has a non-zero curvature in order to collect the light that has reached the outer peripheral portion 41H of the curved beam splitter 41F from the optical processing unit 34 on the user's iris 101. Thereby, the illumination efficiency of a user's iris 101 can be improved. The central portion 41G of the reflecting surface of the curved beam splitter 41F plays a role of reflecting the image generated by the optical processing unit 34.

Next, the procedure for iris authentication by the image processing unit 202 will be described. An iris authentication determination unit (not shown) in the image processing unit 202 determines whether or not the user is a regular user. The image processing unit 202 acquires the iris image captured by the optical unit 200 from the optical unit 200, and determines whether the feature of the iris pattern matches the feature of the regular user's iris pattern acquired from the information storage unit 203. .

When the feature of the iris pattern captured by the optical unit 200 matches the feature of the regular user's iris pattern acquired from the information storage unit 203, the iris authentication determination unit determines that the user is a regular user and the authentication is successful. If they do not match, the iris authentication determination unit determines that the user is not a regular user but an authentication failure. Note that iris authentication may be attempted a plurality of times as in the first embodiment.

FIG. 20 is a diagram illustrating an iris authentication preparation image. As shown in FIG. 20, using a plurality of iris

authentication preparation images

171A and 172A provided with marks 171B and 172B that serve as references for the user's eye position at different positions, iris authentication is performed for each iris authentication preparation image. May be performed. Thereby, the precision of iris authentication can be improved.

In this embodiment, the case where the optical unit 200 includes the lens 34G has been described as an example in order to adjust the projection relationship so that the iris image is formed by the iris imaging unit in the optical processing unit 34. In addition, a part or all of at least one of the optical processing unit 34 and the projection optical unit 4 may include a movable unit. For example, the projection optical unit 4 includes a movable unit that moves the convex lens 41A of the projection optical unit 4 shown in FIG. 6A, and the optical unit 200 operates the movable unit to project the iris 101 and the image sensor 32E. Adjust the relationship. That is, the convex lens 41A included in the projection optical unit 4 functions as an adjustment unit that adjusts the projection relationship so that the user's iris 101 and the image sensor 32E have a relationship between the object plane and the image plane.

The image display device 10 with an iris imaging function provided with a movable part operates the movable part as follows. When the optical unit 200 presents a video to the user, the image processing unit 202 is a movable unit in which the video generation unit in the optical processing unit 34 and the user's retina 7 have a relationship between the object plane and the image plane. A predetermined position is acquired from the information storage unit 203, and an instruction is given to the optical unit 200 to move the movable unit to the acquired position.

The optical unit 200 operates the movable unit according to the command. When the optical unit 200 captures the user's iris 101, information on a predetermined position of the movable unit in which the user's iris 101 and the iris image capturing unit in the optical processing unit 34 are in the relationship between the object plane and the image plane. Obtained from the storage unit 203 and instructs the optical unit 200 to move the movable unit to the acquired position. The optical unit 200 operates the movable unit according to this command. Thereby, the optical unit 200 can present an image to the user and can clearly image the user's iris 101.

In the description of the movable unit control, the image processing unit 202 instructs the optical unit 200 to move the movable unit to the acquired position based on the predetermined position of the movable unit acquired from the information storage unit 203. Although done, the present invention is not limited to this. For example, when the optical unit 200 captures the user's iris 101, the image processing unit 202 quantifies the sharpness of the iris pattern of the captured image acquired from the optical unit 200, and the optical unit 200 increases the sharpness. May be instructed to move the movable part. Further, according to the amount of movement of the movable unit, other movable units may be operated so that the image generation unit in the optical processing unit 34 and the user's retina 7 have a relationship between the object plane and the image plane. .

As described above, in the video display device 10 according to the present embodiment, the optical processing unit 3 displays an image using the light output from the light source unit 1, and the light of the displayed image is the user's eyes. By receiving the reflected light reflected by the lens, an image that is an authentication target for performing biometric authentication processing using the eyes is picked up. Since the optical path is shared by the light and the light source for image display and the light source for iris imaging of the optical unit 200 can be shared as the light source unit 1, authentication for performing biometric authentication processing using the eyes An image display apparatus having an imaging function for imaging a target can be made smaller than before.

In addition, the projection optical unit 4 includes an element that changes the traveling direction of light so that light incident on the projection optical unit 4 from the optical processing unit 3 enters the user's eyeball. An attached video display device can be provided. However, the configuration in which the projection optical unit 4 includes an element that polarizes the traveling direction of light is not essential, and the projection optical unit 4 has a configuration in which light incident from the optical processing unit 3 enters the user's eyeball as it is. Also good.

In the above-described embodiment, the case where the optical processing unit 3 or the projection optical unit 4 includes adjustment units such as the lens 34G and the convex lens 41A, and the user's iris 101 can be clearly imaged has been described as an example. However, this configuration is not essential, and the user's iris 101 can be imaged even when there is no adjustment unit.

DESCRIPTION OF SYMBOLS 1 Light source part 1A-1D Light source 2 Illumination optical part 3 Optical processing part 3A Polarizing plate 3B Pixel electrode 3C Photodiode 3D Liquid crystal layer

3E Opposite electrode

3F Polarizing plate 3L-N Color filter 3P Light shielding film 4 Projection optical part 6 Eyeball 7 Retina 8 Crystal 9 Object 10 Video display device 21A Light tunnel 21B Lens 22A Diffuser 23A-

C Lens

23D, 23E Dichroic mirror 23F Micro lens array 23G Lens 23H Relay lens 31 Integrated liquid crystal display element / image sensor 32 Optical processing unit 32A Polarizing plate 32B Polarization beam splitter 32C Liquid crystal display element

32D Wave plate

32E Image sensor 32F Reflective transmission surface 33 Optical processing unit 33A Fiber polarization beam splitter 33B Fiber scanning element 33C Wave plate 33D Light intensity measurement element 34 Optical processing unit 34D Wave plate 4G lens 35 Integrated liquid crystal display device / imaging device 41A Convex lens 41B Plane mirror 41C Prism 41D Curved mirror 41E Plane beam splitter 100 Optical unit 101 Iris 200 Optical unit 201 Control unit 202 Image processing unit 203 Information storage unit 204 Communication processing unit 205 Communication Input / output section

Claims

A light source unit that outputs light;
An image processing for displaying an image using the light output from the light source unit and an optical processing unit for performing an imaging process for imaging an authentication target for performing a biometric authentication process using the eyes, and
The optical processing unit images the authentication target by receiving reflected light in which the light of the displayed image is reflected by a user's eyes.
The optical processing unit includes a pixel electrode and an image sensor,
The pixel electrode generates the image;
The image sensor receives only reflected light in which the light of the image is reflected by the user's eyes,
The image display apparatus according to claim 1, wherein the imaging element is disposed within a focal depth of an eye image by the reflected light.
The optical processing unit includes a liquid crystal display element, a polarization beam splitter, a wave plate, and an imaging element,
The liquid crystal display element outputs the light of the image,
The wave plate changes the polarization of the light from the liquid crystal display element to the user's eyes and the light from the user's eyes to the imaging element,
The image display apparatus according to claim 1, wherein the polarization beam splitter separates an optical path from the liquid crystal display element to the eyes of the user and an optical path from the eyes of the user to the imaging element. .
The image display apparatus according to claim 1, wherein the optical processing unit displays a predetermined image for imaging the authentication target.
The image display apparatus according to claim 4, wherein the predetermined image has the same color on the entire surface.
The predetermined image includes line-of-sight guidance information for guiding a user's line of sight to a predetermined position;
The said optical processing part images the said authentication object by receiving the reflected light reflected by the eyes of the user who perceived the said predetermined image according to the said visual guidance information. The image display device described.
A light direction changing unit that changes a traveling direction of the light so that light of the image received from the optical processing unit is incident on the eyes of the user;
The image display device according to claim 1, wherein the light direction changing unit is smaller than a range in which the user can perceive an object visually.
A light direction changing unit that changes a traveling direction of the light so that light of the image received from the optical processing unit is incident on the eyes of the user;
The image display device according to claim 1, wherein the light direction changing unit has a light reflectance equal to or greater than a predetermined value.
The optical processing unit includes a fiber scanning element, a fiber polarization beam splitter, a wave plate, and a light intensity measuring element for measuring the intensity of received light,
The fiber scanning element outputs the light of the image,
The wave plate changes the polarization of the light from the fiber scanning element to the user's eyes and the light from the user's eyes to the light intensity measuring element,
The optical fiber polarization beam splitter separates an optical path from the fiber scanning element to the user's eye and an optical path from the user's eye to the light intensity measurement element. Image display device.
The relationship between the object surface and the image surface of the user's eye retina and the optical processing unit on which the light of the image is incident, and the relationship between the object surface and the image surface of the user's eye iris and the optical processing unit Including an adjustment unit that adjusts to
The image display apparatus according to claim 1, wherein the optical processing unit images an iris of the user's eye as the authentication target.
The optical processing unit includes a liquid crystal display element, a polarization beam splitter, a wave plate, and an imaging element,
The liquid crystal display element outputs the light of the image,
The wave plate changes the polarization of the light from the liquid crystal display element to the user's eyes and the light from the user's eyes to the imaging element,
The polarizing beam splitter separates an optical path from the liquid crystal display element to the user's eyes and an optical path from the user's eyes to the imaging element,
The image display apparatus according to claim 10, wherein the adjustment unit is a lens disposed between the polarization beam splitter and the imaging element.
A projection optical unit that projects the light of the image onto the retina of the user's eye;
The image display apparatus according to claim 10, wherein the adjustment unit is a lens included in the projection optical unit.
An image display unit that displays an image using light output from the light source unit;
An imaging unit that images an authentication target for performing biometric authentication processing using eyes, and
The optical device picks up the authentication target by receiving reflected light in which the light of the displayed image is reflected by a user's eyes.
A light source unit that outputs light;
An image display unit that displays an image based on light output from the light source unit;
An imaging unit for imaging an authentication target for performing biometric authentication processing using eyes;
Including
The image pickup device picks up the authentication target by receiving reflected light in which the light of the displayed image is reflected by a user's eyes.