CN114326104B - Augmented reality glasses with structured light detection function - Google Patents

Abstract

The invention provides an augmented reality glasses with a structured light detection function, which comprises a laser projector, a glasses lens, at least one first diffraction optical element film, an invisible light camera and a second diffraction optical element film. The laser projector is used for emitting at least one invisible light beam and an image light beam. The at least one first diffractive optical element film is disposed on the eyeglass lens. The first diffraction optical element is used for diffracting the invisible light beam into a structural light beam, wherein the structural light beam is transmitted to the object to be detected so as to form a light pattern on the object to be detected. The invisible light camera is used for shooting a light pattern on an object to be detected. The second diffractive optical element film is disposed on the eyeglass lens, and the second diffractive optical element film is used for transmitting the image light beam to eyes.

Description

Augmented reality glasses with structured light detection

technical field

The invention relates to an augmented reality display, in particular to augmented reality glasses with a structured light detection function.

Background technique

With the progress of display technology, virtual reality (virtual reality) display technology and augmented reality (augmented reality) display technology are gradually popularized, and have been fully researched and developed. Virtual reality display technology allows users to immerse themselves in the virtual world displayed on the monitor, and can display images with a three-dimensional effect. Augmented reality display technology not only allows users to see images in the virtual world, but also objects in the real world, and even enables the images in the virtual world to interact with objects in the real world.

When the display provides images of the virtual world (ie, virtual images) to the user's eyes, if the system can know the position and rotation angle of the eyes, it can provide corresponding virtual images and have a better display effect. However, when adding an eye tracker to an augmented reality display device, there are disadvantages that the number of components is too large and the system is too complicated.

Contents of the invention

The present invention is directed to an augmented reality glasses with a structured light detection function, which integrates a structured light light source into a laser projector for displaying images, thus having a relatively simple structure and a small number of components.

An embodiment of the present invention provides an augmented reality glasses with a structured light detection function, which is suitable for wearing in front of the eyes. The augmented reality glasses with structured light detection function include a laser projector, glasses lenses, at least one first diffractive optical element (DOE) film, an invisible light camera and a second diffractive optical element film. The laser projector is used to emit at least one invisible beam and image beam, and the spectacle lens is arranged on the paths of the invisible beam and the image beam. The at least one first diffractive optical element film is disposed on the spectacle lens and is located on the path of the invisible light beam. The first diffractive optical element is used for diffracting the invisible beam into a structured beam, wherein the structured beam is transmitted to the object to be tested to form a light pattern on the object to be tested. The invisible light camera is used to capture the light pattern on the object under test. The second diffractive optical element film is arranged on the spectacle lens and is located on the path of the image beam, and the second diffractive optical element film is used to transmit the image beam to the eyes.

In the augmented reality glasses with a structured light detection function according to the embodiment of the present invention, the laser projector emits an invisible beam in addition to the image beam, and the invisible beam is diffracted by the first diffractive optical element to form a structured beam, which is used to detect the object to be tested. That is to say, the embodiment of the present invention integrates the light source of structured light into the laser projector for displaying images, so the augmented reality glasses with structured light detection function can have a relatively simple structure and a small number of components, and simultaneously achieve the functions of displaying images and detecting objects under test.

Description of drawings

FIG. 1 is a schematic diagram of the optical path of augmented reality glasses with a structured light detection function according to an embodiment of the present invention;

Fig. 2 is a schematic diagram of the optical path of the laser projector in Fig. 1;

Fig. 3 is a schematic diagram of the structured beam of Fig. 1 forming a light pattern on the eye;

Fig. 4 shows the scanning paths and positions of the red light beam, green light beam, blue light beam and infrared light beam on the spectacle lens of Fig. 2;

FIG. 5 is a schematic perspective view of an embodiment of the first diffractive optical element film in FIG. 1;

FIG. 6 is a schematic perspective view of another embodiment of the first diffractive optical element in FIG. 1;

7 is a schematic diagram of the optical path of augmented reality glasses with structured light detection function according to another embodiment of the present invention;

Fig. 8 is a schematic front view of the spectacle lens in Fig. 7 viewed from the line of sight of the eyes;

Fig. 9 is a schematic diagram of the optical path of the laser projector in Fig. 7;

Fig. 10 is a schematic front view of the glasses lens in the augmented reality glasses with structured light detection function viewed from the line of sight of the eyes according to another embodiment;

Fig. 11 is a schematic front view of the spectacle lens in the augmented reality glasses with structured light detection function viewed from the line of sight of the eyes according to another embodiment;

FIG. 12 is a schematic diagram of an optical path of augmented reality glasses with a structured light detection function according to another embodiment of the present invention.

Explanation of reference signs

50: eyes

60: External objects

100, 100b, 100d: AR glasses with structured light detection

110: spectacle lens

112: surface

120, 120a, 120b, 120c, 120d, 124b, 124c, 126b, 126c, 128c, 129c: first diffractive optical element film

122, 122a: microstructure

130: Invisible light camera

140: Second diffractive optical element film

150: spectacle frame

160: Processor

200:Laser projector

201: light pattern

202, 202b, 2021, 2022: invisible beams

202': Infrared beam

203: Structured Beam

204: image beam

210: Infrared laser light source

220: laser source

221: red beam

222: red laser source

223: Green Beam

224: Green laser source

225: blue beam

226: Blu-ray laser source

230: Combined light module

232, 234, 236: dichroic mirror

240: scanning mirror

I1: light spot

I2: Red light scanning path

I3: Green light scanning path

I4: Blu-ray scanning path

Detailed ways

Reference will now be made in detail to the exemplary embodiments of the present invention, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers will be used in the drawings and description to refer to the same or like parts.

FIG. 1 is a schematic diagram of the optical path of augmented reality glasses with structured light detection function according to an embodiment of the present invention. FIG. 2 is a schematic diagram of the optical path of the laser projector in FIG. 1 , and FIG. 3 is a schematic diagram of the structured light beam in FIG. 1 forming a glazing pattern on the eye. Referring to FIGS. 1 to 3 , the augmented reality glasses 100 with structured light detection function of this embodiment are suitable for wearing in front of eyes 50 . The augmented reality glasses 100 with structured light detection function include a laser projector 200 , spectacle lenses 110 , at least one first diffractive optical element film 120 (a first diffractive optical element film 120 is taken as an example in FIG. 1 ), an invisible light camera 130 and a second diffractive optical element film 140. The laser projector 200 is used to emit at least one invisible beam 202 (in FIG. 1 , an invisible beam 202 is taken as an example) and an image beam 204 . The spectacle lens 110 is disposed on the path of the invisible beam 202 and the image beam 204 . The first diffractive optical element film 120 is disposed on the spectacle lens 110 and located on the path of the invisible light beam 202 . The first diffractive optical element 120 is used to diffract the invisible beam 202 into a structured beam 203 , such as reflective diffraction, wherein the structured beam 203 is transmitted to the object to form a light pattern on the object. In this embodiment, the object to be measured is the eye 50 , and the structured light beam 203 forms a light pattern 201 on the eye 50 .

The invisible light camera 130 is used to photograph the light pattern 201 on the object under test. The second diffractive optical element film 140 is disposed on the spectacle lens 110 and is located on the path of the image beam 204. The second diffractive optical element film 140 is used to transmit the image beam 204 to the eye 50, for example, to diffract the image beam to the eye 50, so that the eye 50 can see the image frame to be displayed by the laser projector 200, which is presented as a virtual image located in front of the eye 50. The diffraction of the image beam 204 by the second diffractive optical element film 140 is, for example, reflective diffraction. In addition, in this embodiment, the first diffractive optical element film 120 and the second diffractive optical element film 140 are disposed on the surface 112 of the spectacle lens 110 facing the eye 50 . In addition, the second diffractive optical element film 140 may be a general diffractive optical element film or a holographic optical element (HOE) film.

In this embodiment, the laser projector includes an infrared laser source 210 , multiple laser sources 220 of different colors, a light combining module 230 and a scanning mirror 240 . The infrared laser source 210 is used to emit infrared beams 202', and the laser sources 220 of different colors are used to emit multiple beams of different colors. In this embodiment, the laser sources 220 of different colors include a red laser source 222 , a green laser source 224 and a blue laser source 226 , which respectively emit a red beam 221 , a green beam 223 and a blue beam 225 . In this embodiment, the infrared laser source 210 and the laser sources 220 of different colors are all laser diodes, and the beams emitted by them are all laser beams.

The light combining module 230 is disposed on the path of the infrared beam 202' and the beams of different colors (such as the red beam 221, the green beam 223, and the blue beam 225) to combine the paths of the infrared beam 202' and the beams of different colors. The scanning mirror 240 is arranged on the path of the infrared beam 202' from the light combination module 230 and the beams of different colors, wherein the scanning mirror 240 is suitable for rotation, so that the infrared beam 202' forms an invisible beam 202 irradiated on the first diffractive optical element film 120, and makes these beams of different colors form an image beam 204 scanned on the second diffractive optical element film 140. In addition, in this embodiment, the invisible light camera 130 is, for example, an infrared light camera.

FIG. 4 shows the scanning paths and positions of the red light beams, green light beams, blue light beams and infrared light beams on the spectacle lens in FIG. 2 . Please refer to Fig. 1, Fig. 2 and Fig. 4, by the rotation of scanning mirror 240, when scanning mirror 240 rotates to appropriate angle, infrared light laser source 210 can emit infrared beam 202 ' at this moment, but these laser sources 220 of different colors do not emit red beam 221, green beam 223 and blue beam 225, and infrared beam 202 ' is the invisible beam 202 that irradiates on the first diffractive optical element film 120 at this moment, and on the first diffractive optical element film 120 The light spot I1 is formed, and then the first diffractive optical element film 120 diffracts the infrared beam 202' into a structured beam 203. In addition, in most other time, the scanning mirror 240 is constantly rotating from other angles. At this time, these different colors of laser sources 220 can emit red beam 221, green beam 223 and blue beam 225, while the red light laser source 210 does not emit infrared beam 202 ', then red beam 221, green beam 223 and blue beam 225 can be in The second diffraction optical component 140 forms red light scanning path i2, green light scanning path i3, and Blu -ray scanning path i4, respectively. In addition, with the continuous rotation of the scanning mirror 240, the respective intensities of the red light beam 221, the green light beam 223, and the blue light beam 225 can be continuously changed, so that the color and brightness on these scanning paths can be changed, and the second diffractive optical element film 140 diffracts the red light beam 221, the green light beam 223, and the blue light beam 225 to the eye 50, so that the eye 50 can see a color image.

In addition, besides being able to see the color image, the eyes 50 can also see the external scene through the spectacle lens 110, so as to achieve the effect of augmented reality. The spectacle lens 110 is, for example, a myopia spectacle lens, a hyperopia spectacle lens, a presbyopic spectacle lens, or a plano spectacle lens.

In this embodiment, the light combination module 230 may include a plurality of dichroic mirrors or a plurality of dichroic prisms. For example, the light combining module 230 includes a dichroic mirror 232, a dichroic mirror 234, and a dichroic mirror 236, wherein the dichroic mirror 232 is adapted to allow the infrared beam 202′ to pass through to the dichroic mirror 234, and the dichroic mirror 232 is adapted to reflect the blue beam 225 to the dichroic mirror 234. The dichroic mirror 234 is adapted to transmit the infrared beam 202' and the blue beam 225 to the dichroic mirror 236, and the dichroic mirror 234 is adapted to reflect the green beam 223 to the dichroic mirror 236. The dichroic mirror 236 is adapted to transmit the infrared beam 202', the blue beam 225, and the green beam 223 to the scanning mirror 240, and the dichroic mirror 236 is adapted to reflect the red beam 221 to the scanning mirror 240. In this way, the light combination module 230 can combine the paths of the red light beam 221, the green light beam 223, the blue light beam 225 and the infrared light beam 202'.

In this embodiment, the augmented reality glasses 100 with structured light detection function further include a spectacle frame 150, and the laser projector 200, the spectacle lens 110 and the invisible light camera 130 are disposed on the spectacle frame 150, wherein the laser projector 200 can be disposed on the temple of the spectacle frame 150, and the invisible light camera 130 can be disposed near the center of the spectacle frame 150 near the nose pad. In addition, in this embodiment, the augmented reality glasses 100 with a structured light detection function further includes a processor 160, which is electrically connected to the invisible light camera 130, and is used to calculate the position of the object under test (the eye 50 in this embodiment) according to the light pattern 201 captured by the invisible light camera 130 (as shown in FIG. 3 ), for example, calculate the position of the eye 50 and its gaze direction. Since the light pattern 201 will be deformed or shifted along with the concave-convex surface of the eye 50 , the processor 160 can calculate the position of each position on the eye in the three-dimensional space according to these deformations or shifts. The processor 160 can also be configured on the spectacle frame 150 , for example, on the temple of the spectacle frame 150 .

In one embodiment, the processor 160 is, for example, a central processing unit (central processing unit, CPU), a microprocessor (microprocessor), a digital signal processor (digital signal processor, DSP), a programmable controller, a programmable logic device (programmable logic device, PLD) or other similar devices or a combination of these devices, the present invention is not limited thereto. In addition, in one embodiment, each function of the processor 160 may be implemented as a plurality of program codes. These program codes are stored in a memory, and are executed by the processor 160 . Alternatively, in one embodiment, each function of the processor 160 may be implemented as one or more circuits. The present invention does not limit the implementation of the functions of the processor 160 by means of software or hardware.

In the augmented reality glasses 100 with structured light detection function in this embodiment, the laser projector 200 emits an invisible beam 202 in addition to the image beam 204, and the invisible beam 202 forms a structured beam 203 through the diffraction of the first diffractive optical element 120, which is used to detect the object to be tested. That is to say, in this embodiment, the light source of the structured light 203 is integrated into the laser projector 200 for displaying images, that is, the light source of an eye tracker is integrated into the laser projector 200. Therefore, the augmented reality glasses 100 with a structured light detection function can have a relatively simple structure and a small number of components, and simultaneously achieve the functions of displaying images and detecting objects under test.

FIG. 5 is a schematic perspective view of an embodiment of the first diffractive optical element film in FIG. 1 , and FIG. 6 is a schematic perspective view of another embodiment of the first diffractive optical element in FIG. 1 . Please refer to FIG. 1 and FIG. 5 first. The first diffractive optical element film 120 can have a plurality of microstructures 122. In FIG. 5, for example, it is a strip-shaped protrusion. Each microstructure 122 can extend along a direction perpendicular to the drawing surface of FIG. 1, and these microstructures 122 can be arranged along the horizontal direction of FIG. Please refer to FIG. 1 and FIG. 6 again. In another embodiment, the first diffractive optical element film 120a shown in FIG. 6 may be used instead of the first diffractive optical element film 120 in FIG. 5 . The first diffractive optical element film 120a in FIG. 6 has a plurality of microstructures 122a arranged in two dimensions. These microstructures 122a are, for example, dot-like protrusions. The light pattern thus generated is, for example, the dot-like light pattern 201 arranged in an array in FIG. 3 . The first diffractive optical element film 120 in FIG. 5 and the first diffractive optical element film 120a in FIG. 6 are, for example, diffraction gratings.

7 is a schematic diagram of the optical path of augmented reality glasses with a structured light detection function according to another embodiment of the present invention. FIG. 8 is a schematic front view of the spectacle lens in FIG. Please refer to FIG. 7 to FIG. 9 , the augmented reality glasses 100b with structured light detection function in this embodiment are similar to the augmented reality glasses with structured light detection function 100 in FIG. 1 , and the main differences between the two are as follows. The augmented reality glasses 100b with a structured light detection function in this embodiment include two first diffractive optical element films 120b respectively arranged on both sides of the second diffractive optical element film 140, for example, the first diffractive optical element film 124b located on the right side of the second diffractive optical element film 140 and the first diffractive optical element film 126b located on the left side of the second diffractive optical element film 140. In addition, when the scanning mirror 240 of the laser projector 200 turns to two different angles at different times, the infrared laser source 210 emits an infrared beam 202', and the scanning mirror 240 at two different angles at two different times reflects the infrared beam 202' in different directions to form two invisible beams 202b, such as an invisible beam 2021 and an invisible beam 2022, respectively. Wherein, the invisible beam 2021 is irradiated on the first diffractive optical element film 124b to form a structured beam 203, and the invisible beam 2022 is irradiated on the first diffractive optical element film 126b to form another structured beam 203, and both structured beams 203 are transmitted to the eye 50 to form two light patterns on the eye. The two light patterns can cover more angles of the eye 50 so that the processor 160 can calculate the position of the eye 50 and its gaze direction more accurately.

Fig. 10 is a schematic front view of the glasses lens in the augmented reality glasses with structured light detection function viewed from the line of sight of the eyes according to another embodiment. Please refer to FIG. 7, FIG. 8 and FIG. 10, the augmented reality glasses with structured light detection function in the embodiment of FIG. 10 is similar to the augmented reality glasses 100b with structured light detection function in FIG. 7, and the difference between the two is that in the embodiment of FIG. The first diffractive optical element film 124b is on the first diffractive optical element film 126b.

Fig. 11 is a schematic front view of the glasses lens in the augmented reality glasses with structured light detection function viewed from the line of sight of the eyes according to another embodiment. Please refer to FIG. 7, FIG. 8 and FIG. 11, the augmented reality glasses with structured light detection function in the embodiment of FIG. 11 is similar to the augmented reality glasses with structured light detection function 100b in FIG. 7, and the difference between the two is that the augmented reality glasses with structured light detection function in the embodiment of FIG. The first diffractive optical element films 124c, 126c, 128c, and 129c on the lower side, and the scanning mirror of the laser projector rotates to four different angles at four different times to reflect the infrared beams to four different directions, so as to form four invisible beams that irradiate the first diffractive optical element films 124c, 126c, 128c, and 129c respectively. The first diffractive optical element films 124c, 126c, 128c and 129c diffract the four invisible light beams into four structured light beams, and all the four structured light beams are delivered to the eyes to form four light patterns on the eyes. The four light patterns can cover more angles of the eye 50 so that the processor 160 can calculate the position of the eye 50 and its gaze direction more accurately.

FIG. 12 is a schematic diagram of an optical path of augmented reality glasses with a structured light detection function according to another embodiment of the present invention. Please refer to FIG. 12 , the augmented reality glasses 100 d with structured light detection function in this embodiment are similar to the augmented reality glasses 100 with structured light detection function in FIG. 1 , and the differences between the two are as follows. In the augmented reality glasses 100d with structured light detection function of this embodiment, the object to be tested is the external object 60 , wherein the spectacle lens 110 is located between the external object 60 and the eye 50 . In addition, the first diffractive optical element film 120d diffracts the invisible light beam 202 into a structured light beam 203 to the outside, such as transmission diffraction. The structured beam 203 is delivered to the external object 60 to form a light pattern on the external object 60 . The processor 160 can calculate the position of the external object 60 by using the light pattern captured by the invisible light camera 130 . In this embodiment, there may be multiple invisible light cameras 130 , for example two, which are respectively arranged at the center and one side of the spectacle frame 150 . But the present invention does not limit the number of invisible light cameras 130 . In another embodiment, the number of the invisible light camera 130 may also be one.

To sum up, in the augmented reality glasses with structured light detection function according to the embodiment of the present invention, the laser projector emits not only image beams but also invisible beams, and the invisible beams are diffracted by the first diffractive optical element to form structured beams, which are used to detect objects to be tested. That is to say, the embodiment of the present invention integrates the light source of structured light into the laser projector for displaying images, so the augmented reality glasses with structured light detection function can have a relatively simple structure and a small number of components, and simultaneously achieve the functions of displaying images and detecting objects under test.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, but not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.

Claims (9)

1. An augmented reality glasses with structured light detection function, adapted to be worn in front of the eyes, the augmented reality glasses with structured light detection function comprising:

the laser projector is used for emitting at least one invisible light beam and an image light beam;

an eyeglass lens disposed on a path of the invisible light beam and the image light beam;

at least one first diffraction optical element film, disposed on the eyeglass lens and located on the path of the invisible light beam, wherein the first diffraction optical element is configured to diffract the invisible light beam into a structural light beam, and the structural light beam is transmitted to an object to be detected, so as to form a light pattern on the object to be detected;

an invisible light camera for shooting the light pattern on the object to be detected; and

the second diffraction optical element film is configured on the eyeglass lens and is positioned on the path of the image light beam, and the second diffraction optical element film is used for transmitting the image light beam to the eye, wherein the at least one first diffraction optical element film comprises two first diffraction optical element films respectively configured on two sides of the second diffraction optical element film, and the at least one invisible light beam comprises two invisible light beams respectively irradiated on the two first diffraction optical element films.

2. The augmented reality glasses with structured light detection function according to claim 1, wherein the object to be detected is the eye.

3. The augmented reality glasses with structured light detection function according to claim 1, wherein the object to be detected is an external object, wherein the glasses lens is located between the external object and the eye.

4. The augmented reality glasses with structured light detection function according to claim 1, wherein the first and second diffractive optical element films are disposed on a surface of the glasses lens facing the eye.

5. The augmented reality glasses with structured light detection function according to claim 1, wherein the laser projector comprises:

an infrared laser source for emitting an infrared beam;

a plurality of laser sources of different colors for emitting a plurality of light beams of different colors;

the light combining module is configured on the paths of the infrared light beam and the light beams with different colors so as to combine the paths of the infrared light beam and the light beams with different colors; and

and a scanning mirror configured on paths of the infrared light beam from the light combining module and the plurality of light beams with different colors, wherein the scanning mirror is adapted to rotate so that the infrared light beam forms the at least one invisible light beam irradiated on the at least one first diffractive optical element film, and the plurality of light beams with different colors form the image light beam scanned on the second diffractive optical element film.

6. The augmented reality glasses with structured light detection function according to claim 1, wherein the at least one first diffractive optical element film is four first diffractive optical element films respectively arranged around the second diffractive optical element film, and the at least one invisible light beam is four invisible light beams respectively irradiated to the four first diffractive optical element films.

7. The augmented reality glasses with structured light detection function according to claim 1, wherein the second diffractive optical element film is a holographic optical element film.

8. The augmented reality glasses with structured light detection function according to claim 1, further comprising a processor electrically connected to the invisible light camera and configured to calculate a position of the object to be detected according to the light pattern captured by the invisible light camera.

9. The augmented reality glasses with structured light detection function according to claim 1, further comprising a glasses frame, wherein the laser projector and the glasses lenses are configured on the glasses frame.