CN110888233B

CN110888233B - Display module and imaging method

Info

Publication number: CN110888233B
Application number: CN201811045400.9A
Authority: CN
Inventors: 孙洁; 李瑞华
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2018-09-07
Filing date: 2018-09-07
Publication date: 2021-10-22
Anticipated expiration: 2038-09-07
Also published as: CN110888233A; WO2020048536A1

Abstract

The application provides a display module assembly and imaging method, wherein the display module assembly includes: the device comprises a red light waveguide lens, a green light waveguide lens, a blue light waveguide lens, a white light waveguide lens and at least one projection light machine; the at least one projection light machine enables a first light signal to be incident into the red light waveguide lens, the green light waveguide lens and the blue light waveguide lens through a first light path, and lights emitted after being diffracted by the light waveguide lenses jointly represent a first image on a first focal plane; the at least one projection light machine further enables a second light signal to enter the white light waveguide lens through a second light path, emergent light emitted after diffraction of the light waveguide lens presents a second image on a second focal plane, and the second focal plane and the first focal plane are located on different planes. The application provides a display module assembly and imaging method can obtain the function that two focal planes show through less optical waveguide lens, has simplified the structure of the display module assembly that possesses a plurality of focal planes display function to a certain extent.

Description

Display module and imaging method

Technical Field

The application relates to the technical field of display, in particular to a display module and an imaging method.

Background

Augmented Reality (AR) is a technology capable of projecting virtual content represented by an image or video onto an AR display device (e.g., AR glasses) and enabling a user to see the projected virtual content and real content in the real world at the same time through the AR display device. Virtual Reality (VR) is a technology that is capable of projecting Virtual content of an image or video representation onto a VR display device (e.g., VR glasses) so that a user is immersed into a fully Virtual world through the VR display device.

In the prior art, a display module in an AR/VR display device is responsible for displaying images of AR/VR virtual content, and a diffraction optical waveguide in the module is one of the main display components in the display module at present due to its light and thin appearance and the characteristic of mass production by a nanoimprint technology. The diffraction optical waveguide is composed of a group of waveguide lenses for diffracting red light, blue light and green light respectively, and is matched with a projection light machine for use. The projector in the display module is used for sending an image representing virtual content in an optical signal form, and when an optical signal enters the diffraction light waveguide, the three waveguide lenses used for diffracting red light, blue light and green light diffract the red light, the blue light and the green light of the corresponding colors in the optical signal respectively and then emit the red light, the blue light and the green light so as to present the image corresponding to the optical signal to a user together. Meanwhile, because the light emitted by each group of waveguide lenses in the diffractive optical waveguides only has one focus, that is, each group of waveguide lenses can only present an image on one focal plane to a user, the user needs to perceive the distance of the virtual content by presenting different-angle images of the same virtual content to the left and right eyes of the user through the two diffractive optical waveguides. Therefore, in order to prevent the visual convergence adjustment conflict caused by the continuous balance adjustment between the images at different angles by the left eye and the right eye of the user from influencing the visual effect, the display module group usually adopts a mode of superposing the diffraction optical waveguides to realize the display function of a plurality of focal planes, so that each group of waveguide lenses can present the images at different focal planes to the user, and the visual convergence adjustment conflict of the user is reduced.

However, in the prior art, each additional focal plane of the display module needs to be added with an additional diffractive light waveguide on the basis of the diffractive light waveguides of the original three waveguide lenses, and each diffractive light waveguide includes three waveguide lenses for diffracting red light, blue light and green light, which greatly increases the weight, volume and cost of the display module, and causes the structure of the display module to be complicated. Therefore, how to simplify the structure of a display module with multiple focal plane display functions is a technical problem to be solved urgently.

Disclosure of Invention

The application provides a display module and an imaging method, which are used for simplifying the structure of the display module with a plurality of focal plane display functions to a certain extent.

This application first aspect provides a display module assembly, display module assembly is applied to augmented reality's display device or virtual reality's display device in, display module assembly includes:

the device comprises a red light waveguide lens, a green light waveguide lens, a blue light waveguide lens, a white light waveguide lens and at least one projection light machine;

the red light waveguide lens, the green light waveguide lens, the blue light waveguide lens and the white light waveguide lens are arranged in parallel, and the focuses of the red light waveguide lens, the green light waveguide lens, the blue light waveguide lens and the white light waveguide lens are on the same straight line;

the at least one projection light machine is used for enabling a first light signal representing a first image to be incident to the red light waveguide lens, the green light waveguide lens and the blue light waveguide lens through a first light path, and enabling a second light signal representing a second image to be incident to the white light waveguide lens through a second light path;

the red light waveguide lens is used for receiving and diffracting red light in the first optical signal and then emitting the red light, the blue light waveguide lens is used for receiving and diffracting blue light in the first optical signal and then emitting the blue light, the green light waveguide lens is used for receiving and diffracting green light in the first optical signal and then emitting the green light, and the light emitted by the red light waveguide lens, the green light waveguide lens and the blue light waveguide lens jointly presents the first image on a first focal plane;

the white optical waveguide lens is used for receiving and diffracting white light in the second optical signal and then emitting the white light, emergent light emitted by the white optical waveguide lens presents the second image on a second focal plane, and the second focal plane and the first focal plane are on different planes.

The display module provided in this embodiment can make the red light waveguide lens, the green light waveguide lens and the blue light waveguide lens diffract the first light signal and then emit the first light signal through the first light path by using at least one projector, so that the first image is presented on the first focal plane, and the second image is presented on the white light waveguide lens through the second light path, so that the second image is presented on the second focal plane by making the white light waveguide lens diffract the second light signal and then emit the second light signal, and the first focal plane and the second focal plane are located on different planes. Thereby can obtain through four optical waveguide lenses and show the function that shows different images at two different focal planes through a display module assembly, compare with the mode of a plurality of red light waveguide lenses of stack, green light waveguide lens and blue light waveguide lens, reduce the use of optical waveguide lens, and then reduced display module assembly's weight, volume and cost, simplified the structure of the display module assembly that possesses a plurality of focal planes display function to a certain extent. When the display module provided by the embodiment is applied to the AR/VR display device with multiple focal plane display functions, the structure of the AR/VR display device with multiple focal plane display functions can be simplified to a certain extent.

In an embodiment of the first aspect of the present application, the first optical path includes a red optical path, a green optical path, and a blue optical path; the at least one projector is specifically configured to inject the red light into the red light waveguide lens through the red light path, inject the green light into the green light waveguide lens through the green light path, and inject the blue light into the blue light waveguide lens through the blue light path.

The display module in this embodiment can be through different light paths with red light, green light and blue light alone incide with in the red light waveguide lens, the green light waveguide lens and the blue light waveguide lens that these light correspond for the light of diffraction only exists the light of single colour in every optical waveguide lens. And for each optical waveguide lens, the emergent light of the optical waveguide lens only has light with a single color, so that the emergent light of the three optical waveguide lenses can be diffracted more uniformly on a first image formed by the first focal plane together, and crosstalk between optical waveguides with different colors does not exist in the diffraction process of each optical waveguide lens, thereby improving the visual effect of human eyes on the first image.

In an embodiment of the first aspect of the present application, the at least one light projector engine comprises: a first projector for projecting a first optical signal representing a first image through the first optical path into the red light waveguide lens, the green light waveguide lens, and the blue light waveguide lens; and a second optical signal representing a second image is incident on the white light waveguide lens through the second optical path.

In an embodiment of the first aspect of the present application, the first projector engine comprises: the red light source, the green light source, the blue light source and the white light source are independently arranged;

wherein the red light source is configured to generate the red light, the green light source is configured to generate the green light, and the blue light source is configured to generate the blue light; the first light signal representing a first image comprises the red, green, and blue light; the white light source is configured to generate the white light, and the second optical signal representing the second image is the white light.

Alternatively, in an embodiment of the first aspect of the present application, the at least one light projector engine includes: the first projector is used for transmitting a first optical signal representing a first image to the red light waveguide lens, the green light waveguide lens and the blue light waveguide lens through the first optical path; the second projector is used for transmitting a second optical signal representing a second image to the white light waveguide lens through the second optical path.

In an embodiment of the first aspect of the present application, the first projector engine comprises: a red light source, a green light source and a blue light source, wherein the red light source is configured to generate the red light, the green light source is configured to generate the green light, the blue light source is configured to generate the blue light, and the first light signal representing the first image includes the red light, the green light and the blue light; the second light projector includes: and a white light source for generating the white light, wherein the second optical signal representing the second image is the white light.

In this embodiment, at least one of the light projectors in the above embodiments is improved on the existing basis, and the light source in the first light projector is set as three red light sources, green light sources, and blue light sources that are independently set, or an independent white light source may be further set in the first light projector, so that light of a corresponding color emitted by each light source irradiates the microdisplay and then generates independent red light, green light, and blue light, and white light. So that the first projector independently exits the pupil and independently enters the red light waveguide lens, the green light waveguide lens, the blue light waveguide lens and the white light waveguide lens corresponding to the red light, the green light, the blue light and the white light with different wavelengths. And then the diffraction of the first image formed by the emergent light of the red light waveguide lens, the green light waveguide lens and the blue light waveguide lens is uniform, and the crosstalk between the light waveguides with different colors does not exist in the diffraction process of each light waveguide lens, so that the visual effect of human eyes on the first image is improved.

In an embodiment of the first aspect of the present application, the exit pupils of the red light waveguide lens, the green light waveguide lens and the blue light waveguide lens are all arc-shaped, and the focuses of the red light waveguide lens, the green light waveguide lens and the blue light waveguide lens are all located in the first focal plane.

In an embodiment of the first aspect of the present application, the exit pupil grating of the white optical waveguide lens is in an arc shape, and the focal point of the white optical waveguide lens is located in the second focal plane.

The red light waveguide lens, the green light waveguide lens, the blue light waveguide lens and the white light waveguide lens provided in this embodiment all use optical field type optical waveguide lenses with optical power, wherein an outcoupling grating of the optical waveguide lens itself is a diffraction lens, and the outgoing light of the optical waveguide lens has a focus by bending the outcoupling grating. Therefore, the AR/VR display device is not required to be additionally provided with a convex lens for enabling the emergent light to have a focus outside the display module, and the structure of the AR/VR display device is further simplified when the display module provided by the embodiment is applied to the AR/VR display device with a plurality of focal plane display functions.

In an embodiment of the first aspect of the present application, the AR/VR display module further includes: n white light waveguide lenses, N is an integer greater than or equal to 1;

the at least one projection light machine is further configured to respectively inject N optical signals into the N white light waveguide lenses through N optical paths, where the N optical signals carry different images;

the N white light waveguide lenses are respectively used for diffracting the light signals incident by the projection light machine and then emitting the light signals, so that images corresponding to the incident light signals are displayed on different N focal planes.

The display module that this embodiment provided still includes N white light waveguide lenses on the basis of above-mentioned embodiment to can be on the basis that two focal planes provided in the aforesaid, make the display module realize showing the image of more different focal planes. And every increase a focal plane, only need increase a white light waveguide lens on original basis to the increase and the use of optical waveguide lens have been reduced, and then weight, volume and the cost that have reduced display module assembly have simplified the structure that possesses the display module assembly of a plurality of focal planes function.

A second aspect of the present application provides an imaging method comprising:

acquiring a first optical signal representing a first image and a second optical signal representing a second image;

diffracting red light in the first optical signal by a first optical path and then emitting, diffracting green light in the first optical signal by the first optical path and then emitting, and diffracting blue light in the first optical signal by the first optical path and then emitting, so as to present the first image at a first focal plane;

and diffracting the white light in the second optical signal through a second optical path and then emitting the white light to present the second image on a second focal plane, wherein the second focal plane is on a different plane from the first focal plane.

In an embodiment of the second aspect of the present application, the first optical path includes: a red light path, a green light path and a blue light path; the diffracting red light in the first optical signal by the first optical path and emitting, diffracting green light in the first optical signal by the first optical path and emitting, and diffracting blue light in the first optical signal by the first optical path and emitting includes:

the red light in the first optical signal is diffracted by the red optical path and then emitted, the green light in the first optical signal is diffracted by the green optical path and then emitted, and the blue light in the first optical signal is diffracted by the blue optical path and then emitted.

In an embodiment of the second aspect of the present application, the acquiring a first optical signal representing a first image and a second optical signal representing a second image includes: and generating the first light signal for representing the first image and the second light signal for representing the second image through a first projection light machine.

In an embodiment of the second aspect of the present application, the generating, by the first projector engine, the first light signal representing the first image and the second light signal representing the second image includes: the red light is generated by a red light source independently arranged by the first projector, the green light is generated by a green light source independently arranged by the first projector, and the blue light is generated by a blue light source independently arranged by the first projector; the first light signal representing a first image comprises the red, green, and blue light; and generating the white light by a white light source arranged by the first projector.

In an embodiment of the second aspect of the present application, the acquiring a first optical signal representing a first image and a second optical signal representing a second image includes: and generating the first optical signal for representing the first image through a first projection light machine, and generating the second optical signal for representing the second image through a second projection light machine.

In an embodiment of the second aspect of the present application, the generating, by a first light projector, the first light signal representing a first image and generating, by a second light projector, the second light signal representing a second image includes: generating the red light by a red light source independently disposed by the first projector, generating the green light by a green light source independently disposed by the first projector, and generating the blue light by a blue light source independently disposed by the first projector, the first light signal representing the first image including the red light, the green light, and the blue light; and generating the white light by a white light source arranged on the second projector.

In an embodiment of the second aspect of the present application, N optical signals are obtained, where the N optical signals carry different images, and N is an integer greater than or equal to 1;

and diffracting the N optical signals through N optical paths and then emitting the N optical signals so as to present N images corresponding to the N optical signals on different N focal planes.

In an embodiment of the second aspect of the present application, the diffracting red light in the first optical signal by the first optical path and emitting, diffracting green light in the first optical signal by the first optical path and emitting, diffracting blue light in the first optical signal by the first optical path and emitting, includes:

diffracting red light in the first light signal by a red light waveguide optic and then exiting the exit pupil grating, diffracting green light in the first light signal by a green light waveguide optic and then exiting the exit pupil grating, diffracting blue light in the first light signal by a blue light waveguide optic and then exiting the exit pupil grating, to present the first image to a human eye at a first focal plane;

the exit pupil gratings of the red light waveguide lens, the green light waveguide lens and the blue light waveguide lens are all arc-shaped, and the focuses of the red light waveguide lens, the green light waveguide lens and the blue light waveguide lens are all located in the first focal plane.

In an embodiment of the second aspect of the present application, the diffracting the white light in the second optical signal by the second optical path and then emitting the white light includes:

diffracting the white light in the second optical signal by a white light waveguide lens and then emitting the white light from an exit pupil grating;

the exit pupil grating of the white optical waveguide lens is arc-shaped, and the focus of the white optical waveguide lens is located in the second focal plane.

A third aspect of the present application provides an augmented reality device, comprising:

a sensor for acquiring a real scene image;

the display module according to any of the embodiments of the first aspect, wherein the display module is configured to image on at least two focal planes, and to be displayed to a user in an overlapping manner with the image of the real scene.

The present application fourth aspect provides a virtual reality device, including:

the display module according to any of the embodiments of the first aspect, wherein the display module is configured to image on at least two focal planes and present the image to a user;

and the processor is used for controlling a projection light machine in the display module to generate a first light signal representing a first image and a second light signal representing a second image.

Drawings

FIG. 1 is a schematic structural diagram of a display module according to an embodiment of the present disclosure;

FIG. 2 is a schematic structural diagram of a display module according to an embodiment of the present disclosure;

FIG. 3 is a schematic structural diagram of a display module according to an embodiment of the present disclosure;

FIG. 4 is a schematic structural diagram of a display module according to an embodiment of the present disclosure;

FIG. 5A is a schematic view of a projection light engine according to an embodiment of the present application;

FIG. 5B is a schematic diagram of an embodiment of a projection optics of the display module of the present application;

FIGS. 5C-5F are schematic diagrams of the optical path structure in the projector of the display module of the present application;

FIG. 6 is a schematic diagram of an optical path of a projection engine according to the present application;

FIG. 7 is a schematic diagram of a light exit structure of a projection light engine according to the present application;

FIG. 8 is a schematic structural diagram of a display module according to an embodiment of the present disclosure;

FIG. 9 is a schematic structural diagram of a display module according to an embodiment of the present disclosure;

FIG. 10 is a schematic structural diagram of a non-optical field type optical waveguide lens;

FIG. 11 is a schematic view of a structure of an optical field type optical waveguide lens in a display module according to the present application;

FIG. 12 is a schematic view of a light-emitting structure of a white light waveguide lens in a display module of the present application;

FIG. 13 is a schematic structural diagram of an AR/VR display device according to an embodiment of the present application;

FIG. 14 is a schematic structural diagram of an AR/VR display device according to an embodiment of the present application;

FIG. 15 is a schematic structural diagram of an AR/VR display device in accordance with an embodiment of the present application;

FIG. 16 is a schematic structural diagram of an AR/VR display device in accordance with an embodiment of the present application;

FIG. 17 is a schematic structural diagram of an AR/VR display device in accordance with an embodiment of the present application;

FIG. 18 is a schematic flow chart diagram of an embodiment of an imaging method of the present application;

fig. 19 is a schematic structural diagram of an embodiment of an augmented reality device according to the present application;

fig. 20 is a schematic structural diagram of a virtual reality device according to an embodiment of the present application.

Detailed Description

Fig. 1 is a schematic structural diagram of a display module according to an embodiment of the present disclosure. As shown in fig. 1, the display module in this embodiment can be used in an AR display device or a VR display device to display images, and specifically, the display module in this embodiment includes: a red light waveguide lens 11, a green light waveguide lens 12, a blue light waveguide lens 13, a white light waveguide lens 21, and at least one projector engine 3.

The red light waveguide lens 11 diffracts the red light incident on the coupling-in grating 111 and emits the red light from the coupling-out grating 112, the green light waveguide lens 12 diffracts the green light incident on the coupling-in grating 121 and emits the green light from the coupling-out grating 122, the blue light waveguide lens 13 diffracts the blue light incident on the coupling-in grating 131 and emits the blue light from the coupling-out grating 132, and the white light waveguide lens 21 diffracts the white light incident on the coupling-in grating 211 and emits the white light from the coupling-out grating 212. The red light waveguide lens 11, the green light waveguide lens 12, the blue light waveguide lens 13 and the white light waveguide lens 14 are arranged in parallel, and the focuses of the red light waveguide lens 11, the green light waveguide lens 12, the blue light waveguide lens 13 and the white light waveguide lens 14 are all on the same straight line perpendicular to the lenses, wherein the focus refers to a virtual focus of an image formed by the waveguide lenses. For example, as shown in fig. 1, the human eye 5 is located right below the figure, and the direction of the line of sight of the human eye 5 is viewed from right below to right above the figure, and conversely, the outgoing light beams from the red light waveguide lens 11, the green light waveguide lens 12, the blue light waveguide lens 13, and the white light waveguide lens 14 all show an image to the human eye in the direction from top to bottom. And the virtual focal points of the images formed by the red light waveguide lens 11, the green light waveguide lens 12, the blue light waveguide lens 13 and the white light waveguide lens 14 can be on the same straight line passing through the human eye 5 and perpendicular to the four light waveguide lenses. Namely, the red light waveguide lens 11, the green light waveguide lens 12, the blue light waveguide lens 13 and the white light waveguide lens 14 are disposed perpendicular to the line of sight direction of human eyes, and the four light waveguide lenses are disposed in parallel.

The at least one photo-engine 3 is specifically configured to inject a first light signal representing a first image through a first light path 31 into the red light waveguide lens 11, the green light waveguide lens 12, and the blue light waveguide lens 13. Wherein the first light signal may be a first image represented by red, green and blue light, either separately or mixed, or the first light signal is a first image represented by white light. The first light signal may be generated by at least one projector engine 3, for example, after the at least one projector engine 3 obtains a first image from a processor of the AR/VR display device and generates a first light signal representing the first image according to the first image, the first light signal is incident into the red light waveguide lens 11, the green light waveguide lens 12 and the blue light waveguide lens 13 through the first light path 31. Specifically, as shown in fig. 1, one end of the starting point of the first optical path 31 is at least one projector 3, the first optical path sequentially passes through the coupling grating 111 of the red light waveguide lens 11, the coupling grating 121 of the green light waveguide lens 12, and the coupling grating 131 of the blue light waveguide lens 13, when the first signal sequentially passes through the coupling gratings of the three optical waveguide lenses, the red light waveguide lens 11 is configured to receive and diffract red light in the first optical signal and then emit the red light through the coupling grating 112, the blue light waveguide lens 12 is configured to receive and diffract blue light in the first optical signal and then emit the blue light through the coupling grating 122, and the green light waveguide lens 13 is configured to receive and diffract green light in the first optical signal and then emit the green light through the coupling grating 132. Finally, the diffracted red outgoing light 411 emitted from the red light waveguide lens 11, the diffracted green outgoing light 412 emitted from the green light waveguide lens 12, and the diffracted blue outgoing light 413 emitted from the blue light waveguide lens 13 collectively constitute white light which can present the first image 611 to the human eye at the uppermost first focal plane 61 as shown in the figure. That is, the red light waveguide lens 11, the green light waveguide lens 12 and the blue light waveguide lens 13 are used as a combined optical waveguide lens group 1, and the optical waveguide lens group 1 needs to be used in combination to realize the presentation of the first image 611 of the first focal plane 61 to the human eye. It should be noted that the single-arrow representation of the red outgoing light 411, the green outgoing light 412 and the blue outgoing light 413 shown in fig. 1 is merely an example, the actual outgoing light should include multiple paths, and the directions of the actual outgoing light can be represented by arrows that start from a focal point in the first focal plane 61 and diverge in a range shown by two broken lines connecting the first focal plane 61 in the drawing. Here, the focal plane is a virtual focal plane of the images displayed by the red light waveguide lens 11, the green light waveguide lens 12, and the blue light waveguide lens 13, that is, when the human eye 5 located at the lower side in the figure sees the first image 611 through the exit light from the red light waveguide lens 11, the green light waveguide lens 12, and the blue light waveguide lens 13, the human eye 5 can perceive that the first image 611 is located in the first focal plane 61 above the red light waveguide lens 11, the green light waveguide lens 12, and the blue light waveguide lens 13. In addition, as shown in fig. 1, only one possible arrangement of the red light waveguide lens 11, the green light waveguide lens 12 and the blue light waveguide lens 13 is shown, that is, the red light waveguide lens 11, the green light waveguide lens 12 and the blue light waveguide lens 13 are shown in the figure from top to bottom, and the order may be adjusted according to the actual use situation, and the arrangement order of the three light waveguide lenses is not specifically limited in this embodiment.

Meanwhile, the at least one projection light machine 3 is further configured to inject a second light signal representing a second image into the white light waveguide lens 21 through the second light path 32, where the second light signal may be a second image represented by red light, green light, and blue light, which are independent or mixed, or the second light signal may be a second image represented by white light, and the second light signal may be generated by the at least one projection light machine 3, for example, after the at least one projection light machine 3 acquires the second image from the processor of the AR/VR display device and generates a second light signal representing the second image according to the second image, the second light signal is injected into the white light waveguide lens 21 through the second light path 32. Specifically, as shown in fig. 1, one end of the starting point of the second optical path 32 is at least one projector 3, the second optical path 32 sequentially passes through the red light waveguide lens 11, the green light waveguide lens 12 and the blue light waveguide lens 13 and then reaches the coupling grating 211 of the white light waveguide lens 21, the white light waveguide lens 21 receives and diffracts the white light and then emits the white light through the coupling grating 212, and finally the white emitting light 412 emitted by the white light waveguide lens can present a second image 612 to the human eye 5 through the second focal plane 62 as shown in the figure. Similarly, the second focal plane 62 here is a virtual focal plane formed by the white light waveguide lens 21, that is, the second image 612 that the human eye 5 located below the white light waveguide lens can perceive by the light emitted from the white light waveguide lens 21 is located in the second focal plane above the white light waveguide lens. When the display module needs to display a distant image, the light signal of the image generated by at least one projection optical machine 3 enters the red light waveguide lens 11, the green light waveguide lens 12 and the blue light waveguide lens 13 through the first optical path, and is diffracted by the three light waveguide lenses to present the image on the first focal plane 61. When the display module needs to display a relatively close image, the optical signal of the image generated by the at least one projection optical machine 3 is incident to the white optical waveguide lens 21 through the second optical path, and is diffracted by the white optical waveguide lens 21 to present the image on the second focal plane 62. Also, the position of the white light waveguide lens 21 on the blue light waveguide lens 13 in the present embodiment is merely an example, and the four light waveguide lenses as in fig. 1 may be arranged in any order under the condition that they are parallel and have the focal points on the same straight line.

In summary, as shown in fig. 1, at least one of the projector engines 3 in the display module provided in this embodiment can output a first optical signal to the red light waveguide lens 11, the green light waveguide lens 12 and the blue light waveguide lens 13 through the independently disposed first optical path 31, and output a second optical signal to the white light waveguide lens 21 through the independently disposed second optical path 32. The first optical signal is diffracted and emitted by the red light waveguide lens 11, the green light waveguide lens 12 and the blue light waveguide lens 13, and the second optical signal is diffracted and emitted by the white light waveguide lens 21. Thereby enabling the human eye 5 to view a first image at a first focal plane from the outgoing light from the red light waveguide lens 11, the green light waveguide lens 12 and the blue light waveguide lens 13 and a second image at a second focal plane from the outgoing light from the white light waveguide lens 21, and the focal lengths of the first focal plane and the second focal plane are different. Therefore, the white light waveguide lens 21 can realize the function of displaying an image at a specific focal plane only by a single light waveguide lens, so that the display module in the embodiment can obtain the function of displaying at two focal planes by three light waveguide lenses for diffracting monochromatic light, and one light waveguide lens for diffracting white light is added to the red light waveguide lens 11, the green light waveguide lens 12 and the blue light waveguide lens 13, and the white light waveguide lens 21 can obtain the function of displaying at two focal planes, compared with the prior art that the focal plane is increased by adding a plurality of red light waveguide lenses 11, green light waveguide lenses 12 and blue light waveguide lenses 13 in the display module, the use of the light waveguide lenses is reduced, so that the weight, volume and cost of the display module are reduced to a certain extent, when the display module in the embodiment is applied to an AR/VR display device with a plurality of focal plane display functions, the structure of an AR/VR display device having a plurality of focal plane display functions can be simplified to some extent.

Fig. 2 is a schematic structural diagram of an embodiment of a display module according to the present application, and fig. 2 shows a possible implementation manner of a first optical path 31 in the display module based on the embodiment shown in fig. 1.

In particular, since the white light for representing the first picture may be composed of red, green and blue light, in the embodiment as shown in fig. 1, the at least one projection light machine 3 may transmit the white light for representing the first image on the first light path 31, the in-coupling grating 111 of the red light waveguide lens 11 is capable of coupling the red light in the white light into the red light waveguide lens 11, and the green and blue light in the white light does not enter but directly passes through the in-coupling grating 111 of the red light waveguide lens 11. The incoupling grating 121 of the green light waveguide plate 12 couples the green light of the white light into the green light waveguide plate 12, while the blue light of the white light continues to pass through the incoupling grating 121 of the green light waveguide plate 12 to the incoupling grating 131 of the blue light waveguide plate 13 and into the blue light waveguide plate 13. Although this embodiment also enables the first light signal to be coupled into the red light waveguide plate 11, the green light waveguide plate 12 and the blue light waveguide plate 13 via the first light path 31. However, since the coupling-in gratings of the red light waveguide lens 11, the green light waveguide lens 12, and the blue light waveguide lens 13 for diffracting light of different colors are based on the principle of wavelength selection when being arranged, the coupling-in gratings of the red light waveguide lens 11, the green light waveguide lens 12, and the blue light waveguide lens 13 can only couple in light of corresponding colors, and the wavelengths of the three lights of red light, green light, and blue light have a partially overlapped value, so that when the coupling-in grating 111 of the red light waveguide lens 11 couples in the red light waveguide lens 11, a portion of the green light and the blue light can be coupled in. Similarly, the coupling-in grating 121 of the green light waveguide lens 12 couples in part of the red light and the blue light when coupling in the green light, and the coupling-in grating 131 of the blue light waveguide lens 13 couples in part of the red light and the green light when coupling in the blue light, so that the uniformity of the outgoing light of the red light waveguide lens 11, the green light waveguide lens 12 and the blue light waveguide lens 13 is poor, and the visual effect of the human eye on the first image is seriously affected.

Therefore, in the present embodiment, as shown in fig. 2, the first optical path 31 for transmitting the first optical signal by at least one projector engine 3 in the embodiment shown in fig. 1 is divided into a red optical path 311, a green optical path 312 and a blue optical path 313 more finely. The first optical signal transmitted by the at least one projection optical machine 3 through the first optical path 31 includes independent red light, green light, and blue light. The at least one projection light engine 3 is used for respectively injecting red light into the red light waveguide lens 11 through the coupling-in grating 111 of the red light waveguide lens 11 directly and independently through a red light path 311, for injecting green light into the green light waveguide lens 12 through the green light path 312 directly and independently through the coupling-in grating 121 of the green light waveguide lens 12, and for injecting blue light into the blue light waveguide lens 13 through the blue light path 313 directly and independently through the coupling-in grating 131 of the blue light waveguide lens 13. Therefore, the red light, the green light and the blue light are independently incident into the optical waveguide lenses corresponding to the light through different light paths, so that the light actually diffracted in the red light waveguide lens 11, the green light waveguide lens 12 and the blue light waveguide lens 13 has only a single color, and the emergent light of the red light waveguide lens 11, the green light waveguide lens 12 and the blue light waveguide lens 13 also has only a single color. Therefore, the diffraction of the first image formed by the emergent light of the red light waveguide lens 11, the green light waveguide lens 12 and the blue light waveguide lens 13 is uniform, and the crosstalk among the light waveguides with different colors does not exist in the diffraction process of the red light waveguide lens 11, the green light waveguide lens 12 and the blue light waveguide lens 13, so that the visual effect of human eyes on the first image is improved.

Alternatively, since the red light waveguide plate 11, the green light waveguide plate 12, and the blue light waveguide plate 13 are arranged in parallel, for the green light path 312 as shown in the drawing, it is necessary to pass through the red light waveguide plate 11, and the blue light path 313 needs to pass through the red light waveguide plate 11 and the green light waveguide plate 12. Accordingly, for the first light path 31 in the form shown in fig. 2, it is necessary to set the incoupling gratings of the red light waveguide lens 11, the green light waveguide lens 12 and the blue light waveguide lens 13 at different positions accordingly, so that the green light path 312 as shown in the figure does not pass through the incoupling grating 111 of the red light waveguide lens 11, but directly enters the incoupling grating 121 of the green light waveguide lens 12 through the red light waveguide lens 11; the blue light path 313 as shown in the figure does not pass through the incoupling grating 111 of the red light waveguide plate 11 and the incoupling grating 121 of the green light waveguide plate 12, but directly enters the incoupling grating 131 of the blue light waveguide plate 13 through the red light waveguide plate 11 and the green light waveguide plate 12. Similarly, fig. 2 shows only one possible arrangement of the red light waveguide lens 11, the green light waveguide lens 12, and the blue light waveguide lens 13, and the arrangement order of the light waveguide lenses is not particularly limited in the embodiments of the present application.

Fig. 3 is a schematic structural diagram of an embodiment of a display module according to the present application, and the embodiment shown in fig. 3 illustrates that at least one projector includes one projector, that is, at least one projector in the above embodiments is the first projector 301. The projector engine 301 is configured to inject a first optical signal representing a first image into the red light waveguide lens 11, the green light waveguide lens 12, and the blue light waveguide lens 13 through the first optical path 31. Specifically, the projection light engine may be used in the manner as in the embodiment shown in fig. 2, to respectively inject red light into the red light waveguide lens 11 through the coupling-in grating 111 of the red light waveguide lens 11 directly and independently through the red light path 311, and to inject green light into the green light waveguide lens 12 through the green light path 312 directly and independently through the coupling-in grating 121 of the green light waveguide lens 12, and to inject blue light into the blue light waveguide lens 13 through the blue light path 313 directly and independently through the coupling-in grating 131 of the blue light waveguide lens 13. Meanwhile, the projector engine 301 may also be configured to inject a second optical signal representing a second image into the white light waveguide lens 21 through the second optical path 32. Therefore, the first projector 301 can make the red light, the green light, the blue light and the white light enter the light guide lens corresponding to the light through different light paths.

Fig. 4 is a schematic structural diagram of an embodiment of a display module according to the present application, and the embodiment shown in fig. 4 shows that at least one of the projection optical machines 3 includes two projection optical machines, which are a first projection optical machine 301 and a second projection optical machine 302, and the first optical signal and the second optical signal are incident into the optical waveguide lens group 1 and the white light waveguide lens 21 through the first optical path and the second optical path respectively by the first projection optical machine 301 and the second projection optical machine 302.

Specifically, the embodiment shown in fig. 4 can be based on the embodiment shown in fig. 1 or fig. 2, and the at least one projection light machine 3 specifically includes a first projection light machine 301 and a second projection light machine 302, where the first projection light machine 301 is configured to inject a first light signal into the red light waveguide lens 11, the green light waveguide lens 12, and the blue light waveguide lens 13 through a first light path 31, and the second projection light machine 302 is configured to inject a second light signal into the white light waveguide lens 21 through a second light path 32. The specific manner of the incident light signal of the first projector 301 and the second projector 302 can use any manner of the foregoing embodiments, and is not described again. In this embodiment, it is mainly emphasized that two independent projection optical machines respectively project different optical signals through different optical paths, and a single projection optical machine only needs to be responsible for generating the display of a single image, so as to reduce the requirement on the display performance of the projection optical machine.

Further, this embodiment may also be applied to that when the FoV of the image formed by the optical waveguide lens group 1 is different from the FoV of the image formed by the white light waveguide lens 21, the first projection optical machine 301 and the second projection optical machine 302 may also respectively send the optical signals of different FoV images to the corresponding lenses, that is, the fovs of the optical signals sent by the first projection optical machine 301 and the second projection optical machine 302 in this embodiment may be different. For example: assuming that the FoV of the optical waveguide lens group 1 in fig. 4 is 60 degrees, the first projection optical machine 301 injects a first optical signal with the FoV of 60 degrees into the optical waveguide lens group 1, and presents a first image with the FoV of 60 degrees on a first focal plane; the FoV of the white light waveguide lens 21 is 25 degrees, the second projector light machine injects a second light signal with FoV of 25 degrees into the white light waveguide lens 21, and presents a second image with FoV of 25 degrees on the second focal plane. When the pixels of the first image and the second image are the same, because the focal lengths of the optical waveguide lens group 1 and the white light waveguide lens 21 are different, the two optical machines are separated to project optical signals with different FoV to the lenses with different focal lengths, so that the first image can be presented by a larger FoV in a first focal plane with a larger focal length to present a long-range view, and the second image can be presented by a smaller FoV in a second focal plane with a smaller focal length to present a short-range view. Therefore, the resolution of the second image in the small FoV focal plane can be improved, and the visual effect of human eyes on the first image and the second image in different focal planes is further improved. And because human eyes are more sensitive to the visual experience of the central view field, the depth information and the resolution of the central view field of the human eyes can be enhanced through the image display close range of a small FoV, so that the visual effect of the human eyes can be further improved.

Fig. 5A is a schematic structural diagram of a projection light engine in the display module of the present application. Fig. 5A shows a structure of a first projector engine 301 for emitting red light, green light and blue light through different light paths in the embodiment shown in fig. 4.

As shown in fig. 5A, the first projector 301 adopts Bird Bath folded optical path structure, which includes a Polarization Beam Splitter (PBS) 801, a reflector 802 and a projection eyepiece 803. In the figure, light emitted from a light source on the left side is reflected to a reflector 802 by a PBS801, the reflector 802 reflects incident light to an image displayed on a Microdisplay (Microdisplay) to obtain an optical signal representing the image, and the optical signal is reflected to a projection eyepiece 803 by the PBS again and then is output by the projection eyepiece 803, and the Microdisplay may be a Microdisplay with a Liquid Crystal on Silicon (LCoS) structure, for example. The Light source in the existing projector is usually a white Light Emitting Diode (LED) Light source, and the Light signal for marking the image obtained after the Light from the white Light source irradiates the microdisplay is also in the form of white Light, so that it cannot be directly used in the embodiment shown in fig. 4. The projection light machine in this embodiment is improved on the existing basis, and as shown in fig. 5A, the first projection light machine includes three red light sources, green light sources, and blue light sources, which are independently arranged. The light of the corresponding color emitted by each light source passes through the PBS801, the reflector 802, the micro display, the PBS801 and the projection eyepiece 803 in sequence and then is output to the first light projector 301. The path generates independent red, green, and blue light after illuminating the microdisplay, such that the projection light engine exits the pupil independently for red, green, and blue light of different wavelengths. When the first light signal represents the first image by red, green and blue light, it can be applied to the optical waveguide lens which is independently projected to diffract the light of the corresponding color in the system as shown in fig. 4.

Further, fig. 5B is a schematic structural diagram of an embodiment of a projection light engine in the display module of the present application. The structure shown in fig. 5B is the structure shown in fig. 5A, and further includes a white light source provided independently. That is, when the first light projector 301 in fig. 5A is applied to the embodiment shown in fig. 3, the first light projector 301 needs to include an independent white light source based on the structure in fig. 5A. The white light emitted from the white light source irradiates the microdisplay through the same path to generate the same independent white light as the second light signal in the embodiment of fig. 3, and exits the pupil from the first projector 301 separately from the red light, the green light, and the blue light of the first light signal.

Specifically, fig. 5C to 5F are schematic diagrams of the inner optical path structure of the projector in the display module of the present application. Fig. 5C independently shows the optical path of the light emitted by the single red light source in fig. 5A in the first projection light machine 301, the red light emitted by the red light source sequentially passes through the PBS801, the reflecting mirror 802, the microdisplay, the PBS801 and the projection eyepiece 803 and then is output to the first projection light machine 301, similarly, fig. 5D and 5E independently show the optical paths of the green light source and the blue light source in the first projection light machine 301 in fig. 5A, the directions of the optical paths of the red light source, the green light source and the blue light source in the first projection light machine 301 are all the same, and the red light, the green light and the blue light output by the red light source, the green light source and the blue light source together form a light signal for representing an image on the microdisplay. Fig. 5F independently shows the light path of the light emitted by the single white light source in fig. 5A in the first light-projecting machine 301, the white light emitted by the white light source similarly passes through the PBS801, the reflector 802, the microdisplay, the PBS801 and the projection eyepiece 803 in sequence and then is output to the first light-projecting machine 301, and the white light output by the white light source is the light signal for representing the image on the microdisplay. FIG. 6 is a schematic diagram of an optical path of a projection engine according to the present application; fig. 7 is a schematic view of a light exit structure of a projection light engine according to the present application. As shown in fig. 6, the light path direction of the light in the projection light machine is the same as the light path direction of the white light in the prior art, except that there are three different colors of light in this embodiment, and there is an independent light path for each color of light, and finally, as can be seen in the light-emitting structure diagram of fig. 7, the first projection light machine 301 applied to the embodiment shown in fig. 3 makes the projection light machine emit red light, green light, blue light, and white light independently from different positions by adjusting the relative positions of the red light source, the green light source, the blue light source, and the white light source.

In addition, in order to realize the discrete exit pupil of the projector with more focal power images, more LED light sources can be arranged, and the color can be white, red, blue or green, so as to realize more emergent light paths of the projector. For example, the first projector 301 is provided with a red light source, a blue light source, a green light source and two white light sources; the first projector 301 emits red light, green light, and blue light obtained by the red light source, the blue light source, and the green light source independently through the first optical path; the projector machine independently emits white light obtained by one white light source through the second light path and independently emits white light obtained by the other white light source through the third light path. The principle of the simple number superposition is the same as that of the present embodiment, and is not described again. Therefore, the two kinds of first projection optical machines provided by the above embodiments can be applied to the embodiments shown in fig. 4 and fig. 3, respectively, so that diffraction of a first image formed by emergent light of red light, green light, and blue light respectively emitted by the first projection optical machine after being diffracted by the red light waveguide lens 11, the green light waveguide lens 12, and the blue light waveguide lens 13 is uniform, and crosstalk between light waveguides with different colors does not exist in a diffraction process of each light waveguide lens, so as to improve a visual effect of a human eye on the first image.

Fig. 8 is a schematic structural diagram of an embodiment of a display module according to the present application. As shown in fig. 8, the display module of the present embodiment can provide a solution for achieving more focal length display based on the embodiments shown in fig. 1 or fig. 2.

Specifically, as shown in fig. 8, in this embodiment, on the basis of the embodiment shown in fig. 1 or fig. 2, N white light waveguide lenses are further included, where N is an integer greater than or equal to 1, that is, the display module further includes other white light waveguide lenses besides the white light waveguide lens 21 shown in fig. 1 or fig. 2, for example, a white light waveguide lens 22 is added and N is taken as 1 in fig. 8. The specific composition and the implementation principle of the white optical waveguide lens 22 can be implemented by any of the aforementioned embodiments, and the white optical waveguide lens 22 and the other lenses are also arranged in parallel, and the focal point of the white optical waveguide lens 22 is also on the same straight line with the focal points of the other four optical waveguide lenses. In this embodiment, the display module can increase the focal plane by adding more white light guide lenses.

For example, in the embodiment shown in fig. 8, it includes: in addition to the white light waveguide lens 21 in the foregoing embodiment, a white light waveguide lens 22 is additionally provided, and the white light waveguide lens 22 receives white light from the coupling grating 221, diffracts the white light, and emits the white light from the coupling grating 222, in the same principle as the white light waveguide lens 22 described in the foregoing embodiment. Among them, at least one of the projection optical machines 3 inputs a third optical signal representing a third image into the white light waveguide lens 22 through the third optical path 33, and the third optical signal is white light. The light exiting the white light guide lens 22 presents a third image 613 to the human eye at the third focal plane 63. Wherein the focal lengths of the first focal plane 61, the second focal plane 62 and the third focal plane 63 are all different.

Further, assuming that the FoV of the optical waveguide lens group 1 in fig. 8 is 60 degrees, the at least one projector 3 injects the first optical signal with the FoV of 60 degrees into the optical waveguide lens group 1, and presents the first image 611 with the FoV of 60 degrees on the first focal plane 61 to present a long shot; the FoV of the white light waveguide lens 21 and the white light waveguide lens 22 are both 25 degrees, and the projector engine respectively inputs the second optical signal and the third optical signal with the FoV of 25 degrees into the white light waveguide lens 21 and the white light waveguide lens 22 to respectively present the second image 612 and the third image 613 with the FoV of 25 degrees on the second focal plane 62 and the third focal plane 63 to present a close view.

It should be noted that, as shown in fig. 8, which is only an example when N is 1, if more focal planes are needed to be added to the display module, new white light waveguide lenses 23, 24 … … can be added on the basis of the present embodiment, the projector engine sends different light signals to each white light waveguide lens through different independent light paths, and each added white light waveguide lens can present images with different focal lengths to human eyes in different focal planes, thereby realizing the display function of the display module on more focal planes, particularly only one white light waveguide lens is required to be newly added when one focal plane is added, compared with the mode of adding the focal plane to the superposed optical waveguide lens group 1, the use of the optical waveguide lens is greatly reduced, and the structure of the display module with the display function of a plurality of focal planes can be further simplified.

Fig. 9 is a schematic structural diagram of an embodiment of a display module according to the present application. The display module in the embodiment shown in fig. 9 is implemented by the embodiment shown in fig. 8 in a manner that at least one of the light projectors in the embodiment shown in fig. 4 includes a first light projector 301 and a second light projector 302. Specifically, as shown in fig. 9, the first projector engine 301 is configured to inject a first light signal into the red light waveguide lens 11, the green light waveguide lens 12, and the blue light waveguide lens 13 through a first optical path, and the second projector engine 302 is configured to inject a second light signal into the white light waveguide lens 21 through a second optical path and inject a third light signal into the white light waveguide lens 22 through a third optical path. The specific manner of the incident light signal of the first projector and the second projector may use any manner of the foregoing embodiments, and details are not repeated. In this embodiment, the first optical signal is red light, green light, and blue light, and the second optical signal and the third optical signal are white light, so it is necessary to project light with different representation modes through different optical paths respectively by two independent projection optical machines, the first projection optical machine only needs to be responsible for the first optical signal of red light, green light, and blue light, and the second projection optical machine is responsible for all white light, so as to reduce the requirement for the display performance of the projection optical machine. Alternatively, the second projector may use a single white light source to generate N optical signals of N white light waveguide lenses, or set up N white light sources respectively, and each white light source is responsible for generating 1 optical signal of 1 white light waveguide lens. Similarly, as the example shown in fig. 9 only shows the example when N is 2, if new white light waveguide lenses 23 and 24 … … are added, N optical signals of all N white light waveguide lenses are respectively incident into the corresponding N white light waveguide lenses through different N optical paths by the second projection optical machine, and the specific implementation is the same as that in the foregoing embodiment, and is not described again.

Fig. 10 is a schematic structural diagram of a non-optical field type optical waveguide lens. A structure of a non-optical field type optical waveguide lens generally used in an optical waveguide lens used in a conventional display module is shown in fig. 10, and an optical waveguide lens 70 specifically includes an incoupling grating 701, a pupil expanding grating 703, and an outcoupling grating 703. In fig. 10, the lower part is a human eye 5, and the upper part of the human eye 5 is an optical waveguide lens, and the optical waveguide lens arranged in front of the human eye 5 can be understood as the schematic diagram shown in fig. 3. At least one projection light machine 3 emits light into the optical waveguide lens 70 through the incoupling grating 701 from the same direction as the line of sight of the human eyes 5, and the light exits the diffracted light to the human eyes 5 through the outcoupling grating after sequentially passing through the pupil expanding grating 702 and the outcoupling grating 703. The pupil grating 702 is used to split the light edge propagation to expand the field of view (Eye Box), i.e. after one path of light is sent into the pupil grating 702, three (or more paths not shown) of the same light are sent into the coupling grating 703. The coupling-out grating 703 combines the light and projects the combined light as outgoing light into human eyes, and presents an image corresponding to the light to the human eyes 5. Since the coupling grating 703 is a linear grating, the emergent light passing through the coupling grating 703 is parallel light, and the focus of the parallel light is at infinite distance. The optical waveguide lens 70 of the coupling-out grating 703 using the linear grating has no focal point and is a non-optical field type optical waveguide lens. Since the human eye 5 perceives the parallel light as a planar image, if the red light waveguide lens 11, the green light waveguide lens 12, the blue light waveguide lens 13 and the white light waveguide lens 21 shown in fig. 1 and 2 have such a structure as shown in fig. 10, a convex lens is further required to bring the infinite focal point of the light waveguide lens to a comfortable viewing distance, which makes the structure of the display module complicated.

Therefore, in an embodiment of the present invention, an optical field type optical waveguide lens with optical power is provided, so that the red light waveguide lens 11, the green light waveguide lens 12, the blue light waveguide lens 13, and the white light waveguide lens 21 shown in fig. 1 and fig. 2 can all be realized with a focus by using the optical waveguide lens provided in this embodiment without additionally providing a convex lens in a display module. Specifically, fig. 11 is a schematic structural diagram of an optical field type optical waveguide lens in a display module according to the present application, in which the viewing angle, the incoupling grating 701, and the pupil expanding grating 702 are the same as those shown in fig. 10, except that the outcoupling grating 703 is a bent arc. Specifically, in the embodiment shown in fig. 11, the linear grating shown in fig. 10 needs to be bent, and the bending direction may be upward or downward in the direction shown in the figure, and the downward bending is taken as an example in fig. 11. The coupling-in grating 703 is bent from a linear grating to a curved grating, the emergent light of the bent coupling-out grating 703 is non-parallel light and has a focus, and the larger the bending degree of the coupling-out grating 703 is, the closer the focus of the emergent light is to the optical waveguide lens 70. Therefore, if the red light waveguide lens 11, the green light waveguide lens 12, the blue light waveguide lens 13 and the white light waveguide lens 21 shown in fig. 1 and 2 have such a structure as shown in fig. 11, the coupling grating is curved, so that the image of the light emitted from the coupling grating of the light waveguide lenses has a virtual focus. Optionally, the coupling-out grating 703 in this embodiment may adopt a surface relief type grating, so as to make an image displayed by the light emitted from the optical waveguide lens have a larger FoV according to a characteristic that a Field of view (FoV) of the surface relief type grating is larger, thereby further improving a perception effect of human eyes on the image.

Specifically, for the linear grating used in the optical waveguide lens as shown in fig. 10 as the coupling-out grating, the wave vector of the linear grating is a constant

According to the grating equation

It can be seen that for parallel incident light

Emergent light passing through linear grating

Also parallel light. While the coupling-out grating in the optical waveguide lens shown in fig. 11 is a curved grating, for example, a diffractive lens based on a surface relief grating, the wave vector of the curved grating varies along the coordinates (x, y) of each point in the optical waveguide plane according to the grating equation

It can be seen that even for parallel incident light

Emergent light passing through curved grating

The virtual focus is propagated and formed according to the grating equation, and the larger the degree of bending of the grating from the straight line, the shorter the distance of the virtual focus from the waveguide lens.

For example: the light guide lens with the curved surface relief grating described above can be simulated by means of binary grating profiles in the optical simulation software Zemax or Fred. Wherein the binary grating surface type passes through a phase formula polynomial

The continuous phase change of the grating surface is calculated. Wherein phi isPhase of the binary grating surface, M being the polynomial coefficient to calculate the phase, each A_iρ²ⁱAnd the ith monomials are provided, wherein A in each polynomial is a grating coefficient, rho is a coordinate of a specific direction and a range, the higher the subscript of the grating coefficient is, the higher the order of the polynomial is represented, and the N monomials are added to obtain a phase formula so as to represent the fluctuation of the grating surface. Specifically, the focal length of the light guide lens simulating different bending degrees can be adjusted by adjusting the grating coefficient of each term in the above polynomial. For example: when the virtual focal length is infinity, only A2 in the grating coefficients A1-A15 corresponding to emergent light in the direction vertical to the waveguide lens is not 0, so the emergent light is parallel light, and the focal length of the waveguide lens is infinity; if adjusting the grating coefficients of the outgoing light in different directions, for example, adjusting a4, a6, a11, a13 and a15 at intervals can make the surface of the grating undulate to achieve the effect of grating bending, when the grating coefficients are respectively the values in the following table, the focal length of the waveguide lens is 100mm and 2000 mm. It should be noted that the above values of the grating coefficients are only examples, and the adjustment of different parameters to obtain different focal lengths are within the scope of the present embodiment. For the use of simulation software and other related parameter settings, reference may be made to software and setting methods in the prior art, and the present embodiment is not limited thereto.

Fig. 12 is a schematic view of a light-emitting structure of a white light waveguide lens in a display module according to the present application, further illustrating a possible light-emitting structure of the white light waveguide lens in the above embodiments.

Specifically, in the prior art, the exit pupil grating of the optical waveguide lens for diffracting white light all adopts a holographic grating, so that the FoV of the optical waveguide lens is narrow and has a certain wavelength selectivity. In the embodiments of the present application, the exit pupil grating of the white light waveguide lens uses a surface relief grating, so that the white light waveguide lens has improved FoV and no wavelength selectivity. As shown in fig. 8, when the white optical waveguide lens is realized by glass having a refractive index of 2.0, there is about 60 degrees with respect to the lateral FoV of the outgoing light after diffraction in the white optical waveguide lens of red light (wavelength 633nm), green light (wavelength 532nm), and blue light (455nm) incident on the white optical waveguide lens, and the outgoing light of each monochromatic light is not completely overlapped laterally. On the other hand, the white light waveguide lens has a lateral FoV of only 25 degrees when combined with the overlapping portion of the outgoing light diffracted by the red light, the green light, and the blue light.

Therefore, when the white optical waveguide lens using the surface relief grating in the present embodiment is applied to the embodiments shown in fig. 1 and fig. 2, it is able to display an image of a short-range view of a small FoV in the second focal plane when the red, green and blue optical waveguide lenses are responsible for displaying an image of a long-range view of a large FoV in the first focal plane, that is, the focal length of the first focal plane is greater than that of the second focal plane of the white optical waveguide lens. For example, when the display module needs to display content that a person walks to near from far, when the person is far, the image of the person generated by the projection optical machine at far is presented to the human eyes by the red light waveguide lens, the green light waveguide lens and the blue light waveguide lens, and when the person walks to near, the image of the person generated by the projection optical machine at near is presented to the human eyes by the white light waveguide lens, and the distance is relative concept, and different focal planes can be set according to actual needs. Because human eyes are more sensitive to the visual experience of the central view field, the depth information and the resolution of the central view field of the human eyes can be enhanced through the image display close range of a small FoV, and therefore the visual effect of the human eyes can be further improved. And adopt the display module assembly of this embodiment display mode, through the red light waveguide lens that contains three lenses, green light waveguide lens and the big FoV image of blue light waveguide lens display, the white light waveguide lens of single lens shows little FoV's image alone, and the mode that the two combined together not only makes the display module assembly guarantee under the prerequisite of FoV maximize, compromise the display of big FoV, the high resolution of display content and comparatively simplify the structure of frivolous display module assembly.

FIG. 13 is a schematic structural diagram of an AR/VR display device according to an embodiment of the present application. The AR/VR display device as shown in FIG. 13 includes a display module as shown in any one of FIGS. 1-12. Specifically, as shown in fig. 13, the AR/VR display device includes the two display modules, which are respectively used for displaying AR/VR contents to the left eye and the right eye of the user. The AR/VR content may be the first image, the second image, and the third image described in the above embodiments. Further, the AR/VR display device further includes: a sensor, a processor, a memory, and a power source. The processor can be connected with a communication network through the network communication module, acquires images needing to be displayed from a server located at a user side or a network side through the communication network, and sends the acquired images to a projection light machine in the display module to be displayed. Or, when the storage of the AR/VR display device stores the image to be displayed, the processor may also directly send the image in the storage to the projector in the display module for displaying. FIG. 14 is a schematic structural diagram of an AR/VR display device according to an embodiment of the present application. Fig. 14 is a system circuit configuration diagram showing the AR/VR display apparatus shown in fig. 13. The processing unit is the processor in the above embodiment, the memory may be used to store images to be displayed, the network communication module is used to connect to a communication network, and the power supply is used to supply power to the modules in the whole AR/VR display device. The micro display circuit system is used for displaying an image to be displayed in a micro display of the projection light machine, and the display illumination driver is used for driving light emitted by an illumination unit of the projection light machine to obtain an optical signal for representing the image after the light passes through the micro display. The sensor unit is used for processing the dynamic information and the position information of the user acquired by the AR/VR display device so as to adjust the displayed image content according to the posture of the user. The embodiment shows only one implementation manner of the AR/VR display device, and the emphasis is that the AR/VR display device includes a display module. Reference may be made to the common general knowledge in the art of AR/VR applications where other modules in the AR/VR display device are not or not shown in their entirety, and the application is not limited thereto.

FIG. 15 is a schematic structural diagram of an AR/VR display device according to an embodiment of the present application. The application scenario shown in fig. 15 is that the AR/VR display apparatus shown in fig. 13 is applied to an AR/VR scenario interacting with a virtual object at a short distance, allowing images to be displayed at a close distance that can be touched by a human hand, and can be applied to a scenario in which a human interacts with a virtual object at a short distance. Specifically, the AR/VR display device may determine a position of a hand of the user through the gesture recognition and positioning system, and retrieve the virtual object to be displayed from the storage system, and the processor of the display device combines the acquired actual images with the pre-virtual object through an image algorithm, so as to obtain that the virtual object in the image to be displayed is located in the hand of the user, and send the image to be displayed to the display system for displaying, where the display system is the display module in the above embodiment. FIG. 16 is a schematic structural diagram of an AR/VR display device according to an embodiment of the present application. The application scenario of FIG. 16 is an AR/VR application in which the AR/VR display device of FIG. 13 is applied to a virtual game scenario. Specifically, the AR/VR display device retrieves a virtual object to be displayed from the storage system, determines the operation of the user on the virtual object through the gesture recognition and positioning system, combines the acquired actual images with the pre-virtual object through the image algorithm, obtains the virtual object in the image to be displayed, moves according to the operation of the user, and sends the image to be displayed to the display system for displaying, where the display system is the display module in the above embodiment. In addition, the image resource to be displayed in the network can be acquired through the wireless network and stored in the storage system for calling. FIG. 17 is a schematic structural diagram of an AR/VR display device according to an embodiment of the present application. The application scenario of FIG. 17 is an AR/VR scenario in which the AR/VR display device of FIG. 13 is applied to a 3D video conference. The equipment is used for collecting images and audios to be displayed through the microphone and the camera and sending the images and the audios to the storage system of the AR/VR display device through the wireless network, so that the images to be displayed are sent to the display system for displaying after being processed through an image algorithm by the AR/VR display device, the display system is the display module in the embodiment, and meanwhile the AR/VR display device also synchronously broadcasts the received audios and the images. It should be noted that the objects processed in the embodiments shown in fig. 15 to fig. 17 may be single images or video contents, and the video contents may be understood as continuous images, and for each single image in the continuous images, the manner and principle of processing the single image by the display module in the foregoing embodiments of the present application may be adopted.

Fig. 18 is a schematic flowchart of an embodiment of an imaging method according to the present application. The imaging method shown in fig. 18 can be used for the display module shown in fig. 1 to present images at the first focal plane or the second focal plane. The imaging method of the embodiment comprises the following steps:

s101: a first optical signal representing a first image and a second optical signal representing a second image are acquired.

S102: the red light in the first optical signal is diffracted by the first optical path and then emitted, the green light in the first optical signal is diffracted by the first optical path and then emitted, and the blue light in the first optical signal is diffracted by the first optical path and then emitted, so that a first image is presented on a first focal plane.

S103: and diffracting the white light in the second optical signal through a second optical path and then emitting the white light to present a second image on a second focal plane, wherein the second focal plane and the first focal plane are on different planes.

The sequence of S102 and S103 is not specifically limited, and in this embodiment, S102 may be executed after S103 is executed, or S102 and S103 may be executed simultaneously.

The imaging method shown in fig. 18 can be implemented in the display module shown in fig. 1, and the specific implementation manner and principle thereof are the same as those described in the embodiment of fig. 1, and are not described again.

Optionally, in the above embodiment, the first optical path includes: a red light path, a green light path, and a blue light path. S102 in the foregoing embodiment specifically includes: the red light in the first optical signal is diffracted by the red optical path and then emitted, the green light in the first optical signal is diffracted by the green optical path and then emitted, and the blue light in the first optical signal is diffracted by the blue optical path and then emitted.

Optionally, S101 in the above embodiment specifically includes: a first light signal representing a first image and a second light signal representing a second image are generated by a first light projector.

Optionally, in the above embodiment, S101 specifically includes: the red light source independently arranged by the first projection light machine generates red light, the green light source independently arranged by the first projection light machine generates green light, and the blue light source independently arranged by the first projection light machine generates blue light; the first light signal representing the first image comprises red light, green light, and blue light; and white light is generated by a white light source arranged on the first projector.

Optionally, S101 in the above embodiment specifically includes: a first light signal representing a first image is generated by a first light projector and a second light signal representing a second image is generated by a second light projector.

Optionally, S101 in the above embodiment specifically includes: the first light signal representing the first image comprises red light, green light and blue light; and white light is generated by a white light source arranged on the second projector.

Optionally, in the above embodiment, the method further includes: acquiring N optical signals, wherein the N optical signals carry different images, and N is an integer greater than or equal to 1; and the N optical signals are diffracted through the N optical paths and then emitted out, so that N images corresponding to the N optical signals are presented on different N focal planes.

Optionally, in the above embodiment, S102 specifically includes: the first image is presented at a first focal plane by diffracting red light in the first light signal by the red light waveguide mirror and exiting the exit pupil grating, diffracting green light in the first light signal by the green light waveguide mirror and exiting the exit pupil grating, and diffracting blue light in the first light signal by the blue light waveguide mirror and exiting the exit pupil grating. The exit pupil gratings of the red light waveguide lens, the green light waveguide lens and the blue light waveguide lens are all arc-shaped, and the focuses of the red light waveguide lens, the green light waveguide lens and the blue light waveguide lens are all located in a first focal plane.

Optionally, in the above embodiment, S103 specifically includes: the white light in the second optical signal is diffracted by the white light waveguide lens and then emitted from the exit pupil grating. The exit pupil grating of the white light waveguide lens is arc-shaped, and the focus of the white light waveguide lens is positioned in the second focus plane.

The imaging method shown in each of the above embodiments can be implemented in the display module shown in the above embodiments, and the specific implementation manner and principle thereof are consistent with those described in the above embodiments, and will not be described again.

The present application further provides an apparatus comprising: a processor and a memory; the memory is used for storing programs; the processor is configured to call a program stored in the memory to perform the imaging method according to any one of the above embodiments.

The present application also provides a computer-readable storage medium having stored therein program code which, when executed, performs the imaging method as in any one of the above embodiments.

The present application also provides a computer program product comprising program code that, when executed by a processor, implements the imaging method as in any one of the above embodiments.

Fig. 19 is a schematic structural diagram of an embodiment of an augmented reality device according to the present application. As shown in fig. 19, the augmented reality device 19 provided in this embodiment includes: a sensor 1901 and a display module 1902. In some possible embodiments, a positioning device 1903 and a processor 1904 may also be included. The display module 1902 may be any one of the display modules described in the previous embodiments of the present application. The sensor 1901 is configured to obtain a real scene map where the augmented reality device 19 is located; the positioning device is used for determining the space position of the augmented reality device 19; the processor 1904 is configured to perform image processing according to the real scene image and the spatial position of the augmented reality device 19; the processed image is imaged on at least two focal planes through the display module 1902 and is displayed to the user in superposition with the real scene graph.

Fig. 20 is a schematic structural diagram of a virtual reality device according to an embodiment of the present application. As shown in fig. 20, the virtual reality device 20 provided in the present embodiment includes: a display module 2001 and a processor 2003. In some possible embodiments, a positioning device 2002 may also be included. The display module 2001 may be any one of the display modules described in the previous embodiments of the present application. The positioning device is used for determining a spatial position of the virtual reality apparatus 20, and the processor 2003 is used for performing image processing according to the spatial position of the virtual reality apparatus 20, and controlling a projector in the display module to generate a first optical signal representing a first image and a second optical signal representing a second image. The processed image is imaged on at least two focal planes by the display module 2001 and presented to the user.

Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

Claims

1. The utility model provides a display module assembly, its characterized in that, display module assembly includes in being applied to augmented reality's display device or virtual reality's display device:

2. The display module of claim 1,

the first light path comprises a red light path, a green light path and a blue light path;

the at least one projector is specifically configured to inject the red light into the red light waveguide lens through the red light path, inject the green light into the green light waveguide lens through the green light path, and inject the blue light into the blue light waveguide lens through the blue light path.

3. The display module according to claim 1 or 2,

the at least one light projector engine comprises: a first projector for projecting a first optical signal representing a first image through the first optical path into the red light waveguide lens, the green light waveguide lens, and the blue light waveguide lens; and a second optical signal representing a second image is incident on the white light waveguide lens through the second optical path.

4. The display module of claim 3,

the first light projector includes: the red light source, the green light source, the blue light source and the white light source are independently arranged;

wherein the red light source is configured to generate the red light, the green light source is configured to generate the green light, and the blue light source is configured to generate the blue light; the first light signal representing a first image comprises the red, green, and blue light;

the white light source is configured to generate the white light, and the second optical signal representing the second image is the white light.

5. The display module according to claim 1 or 2,

the at least one light projector engine comprises: the first projector is used for transmitting a first optical signal representing a first image to the red light waveguide lens, the green light waveguide lens and the blue light waveguide lens through the first optical path; the second projector is used for transmitting a second optical signal representing a second image to the white light waveguide lens through the second optical path.

6. The display module of claim 5,

the first light projector includes: a red light source, a green light source and a blue light source, wherein the red light source is configured to generate the red light, the green light source is configured to generate the green light, the blue light source is configured to generate the blue light, and the first light signal representing the first image includes the red light, the green light and the blue light;

the second light projector includes: and a white light source for generating the white light, wherein the second optical signal representing the second image is the white light.

7. The display module according to any one of claims 1 to 4 and 6, further comprising: n white light waveguide lenses, N is an integer greater than or equal to 1;

8. The display module according to any one of claims 1-4 and 6,

9. The display module according to any one of claims 1-4 and 6,

the exit pupil grating of the white optical waveguide lens is arc-shaped, and the focus of the white optical waveguide lens is positioned in the second focus plane.

10. An imaging method applied to the display module according to any one of claims 1 to 9, comprising:

11. The imaging method of claim 10, wherein the first optical path comprises: a red light path, a green light path and a blue light path; the diffracting red light in the first optical signal by the first optical path and emitting, diffracting green light in the first optical signal by the first optical path and emitting, and diffracting blue light in the first optical signal by the first optical path and emitting includes:

12. The imaging method according to claim 10 or 11, wherein the acquiring a first light signal representing a first image and a second light signal representing a second image comprises:

and generating the first light signal for representing the first image and the second light signal for representing the second image through a first projection light machine.

13. The imaging method of claim 12, wherein the generating, by a first projector engine, the first light signal representing a first image and the second light signal representing a second image comprises:

the red light is generated by a red light source independently arranged by the first projector, the green light is generated by a green light source independently arranged by the first projector, and the blue light is generated by a blue light source independently arranged by the first projector; the first light signal representing a first image comprises the red, green, and blue light; and generating the white light by a white light source arranged on the first projector.

14. The imaging method according to claim 10 or 11, wherein the acquiring a first light signal representing a first image and a second light signal representing a second image comprises:

and generating the first optical signal for representing the first image through a first projection light machine, and generating the second optical signal for representing the second image through a second projection light machine.

15. The method of claim 14, wherein generating the first light signal representing the first image with a first light projector engine and the second light signal representing the second image with a second light projector engine comprises:

generating the red light by a red light source independently disposed by the first projector, generating the green light by a green light source independently disposed by the first projector, and generating the blue light by a blue light source independently disposed by the first projector, the first light signal representing the first image including the red light, the green light, and the blue light; and generating the white light by a white light source arranged on the second projector.

16. The imaging method according to any one of claims 10, 11, 13, 15, further comprising:

acquiring N optical signals, wherein the N optical signals carry different images, and N is an integer greater than or equal to 1;

17. The imaging method according to any one of claims 10, 11, 13, and 15, wherein the diffracting red light in the first light signal by a first light path and emitting, the diffracting green light in the first light signal by the first light path and emitting, the diffracting blue light in the first light signal by the first light path and emitting comprises:

diffracting red light in the first light signal by a red light waveguide optic and exiting from an exit pupil grating, diffracting green light in the first light signal by a green light waveguide optic and exiting from an exit pupil grating, diffracting blue light in the first light signal by a blue light waveguide optic and exiting from an exit pupil grating to present the first image at a first focal plane;

18. The imaging method according to any one of claims 10, 11, 13, and 15, wherein the diffracting the white light in the second optical signal by the second optical path and emitting the diffracted white light includes:

19. An augmented reality device, comprising:

a sensor for acquiring a real scene image;

and the display module according to any one of claims 1 to 9, wherein the display module is configured to image on at least two focal planes and to be displayed to a user in superposition with the real scene image.

20. A virtual reality device, comprising:

the display module according to any one of claims 1 to 9, for imaging on at least two focal planes and presenting to a user;

and the processor is used for controlling a projection light machine in the display module to generate a first light signal representing the first image and a second light signal representing the second image.