CN117590604A - Multi-screen spliced display method, near-to-eye display system and head-mounted display device - Google Patents

Abstract

The embodiment of the application provides a multi-screen spliced display method, a near-to-eye display system and head-mounted display equipment; the multi-screen spliced display method is applied to a near-eye display system, and the near-eye display system comprises a first screen and a second screen, wherein the first screen and the second screen are parallel and are arranged in a staggered mode, a first camera is arranged opposite to the first screen, a second camera is arranged opposite to the second screen, a first light splitting element is arranged between the first screen and the first camera, and a second light splitting element is arranged between the second screen and the second camera; the multi-screen spliced display method comprises the steps of controlling a first camera to shoot a first image of a first screen and controlling a second camera to shoot a second image of a second screen; acquiring a first brightness value of a first image and a second brightness value of a second image; and when the brightness difference value of the first brightness value and the second brightness value is larger than the target value and the duration time is longer than the set duration time, reducing the brightness of the screen with the maximum brightness in the first screen and the second screen.

Description

Multi-screen spliced display method, near-to-eye display system and head-mounted display device

Technical Field

The embodiment of the application relates to the technical field of optical imaging, in particular to a multi-screen spliced display method, a near-eye display system and head-mounted display equipment.

Background

In recent years, a high-speed development situation is presented by a virtual reality head display type product. However, the method is limited by factors such as processing technology and production cost of the screen, and the method is suitable for small-size screens of virtual reality head display products, and is difficult to meet the requirement of high resolution. The traditional scheme for improving the resolution of the screen integrates as many pixel points as possible on the limited area of a single screen, and the scheme leads to high processing cost and high processing difficulty of the screen, and low yield of products, which is not suitable for mass production.

Disclosure of Invention

The purpose of the application is to provide a novel technical scheme of a multi-screen spliced display method, a near-eye display system and head-mounted display equipment.

In a first aspect, an embodiment of the present application provides a multi-screen tiled display method, which is applied to a near-eye display system, where the near-eye display system includes a first screen and a second screen, the first screen and the second screen are parallel and are arranged in a staggered manner, a first camera is arranged opposite to the first screen, a second camera is arranged opposite to the second screen, a first light splitting element is arranged between the first screen and the first camera, and a second light splitting element is arranged between the second screen and the second camera;

the multi-screen spliced display method comprises the following steps:

controlling the first camera to shoot a first image of the first screen, and controlling the second camera to shoot a second image of the second screen;

acquiring a first brightness value of the first image and a second brightness value of the second image;

and when the brightness difference value of the first brightness value and the second brightness value is larger than a target value and the duration time is longer than a set duration time, reducing the brightness of the screen with the maximum brightness in the first screen and the second screen so that the brightness difference value is smaller than or equal to the target value.

Optionally, the multi-screen tiled display method further includes:

acquiring the gray value of the first image and the gray value of the second image;

acquiring the first brightness value according to the gray value of the first image;

and acquiring the second brightness value according to the gray value of the second image.

Optionally, the target value is 2nit, and the set duration is more than or equal to 0.5s.

Optionally, the multi-screen tiled display method further includes:

at any time, the brightness difference value between the first brightness value and the second brightness value is controlled to be less than or equal to 2nit.

Optionally, the near-eye display system further includes a lens, the second light splitting element is located between the lens and the first light splitting element, a short side of the second light splitting element is vertically connected with a short side of the first light splitting element, and a short side size of the second light splitting element is smaller than a short side size of the first light splitting element;

the first image light emitted by the first screen is emitted to the first light-splitting element, a part of the first image light is reflected to the lens to form a first display picture, and the other part of the first image light is transmitted to the first camera, and the first camera receives light rays and shoots a first image of the first screen;

the second image light emitted by the second screen is emitted to the second light splitting element, a part of the second image light is reflected to the lens to form a second display picture, and the other part of the second image light is transmitted to the second camera, and the second camera receives the light and shoots a second image of the second screen.

Optionally, the first display picture and the second display picture are spliced in a single eye to form a target image; the target image has a superposition area of the first display picture and the second display picture, and the area of the superposition area is 5% -10% of the display area of the screen with the smallest display area in the first screen and the second screen.

In a second aspect, an embodiment of the present application provides a near-eye display system, where the near-eye display system includes a lens barrel, and a first screen, a second screen, a first camera and a second camera that are disposed on an inner wall of the lens barrel;

the first screen and the second screen are parallel and arranged in a staggered manner;

the first camera is positioned right opposite to the first screen and used for acquiring a first image of the first screen; the second camera is positioned right opposite to the second screen and used for acquiring a second image of the second screen;

the near-eye display system further comprises a first light-splitting element and a second light-splitting element which are arranged in the inner cavity of the lens barrel, wherein the first light-splitting element is positioned between the first camera and the first screen in the radial direction of the lens barrel, and the second light-splitting element is positioned between the second camera and the second screen.

Optionally, the first light splitting element and the second light splitting element are half-reflecting half-lenses and are rectangular;

one short side of the first light-splitting element is vertically connected with one short side of the second light-splitting element, and in the vertical connection position, the short side size of the second light-splitting element is smaller than that of the first light-splitting element, so that a hollow area is formed at one side of the second light-splitting element.

Optionally, the first light splitting element forms a first included angle with respect to the first screen, the second light splitting element forms a second included angle with respect to the second screen, and the first included angle and the second included angle are: 45 ° ± 0.5 °.

Optionally, along a radial direction of the lens barrel: the front projection of the first camera on the first screen is positioned at the center of the first screen, and the front projection of the second camera on the second screen is positioned at the center of the second screen.

Optionally, the near-eye display system further comprises a lens, and the lens is arranged at one end of the lens barrel;

the second light splitting element is positioned between the lens and the first light splitting element;

part of the first image light emitted by the first screen is reflected to the lens through the first light-splitting element, and part of the second image light emitted by the second screen is reflected to the lens through the second light-splitting element.

Optionally, the wall surface of the lens barrel is of a straight wall structure, and two opposite ends of the lens barrel are arc-shaped;

the first screen and the second screen are respectively embedded in the inner wall of the lens barrel, and are respectively arranged in parallel with the wall surface of the lens barrel.

Optionally, the first camera and the second camera are respectively embedded in the inner wall of the lens barrel;

the first camera is used for shooting a first image of the first screen;

the second camera is used for shooting a second image of the second screen.

In a third aspect, the present application provides a head mounted display device. The head-mounted display device includes:

a housing; and

the near-eye display system of the first aspect, the near-eye display system being disposed in the housing.

The beneficial effects of this application are:

the embodiment of the application provides a multi-screen spliced display method which is applied to the multi-screen display light path design of VR products, and can realize the functions of monitoring the brightness conditions of different screens in real time and dynamically adjusting the brightness difference between the screens in the light path; the optical scheme solves the problems that the resolution of the screen of the virtual reality product is not high and the definition of the screen is not enough; the resolution and definition of imaging display can be improved on the basis that the appearance structure of the virtual reality product is not affected, the quality of an output picture of the virtual reality product can be improved, and the optical display effect of the virtual reality product can be more vivid.

Other features of the present specification and its advantages will become apparent from the following detailed description of exemplary embodiments thereof, which proceeds with reference to the accompanying drawings.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the specification and together with the description, serve to explain the principles of the specification.

Fig. 1 is a schematic structural diagram of a near-eye display system according to an embodiment of the present application;

fig. 2 is a schematic structural diagram of a combination of a first light splitting element and a second light splitting element of a near-eye display system according to an embodiment of the present application;

fig. 3 is a first image mosaic display effect diagram of the near-eye display system provided in the embodiment of the present application;

fig. 4 is a second image mosaic display effect diagram of the near-eye display system provided in the embodiment of the present application;

fig. 5 is an external view of a lens barrel of a near-eye display system according to an embodiment of the present application.

Reference numerals illustrate:

1. a first screen; 2. a second screen; 3. a first camera; 4. a second camera; 5. a lens barrel; 6. a first spectroscopic element; 7. a second light splitting element; 8. a lens; 01. a human eye; 11. a first display screen; 21. a second display screen; 61. a first field of view coverage area; 71. the second field of view covers the area.

Detailed Description

Various exemplary embodiments of the present application will now be described in detail with reference to the accompanying drawings. It should be noted that: the relative arrangement of the components and steps, numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present application unless it is specifically stated otherwise.

The following description of at least one exemplary embodiment is merely exemplary in nature and is in no way intended to limit the application, its application, or uses.

Techniques and equipment known to those of ordinary skill in the relevant art may not be discussed in detail, but should be considered part of the specification where appropriate.

In all examples shown and discussed herein, any specific values should be construed as merely illustrative, and not a limitation. Thus, other examples of exemplary embodiments may have different values.

It should be noted that: like reference numerals and letters denote like items in the following figures, and thus once an item is defined in one figure, no further discussion thereof is necessary in subsequent figures.

The multi-screen tiled display method, the near-eye display system and the head-mounted display device provided by the embodiment of the application are described in detail below with reference to the accompanying drawings.

According to an aspect of the embodiments of the present application, a multi-screen tiled display method is provided, which can be applied to optical path design of a near-eye display system, where the near-eye display system is applicable to a virtual reality display device such as a VR headset display device.

According to the multi-screen spliced display method provided by the embodiment of the application, the multi-screen spliced display method is applied to a near-eye display system, referring to fig. 1 and 2, the near-eye display system comprises a first screen 1 and a second screen 2, the first screen 1 and the second screen 2 are parallel and arranged in a staggered mode, a first camera 3 is arranged opposite to the first screen 1, a second camera 4 is arranged opposite to the second screen 2, a first light splitting element 6 is arranged between the first screen 1 and the first camera 3, and a second light splitting element 7 is arranged between the second screen 2 and the second camera 4.

It should be noted that, the multi-screen tiled display method provided in the embodiment of the present application is implemented by the above-mentioned near-eye optical system, and includes the following steps:

step S1, controlling the first camera 3 to shoot a first image of the first screen 1, and controlling the second camera 4 to shoot a second image of the second screen 2;

s2, acquiring a first brightness value of the first image and a second brightness value of the second image;

step S3, when the luminance difference value between the first luminance value and the second luminance value is greater than the target value S and the duration is longer than the set duration T, the luminance of the screen with the maximum luminance among the first screen 1 and the second screen 2 may be controlled to be reduced so that the luminance difference value is less than or equal to the target value S.

According to the multi-screen tiled display method provided in the above embodiment of the present application, the multi-screen tiled display method is applied to the above near-eye display system, see the optical architecture of the near-eye display system shown in fig. 1, which is a special display light path design of a single-eye corresponding dual-screen, and can achieve double improvement of single-eye resolution by using a mode of stitching and compositing two screen images, see fig. 3, and certainly, can also improve binocular resolution.

For example, the single screen resolution in current VR devices can only reach up to 4K. However, the optical scheme provided by the embodiment of the application can realize the resolution above 8K for the monocular, so that the monocular resolution and the binocular resolution are multiplied.

The resolution is also called resolution and resolution. In general, the higher the resolution of an image, the more pixels it contains and the more clear the image. Resolution may be expressed as the number of pixels in each direction.

From the comprehensive point of view of improving visual experience and production cost control of a user, the near-to-eye display system based on the optical scheme of the embodiment of the application adopts two screens, namely the first screen 1 and the second screen 2, and realizes multi-image splicing and fusion by matching with a special light path design, so that the resolution of imaging display can be greatly improved.

Specifically, referring to fig. 3, the first display screen 11 formed by the first screen 1 and the second display screen 21 formed by the second screen 2 may be subjected to image stitching and fusion in a single eye, which achieves a multiple increase in resolution of imaging display. In this case, the resolution of the single screen can be reduced, and the design requirement of the production cost of the virtual reality product is met. For example, two screens with lower resolution may be selected for use in combination, which may reduce production costs compared to a single screen with very high resolution.

It should be noted that, the multi-screen display system provided in the embodiment of the present application includes, but is not limited to, performing image stitching and fusion by using two screens, and may further increase the number of screens as required.

For example, when two or more screens are adopted as the monocular display screen, if the display brightness difference value between different screens is too large, the effect of image stitching and fusion may be poor, thereby greatly affecting the viewing experience of the user. Therefore, in the multi-screen display system provided by the embodiment of the application, the brightness uniformity of two screens is monitored in real time and is dynamically adjusted, so that the brightness difference value between different screens is always maintained in a smaller range, namely, the brightness difference value does not exceed the preset threshold S in the whole process of using the multi-screen display system to carry out viewing experience, and the user' S viewing experience can be further improved through the design.

The technical implementation of the multi-screen tiled display method provided by the embodiment of the application mainly depends on a first screen 1, a second screen 2, a first camera 3, a second camera 4 which are arranged at specific positions, and an optical foldback structure which is combined with two screens and two cameras, wherein the optical foldback structure can be formed by splicing a first light splitting element 6 and a second light splitting element 7.

The first screen 1 and the second screen 2 are disposed in a lens barrel 5 in a staggered and parallel manner, for example, see fig. 1, and a light-emitting side of each screen is specially designed with a light-splitting element, which can be used for transmitting the image light emitted by each screen in two paths according to a specific light path track: one path of light is reflected to the lens 8 for imaging display, the other path of light is transmitted to the corresponding camera, and the camera receives light to shoot a current picture of the screen so as to acquire the brightness condition of the screen.

The first camera 3 and the second camera 4 are, for example, color cameras.

The first camera 3 has, for example, a first angle of view, which is defined, for example, as a first field of view coverage area 61, which is to cover at least more than 90% of the area displayed on the first screen 1, see fig. 4. So that the brightness of the first screen 1 can be accurately obtained.

Wherein the second camera 4 has, for example, a second field angle, which is defined, for example, as a second field coverage area 71, which is to be able to cover at least more than 90% of the area of the second screen 2 display, see fig. 4. So that the brightness of the second screen 2 can be accurately obtained.

For example, when the first screen 1 and the second screen 2 are normally displayed, the first camera 3 is used for taking a picture of the first screen 1 in real time, and the second camera 4 is used for taking a picture of the second screen 2 in real time.

Specifically, the first screen 1 emits, for example, first image light, and after the first image light encounters the first light-splitting element 6, a part of the first image light is reflected, and a part of the first image light is transmitted, wherein the first image light transmitted through the first light-splitting element 6 can be received and imaged by the first camera 3.

Likewise, the second screen 2 emits, for example, second image light, which, after passing through the second light-dividing element 7, is partly reflected and partly transmitted, wherein the second image light transmitted through the second light-dividing element 7 can be received by the second camera 4 for imaging.

The first camera 3 and the second camera 4 take images (photos) at a certain frame rate, and then monitor the brightness of each screen through the gray value of the taken photos.

The embodiment of the application provides a multi-screen spliced display method which is applied to the multi-screen display light path design of VR products, and can realize the functions of monitoring the brightness conditions of different screens in real time and dynamically adjusting the brightness difference between the screens in the light path; the optical scheme solves the problems that the resolution of the screen of the virtual reality product is not high and the definition of the screen is not enough; the resolution and definition of imaging display can be improved on the basis that the appearance structure of the virtual reality product is not affected, the quality of an output picture of the virtual reality product can be improved, and the optical display effect of the virtual reality product can be more vivid.

According to some examples of the present application, the multi-screen tiled display method further includes the steps of:

a1, acquiring a gray value of the first image and a gray value of the second image;

a2, acquiring the first brightness value according to the gray value of the first image; and acquiring the second brightness value according to the gray value of the second image.

When the first screen 1 and the second screen 2 are normally displayed, the first camera 3 opposite to the first screen 1 can be used for shooting the screen of the first screen 1, and the second camera 4 opposite to the second screen 2 can be used for shooting the picture of the second screen 2, and on the basis of this, the brightness value of the screen can be converted according to the gray value of the picture obtained by shooting. By means of this step, the brightness condition of the corresponding screen can be acquired from the taken screen photograph. Thus, the brightness of the two screens can be monitored in real time.

The first camera 3 and the second camera 4 are always operated during the use of the near-eye display system by the user. I.e. the monitoring and adjustment of the first screen 1 and the second screen 2 is performed in real time.

Furthermore, the gray values of the first camera 3 and the second camera 4 taking the same picture should be the same.

Optionally, before the first camera 3 and the second camera 4 are assembled into the lens barrel 5, gray scale calibration is performed on the first camera 3 and the second camera 4. The calibrated first camera 3 and the second camera 4 can shoot pictures obtained by the same picture card under the same environment, and the gray value difference of the two pictures after gray conversion is the same. Therefore, the two cameras can achieve accurate brightness adjustment effect in the dynamic brightness adjustment of the multi-screen splicing scheme.

According to some examples of the present application, the target value is 2nit, and the set time period is equal to or longer than 0.5s.

When the brightness difference value of the first screen 1 and the second screen 2 at a certain moment is greater than 2nit and the duration is more than or equal to 0.5s, the brightness of the screen with higher brightness of the first screen 1 and the second screen 2 can be controlled to be dimmed, so that the brightness difference value of the two screens can be always maintained within 2nit. Thus, the influence on the viewing experience of the user caused by overlarge display brightness difference among different screens can be avoided.

According to some examples of the present application, the multi-screen tiled display method further includes: at any time, the brightness difference value between the first brightness value and the second brightness value is controlled to be less than or equal to 2nit.

Wherein the first luminance value is the luminance value of the first screen 1, and the second luminance value is the luminance value of the second screen 2. According to the above example, in order to ensure the viewing experience of the user, when the user uses the near-eye display system, the brightness difference value between the first screen 1 and the second screen 2 needs to be controlled in real time by a multi-screen splicing display method, that is, the brightness difference value of the two is preferably not more than 2nit, so that the splicing and fusion effects of the two screen images are better.

According to some examples of the present application, the near-eye display system further includes a lens 8, the second light splitting element 7 is located between the lens 8 and the first light splitting element 6, a short side of the second light splitting element 7 is perpendicularly connected to a short side of the first light splitting element 6, and a short side dimension of the second light splitting element 7 is smaller than a short side dimension of the first light splitting element 6;

the first image light emitted by the first screen 1 is directed to the first light splitting element 6, a part of the first image light is reflected to the lens 8 to form a first display screen 11, and another part of the first image light is transmitted to the first camera 3, and the first camera 3 receives the light and captures a first image of the first screen 1;

the second image light emitted from the second screen 2 is directed to the second light splitting element 7, a part of the second image light is reflected to the lens 8 to form a second display screen 21, and another part of the second image light is transmitted to the second camera 4, and the second camera 4 receives the light and captures a second image of the second screen 2.

Wherein the number of lenses 8 includes, but is not limited to, one.

The number of lenses 8 may be adjusted as desired, and is not limited in this application.

Wherein the lens 8 is for example arranged at one end of the barrel 5, see fig. 1.

Specifically, the lens 8 may be disposed at an end of the lens barrel 5 near the human eye 01, for modulating light projected to the human eye 01, so as to improve imaging quality.

The first beam splitter 6 and the second beam splitter 7 form an optical return structure between two screens, and the dimensions of the two beam splitters are different.

Specifically, the first spectroscopic element 6 has a larger size than the second spectroscopic element 7, see fig. 2. The first spectroscopic element 6 and the second spectroscopic element 7 are both half-reflecting and half-lenses. The first image light emitted by the first screen 1 is incident on the first light splitting element 6, half of the energy light can be reflected and then emitted into the lens 8 without passing through the second light splitting element 7, the light enters the human eye 01 for imaging through refraction of the lens 8, and the other half of the energy light is transmitted to the first camera 3 and is received for imaging by the first camera 3. The second image light emitted by the second screen 2 strikes the second light splitting element 7, half of the energy light is reflected to the lens 8, and enters the human eye 01 for imaging through refraction of the lens 8, and the other half of the energy light is transmitted to the second camera 4 and is received for imaging by the second camera 4.

According to some examples of the present application, the first display screen 11 and the second display screen 21 are spliced in a single eye to form a target image, see fig. 3; the target image has a superposition area of the first display screen 11 and the second display screen 21, and the area of the superposition area is 5% -10% of the display area of the screen with the smallest display area in the first screen 1 and the second screen 2.

The first display screen 11 of the first screen 1 and the second display screen 21 of the second screen 2 have partial overlapping areas, so that partial deletion of the target image formed by splicing and fusion can be avoided.

The splicing and fusion of the double-screen images can be better realized by restraining the area size of the overlapping area, the final imaging picture can be ensured to be complete without loss, the monocular resolution and the binocular resolution can be further improved, and the formed image is clearer.

In addition, the brightness of the pixel points in the overlapping position area needs to be regulated and controlled, so that the brightness of the overlapping area is kept the same as the screen brightness of the non-overlapping area.

According to another embodiment of the present application, a near-eye display system applying the above multi-screen tiled display method is provided. The near-eye display system, see fig. 1, includes a lens barrel 5, and a first screen 1, a second screen 2, a first camera 3 and a second camera 4 disposed on an inner wall of the lens barrel 5; the first screen 1 and the second screen 2 are parallel and arranged in a staggered manner; the first camera 3 is located right opposite to the first screen 1 and is used for acquiring a first image of the first screen 1; the second camera 3 is located right opposite to the second screen 2 and is used for acquiring a second image of the second screen 2; the near-eye display system further comprises a first light splitting element 6 and a second light splitting element 7 which are arranged in the inner cavity of the lens barrel 5, the first light splitting element 6 is positioned between the first camera 3 and the first screen 1 in the radial direction of the lens barrel 5, and the second light splitting element 7 is positioned between the second camera 4 and the second screen 2.

The lens barrel 5 is used for carrying the optical elements such as the first screen 1, the second screen 2, the first camera 3, the second camera 4, the first spectroscopic element 6, the second spectroscopic element 7, and the like.

According to the near-eye display system provided in the above embodiment of the present application, the multi-screen tiled display method provided in the above embodiment is used in combination. The near-eye display system is a multi-screen display scheme, can be used for VR light path design, and can play a role in monitoring different screen brightness conditions in real time and dynamically adjusting brightness differences among different screens in the light path.

The near-to-eye display system provided by the embodiment of the application solves the problems of low screen resolution and insufficient screen definition of virtual reality products when applied to the virtual reality products. In particular, the imaging definition can be improved on the basis of not affecting the appearance structure of the virtual reality product, the quality of the output picture of the virtual reality product can be improved, and the optical display effect of the virtual reality product can be more vivid.

In some examples of the present application, referring to fig. 2, the first light splitting element 6 and the second light splitting element 7 are half-reflecting and half-lenses, and are rectangular; one short side of the first light splitting element 6 is vertically connected with one short side of the second light splitting element 7, and in the vertical connection position, the short side size of the second light splitting element 7 is smaller than the short side size of the first light splitting element 6, so that a hollow area is formed at one side of the second light splitting element 7.

The hollow area may be used for at least part of the first image light reflected by the first light splitting element 6 to directly pass through and then be directed to the lens 8, see fig. 1 and 2.

The first beam splitter 6 and the second beam splitter 7 are both half-reflecting and half-reflecting lenses, and the half-reflecting and half-reflecting lenses can transmit a part of light and reflect a part of light.

For example, the transmittance of the half mirror is, for example, about 50%.

In some examples of the present application, the first light splitting element 6 forms a first angle with respect to the first screen 1, and the second light splitting element 7 forms a second angle with respect to the second screen 2, where the first angle and the second angle are: 45 ° ± 0.5 °.

According to the near-eye display system provided in the embodiment of the present application, after the first display image 11 formed by the first image light emitted by the first screen 1 and the second display image 21 formed by the second image light emitted by the second screen 2 are spliced and fused in a single eye, a part of overlapping area exists, and referring to fig. 3 and 4, the size of the overlapping area should depend on the specific placement positions of the two screens.

In order to ensure the effect of image stitching and fusion, there is a higher requirement on the parallelism of the first screen 1 and the second screen 2, and the difference angle between the two is recommended to be smaller than 0.1 degrees; and, the angles between the first light splitting element 6 and the first screen 1, and between the second light splitting element 7 and the second screen 2 should be controlled to be 45 ° ± 0.5 °.

In some examples of the present application, see fig. 1, in the radial direction of the barrel 5: the front projection of the first camera 3 on the first screen 1 is located at the center of the first screen 1, and the front projection of the second camera 4 on the second screen 2 is located at the center of the second screen 2.

According to the above example, such a position design can more accurately monitor the brightness condition of the main display areas of the two screens.

In some examples of the present application, referring to fig. 1, the near-eye display system further includes a lens 8, the lens 8 being disposed at one end of the lens barrel 5; the second light-splitting element 7 is located between the lens 8 and the first light-splitting element 6. Part of the first image light emitted by the first screen 1 is reflected to the lens 8 through the first light splitting element 6, and part of the second image light emitted by the second screen 2 is reflected to the lens 8 through the second light splitting element 7.

In some examples of the present application, the wall surface of the lens barrel 5 is in a straight wall structure, and two opposite ends of the lens barrel 5 are arc-shaped, see fig. 5. The first screen 1 and the second screen 2 are respectively embedded in the inner wall of the lens barrel 5, and the first screen 1 and the second screen 2 are respectively arranged in parallel with the wall surface of the lens barrel 5.

According to the near-to-eye display system provided by the embodiment of the application, the two screens and the two cameras are both fixed on the inner wall of the lens cone 5, and because the two screens are parallel and staggered on the placement position, in order to reduce the installation difficulty of the two screens on the lens cone 5, the two screens are ensured to be parallel, the wall surface of the lens cone 5 can be set into a straight wall structure, so that a supporting plane can be formed, and the screen installation is prevented from being inclined.

The first screen 1 and the second screen 2 may be embedded in the wall surface of the lens barrel 5, or may be fixedly arranged on the inner wall of the lens barrel 5 by bonding or a connecting piece.

In this application, the two screens are disposed on the inner wall of the lens barrel 5, but not along the axial direction of the lens barrel 5, so that the dimension of the lens barrel 5 in the axial direction is not occupied.

In addition, referring to fig. 5, the outer shape of the lens barrel 5 is also designed to have an arc structure near the nose bridge side, so that the avoidance effect can be achieved. The cross section of the lens barrel 5 resembles a racetrack shape.

In some examples of the present application, the first camera 3 and the second camera 4 are respectively embedded in the inner wall of the lens barrel 5; the first camera 3 is used for shooting a first image of the first screen 1; the second camera 4 is used for shooting a second image of the second screen 2.

Referring to fig. 1, the first camera 3 and the second screen 2 are located on the same side, the second camera 4 and the first screen 1 are located on the same side, the first camera 3 and the second camera 4 are located on different sides and are staggered, through the layout on the position, the first camera 3 can receive part of the first image light of the first screen 1, and the second camera 4 can receive part of the second image light of the second screen 2. Therefore, the first camera 3 and the second camera 4 can acquire the brightness conditions of the two screens while the spliced images formed by the two screens are not influenced.

According to the near-to-eye display system provided by the embodiment of the application, the resolution limit of the virtual reality product can be further improved, the number of resolutions which can be observed by human eyes of a user is improved in multiple under the conditions of control volume and production cost, and the display brightness among a plurality of screens and other differences which can influence the appearance of the user are managed, controlled and dynamically in real time while the plurality of screens are simultaneously used as single-eye display screens; and the user experience is improved, and more realistic virtual reality experience is given to the user.

According to another embodiment of the present application, a head mounted display device is provided.

The head-mounted display device comprises a housing and the near-eye display system, wherein the near-eye display system is arranged on the housing.

The near-eye display system can be arranged in two, and corresponds to the left eye and the right eye of a user respectively, so that the monocular resolution and the binocular resolution can be improved in a multiplied mode, and the display effect and the definition are further improved.

The form of the head-mounted display device may be VR glasses or VR helmets, which is not limited in the embodiments of the present application.

The specific implementation manner of the head-mounted display device in the embodiment of the present application may refer to each embodiment of the above-mentioned near-eye display system, so that the head-mounted display device at least has all the beneficial effects brought by the technical solutions of the above-mentioned embodiments, which are not described in detail herein.

The foregoing embodiments mainly describe differences between the embodiments, and as long as there is no contradiction between different optimization features of the embodiments, the embodiments may be combined to form a better embodiment, and in consideration of brevity of line text, no further description is given here.

Although some specific embodiments of the present application have been described in detail by way of example, it should be understood by those skilled in the art that the above examples are for illustration only and are not intended to limit the scope of the present application. It will be appreciated by those skilled in the art that modifications may be made to the above embodiments without departing from the scope and spirit of the present application. The scope of the application is defined by the appended claims.

Claims (14)

1. The multi-screen spliced display method is characterized by being applied to a near-eye display system, wherein the near-eye display system comprises a first screen (1) and a second screen (2), the first screen (1) and the second screen (2) are parallel and arranged in a staggered mode, a first camera (3) is arranged opposite to the first screen (1), a second camera (4) is arranged opposite to the second screen (2), a first light splitting element (6) is arranged between the first screen (1) and the first camera (3), and a second light splitting element (7) is arranged between the second screen (2) and the second camera (4);

the multi-screen spliced display method comprises the following steps:

controlling the first camera (3) to shoot a first image of the first screen (1) and controlling the second camera (4) to shoot a second image of the second screen (2);

acquiring a first brightness value of the first image and a second brightness value of the second image;

and when the brightness difference value of the first brightness value and the second brightness value is larger than a target value and the duration time is longer than a set duration time, reducing the brightness of the screen with the maximum brightness in the first screen (1) and the second screen (2) so that the brightness difference value is smaller than or equal to the target value.

2. The multi-screen tiled display method according to claim 1, further comprising:

acquiring the gray value of the first image and the gray value of the second image;

acquiring the first brightness value according to the gray value of the first image;

and acquiring the second brightness value according to the gray value of the second image.

3. The multi-screen tiled display method according to claim 1 or 2, wherein the target value is 2nit, and the set time period is not less than 0.5s.

4. The multi-screen tiled display method according to claim 3, further comprising:

at any time, the brightness difference value between the first brightness value and the second brightness value is controlled to be less than or equal to 2nit.

5. The multi-screen tiled display method according to claim 1, wherein the near-to-eye display system further comprises a lens (8), the second light splitting element (7) is located between the lens (8) and the first light splitting element (6), a short side of the second light splitting element (7) is perpendicularly connected to a short side of the first light splitting element (6), and a short side dimension of the second light splitting element (7) is smaller than a short side dimension of the first light splitting element (6);

the first image light emitted by the first screen (1) is emitted to the first light splitting element (6), one part of the first image light is reflected to the lens (8) to form a first display picture (11), the other part of the first image light is transmitted to the first camera (3), and the first camera (3) receives light rays and shoots a first image of the first screen (1);

the second image light emitted by the second screen (2) is emitted to the second light splitting element (7), a part of the second image light is reflected to the lens (8) to form a second display picture (21), the other part of the second image light is transmitted to the second camera (4), and the second camera (4) receives light rays and shoots a second image of the second screen (2).

6. The multi-screen tiled display method according to claim 5, wherein the first display (11) and the second display (21) are tiled in a single eye to form a target image; the target image has a superposition area of the first display screen (11) and the second display screen (21), and the area of the superposition area is 5% -10% of the display area of the screen with the smallest display area in the first screen (1) and the second screen (2).

7. The near-eye display system is characterized by comprising a lens cone (5), a first screen (1), a second screen (2), a first camera (3) and a second camera (4), wherein the first screen (1), the second screen (2), the first camera (3) and the second camera (4) are arranged on the inner wall of the lens cone (5);

the first screen (1) and the second screen (2) are parallel and arranged in a staggered manner;

the first camera (3) is positioned right opposite to the first screen (1) and is used for acquiring a first image of the first screen (1); the second camera (4) is positioned right opposite to the second screen (2) and is used for acquiring a second image of the second screen (2);

the near-to-eye display system further comprises a first light splitting element (6) and a second light splitting element (7) which are arranged in the inner cavity of the lens barrel (5), the first light splitting element (6) is positioned between the first camera (3) and the first screen (1) in the radial direction of the lens barrel (5), and the second light splitting element (7) is positioned between the second camera (4) and the second screen (2).

8. The near-eye display system of claim 7, characterized in that the first light splitting element (6) and the second light splitting element (7) are half-reflecting half-lenses and are rectangular;

one short side of the first light-splitting element (6) is vertically connected with one short side of the second light-splitting element (7), and in a vertical connection position, the short side size of the second light-splitting element (7) is smaller than the short side size of the first light-splitting element (6) so as to form a hollowed-out area at one side of the second light-splitting element (7).

9. The near-eye display system of claim 8, characterized in that the first light splitting element (6) forms a first angle with respect to the first screen (1), the second light splitting element (7) forms a second angle with respect to the second screen (2), the first angle and the second angle being: 45 ° ± 0.5 °.

10. The near-eye display system according to claim 7, characterized in that in the radial direction of the barrel (5): the front projection of the first camera (3) on the first screen (1) is positioned at the center of the first screen (1), and the front projection of the second camera (4) on the second screen (2) is positioned at the center of the second screen (2).

11. The near-eye display system according to claim 8, further comprising a lens (8), the lens (8) being disposed at one end of the barrel (5);

the second light splitting element (7) is positioned between the lens (8) and the first light splitting element (6);

part of the first image light emitted by the first screen (1) is reflected to the lens (8) through the first light-splitting element (6), and part of the second image light emitted by the second screen (2) is reflected to the lens (8) through the second light-splitting element (7).

12. The near-eye display system according to claim 7, wherein the wall surface of the lens barrel (5) is of a straight wall structure, and opposite ends of the lens barrel (5) are arc-shaped;

the first screen (1) and the second screen (2) are respectively embedded in the inner wall of the lens cone (5), and the first screen (1) and the second screen (2) are respectively arranged in parallel with the wall surface of the lens cone (5).

13. The near-eye display system according to claim 12, wherein the first camera (3) and the second camera (4) are respectively embedded in an inner wall of the lens barrel (5);

the first camera (3) is used for shooting a first image of the first screen (1);

the second camera (4) is used for shooting a second image of the second screen (2).

14. A head-mounted display device, comprising:

a housing; and

the near-eye display system of any one of claims 7-13, disposed on the housing.