CN118585060A - Method and device for improving human eye perception ability under low-light night vision goggles - Google Patents

Abstract

The invention provides a method and a device for improving human eye perception capability under a low-light night vision goggles, wherein the method comprises the following steps: acquiring scene information of a low-light night vision goggles; generating enhancement information according to the scene information; and fusing the low-light night vision goggles image with the enhancement information, and converging and presenting the low-light night vision goggles image in human eyes. By utilizing the scheme of the invention, the visual perception capability under the low-light night vision goggles can be improved.

Description

Method and device for improving human eye perception ability under low-light night vision goggles

Technical Field

The present invention relates to the technical field of low-light-level night vision goggles (NVG) visual perception training, and in particular to a method and device for improving the perception ability of human eyes under low-light-level night vision goggles.

Background Art

Vision is the main sense for humans to obtain information, but due to the limitations of the spectrum and spatial resolution of the human eye, the time and spatial scope of human activities, as well as the ability to understand and transform the world are greatly restricted. Improving, expanding and extending human visual ability under low illumination at night has always been the goal pursued by mankind. In recent decades, with the rapid development of night vision technology, various new night vision products and equipment have emerged, and have gradually been applied to monitoring, surveillance, tracking, reconnaissance and other aspects in the fields of traffic security in addition to military security. The market potential and application prospects in the military and civilian fields are huge.

Low-light level night vision goggles are a type of low-light level night vision equipment. They convert targets in low-light environments at night into visible light signals for the human eye through photoelectric conversion and amplification, so that images that are unclear or invisible to the human eye at night or in low-light environments are converted into images visible to the human eye. With the help of night vision goggles, the human eye can observe targets in low-light environments, improving visual perception capabilities at night and in low light conditions.

Although the visual aids of low-light night vision goggles can help observers see targets in low-light scenes, the imaging of low-light night vision goggles themselves also has a series of visual perception physiological effects such as reduced observation field, decreased vision, changes in distance judgment and stereoscopic vision, as well as illusions, spatial orientation disorders, and visual fatigue. Therefore, how to reduce the series of visual perception physiological effects of low-light night vision goggles and improve the visual perception ability under low-light night vision goggles is an important issue that the industry needs to solve.

Summary of the invention

The present invention provides a method and a device for improving the perception ability of human eyes under low-light-level night vision goggles, so as to improve the visual perception ability under low-light-level night vision goggles.

To this end, the present invention provides the following technical solutions:

A method for improving the perception ability of human eyes under low-light-level night vision goggles, the method comprising:

Get low-light-level night vision goggle scene information;

generating enhancement information according to the scene information;

The low-light-level night vision goggle image is fused with the enhanced information and converged and presented in the human eye.

Optionally, fusing the low-light-level night vision goggle image with the enhanced information and presenting them together in human eyes comprises:

displaying the enhanced information;

The first light from the low-light-level night vision goggles objective lens to produce the image formed by the low-light-level night vision goggles and the second light produced by displaying the enhanced information are combined together and converged and presented in the human eye.

Optionally, the first light is light that enters from the objective lens of the low-light night vision goggles, is formed by the low-light night vision goggles, and then enters the human eye for formation after passing through the optical module; the second light is light that is emitted by the display module used to display the enhanced information, and enters the human eye for formation after being folded by the optical module.

A device for improving the perception ability of human eyes under low-light night vision goggles, the device comprising:

A computing module, used to obtain low-light-level night vision goggle scene information and generate enhanced information based on the scene information;

The fusion module is used to fuse the low-light night vision goggle image with the enhanced information and converge and present them in the human eye.

Optionally, the computing power module includes any one or more of the following: a wearable smart device, a smart phone, and a computer.

Optionally, the fusion module includes:

A display module, used for displaying the enhanced information;

The optical module is used to combine the first light from the objective lens of the low-light-level night vision goggles to produce the image formed by the low-light-level night vision goggles and the second light generated by displaying the enhanced information, and converge and present them in the human eye.

Optionally, the display module includes any one of the following: liquid crystal on silicon, a digital light processor, a digital micromirror device, a laser beam scanner, a light emitting diode, and a light emitting micro display screen.

Optionally, the fusion module is an optical machine.

Optionally, the device further comprises:

I/O interface module, used to provide a transmission interface for data and protocol instructions;

The computing power module is also used to obtain sensor information through the I/O interface module, and generate the enhanced information according to the scene information and the sensor information.

Optionally, the device further comprises:

Detection module, used to sense and detect the current environment and provide environmental sensing data;

A tracking module, used to determine the user's location information based on the environmental sensing data;

The computing power module is also used to modify the enhanced information according to the user's location information.

The method and device for improving the perception ability of the human eye under low-light-level night vision goggles provided by the present invention, without changing the structure and key performance of the low-light-level night vision goggles themselves, superimpose and fuse the visual perception enhancement information on the low-light-level night vision image formed by the low-light-level night vision goggles, fuse the low-light-level night vision goggles image with the enhancement information, and converge and present them in the human eye, thereby effectively solving the problem of the physiological influence of visual perception caused by the imaging limitations of the low-light-level night vision goggles themselves, and can better help observers master the methods of observing, discovering, and identifying targets with night vision goggles, and improve their situational awareness ability under low-light-level night vision goggles.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

FIG1 is a flow chart of a method for improving the perception ability of human eyes under low-light-level night vision goggles provided by the present invention;

FIG2 is a schematic diagram of a structure of a device for improving the perception ability of human eyes under low-light-level night vision goggles provided by the present invention;

FIG3 is a schematic diagram of a specific implementation structure of the device for improving the perception ability of human eyes under low-light-level night vision goggles provided by the present invention.

DETAILED DESCRIPTION

In order to make the above-mentioned purposes, features and beneficial effects of the present application more obvious and easy to understand, the specific embodiments of the present application are described in detail below with reference to the accompanying drawings.

Theoretically, a new type of low-light-level night vision goggles with small size, light weight, large field of view, high resolution, binocular, color, and stereoscopic display can solve the problem of physiological impact of visual perception of existing low-light-level night vision goggles. However, there is a mutual restriction relationship between the requirements of low-light-level night vision goggles, such as small size, light weight, large field of view, high resolution, binocular, color, and stereoscopic display. If one requirement is highlighted, another or several requirements must be sacrificed. For example, if a large field of view is required, resolution must be sacrificed; if a large aperture is required, volume and weight must be sacrificed. Obviously, if various requirements are to be met, it is necessary to break through the existing difficulties in night vision imaging theory and engineering technology, and research and development is difficult and costly.

To this end, the embodiments of the present invention provide a method and device for improving the perception ability of the human eye under low-light-level night vision goggles. In view of some deficiencies in the existing low-light-level night vision goggles' own imaging, augmented reality (AR) technology is used to adapt the structural performance of the low-light-level night vision goggles with the low-light-level night vision goggles as the front-end input of the AR system, so as to enhance the image information formed by the low-light-level night vision goggles, reduce the physiological impact of the low-light-level night vision goggles' imaging limitations on the human eye's visual perception, and improve the visual perception ability under night vision goggles.

AR technology is a new technology that seamlessly integrates the real world and virtual information. It superimposes computer-generated virtual information on the real world and presents it in people's field of vision through certain display devices to enhance people's perception and cognition of the real world. Augmented reality technology has two optical synthesis methods: optical perspective and video perspective. In the optical perspective optical combination, the human eye can see the real world and the virtual information superimposed on it at the same time, while in the video perspective optical combination, the human eye can see the image of the real world and the virtual information superimposed on it at the same time. In the optical perspective optical combination, the human eye is open to the real world and directly observes the external space to understand the real world. In the video perspective optical combination, the human eye is closed in the image space and perceives the real world through the image of the external space.

As shown in FIG1 , it is a flow chart of a method for improving the perception ability of human eyes under low-light-level night vision goggles provided by the present invention, comprising the following steps:

Step 101, obtaining low-light-level night vision goggle scene information.

The scene information may include, but is not limited to: low-light scene images, images formed by low-light night vision goggles, and other information.

Among them, the low-light scene image can be acquired by a camera, and the image formed by the low-light night vision goggles can be directly obtained from the low-light night vision goggles, or acquired by capturing the low-light night vision goggles screen by a camera, which is not limited in this embodiment of the present invention.

Step 102: Generate enhancement information according to the scene information.

Specifically, the low-light scene image and the image formed by the low-light night vision goggles can be analyzed to determine the information that needs to be enhanced based on the limitations of the low-light night vision image. For example, the low-light scene image is first analyzed and processed, and then the relevant parameters are calculated based on the low-light scene image features obtained by the analysis and the image formed by the low-light night vision goggles to generate the enhanced information based on these parameters.

It should be noted that when determining the above-mentioned enhanced information, the calculated parameters may be optimized based on some stored information, prior knowledge, perceptual theory, visual ergonomics rules, etc., so as to improve the quality of the enhanced information.

In another non-limiting embodiment, the current environment can be further sensed and detected, and the user's location information can be determined based on the environment data. Accordingly, the enhanced information can be modified using the location information.

Step 103, fusing the low-light-level night vision goggle image with the enhanced information, and converging and presenting them in the human eye.

Specifically, the enhanced information is displayed; a first light from the low-light-level night vision goggles objective lens to generate the image formed by the low-light-level night vision goggles and a second light generated by displaying the enhanced information are combined together and converged and presented in the human eye.

In a specific implementation, the first light can enter from the objective lens of the low-light night vision goggles, form an image through the low-light night vision goggles, and then enter the human eye after passing through the optical module; the second light can be emitted by the display module for displaying the enhanced information, and enter the human eye after being refracted by the optical module.

The method for improving the perception ability of the human eye under low-light-level night vision goggles provided by the present invention, without changing the structure and key performance of the low-light-level night vision goggles themselves, superimposes and fuses the low-light-level night vision image formed by the low-light-level night vision goggles with the enhanced information, and converges and presents them in the human eye, thereby effectively solving the problem of the physiological influence of visual perception caused by the imaging limitations of the low-light-level night vision goggles themselves, and can better help observers master the methods of observing, discovering, and identifying targets with night vision goggles, and improve their situational awareness ability under low-light-level night vision goggles.

Correspondingly, the present invention also provides a device for improving the perception ability of human eyes under low-light-level night vision goggles, as shown in FIG2 , which is a structural schematic diagram of the device.

The device 200 for improving the perception ability of human eyes under low-light-level night vision goggles includes the following modules:

The computing module 201 is used to obtain low-light-level night vision goggles scene information and generate enhancement information based on the scene information; the scene information may include but is not limited to: low-light-level scene images, images formed by low-light-level night vision goggles and other information.

The fusion module 202 is used to fuse the low-light night vision goggle image with the enhanced information and converge and present them in the human eye.

The computing module 201 may include but is not limited to any one or more of the following: wearable smart devices, smart phones, computers and other equipment.

The fusion module 202 includes an optical combination display device that can simultaneously display real-world scenes and digital information, which can also be called an optical combiner. AR optical combiners mainly include video perspective type and optical transmission type. Optical transmission type combiners mainly include optical elements such as prisms, free-form surfaces, birdbaths, and optical waveguides.

As shown in FIG3 , it is a schematic diagram of a specific implementation structure of the device for improving the perception ability of human eyes under low-light-level night vision goggles provided by the present invention.

In this example, the computing module 201 receives and processes scene information from the camera module 115, including but not limited to low-light scene images, images on the low-light night vision goggles screen (i.e., images formed by low-light night vision goggles), images on the optical module 111, etc., and determines the relevant parameters of the enhancement information required for the image formed by the low-light night vision goggles through image analysis calculation. Furthermore, an optimization algorithm can be established based on pre-stored prior knowledge, various rules, etc. to generate enhancement information.

The fusion module includes a display module 112 and an optical module 111. The optical module 111 is between the human eye and the low-light night vision goggles 100.

The display module 112 is used to display the enhanced information. The enhanced information may be in the form of text, numbers, symbols, marks, graphics, images, animations, etc. The display module 112 may include but is not limited to any of the following: liquid crystal on silicon (LCOS), digital light processor (DLP), digital micromirror device (DMD), laser beam scanner (LBS), light emitting diode (OLED) (such as micro light emitting diode (μLED), micro organic light emitting diode (Micro-OLED)), etc.), light emitting micro display screen, etc. For example, a light emitting micro display screen may be preferred.

The screen brightness, color, and resolution of the display module 112 are compatible with the eyepiece screen of the low-light-level night vision goggles, and its thickness, weight, and size do not affect the matching of the optical module 111 with the low-light-level night vision goggles 100. In addition, the brightness, color, resolution, transparency, and contrast of the text, numbers, symbols, marks, graphics, images, animations, and other information displayed on the screen of the display module 112 are compatible with the low-light-level night vision goggles 100, and can effectively reduce the impact of the imaging limitations of the low-light-level night vision goggles 100 on human eye observation, thereby improving the visual perception ability of the observer under the night vision goggles.

The optical module 111 is used to combine the first light from the objective lens of the low-light-level night vision goggles 100 to produce the image formed by the low-light-level night vision goggles and the second light generated to display the enhanced information, and converge and present them in the human eye.

In a specific implementation example, the display module 112 can be integrated with the optical module 111 as an optical machine of the AR system.

The optical machine is the key to distinguishing the characteristics of different AR systems, and different optical machines are suitable for different application scenarios and tasks. The optical machine in the embodiment of the present invention is suitable for low-light scenes, and is adapted to low-light night vision goggles for night vision observation. The key components of the display module and optical module that make up the optical machine are constrained by the structure, performance and optical parameters of the low-light night vision goggles. The constraint parameters include but are not limited to the size of the eyepiece of the low-light night vision goggles, the brightness of the eyepiece screen of the night vision goggles, the color of the eyepiece screen of the night vision goggles, the exit pupil distance of the night vision goggles, the exit pupil diameter of the night vision goggles, the field of view of the night vision goggles and other key parameters. All the constraint parameters for the selection and design of AR optical machines with front-end visual optical systems such as low-light night vision goggles as front-end inputs belong to the present invention.

The device for improving the perception ability of the human eye under low-light-level night vision goggles provided by the present invention uses the low-light-level night vision goggles as the front-end input of the AR system, adapts the structural performance of the low-light-level night vision goggles, and realizes information enhancement of the image formed by the low-light-level night vision goggles, effectively reducing the physiological impact of the low-light-level night vision goggles' imaging limitations on the visual perception of the human eye, and improving the visual perception ability under low-light-level night vision goggles.

In another non-limiting embodiment of the device for improving the perception ability of human eyes under low-light night vision goggles of the present invention, the device may further include: an I/O interface module for providing a transmission interface for data and protocol instructions. Accordingly, the computing power module 201 may also obtain the sensing information through the I/O interface module, and generate the enhanced information according to the scene information and the sensing information.

In another non-limiting embodiment of the device for improving the perception ability of the human eye under low-light-level night vision goggles of the present invention, the device may further include: a detection module and a tracking module. Among them, the detection module is used to perceive and detect the current environment and provide environmental sensing data; the tracking module is used to determine the user's location information based on the environmental sensing data, such as a visual sensor or other tracking sensors. The visual sensor can also collect information using the micro camera group of the detection module. Accordingly, in this embodiment, the computing power module can also correct the enhanced information according to the user's location information, further improve the quality of the enhanced information, and enhance the auxiliary effect on the low-light-level night vision goggles image.

In a specific application, the detection module may include a visual sensor composed of one or more groups of micro cameras. The visual sensor can also collect information using the micro camera group of the detection module. The visual sensor may include, for example, infrared, grayscale, and laser cameras, integrated on the AR optical machine or installed on its housing. Among them, the infrared camera collects night vision scene images, the grayscale camera collects low-light night vision images on the night vision goggle eyepiece screen, and the laser scanning camera obtains the scene depth image. According to the actual spatial layout of each module, the visual sensor layout, orientation, and installation position are debugged, and the relative coordinates of each micro camera are calibrated to support the computing power module to align the images collected by each sensor, and the images correspond to the scene digital model, perform AI image analysis and processing, determine the user's viewpoint and device position, and predict the next viewpoint and position.

The other tracking sensors may include but are not limited to any one of the following: an inertial tracker, a gyroscope, an ultrasonic tracker, a laser tracking locator, etc.

It should be noted that the tracking module is an optional module, which can make up for or supplement the shortcomings of visual sensors under conditions of high accuracy or harsh low-light environment, that is, multi-strategy fusion SLAM (Simultaneous localization and mapping), various methods complement each other's strengths and weaknesses, and improve algorithm accuracy and operation robustness.

By utilizing the device for improving the perception ability of the human eye under low-light-level night vision goggles provided by the present invention, the AR system can be integrated with the low-light-level night vision goggles through an optical path combination. The structures of the two are matched and independent of each other. The AR system can be freely loaded and unloaded. After installation, it can enhance the low-light-level night vision image information formed by the night vision goggles, and after removal, the original function of the low-light-level night vision goggles can be restored.

The method and device for improving the perception ability of human eyes under low-light-level night vision goggles provided by the present invention can be used in teaching and training of low-light-level night vision goggles, as well as application fields such as simulation training under low-light-level night vision goggles and individual night mission execution.

The “plurality” that appears in the embodiments of the present invention refers to two or more than two.

It should be noted that the terms "including" and "having" and any variations thereof in the specification and claims of the present invention and the above-mentioned drawings are intended to cover non-exclusive inclusions. For example, a process, method, system, product or apparatus comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or apparatus.

Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. Moreover, the system embodiments described above are merely schematic, in which the modules and units described as separate components may or may not be physically separated. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without creative work.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may be physically arranged separately, or two or more units may be integrated into one unit.

The embodiments of the present invention are described in detail above. The present invention is described in detail using specific implementation methods herein. The description of the above embodiments is only used to help understand the method and system of the present invention. It is only a part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should belong to the scope of protection of the present invention, and the content of this specification should not be understood as limiting the present invention. Therefore, any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims (10)

1. A method of improving the human eye perception under a night vision goggles, the method comprising:

Acquiring scene information of a low-light night vision goggles;

Generating enhancement information according to the scene information;

And fusing the low-light night vision goggles image with the enhancement information, and converging and presenting the low-light night vision goggles image in human eyes.

2. The method of claim 1, wherein the fusing the night vision goggles image with the enhanced information and converging the presentation in the human eye comprises:

Displaying the enhancement information;

And combining the first light ray generated by the glimmer night vision lens to generate an image formed by the glimmer night vision lens with the second light ray generated by displaying the enhancement information, and converging and presenting the first light ray and the second light ray in human eyes.

3. The method for improving the human eye perception under a low-light night vision goggles according to claim 2, wherein,

The first light enters from the low-light night vision lens objective, is imaged by the low-light night vision lens, and enters human eyes after passing through the optical module;

the second light is emitted by the display module for displaying the enhanced information, and enters human eyes for imaging after being folded by the optical module.

4. A device for improving the perception of the human eye under a night vision goggles, the device comprising:

the power calculation module is used for acquiring scene information of the low-light night vision goggles and generating enhancement information according to the scene information;

And the fusion module is used for fusing the low-light night vision lens image with the enhancement information and converging and presenting the low-light night vision lens image in human eyes.

5. The device for improving the human eye perception under a low-light night vision goggles according to claim 4, wherein the power calculating module comprises any one or more of the following: wearable intelligent device, smart mobile phone, computer.

6. The device for improving the human eye perception under a low-light night vision goggles according to claim 4, wherein the fusion module comprises:

the display module is used for displaying the enhancement information;

and the optical module is used for combining the first light ray for generating the image formed by the low-light-level night vision goggles from the low-light-level night vision goggles objective lens and the second light ray for displaying the enhancement information and converging and presenting the first light ray and the second light ray in human eyes.

7. The device for improving the human eye perception under a night vision goggles according to claim 6, wherein the display module comprises any one of the following: liquid crystal on silicon, digital light processor, digital micromirror device, laser beam scanner, light emitting diode, and light emitting micro display.

8. The device for improving the human eye perception under a night vision goggles according to claim 4, wherein the fusion module is a light machine.

9. Device for improving the perception of the human eye under a night vision goggles according to any one of claims 4 to 8, characterized in that it further comprises:

the I/O interface module is used for providing a transmission interface of data and protocol instructions;

The power calculation module is further used for acquiring sensing information through the I/O interface module and generating the enhancement information according to the scene information and the sensing information.

10. Device for improving the perception of the human eye under a night vision goggles according to any one of claims 4 to 8, characterized in that it further comprises:

The detection module is used for sensing and detecting the current environment and providing environment sensing data;

the tracking module is used for determining the position information of the user according to the environment sensing data;

and the power calculation module is also used for correcting the enhancement information according to the position information of the user.