CN109407329B - Space light field display method and device - Google Patents
Space light field display method and device Download PDFInfo
- Publication number
- CN109407329B CN109407329B CN201811312531.9A CN201811312531A CN109407329B CN 109407329 B CN109407329 B CN 109407329B CN 201811312531 A CN201811312531 A CN 201811312531A CN 109407329 B CN109407329 B CN 109407329B
- Authority
- CN
- China
- Prior art keywords
- optical
- parameter
- grating
- image
- optical parameter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 17
- 230000003287 optical effect Effects 0.000 claims abstract description 84
- 238000012360 testing method Methods 0.000 claims abstract description 20
- 238000004088 simulation Methods 0.000 claims abstract description 16
- 230000000007 visual effect Effects 0.000 claims abstract description 12
- 239000012788 optical film Substances 0.000 claims description 13
- 230000000694 effects Effects 0.000 claims description 5
- 238000004519 manufacturing process Methods 0.000 claims description 5
- 230000002708 enhancing effect Effects 0.000 abstract description 4
- 238000012937 correction Methods 0.000 description 10
- 239000013598 vector Substances 0.000 description 5
- 238000012545 processing Methods 0.000 description 3
- 238000004422 calculation algorithm Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- HPTJABJPZMULFH-UHFFFAOYSA-N 12-[(Cyclohexylcarbamoyl)amino]dodecanoic acid Chemical compound OC(=O)CCCCCCCCCCCNC(=O)NC1CCCCC1 HPTJABJPZMULFH-UHFFFAOYSA-N 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
- G02B30/20—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
- G02B30/26—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type
- G02B30/27—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type involving lenticular arrays
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
The invention relates to the technical field of light fields, in particular to a space light field display method and a device thereof, wherein the display method comprises the following steps: carrying out simulation test according to a preset first optical parameter to obtain an accurate second optical parameter; acquiring image coding information according to the second optical parameters and the number of the viewpoints; obtaining a sequence of images in a digital light field; and coding the image sequence according to the image coding information, and restoring true three-dimensional information of the image by combining optical demodulation of the grating. The invention can achieve the aim of accurately restoring the true three-dimensional information by combining the image sequence with the optical demodulation function of the grating through the adjustment function of the image coding, thereby improving the restoring precision and enhancing the visual three-dimensional sense.
Description
Technical Field
The invention relates to the technical field of light fields, in particular to a space light field display method and a device thereof.
Background
The light field technology is used for collecting light rays and recombining the light rays, so that the virtual reality simulates the effect of focusing and moving an object by human eyes based on distance, captures light ray information and reproduces a three-dimensional world.
The 3D content processing is mainly a conversion of shot lens calculations to model light fields. Because the lighting information of the scene, i.e. the model light field information, is to be fitted, the amount of data is very large, while the computation is very complex. Because the more lenses of the scene, the more exquisite the model light field, and the larger the data volume, the general computer can not bear at all. It is very complicated to process high-quality 3D contents. The naked eye 3D viewing mainly realizes the three-dimensional display effect through the grating in front of the screen.
In practice, the inventor finds that the technical scheme has the following defects:
the digital light field in the prior art has lower precision for restoring the light field of the 3D image, and an observer has no obvious stereoscopic impression on the model.
Disclosure of Invention
In order to solve the technical problems, the invention provides a space light field display method and a device thereof, and the adopted technical scheme is as follows:
in a first aspect, a spatial light field display method includes:
carrying out simulation test according to a preset first optical parameter to obtain an accurate second optical parameter;
acquiring image coding information according to the second optical parameters and the number of the viewpoints;
obtaining a sequence of images in a digital light field;
and coding the image sequence according to the image coding information, and restoring true three-dimensional information of the image by combining optical demodulation of the grating.
Further, the performing a simulation test according to a preset first optical parameter to obtain an accurate second optical parameter may further include:
manufacturing a test coding image by adopting the parameters of the optical film to obtain a third optical correction parameter;
and further combining the second optical parameter and the third optical correction parameter to obtain an image code.
Further, the second optical parameter is a grating intercept and a grating inclination angle.
In a second aspect, a spatial light field display device, the device comprising:
the parameter acquisition module is used for carrying out simulation test according to a preset first optical parameter to acquire an accurate second optical parameter;
the first code acquisition module is used for acquiring image coding information according to the second optical parameters and the number of the viewpoints;
an image sequence acquisition module for acquiring an image sequence in the digital light field;
and the filling module is used for coding the image sequence according to the image coding information and restoring the true three-dimensional information of the image by combining optical demodulation of the grating.
Further, the parameter obtaining module further includes:
the correction parameter acquisition module is used for manufacturing a test coding image by adopting the parameters of the optical film to obtain a third optical correction parameter;
and the second code acquisition module is used for further combining the second optical parameters and the third optical correction parameters to obtain image codes.
Further, the second optical parameter in the parameter obtaining module is a grating intercept and a grating inclination angle.
The invention has the following beneficial effects:
the method comprises the steps of carrying out simulation test according to a preset first optical parameter to obtain an accurate second optical parameter; acquiring image codes according to the second optical parameters and the number of the viewpoints; obtaining a sequence of images in a digital light field; and coding the image sequence according to the image coding information, and restoring true three-dimensional information of the image by combining optical demodulation of the grating. The invention can achieve the aim of accurately restoring the true three-dimensional information by combining the image sequence with the optical demodulation function of the grating through the adjustment function of the image coding, thereby improving the restoring precision and enhancing the visual three-dimensional sense.
Drawings
Fig. 1 is a flowchart of a method for displaying a spatial light field according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a spatial light field display device according to another embodiment of the present invention.
Detailed Description
The present invention is described in detail below with reference to specific embodiments and drawings, and it should be noted that the features of the embodiments and examples of the present invention may be combined with each other without conflict, and the scope of the present invention is not limited thereto.
It should be noted at the outset that the "first" and "second" are presented herein for the purpose of better describing the invention and are not to be construed as indicating their sequential order or importance. The term "obtaining" as used herein may be directly obtaining according to the corresponding conditions and rules, or may have intermediate steps or other corresponding conditions and rules.
Referring to fig. 1, a flowchart of a method for displaying a spatial light field according to an embodiment of the present invention is shown, where the method includes the following steps:
101, performing simulation test according to a preset first optical parameter to obtain an accurate second optical parameter;
parameters are designed according to the requirements of a display screen to realize true three-dimensional display, and high-density viewpoint image joint coding is carried out. The optical film of the current mobile phone screen client has the requirements of large visual angle, thinness and the like, in order to realize true three-dimensional display, first optical parameters need to be designed according to the requirements of reducing crosstalk, reducing thickness, expanding display visual angle and the like, simulation test is carried out through Unity3D to obtain theoretical parameters, a prototype is manufactured, the display effect is observed and judged, parameters are finely adjusted, accurate grating intercept and grating inclination angle are determined, and the accurate grating intercept and grating inclination angle are used as second optical parameters.
102, acquiring image coding information according to the second optical parameters and the number of the viewpoints;
and designing an encoding rule of the image according to the second optical parameters, such as the accurate grating intercept and the grating inclination angle, and the number of the viewpoints, and taking the encoding rule as image encoding information.
Preferably, in order to quickly acquire a coded image corresponding to a display screen structure, the invention adopts a pixel parallel vector rendering method, in the image coding process, a pixel corresponding to each lens behind forms a pixel parallel vector through a corresponding lens, and the parallel vectors are intersected with the reconstructed three-dimensional scene for imaging to obtain the content to be displayed. And acquiring texture information of the intersection point of each parallel vector and the reconstructed three-dimensional scene through a ray backtracking algorithm, and assigning values to pixels in the texture information to obtain a corresponding coded image.
The algorithm for generating the raster coded image in real time can be realized based on the CUDA programming architecture, and real-time rendering and display of the 3D scene can be further ensured through parallel processing on hardware. The backtracking process of the corresponding pixel vector in the raster coding has high parallelism, and can fully utilize the capability of the GPU for processing data in parallel to finish the generation of pixel information in high speed and in parallel.
and 104, coding the image sequence according to the image coding information, and restoring true three-dimensional information of the image by combining optical demodulation of the grating.
And correspondingly filling the image sequence obtained from the digital light field according to the image coding information. The image can achieve the purpose of accurately restoring true three-dimensional information after the image is subjected to encoding adjustment and optical demodulation of the grating.
Preferably, the performing a simulation test according to a preset first optical parameter to obtain an accurate second optical parameter may further include:
manufacturing a test coding image by adopting the parameters of the optical film to obtain a third optical correction parameter;
and further combining the second optical parameter and the third optical correction parameter to obtain an image code.
Preferably, the second optical parameter is a grating intercept and a grating tilt angle.
In summary, the present invention obtains the accurate second optical parameter by performing the simulation test according to the preset first optical parameter; acquiring image coding information according to the second optical parameters and the number of the viewpoints; obtaining a sequence of images in a digital light field; and coding the image sequence according to the image coding information, and restoring true three-dimensional information of the image by combining optical demodulation of the grating. The invention can achieve the aim of accurately restoring the true three-dimensional information by combining the image sequence with the optical demodulation function of the grating through the adjustment function of the image coding, thereby improving the restoring precision and enhancing the visual three-dimensional sense. The observed model angles at different viewing angles are different and are consistent with the real scene. And further realizes the large-view-angle super-smooth dense viewpoint display. According to the invention, by optimizing the parameters of the display screen, crosstalk can be reduced, an error area is reduced, a display visual angle is enlarged, and finally a 3D image with a large visual angle and an ultra-many smooth dense view point is generated.
Referring to fig. 2, a schematic structural diagram of a spatial light field display device according to an embodiment of the present invention is shown, where the device includes:
the parameter obtaining module 201 is configured to perform a simulation test according to a preset first optical parameter, and obtain an accurate second optical parameter;
a first code obtaining module 202, configured to obtain image code information according to the second optical parameter and the number of viewpoints;
an image sequence acquisition module 203 for acquiring an image sequence in the digital light field;
and the filling module 204 is configured to encode the image sequence according to the image encoding information, and restore true three-dimensional information of the image by combining optical demodulation of a grating.
Preferably, the parameter obtaining module 201 further includes:
a correction parameter obtaining module 2011, configured to make a test encoded image using parameters of the optical film, so as to obtain a third optical correction parameter;
a second code obtaining module 2012, configured to further combine the second optical parameter and the third optical correction parameter to obtain an image code.
Preferably, the second optical parameters in the parameter obtaining module 201 are a grating intercept and a grating inclination.
In summary, the parameter obtaining module performs the simulation test according to the preset first optical parameter to obtain the accurate second optical parameter; the first code acquisition module acquires image coding information according to the second optical parameters and the number of the viewpoints; the image sequence acquisition module acquires an image sequence in the digital light field; and the filling module encodes the image sequence according to the image encoding information and restores the true three-dimensional information of the image by combining optical demodulation of the grating. The invention can achieve the aim of accurately restoring the true three-dimensional information by combining the image sequence with the optical demodulation function of the grating through the adjustment function of the image coding, thereby improving the restoring precision and enhancing the visual three-dimensional sense. The observed model angles at different viewing angles are different and are consistent with the real scene. And further realizes the large-view-angle super-smooth dense viewpoint display. According to the invention, by optimizing the parameters of the display screen, crosstalk can be reduced, an error area is reduced, a display visual angle is enlarged, and finally a 3D image with a large visual angle and an ultra-many smooth dense view point is generated.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (4)
1. A spatial light field display method is characterized by comprising the following steps:
carrying out simulation test according to a preset first optical parameter to obtain an accurate second optical parameter, wherein the first optical parameter is an optical parameter designed according to the display requirement of the optical film, the display requirement comprises reducing crosstalk, reducing the thickness of the optical film and expanding the display visual angle of the optical film, and the second optical parameter is a grating intercept and a grating inclination angle;
acquiring image coding information according to the second optical parameters and the number of the viewpoints;
obtaining a sequence of images in a digital light field;
and coding the image sequence according to the image coding information, and restoring true three-dimensional information of the image by combining optical demodulation of the grating.
2. The method for displaying the spatial light field according to claim 1, wherein the performing a simulation test according to a preset first optical parameter to obtain an accurate second optical parameter specifically comprises:
taking an optical parameter designed according to the display requirement of the optical film as a first optical parameter;
carrying out simulation test on the first optical parameter to obtain a theoretical parameter;
manufacturing a prototype machine based on theoretical parameters, and observing and judging the display effect of the prototype machine;
and fine-tuning parameters influencing display, determining an accurate grating intercept and a grating inclination angle, and taking the accurate grating intercept and the grating inclination angle as second optical parameters.
3. A spatial light field display device, the device comprising:
the parameter acquisition module is used for carrying out simulation test according to a preset first optical parameter and acquiring a precise second optical parameter, wherein the first optical parameter is an optical parameter designed according to the display requirement of the optical film, the display requirement comprises crosstalk reduction, optical film thickness reduction and optical film display visual angle expansion, and the second optical parameter is a grating intercept and a grating inclination angle;
the first code acquisition module is used for acquiring image coding information according to the second optical parameters and the number of the viewpoints;
an image sequence acquisition module for acquiring an image sequence in the digital light field;
and the filling module is used for coding the image sequence according to the image coding information and restoring the true three-dimensional information of the image by combining optical demodulation of the grating.
4. The spatial light field display device according to claim 3, wherein the parameter obtaining module specifically comprises:
taking an optical parameter designed according to the display requirement of the optical film as a first optical parameter;
carrying out simulation test on the first optical parameter to obtain a theoretical parameter;
manufacturing a prototype machine based on theoretical parameters, and observing and judging the display effect of the prototype machine;
and fine-tuning parameters influencing display, determining an accurate grating intercept and a grating inclination angle, and taking the accurate grating intercept and the grating inclination angle as second optical parameters.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811312531.9A CN109407329B (en) | 2018-11-06 | 2018-11-06 | Space light field display method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811312531.9A CN109407329B (en) | 2018-11-06 | 2018-11-06 | Space light field display method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109407329A CN109407329A (en) | 2019-03-01 |
| CN109407329B true CN109407329B (en) | 2021-06-25 |
Family
ID=65471875
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811312531.9A Expired - Fee Related CN109407329B (en) | 2018-11-06 | 2018-11-06 | Space light field display method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109407329B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102726050A (en) * | 2009-07-31 | 2012-10-10 | 和乐格拉飞卡公司 | Method and apparatus for displaying 3D images |
| CN103647960A (en) * | 2013-12-24 | 2014-03-19 | 北京邮电大学 | Three-dimensional image compositing method |
| CN106507096A (en) * | 2016-11-24 | 2017-03-15 | 北京邮电大学 | A kind of tracing type ground light field 3D display packing and system with super large visual angle |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050264559A1 (en) * | 2004-06-01 | 2005-12-01 | Vesely Michael A | Multi-plane horizontal perspective hands-on simulator |
-
2018
- 2018-11-06 CN CN201811312531.9A patent/CN109407329B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102726050A (en) * | 2009-07-31 | 2012-10-10 | 和乐格拉飞卡公司 | Method and apparatus for displaying 3D images |
| CN103647960A (en) * | 2013-12-24 | 2014-03-19 | 北京邮电大学 | Three-dimensional image compositing method |
| CN106507096A (en) * | 2016-11-24 | 2017-03-15 | 北京邮电大学 | A kind of tracing type ground light field 3D display packing and system with super large visual angle |
Non-Patent Citations (1)
| Title |
|---|
| 具有平滑运动视差的三维显示技术;桑新柱等;《中国激光》;20140228;第41卷(第2期);第0209011-1至0209011-5页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109407329A (en) | 2019-03-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110798673B (en) | Free viewpoint video generation and interaction method based on deep convolutional neural network | |
| CN105704479B (en) | The method and system and display equipment of the measurement human eye interpupillary distance of 3D display system | |
| Luo et al. | Parallax360: Stereoscopic 360 scene representation for head-motion parallax | |
| US9460555B2 (en) | System and method for three-dimensional visualization of geographical data | |
| JP2010045776A (en) | Method and system for rendering image, and computer program therefor | |
| JP2017532847A (en) | 3D recording and playback | |
| CN101631257A (en) | Method and device for realizing three-dimensional playing of two-dimensional video code stream | |
| CN114998559B (en) | Real-time remote rendering method for mixed reality binocular stereoscopic vision image | |
| CN104902255A (en) | Data source generation method based on volume scanning three-dimensional display system | |
| CN111612878B (en) | Method and device for making static photo into three-dimensional effect video | |
| CN107562185B (en) | Light field display system based on head-mounted VR equipment and implementation method | |
| CN113238472B (en) | High-resolution light field display method and device based on frequency domain displacement | |
| Yan et al. | Integral image compression based on optical characteristic | |
| Jin et al. | From capture to display: A survey on volumetric video | |
| CN111079673A (en) | Near-infrared face recognition method based on naked eye three-dimension | |
| Fachada et al. | Chapter View Synthesis Tool for VR Immersive Video | |
| CN109407329B (en) | Space light field display method and device | |
| Yang et al. | Real-time light-field generation based on the visual hull for the 3D light-field display with free-viewpoint texture mapping | |
| CN116095294B (en) | Three-dimensional light field image coding method and system based on depth value rendering resolution | |
| CN116708746A (en) | Naked eye 3D-based intelligent display processing method | |
| Waizenegger et al. | Real-time patch sweeping for high-quality depth estimation in 3D video conferencing applications | |
| Thatte et al. | Real-World Virtual Reality With Head-Motion Parallax | |
| CN116939186B (en) | Processing method and device for automatic associative covering parallax naked eye space calculation | |
| CN118474323B (en) | Three-dimensional image, three-dimensional video, monocular view, training data set generation method, training data set generation device, storage medium, and program product | |
| Zhang et al. | Efficient variational light field view synthesis for making stereoscopic 3D images |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20210625 |