JP3324695B2 - Three-dimensional display method and head-mounted display device - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a three-dimensional display method and a head-mounted display device.
The present invention relates to a three-dimensional display method and a head-mounted display device capable of electronically reproducing a moving image of a three-dimensional image with a reduced amount of information.

[0002]

2. Description of the Related Art Conventionally, as a head mounted display device for displaying an electrically rewritable three-dimensional moving image,
A flat panel display device as shown in FIG. 18 is known. The flat panel display shown in FIG. 18 is a liquid crystal display (LCD).
(53L, 53R) and convex lenses (54L, 54R). The principle of the flat panel display shown in FIG. 18 will be described below. Images of the three-dimensional object 501 viewed from different directions (this is called a parallax image) are captured by, for example, cameras (52L, 52R). This camera (5
2L and 52R) are input and displayed on the left and right liquid crystal display devices (53L and 53R), respectively. The observer views the different display images of the left and right liquid crystal display devices (53L, 53R) with convex lenses (54L, 5R), respectively.
4R) and separately observed with the left and right eyes (55L, 55R). Thereby, the observer can observe the parallax image 506 with the left and right eyes at the same time, and the stereoscopic vision by the binocular parallax becomes possible.

[0003]

However, the flat display device as shown in FIG. 18 can present the binocular parallax in a certain range in the depth direction, but the binocular parallax, the convergence, and the binocular parallax. Since inconsistency arises with focus, natural stereoscopic vision is difficult. That is, in the flat display device as shown in FIG. 18, the eye focuses on the focal length of the convex lenses (54L, 54R) and the liquid crystal display device (53).
(L, 53R). In addition, in order to increase the amount of change in the convergence angle of both eyes, it is necessary to extremely increase the size of the liquid crystal display devices (53L, 53R) while maintaining the definition. As described above, in the flat display device as shown in FIG. 18, there is a problem that inconsistency arises between binocular parallax, convergence, and eye focus necessary for natural stereoscopic vision, and a feeling of fatigue is felt. .

SUMMARY OF THE INVENTION The present invention has been made to solve the problems of the prior art, and an object of the present invention is to eliminate inconsistencies between physiological factors of stereoscopic vision without using glasses,
It is still another object of the present invention to provide a three-dimensional display method which is electrically rewritable and can display a moving image. Further, another object of the present invention is to provide a head mounted display device which can suppress inconsistency between physiological factors of stereoscopic vision without glasses, and is further electrically rewritable and capable of displaying moving images. It is in. The above and other objects and novel features of the present invention will become apparent from the description of the present specification and the accompanying drawings.

[0005]

SUMMARY OF THE INVENTION Among the inventions disclosed in the present application, the outline of a representative one will be briefly described.
It is as follows. That is, the present invention arranges a plurality of display surfaces having different depth positions for each of the left eye and the right eye of the observer, and forms a two-dimensional image on the plurality of display surfaces for the left eye and the right eye of the observer. A three-dimensional display method for displaying and displaying a three-dimensional stereoscopic image, in which a display target object is projected onto a plurality of display surfaces from a point on a line connecting a right eye and a left eye of an observer. An image is generated, and the brightness of the generated two-dimensional image is independently changed for each of a plurality of display surfaces for the left eye and the right eye of the observer, and the generated two-dimensional image is generated by the observer. When displaying on a plurality of display surfaces for the left and right eyes , if the display target object is an object displayed at a depth position close to the observer, the display target object is closer to the observer of the plurality of display surfaces. The brightness of the two-dimensional image displayed on the display surface is increased, and The brightness of the two-dimensional image displayed on a distant display surface is reduced, and when the display target object is an object displayed at a depth position distant from the observer, the observer of the plurality of display surfaces The brightness of the two-dimensional image displayed on the display surface close to the image is reduced, and the brightness of the two-dimensional image displayed on the display surface far from the observer is increased. Also, the present invention displays the two-dimensional image on the plurality of display surfaces so as to overlap when viewed from one point on a line connecting the right eye and the left eye of the observer, and the overall luminance seen by the observer. The brightness of the two-dimensional images displayed on the plurality of display surfaces is changed so that the brightness of the two-dimensional images becomes equal to the brightness of the original display target object. Also, the present invention displays the two-dimensional image on the plurality of display surfaces so as to overlap when viewed from one point on a line connecting the right eye and the left eye of the observer, and the overall luminance seen by the observer. The luminance of each part of the two-dimensional image displayed on the plurality of display surfaces is changed in accordance with the depth position of the display target object so that is equal to the luminance of the original display target object. Further, the present invention is characterized in that a three-dimensional moving image is generated by sequentially switching the two-dimensional image. Further, the present invention, in the case where the two-dimensional image includes a plurality of object images moving in the depth direction, when the moving direction of the object is a direction approaching the observer, synchronized with the switching of the two-dimensional image The brightness of the object image displayed on the plurality of display surfaces is sequentially increased from the display surface far from the observer to the display surface close to the observer, and the two-dimensional image moves in the depth direction. In the case of including the object image, when the moving direction of the object is a direction away from the observer, in synchronization with the switching of the two-dimensional image, the brightness of the object image displayed on the plurality of display surfaces is The display surface is sequentially raised from the display surface closer to the observer to the display surface farther from the observer.

The present invention also relates to a head-mounted display device for displaying a two-dimensional image and displaying a three-dimensional stereoscopic image on a plurality of display surfaces each having a different depth position as viewed from an observer. Display surface, the first means for fixing the relative position of the observer's left eye and right eye, and the display target object, from one point on a straight line connecting the observer's left eye and right eye, Second means for generating a two-dimensional image projected on a plurality of display surfaces, and third means for displaying the two-dimensional image generated by the image generating means on at least two display surfaces of the plurality of display surfaces And fourth means for independently changing the luminance of the two-dimensional image displayed on the at least two display surfaces for each display surface , wherein the fourth means
Means for moving the display object at a depth position close to the observer;
When the object is displayed, the plurality of display surfaces
Brightness of the two-dimensional image displayed on the display surface close to the observer of
The two-dimensional image to be raised and displayed on a display surface far from the observer
Lower the brightness of the display target object from the observer
If the object is displayed at a distant depth position,
Displaying on the display surface closer to the observer among the number of display surfaces
Reduces the brightness of the two-dimensional image and displays it on the display surface far from the observer
The brightness of the two-dimensional image is increased .
Further, the present invention displays a two-dimensional image on each of a plurality of display surfaces having different depth positions as viewed from the left eye of the observer, and a plurality of display surfaces having different depth positions as viewed from the right eye of the observer. A head-mounted display device for displaying a three-dimensional stereoscopic image, comprising a plurality of display surfaces for the left eye and the right eye, and first means for fixing a relative position between a left eye and a right eye of an observer. A second means for generating a two-dimensional image by projecting the display target object from a point on a straight line connecting the left and right eyes of the observer to a plurality of display surfaces for the left and right eyes, Third means for displaying the two-dimensional image generated by the image generating means on at least two of the plurality of display surfaces for the left and right eyes, and at least two for the left and right eyes Brightness of the two-dimensional image displayed on one display surface And a fourth means for varying each independently at least two display surfaces each for the left and right eyes
The fourth means is arranged so that the display target object is close to the observer.
If the object is displayed at a different depth position,
The display on the display surface closer to the observer among the display surfaces of
Increasing the luminance dimension image, and displays on the display surface not far from the observer
Lowering the brightness of the two-dimensional image,
An object whose body is displayed at a depth position far from the observer
A display surface that is closer to an observer among the plurality of display surfaces.
Lower the brightness of the two-dimensional image displayed on the
A brightness of the two-dimensional image displayed on the display surface is increased . Further, the present invention is characterized in that the third means is combined with a plurality of two-dimensional display devices and a two-dimensional display device arranged at a depth position farthest from an observer among the plurality of two-dimensional display devices, Combining a two-dimensional display device other than the two-dimensional display device arranged at the depth position farthest from the observer with a total reflection mirror or a partial reflection mirror that arranges the display of the two-dimensional display device as an image on the line of sight of the observer And a partial reflector for arranging the display of each two-dimensional display device as an image on the line of sight of the observer. Further, the present invention is characterized in that the third means is combined with a plurality of two-dimensional display devices and a two-dimensional display device arranged at a depth position farthest from an observer among the plurality of two-dimensional display devices, A combination of a total reflection mirror and a lens, or a combination of a partial reflection mirror and a lens, which arranges the display of the two-dimensional display device as an image on the line of sight of the observer,
A partial reflector and a lens that are combined with a two-dimensional display device other than the two-dimensional display device that is arranged at a depth position farthest from the observer, and that arranges the display of each two-dimensional display device as an image on the line of sight of the observer. And a combination of the following. Further, in the present invention, the third means may include a plurality of scattering plates which are arranged at different depth positions as viewed from an observer and which can control switching between a transmission state and a scattering state; A plurality of projection type two-dimensional display devices for projecting images, disposed between the plurality of scattering plates and the plurality of projection type two-dimensional display devices, switching between the transmission state and the scattering state of the plurality of scattering plates. And a plurality of shutters that switch between a transmission state and a blocking state in synchronization with the shutter. Further, the present invention is characterized in that a lens optical system is provided between the plurality of display surfaces and an observer . Also, the present invention, the third means, the two-dimensional image, the display to a plurality of display surfaces so as to overlap when viewed from a point on a line connecting the right and left eyes of the observer, the The fourth means is characterized in that the luminance of the two-dimensional images displayed on the plurality of display surfaces is changed so that the overall luminance seen by the observer is equal to the luminance of the original display target object. . Also, in the present invention, the third means displays the two-dimensional image on the plurality of display surfaces so as to overlap when viewed from one point on a line connecting the right eye and the left eye of the observer, and Means for measuring the brightness of each part of the two-dimensional image displayed on the plurality of display surfaces so that the overall brightness viewed by the observer is equal to the brightness of the original display target object; It is characterized by being changed according to the position. Further, the present invention is characterized in that the third means sequentially switches and displays the two-dimensional images generated by the image generating means, and displays a three-dimensional moving image. Also, in the present invention, when the two-dimensional image generated by the first means includes a plurality of object images moving in the depth direction, the fourth means may provide the observer with a direction in which the object moves. In the case of the approaching direction, in synchronization with the switching of the two-dimensional image by the third means, the brightness of the object image displayed on the plurality of display surfaces is changed from the display surface far from the observer to the observer. If the moving direction of the object is a direction away from the observer,
In synchronization with the switching of the two-dimensional image in the third means, the brightness of the object images displayed on the plurality of display surfaces is sequentially increased from the display surface closer to the observer to the display surface farther from the observer. It is characterized by doing.

[0007]

Embodiments of the present invention will be described below in detail with reference to the drawings. In all the drawings for describing the embodiments, components having the same functions are denoted by the same reference numerals, and repeated description thereof will be omitted. [Embodiment 1] In the following examples, the expression "surface" on which an image is arranged is used. This expression is similar to an image surface often used in optics and the like. As means for realizing, various optical elements (for example, lens, total reflection mirror, partial reflection mirror, curved mirror, prism, polarizing element, wave plate, etc.) and two-dimensional display device (for example, CRT,
Liquid crystal display, LED display, plasma display, FED display, DMD display,
It is obvious that the present invention can be realized by many optical combination techniques using a projection display, a line drawing display, and the like. Further, in the following embodiment, a case will be described in which a presented three-dimensional object is mainly displayed as a two-dimensional image on two surfaces. However, it is apparent that a similar effect can be expected by using two or more surfaces. . FIG. 1 is a diagram for explaining the principle of the head mounted display device according to the first embodiment of the present invention. In the present embodiment, a plurality of surfaces (10
1, 102) (for example, the surface 101 is closer to the observer 100 than the surface 102) and in order to display a plurality of two-dimensional images on these surfaces, for example, a two-dimensional display device and various optical elements are used. Is used to configure the optical system 103 (details will be described later in Embodiment 3 and below). Examples of the two-dimensional display device include a CRT, a liquid crystal display, an LED display, a plasma display, an FED display, a DMD display, a projection type display, and a line drawing type display. A reflecting mirror, a partial reflecting mirror, a curved mirror, a prism, a polarizing element, a wave plate, and the like can be used. Here, the observer 100 recognizes these planes (101, 1).
In order to fix the relative positions of the plurality of two-dimensional images displayed in 02) and the left and right eyes of the observer 100, for example, a fixing jig 110 is attached.

Next, as shown in FIG. 2, a three-dimensional object 104 to be presented to the observer 100 is viewed from a point on a line connecting the left eye and the right eye of the observer 100, and the plane (101, 10)
2D images (105, 106), which are images projected on 2) (hereinafter referred to as 2D images), are generated. As a method of generating the 2D image, for example, a method of photographing the three-dimensional object 104 from the one point with a camera, a method of composing from a plurality of two-dimensional images photographed from another direction, a compositing technique using computer graphics, or There are various methods such as a method using modeling. This 2D image (105, 1
06) is displayed on both the surface 101 and the surface 102 as shown in FIG. This is possible, for example, by arranging the centers and the centers of gravity of the 2D images (105, 106) on the line of sight.

An important point of the present invention is that the luminance of each of the 2D images (105, 106) is kept constant on the apparatus having the above configuration while maintaining the overall luminance as viewed from the observer 100 (that is, the luminance is kept constant). (So that the overall luminance as viewed from the observer 100 becomes equal to the luminance of the three-dimensional object 104), corresponding to the depth position of the three-dimensional object 104. An example of the change is described below. 3 to 6 are black and white drawings, so that those with higher luminance are shown darker for easy understanding. For example, the three-dimensional object 104
Is displayed at a depth position corresponding to the position of the surface 101, as shown in FIG.
5 is equal to the luminance of the three-dimensional object 104, and the surface 10
The brightness of the 2D image 106 on 2 is set to zero. Next, for example, when the three-dimensional object 104 is slightly away from the observer 100 and the three-dimensional object 104 is displayed at a depth position slightly closer to the surface 102 side than the surface 101, as shown in FIG. The brightness of the compounded image 105 is slightly reduced,
Increase the brightness a little. Further, for example, the three-dimensional object 10
4 is further away from the observer 100, and the three-dimensional object 1
04 is displayed at a depth position further closer to the surface 102 than the surface 101, as shown in FIG.
Further, the luminance of the 2D image 106 is further increased. Finally, for example, the three-dimensional object 104 is
When the image is displayed at the depth position corresponding to the position 2, the luminance of the 2D image 106 on the surface 102 is made equal to the luminance of the three-dimensional object 104, and the luminance of the 2D image 105 on the surface 101 is set to zero. . By displaying in this manner, even if what is displayed is a 2D image (105, 106) due to human physiological or psychological factors or an illusion, the observer 100 is presented to the surface 101 as if it were a surface 101. It is felt that the three-dimensional object 104 is located between the and the surface 102. That is, for example, when the 2D images (105, 106) with almost equal luminance are displayed on the surfaces 101 and 102, it is felt that the three-dimensional object 104 is located near the middle of the depth position between the surfaces 101 and 102. Can be

In particular, when one point between the left eye and the right eye is used as one point on the line connecting the left eye and the right eye of the observer 100, the reliability of obtaining this effect is increased (in short, many points). The effect is obtained in many people or in many cases.) Furthermore, when the center position of the left and right eyes of the observer 100 is used as the one point, the effect is more easily obtained, and for example, the plane (101, 102) in the left and right eyes
This has the advantage that the size of the double image resulting from is reduced.

In the above description, for example, the depth position of the entire three-dimensional object 104 is, for example,
Although the method and apparatus for expressing using a two-dimensional image displayed on the surface 102 have been mainly described, the method according to the first embodiment is also used, for example, as a method and apparatus for expressing the depth of a three-dimensional object itself. Clearly what you can do. In this case, the brightness of each part of the 2D image (105, 106) is kept constant while the overall brightness viewed from the observer 100 is kept constant (that is, the overall brightness viewed from the observer 100 is reduced). (Equal to the brightness of the three-dimensional object 104),
What is necessary is just to change according to the depth position which each part of the three-dimensional object 104 has. That is, for example, the observer 10
In the 2D image 105 displayed on the surface 101 near 0,
The luminance is gradually changed in accordance with the depth position so that the luminance of a part close to the observer 100 is high and the luminance of a part far from the observer 100 is low. Further, in the 2D image 105 displayed on the surface 102 far from the observer 100, the brightness of a portion close to the observer 100 is low and the brightness of a portion far from the observer 100 is gradually changed in accordance with the depth position so as to increase the brightness. Let it. By displaying in this way, even if a two-dimensional image is displayed due to a physiological or psychological factor or an illusion of the observer 100, the observer 100 is given a three-dimensional object as if it had a depth. I feel as if I have a body.

In the present embodiment, unlike the conventional device (flat display device) shown in FIG. 18, there are at least two or more surfaces for actually displaying an image across the illusion position. Binocular parallax, convergence that was in the device of
It is considered that contradiction between focus adjustment and eye strain can be greatly suppressed. In addition, since the focus adjustment itself causes the observer 100 to view two or more surfaces at the same time, it matches the illusion position where both images can be seen without blurring. Furthermore, in this embodiment, since the three-dimensional object 104 between a plurality of surfaces can be expressed,
There is also an advantage that the data amount when performing three-dimensional display can be greatly reduced. In addition, the present embodiment has an advantage that the 2D image can be easily displayed in accordance with the movement of the observer 100 and the movement of the eyes because the apparatus is fixed to the observer 100 and the device is mounted. The head-mounted display device is basically a device in which the display device is attached and fixed to the head, but is a device configured so that the positional relationship between the eyes and the surface of the observer 100 does not change. If so, it is clear that the present invention is applicable to a device in which the display device is not mounted on the head. In addition, since the present embodiment utilizes the physiological, psychological, or illusion of a person only due to the change in the luminance of the two-dimensional image, it does not require a coherent light source such as a laser, and This has the advantage that the conversion is easy. In addition, the present embodiment does not include a mechanical drive unit, and thus has an advantage that it is suitable for weight reduction, improvement in reliability, and the like. Note that, in the present embodiment, only two planes are mainly described among the planes on which the two-dimensional image is arranged, and the three-dimensional object 104 to be presented to the observer 100 is between the two planes. However, it is obvious that the same configuration is possible even when the number of surfaces on which the two-dimensional image is arranged is larger than this, or when the position of the presented three-dimensional object 104 is different.

In the present embodiment, it is clear that a moving image can be displayed in the upper right and left directions from the viewpoint of the observer only when each of the two-dimensional display devices has a display speed capable of coping with the moving image. However, it is obvious that the luminance can be changed by changing the luminance of a plurality of surfaces for each frame. In this case, the brightness of each part of the 2D image (105, 106) is kept constant while the overall brightness viewed from the observer 100 is kept constant (that is, the overall brightness viewed from the observer 100 is reduced). (Equal to the brightness of the three-dimensional object 104),
This is to change the depth position of the three-dimensional object 104 in response to a temporal change. That is, for example, the three-dimensional object 10
When 4 is on the surface 101, the luminance of the 2D image 105 on the surface 101 is made equal to the luminance of the three-dimensional object 104, and the luminance of the 2D image 106 on the surface 102 is set to zero.

Next, for example, when the three-dimensional object 104 gradually moves away from the observer 100 a little in time and slightly closes to the surface 102 from the surface 101, the depth position of the three-dimensional object 104 The brightness of the 2D image 105 is slightly reduced temporally in accordance with the movement of the
Slightly increase the brightness over time. Next, for example, the three-dimensional object 104 moves farther in time than the observer 100,
In the case of temporally moving to a position further closer to the surface 102 than the surface 101, the luminance of the 2D image 105 is further reduced temporally in accordance with the movement of the depth position of the three-dimensional object 104, and the 2D image is formed. The brightness of the image 106 is further increased over time. Next, for example, the three-dimensional object 104 finally reaches the surface 102.
When moving up in time, the three-dimensional object 10
2D image 1 corresponding to the movement of the depth position 4
06 is changed over time until it becomes equal to the brightness of the three-dimensional object 104, and until the brightness of the 2D image 105 on the surface 101 becomes zero. By displaying in this manner, what is displayed is a 2D image (105, 10) due to human physiological or psychological factors or an illusion.
6), it is as if the observer 100 is facing (10
It is felt that the three-dimensional object 104 moves in the depth direction from the surface 101 to the surface 102 between (1, 102). In addition, if the two-dimensional image is displayed in one frame, the two-dimensional image can be displayed simultaneously or at different times.
Alternatively, it is apparent that the same effect can be obtained from the principle of the afterimage effect even if the image is displayed simultaneously for a certain time and separately displayed at other times. Further, in the present embodiment, since a three-dimensional object existing between a plurality of surfaces can be expressed, there is an advantage that the amount of data when performing three-dimensional display can be greatly reduced. [Second Embodiment] FIG. 7 is a diagram for explaining the principle of a head-mounted display device according to a second embodiment of the present invention. In the present embodiment, a plurality of surfaces, for example, surfaces (1R1, 1R2, 1) are provided in front of the right and left eyes of the observer 100.
L1, 1L2) (for example, the plane (1R1, 1L1) is closer to the observer 100 than the plane (1R2, 1L2)), and in order to display a plurality of two-dimensional images on these planes, for example, two-dimensional Using the display device and various optical elements, the optical system 103 is constructed for each of the right eye and the left eye (details will be described later in Embodiment 3 and below). As the two-dimensional display device, for example, a CRT, a liquid crystal display, an LE
D display, plasma display, FED display, projection type display, line drawing type display, etc., and as the optical element, for example,
A lens, a total reflection mirror, a partial reflection mirror, a curved surface, a prism, a polarizing element, a wave plate, and the like can be used. Here, observer 1
00 indicates these planes (1R1, 1R2, 1L1, 1L
In order to fix the relative positions of the plurality of two-dimensional images displayed in 2) and the left and right eyes of the observer 100, for example, a fixing jig 210 is attached.

Next, as shown in FIG. 8, the three-dimensional object 104 to be presented to the observer 100 is viewed from a point on a line connecting the left eye and the right eye of the observer 100, and is viewed from the surface (1R1, 1R).
2D image (1R5, 1R6, 1L5) which is an image (hereinafter, referred to as a 2D image) projected onto (2, 1L1, 1L2).
1L6). Although FIG. 8 shows only the configuration for the right eye, the symbol R may be replaced with L for the left eye. In addition, 2D images (1R5, 1R6, 1L
The method of generating (5, 1L6) includes, for example, a method using a two-dimensional image of the three-dimensional object 104 captured by a camera from the line of sight, a method of combining a plurality of two-dimensional images captured from another direction, or There are various methods such as a synthesis technique using computer graphics and a method using modeling. These 2D images (1R5, 1R6, 1L
5, 1L6) as shown in FIG.
1, 1L1) and the plane (1R2, 1L2) are displayed so as to overlap as viewed from one point on a line connecting the left eye and the right eye of the observer 100. This is, for example, a 2D image (1R
5, 1R6, 1L5, 1L6) can be realized by arranging the center or the center of gravity on the line of sight.

An important point of this embodiment is that the apparatus having the above-described configuration is a 2D image (1R5, 1R6, 1L).
5, 1L6) so that the overall brightness as viewed from the observer 100 is kept constant (that is, the overall brightness as viewed from the observer 100 is equal to the brightness of the three-dimensional object 104). ), Changing within the afterimage time of the human eye in accordance with the depth position of the three-dimensional object 104. An example of the change is described below. Since both eyes are the same, only the right eye is shown in FIGS. 9 to 12, and since FIGS. 9 to 12 are black and white drawings, those with higher luminance are shown darker for easy understanding. . For example, when the three-dimensional object 104 is displayed at a depth position corresponding to a position on the plane (1R1, 1L1), as shown in FIG. 9, a 2D image (1R5, 1R5) of the plane (1R1, 1L1) is displayed.
1L5) is equal to the luminance of the three-dimensional object 104,
2D image (1R6, 1L6) on plane (1R2, 1L2)
Has a luminance of zero. Next, for example, the three-dimensional object 104
Is slightly away from the observer 100, and the three-dimensional object 104
Is displayed at a position slightly closer to the surface (1R2, 1L2) than the surface (1R1, 1L1), as shown in FIG. 10, the brightness of the 2D image (1R5, 1L5) is slightly reduced. The brightness of the 2D image (1R6, 1L6) is slightly increased. Further, for example, the three-dimensional object 104 is
When the three-dimensional object 104 is displayed at a depth position closer to the plane (1R2, 1L2) side than the plane (1R1, 1L1) further away from 00, FIG.
As shown in (2), the luminance of the 2D image (1R5, 1L5) is further reduced, and the luminance of the 2D image (1R6, 1L6) is further increased. Finally, for example, the three-dimensional object 104 is placed on a surface (1R
When displaying at a depth position corresponding to (1, 2L2) on the plane (1R2, 1L2), as shown in FIG.
The luminance of the D images (1R6, 1L6) is made equal to the luminance of the three-dimensional object 104, and the luminance of the 2D images (1R5, 1L5) on the plane (1R1, 1L1) is set to zero. By displaying in this manner, the displayed 2D image (1R5, 1R) is displayed due to a physiological or psychological factor or an illusion of a person.
6, 1L5, 1L6), the observer 100
As if the plane (1R1, 1L1) and the plane (1R2, 1L2)
It is felt that the three-dimensional object 104 is located in the middle between the two. That is, for example, the plane (1R1, 1L1) and the plane (1
R2, 1L2) and the planes (1R1, 1L1) and (1R2, 1L2)
It is felt that there is a three-dimensional object 104 near the middle of the depth position of. In particular, when one point between the left eye and the right eye is used as one point on a line connecting the left eye and the right eye of the observer 100, the reliability of obtaining this effect is increased (in short, many people have a problem). Or, in many cases, the effect is obtained.) Further, when the center position of the left and right eyes of the observer 100 is used as the one point, the effect is more easily obtained, and for example, the plane (101, 10) in the left and right eyes
This has the advantage that the size of the double image resulting from 2) can be reduced.

It is clear that the depth of the three-dimensional object itself can be expressed in the present embodiment, as in the first embodiment. In the present embodiment, unlike the conventional device shown in FIG. 18, since there are at least two surfaces for actually displaying an image across the illusion position, the binocular parallax, It is considered that the contradiction between the convergence and the focus adjustment can be largely suppressed, and eyestrain and the like can be suppressed. In the present embodiment, the focus adjustment itself matches the illusion position where the observer 100 can see both images with the least blur since the observer 100 sees two or more surfaces simultaneously. In the present embodiment,
Since the devices are individually attached to the left and right eyes, there is an advantage that a 2D image can be easily displayed according to the movement of the observer or the movement of the eyes. Further, in the present embodiment, since a physiological or psychological factor or an illusion of a person based only on a change in luminance of a two-dimensional image is used, a coherent light source such as a laser is not particularly required as a light source, and It has the advantage that colorization is easy. In addition, the present embodiment does not include a mechanical driving unit, and thus has an advantage that it is suitable for weight reduction, improvement in reliability, and the like. In the present embodiment, only two planes among the planes on which a two-dimensional image is arranged will be described, and the three-dimensional object 104 to be presented to the observer 100 is two-dimensional.
Although the case where the two-dimensional image is located between two surfaces has been described, a similar configuration is possible even when the number of surfaces on which the two-dimensional image is arranged is larger than this, or when the position of the three-dimensional object to be presented is different. It is clear. In the present embodiment, it is clear that each two-dimensional display device has a display speed that can support a moving image, and it is clear that a moving image can be displayed in the left and right upper direction as viewed from the observer, and also in the depth direction, It is possible if the brightness changes of multiple surfaces are performed for each frame,
It is clear that moving images can be displayed as in the first embodiment. In addition, if the two-dimensional image described above is displayed in one frame, it can be displayed simultaneously, displayed at different times, or displayed simultaneously for a certain time, and separately displayed at other times. However, it is clear that a similar effect can be obtained from the principle of the afterimage effect. Further, in the present embodiment, since a three-dimensional object existing between a plurality of surfaces can be expressed, there is an advantage that the amount of data when performing three-dimensional display can be greatly reduced. [Embodiment 3] Hereinafter, an optical system 103 that can be used in each of the above embodiments will be described. FIG. 13 is a diagram illustrating an example of the optical system 103 that can be used in each of the embodiments. The optical system 103 shown in FIG. 13 includes a plurality of two-dimensional display devices (201, 202), a total reflection mirror 203 (for example, reflectance / transmittance = 100/0), and a partial reflection mirror 204 (for example, reflectance / (Transmittance = 50/50). Here, a plurality of two-dimensional display devices (201, 20)
2) includes, for example, a CRT, a liquid crystal display, an LED display, a plasma display, an FED display, a DMD display, a projection display, a line drawing display, and the like. FIG.
In the optical system shown in (1), the two-dimensional image of the two-dimensional display device 201 is changed by changing the respective arrangements.
Surface 205 that is reflected by
And the two-dimensional image of the two-dimensional display device 202 is
4 can be arranged at different positions in the depth direction. In the optical system shown in FIG.
Since only mirrors (total reflection mirror 203 and partial reflection mirror 204) are used, there is an advantage that image quality is less deteriorated.

FIG. 14 is a diagram showing another example of the optical system 103 that can be used in each of the above embodiments. The optical system 103 shown in FIG. 14 is similar to the optical system shown in FIG.
208) etc., the position of the surface can be changed more flexibly. In the optical system shown in FIG. 14, that is, a plurality of two-dimensional display devices (2
01, 202) and the total reflection mirror 203 (for example, the reflectance /
By changing the image position by adding, for example, a convex lens (207, 208) to the configuration of the partial reflecting mirror 204 (for example, reflectance / transmittance = 50/50), the size of the apparatus can be increased. The surface 20 which was limited due to restrictions on length
The positional relationship between 5 and the surface 206 can be set more flexibly. Of course, the use of a lens optical system using not only a convex lens but also a combination lens may be advantageous in terms of distortion and the like, as in the ordinary lens optical system. Further, in this case, the case where a virtual image is used has been described as an example, but it is apparent that the same can be achieved when a real image is used.

FIG. 15 is a diagram showing another example of the optical system 103 that can be used in each of the above embodiments. The optical system 103 shown in FIG. 15 is obtained by further adding a two-dimensional display device to the optical system shown in FIG. That is, a plurality of two-dimensional display devices (211, 212, 213, 214, 215)
For example, the total reflection mirror 216 (for example, reflectance / transmittance = 1
00/0), partial reflecting mirror 217 (for example, reflectance / transmittance = 50/50), 218 (for example, reflectance / transmittance =
33.3 / 66.7), 219 (eg, reflectivity / transmittance = 25/75), 220 (eg, reflectivity / transmittance =
20/80) to form an optical system. In the optical system 103 shown in FIG. 15, the surface 221 formed by changing the arrangement of the two-dimensional display device 211 reflects the total reflection mirror 216 and transmits the partial reflection mirrors (217 to 220). And a two-dimensional display device (212 to 2)
15) The two-dimensional images are partially reflected mirrors (217 to 220), respectively.
Surface (22)
2 to 225) can be arranged at different positions in the depth direction. In the optical system 103 shown in FIG.
Since only a mirror is used, there is an advantage that image quality is less deteriorated. Although FIG. 15 illustrates the case where the number of the two-dimensional display devices is five, it is obvious that a similar configuration can be performed with other two-dimensional display devices. In this case as well, it is apparent that the position of the surface can be easily controlled by adding a lens optical system as shown in FIG.

FIG. 16 is a diagram showing another example of the optical system 103 that can be used in each of the above embodiments. The optical system 103 shown in FIG. 16 includes a plurality of projector type two-dimensional display devices (231, 232, 233, 234, 235), shutters (241, 242, 243, 244, 245),
Using the scattering plates (236, 237, 238, 239, 240), each projector type two-dimensional display device (231 to 231) is used.
An optical system for arranging a plurality of binary images is formed by projecting a two-dimensional image from the light source 235 through the shutters 241 to 245 onto the scattering plates 236 to 240. Here, each of the projector type two-dimensional display devices (231 to 235) is, for example, a CTR type, an LCD type,
It is composed of ILV type, DMD type and the like. In addition, the scattering plate (2
36 to 240) can control a scattering state / transmission state and a reflection state / transmission state, for example, like a polymer dispersed liquid crystal element, a holographic polymer dispersed liquid crystal element, and a combination element of a liquid crystal and a multi-lens array. Further, the shutters (241 to 245) can control the transmission state / blocking state like a twisted nematic liquid crystal element, a ferroelectric liquid crystal element, or a mechanical shutter element. The scattering plates (236 to 240) are arranged at different depth positions, and the respective focusing surfaces of the projector type two-dimensional display devices (231 to 235) are aligned with these scattering plates (236 to 240) to obtain a two-dimensional image. And the timing of the scattering state / transmission state of the scattering plates (236 to 240) and the timing of the transmission state / blocking state of the shutters (241 to 245) are driven in synchronization with each other, so that (236-240) formed on the surface (24
1 to 245) can be controlled. When the projector type two-dimensional display device (231 to 235) is used as in the optical system 103 shown in FIG. 16, there is an advantage that the degree of freedom in the layout of the device is large. Note that FIG.
In the optical system 103 shown in FIG. 6, the case where the number of the projector-type two-dimensional display devices is five has been described, but it is apparent that the same configuration is possible with other numbers. Also, instead of the shutters (241 to 245), the lamps of the projector type two-dimensional display devices (231 to 235) are turned ON / OF.
Obviously, F may be used.

In each of the above-described embodiments, the case where there is a surface near, inside, or behind the head-mounted display device has been mainly described. It is easily possible to arrange them further apart or on the front side.
An example is shown in FIG. For example, on the front surface of the optical system 301 shown in each of the above embodiments, for example, the lens optical system 3
Obviously, by arranging 03, the inner surface 302 can be converted to the position of the outer surface 304. In such a case, since the three-dimensional image is reproduced floating in space, there is an advantage that a person can easily feel three-dimensionally compared to a case where the three-dimensional image is inside or behind the apparatus. As described above, the invention made by the inventor has been specifically described based on the embodiment. However, the present invention is not limited to the embodiment, and can be variously modified without departing from the gist of the invention. Of course, it is.

[0022]

The effects obtained by typical ones of the inventions disclosed in the present application will be briefly described as follows. ADVANTAGE OF THE INVENTION According to this invention, the contradiction between the physiological factors of stereoscopic vision can be suppressed, the amount of information can be reduced, and it is possible to reproduce an electrically rewritable three-dimensional moving image.

[Brief description of the drawings]

FIG. 1 is a diagram for explaining the principle of a head mounted display device according to a first embodiment of the present invention.

FIG. 2 is a diagram for explaining a method of generating a 2D image in the head mounted display device according to the first embodiment of the present invention.

FIG. 3 is a diagram for explaining a method of displaying a three-dimensional image in the head mounted display device according to the first embodiment of the present invention.

FIG. 4 is a diagram for explaining a method of displaying a three-dimensional image in the head mounted display device according to the first embodiment of the present invention.

FIG. 5 is a diagram for explaining a method of displaying a three-dimensional image in the head mounted display device according to the first embodiment of the present invention.

FIG. 6 is a diagram for explaining a method of displaying a three-dimensional image in the head mounted display device according to the first embodiment of the present invention.

FIG. 7 is a diagram for explaining the principle of the head mounted display device according to the second embodiment of the present invention.

FIG. 8 is a diagram for explaining a method of generating a 2D image in the head mounted display device according to the second embodiment of the present invention.

FIG. 9 is a diagram for explaining a method of displaying a three-dimensional image in the head mounted display device according to the second embodiment of the present invention.

FIG. 10 is a diagram for explaining a method of displaying a three-dimensional image in the head mounted display device according to the second embodiment of the present invention.

FIG. 11 is a diagram for explaining a method of displaying a three-dimensional image in the head mounted display device according to the second embodiment of the present invention.

FIG. 12 is a diagram for explaining a method of displaying a three-dimensional image in the head mounted display device according to the second embodiment of the present invention.

FIG. 13 is a diagram illustrating an example of an optical system that can be used in each embodiment of the present invention.

FIG. 14 is a diagram illustrating another example of an optical system that can be used in each embodiment of the present invention.

FIG. 15 is a diagram illustrating another example of an optical system that can be used in each embodiment of the present invention.

FIG. 16 is a diagram illustrating another example of an optical system that can be used in each embodiment of the present invention.

FIG. 17 is a diagram illustrating another example of an optical system that can be used in each embodiment of the present invention.

FIG. 18 is a diagram showing a conventional head mounted display device for performing stereoscopic display of an electrically rewritable moving image.

[Explanation of symbols]

52L, 52R: camera, 53L, 53R: liquid crystal display (LCD), 54L, 54R, 207, 208: convex lens, 55L, 55R: left and right eyes, 100: observer, 1
01, 102, 1R1, 1R2, 1L1, 1L2, 20
5,206,221,222,223,224,22
5, 302, 304 ... surface, 103, 301 ... optical system, 1
04, 501 ... three-dimensional object, 105, 106, 1R5
1R6, 1L5, 1L6 ... 2D image, 110, 210 ...
Fixing jigs, 201, 202, 211, 212, 213
214, 215 ... two-dimensional display device, 203, 216 ... total reflection mirror, 204, 217, 218, 219, 220 ... partial reflection mirror, 231, 232, 233, 234, 235 ...
Projector type two-dimensional display device, 236, 237, 23
8,239,240 ... scattering plate, 241,242,24
3, 244, 245: shutter, 303: lens optical system, 506: parallax image.

 ──────────────────────────────────────────────────続 き Continuing from the front page (72) Inventor Katojo Kamihira 3-19-2 Nishi-Shinjuku, Shinjuku-ku, Tokyo Within Nippon Telegraph and Telephone Corporation (56) References JP-A-9-297282 (JP, A JP-A-9-331552 (JP, A) JP-A-3-17999 (JP, A) JP-A-2000-134643 (JP, A)

Claims (15)

(57) [Claims] 1. A plurality of display surfaces having different depth positions are arranged for each of a left eye and a right eye of an observer, and two-dimensional images are respectively displayed on the plurality of display surfaces for the left and right eyes of the observer. A three-dimensional display method for displaying and displaying a three-dimensional stereoscopic image, comprising projecting a display target object from a point on a line connecting the right and left eyes of an observer to the plurality of display surfaces. The brightness of the generated two-dimensional image is independently changed for each of a plurality of display surfaces for the left eye and the right eye of the observer, and the generated two-dimensional image is displayed on the left side of the observer. a three-dimensional display method that displays a plurality of display surfaces for the eye and the right eye
The display target object is displayed at a depth position close to the observer.
Observing the plurality of display surfaces when the object is
The brightness of the two-dimensional image displayed on the display surface close to the user
And the brightness of the two-dimensional image displayed on the display surface far from the observer.
Degrees were low, and the display target object, the depth position distant from the viewer
When the object is displayed on the plurality of display surfaces,
Brightness of the two-dimensional image displayed on the display surface close to the observer
The two-dimensional display on a display surface far from the observer
A three-dimensional display method characterized by increasing the brightness of an image . 2. The two-dimensional image is displayed on the plurality of display surfaces so as to overlap when viewed from one point on a line connecting the right eye and the left eye of the observer, and the overall luminance seen by the observer is to be equal to the luminance of the original display object, three-dimensional display method according to claim 1, characterized in that to change the brightness of the two-dimensional image to be displayed on the plurality of display surfaces. 3. The two-dimensional image is displayed on the plurality of display surfaces so as to overlap when viewed from a point on a line connecting the right eye and the left eye of the observer, and the overall luminance seen by the observer is The brightness of each part of the two-dimensional image displayed on the plurality of display surfaces is changed according to the depth position of the display target object so as to be equal to the luminance of the original display target object.
Three-dimensional display method according to 1. By wherein sequentially switching the two-dimensional image, three-dimensional display method according to any one of claims 1 to claim 3, characterized in that to generate a moving image of three dimensions. In case of 5. A includes a plurality of object image the two-dimensional image is moved in the depth direction, when the moving direction of the object is a direction approaching the observer, in synchronization with the switching of the two-dimensional image The brightness of the object image displayed on the plurality of display surfaces, sequentially increasing from the display surface far from the observer to the display surface closer to the observer, and a plurality of the two-dimensional image is moved in the depth direction In the case of including the object image, if the moving direction of the object is a direction away from the observer, in synchronization with the switching of the two-dimensional image, the brightness of the object image displayed on the plurality of display surfaces, 5. The three-dimensional display method according to claim 4 , wherein the height is sequentially increased from a display surface closer to the observer to a display surface farther from the observer. 6. A head mounted display device for displaying a two-dimensional image and displaying a three-dimensional stereoscopic image on a plurality of display surfaces each having a different depth position as viewed from an observer, wherein the plurality of display surfaces are First means for fixing a relative position between the left eye and the right eye of the observer; and displaying the display target object from one point on a straight line connecting the left eye and the right eye of the observer to the plurality of display surfaces. A second unit that generates a two-dimensional image projected to the at least one of the plurality of display surfaces, and a third unit that displays the two-dimensional image generated by the image generating unit on at least two of the plurality of display surfaces. And fourth means for independently changing the luminance of the two-dimensional image displayed on the two display surfaces for each display surface , wherein the fourth object is configured such that the display target object is provided to an observer. near
If the object is displayed at a depth position,
The secondary display on the display surface of the display surface that is closer to the observer.
Increase the brightness of the original image and display it on a display surface far from the observer
The brightness of the two-dimensional image is reduced, and the display target object is located at a depth position far from an observer.
When the object is displayed on the plurality of display surfaces,
Brightness of the two-dimensional image displayed on the display surface close to the observer
The two-dimensional display on a display surface far from the observer
A head-mounted display device characterized by increasing the brightness of an image . 7. A three-dimensional image is displayed on a plurality of display surfaces having different depth positions as viewed from the left eye of the observer and a plurality of display surfaces having different depth positions as viewed from the right eye of the observer. A head-mounted display device for displaying an original stereoscopic image, wherein a plurality of display surfaces for the left eye and the right eye, and first means for fixing a relative position between the left eye and the right eye of the observer, Second means for generating a two-dimensional image by projecting the display target object from a point on a straight line connecting the left and right eyes of the observer to a plurality of display surfaces for the left and right eyes, Third means for displaying the two-dimensional image generated by the image generating means on at least two of the plurality of display surfaces for the left and right eyes; and at least two for the left and right eyes The brightness of the two-dimensional image displayed on the display surface ; And a fourth means for varying each independently Kihidarime and at least two display surfaces each for the right eye, the fourth means, the display target object is closer to the viewer
If the object is displayed at a depth position,
The secondary display on the display surface of the display surface that is closer to the observer.
Increase the brightness of the original image and display it on a display surface far from the observer
The brightness of the two-dimensional image is reduced, and the display target object is located at a depth position far from an observer.
When the object is displayed on the plurality of display surfaces,
Brightness of the two-dimensional image displayed on the display surface close to the observer
The two-dimensional display on a display surface far from the observer
A head-mounted display device characterized by increasing the brightness of an image . Wherein said third means are combined and a plurality of two-dimensional display unit, a two-dimensional display unit disposed farthest depth position from the observer of the plurality of two-dimensional display device,
A two-dimensional display device other than a two-dimensional display device that is arranged at a depth position farthest from the observer, and a total reflection mirror or a partial reflection mirror that arranges the display of the two-dimensional display device as an image on the line of sight of the observer; And a partial reflector for arranging the display of each two-dimensional display device as an image on the line of sight of the observer.
A head-mounted display device according to claim 6 . 9. The third means is combined with a plurality of two-dimensional display devices, and a two-dimensional display device located at a depth position farthest from an observer among the plurality of two-dimensional display devices,
A combination of a total reflection mirror and a lens, or a combination of a partial reflection mirror and a lens, which arranges the display of the two-dimensional display device as an image on the observer's line of sight, and a two-dimensional arrangement arranged at a depth position farthest from the observer combined with two-dimensional display device other than the display device, according to claim, characterized in that they are composed of a combination of partially reflecting mirror and a lens to place the display of the two-dimensional display device as an image on the line of sight of each observer The head mounted display device according to claim 6 or 7 . Wherein said third means includes a transmission state which is disposed at different depth positions as viewed from the observer and switching control multiple scattering plate capable of scattering state, two-dimensional images wherein each scattering plate And a plurality of projection type two-dimensional display devices, which are disposed between the plurality of scattering plates and the plurality of projection type two-dimensional display devices, for switching between the transmission state and the scattering state of the plurality of scattering plates. synchronously switches the cutoff state to the transmitting state, characterized in that it is composed of a plurality of shutter 請
A head-mounted display device according to claim 6 or claim 7 . 11. A method according to claim 11, further comprising :
7. The method according to claim 6 , wherein a lens optical system is provided.
The head-mounted display device according to claim 10 . 12. The method according to claim 11, wherein the third means converts the two-dimensional image into
The plurality of display surfaces are displayed so as to be overlapped when viewed from a point on a line connecting the right eye and the left eye of the observer, and the fourth means is configured so that the overall luminance seen by the observer is the original display target object. The head mounted display device according to any one of claims 6 to 11 , wherein the luminance of the two-dimensional images displayed on the plurality of display surfaces is changed so as to be equal to the luminance of the head. 13. The method according to claim 13, wherein the third means converts the two-dimensional image into
The plurality of display surfaces are displayed so as to be overlapped when viewed from a point on a line connecting the right eye and the left eye of the observer, and the fourth means is configured so that the overall luminance seen by the observer is the original display target object. of to equal the brightness claims, characterized in that is changed according to the depth position of the display target object brightness of each part of the two-dimensional image to be displayed on the plurality of display surface
The head mounted display device according to any one of claims 6 to 11 . 14. The method of claim 13, wherein the third means displays sequentially switching the two-dimensional image generated by said image generating means, according to claim 6 or claims and displaying a moving image of the three-dimensional
Item 14. The head-mounted display device according to any one of items 13 . 15. The fourth means, when the two-dimensional image generated by the first means includes a plurality of object images moving in the depth direction, the moving direction of the object approaches the observer. In the case of the direction, in synchronization with the switching of the two-dimensional image in the third means, the brightness of the object image displayed on the plurality of display surfaces is closer to the observer from a display surface far from the observer. When the moving direction of the object is a direction moving away from the observer, the display is displayed on the plurality of display surfaces in synchronization with the switching of the two-dimensional image by the third means. 15. The head-mounted display device according to claim 14 , wherein the brightness of the object image is sequentially increased from a display surface closer to the observer to a display surface farther from the observer.