JPH08234141A - Head mounted video display device - Google Patents

Abstract

PURPOSE: To provide a head mounted video display device capable of obtaining a video where visibility corresponds to parallax or the angle of convergence in all the area of video observation from the center to the end of the video being an observed object. CONSTITUTION: This head mounted video display device is provided with LCDs 1L and 1R corresponding to the left and the right eyeballs 5L and 5R of an observer, and the 1st and the 2nd videos having the parallax are respectively displayed on the LCDs 1L and 1R so as to realize stereoscopic observation. The device is equipped with a line-of-sight detecting device(an infrared light source 51, a projection lens 52, a condensing lens 53, a CCD 54 and an infrared transmitting filter 55) for deciding the gazing position of the observer in an observation area by detecting the line-of-sight direction of at least either the left or the right eyeball, a video processor deciding a visibility adjusting signal corresponding to the parallax or the angle of convergence of the video at the gazing position, and motors 3L and 3R adjusting the visibility of the LCDs 1L and 1R by receiving the visibility adjusting signal.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a head-mounted image display device capable of observing a stereoscopic image by guiding different images to the left and right eyes of an observer.

[0002]

2. Description of the Related Art As a conventional example of a head-mounted image display device that can be used for stereoscopic observation, there is one disclosed in Japanese Patent Application Laid-Open No. 2-281891. In this conventional example, a liquid crystal display (LCD) and a magnifying lens are provided for the left and right eyes of an observer, respectively, and a frame that supports so that the left and right virtual images generated by the magnifying lens match is provided, and stereoscopic observation is performed by binocular parallax. I'm trying to do.

In a video display device, a sense of discomfort generally occurs unless the parallax or vergence angle is matched with the diopter. Therefore, in the above-described conventional example, the vergence angle and the diopter are related to the video displayed under a predetermined condition. Configured to match. However, in the above conventional example, when observing a stereoscopic image, the convergence angle changes depending on the content of the image (such as the size of the object to be observed in the image and the distance from the eyeball). For example, when observing an object at a long distance, The vergence angle becomes smaller, and it is not taken into consideration that the vergence angle becomes large when observing an object located at a short distance.Although the vergence angle changes depending on the content of the object to be observed, However, since the diopter is fixed, the convergence angle and the diopter cannot be unconditionally matched, and in the end, the discomfort due to the disparity or the mismatch between the convergence angle and the diopter cannot be eliminated.

A conventional example for solving this problem is disclosed in Japanese Patent Laid-Open No. 5-344541. In this conventional example, image pickup devices are arranged on the lines of sight of the left and right eyes of the video display device, and the images picked up by these image pickup devices are displayed by the left and right display devices in the video display device, and the image pickup focus from the autofocus section is displayed. The display lens in the image display device is moved based on the distance signal to adjust the diopter to the optimum value. In this conventional example, since the convergence angle and the diopter match under a predetermined condition, the sense of discomfort due to the mismatch of the vergence angle and the diopter in stereoscopic vision is reduced.

Further, in Japanese Unexamined Patent Publication No. 6-235885, the line-of-sight directions of both eyes of an observer are detected, the vergence angle is obtained based on the change of the line-of-sight directions, and the diopter is adjusted based on the vergence angle. An image display device configured to do so is disclosed. In this conventional example, the convergence position (distance from the eyeball to the virtual image) is Z, the pupil distance (eye width) is I, and the convergence angle is θ.
Then, the display element and the eyepiece optical system are moved so as to satisfy Z = I / θ. In addition, Japanese Patent Laid-Open No. 3-
Japanese Patent No. 292093 discloses a video display device in which a gazing point is detected, its position is compared with image data to determine depth information, and an eyepiece lens is driven according to the depth information.

[0006]

DISCLOSURE OF THE INVENTION Problems to be Solved by the Invention
In the conventional example of Japanese Patent No. 541, the convergence angle and the diopter are made to match at only one point (for example, the center point) in the observation area, and the convergence angle is set for the observation target object existing in another area of the observation area. And the diopter does not match, and in the case of observing the image with the image display device attached, it is usually impossible to keep gazing at only one point. The discomfort due to the disagreement will not be resolved.

Further, in the conventional example of the above-mentioned Japanese Patent Laid-Open No. 6-235885, when the virtual image projected at a position away from the observer is a fixed plane, the convergence angle at the time of gazing at the central portion of the virtual image is Since the convergence angle when the end of the virtual image is focused is smaller, when the end of the virtual image is focused by this conventional image display device, the convergence angle is greater than the convergence angle when the central part of the virtual image is focused. Becomes smaller and the image is guided farther than it should be. Therefore,
When the observation object is displayed at the end, there is a problem that the convergence angle and the diopter do not match. In addition, Japanese Patent Laid-Open No. 3-2920
The conventional example of Japanese Patent Laid-Open No. 93 does not show a specific configuration for determining depth information, and does not disclose a suitable method for determining depth information.

The present invention has been made in view of the above problems, and the diopter corresponds to the parallax or the convergence angle in the entire region of image observation from the center to the edge of the image of the observation object. It is an object of the present invention to provide a head-mounted image display device capable of obtaining an image.

[0009]

To this end, the structure of claim 1 of the present invention has first and second image display portions corresponding to the left and right eyeballs of the observer, and the first and second image display portions are provided. In a head-mounted image display device capable of stereoscopically observing by displaying first and second images having parallax on a second image display unit, at least one of the left and right eyeballs of an observer is displayed. A gaze position determining means for detecting the gaze direction of the eyeball to determine the gaze position of the observer in the observation area, and a gaze position determining means for determining a diopter adjustment signal corresponding to the parallax or vergence angle of the image of the gaze position, and the diopter. A diopter adjustment mechanism that receives the adjustment signal and adjusts the diopter of the first and second image display units is provided, and the gaze position determination means sends the diopter adjustment signal to a plurality of diopters. From the adjustment signal or the related signal, the gaze It is characterized in that it comprises a diopter adjusting signal selecting means for selecting on the basis of the location.

According to the head-mounted image display device having the structure of claim 1 of the present invention, the first one corresponding to the left and right eyeballs of the observer.
And first and second parallaxes on the second video display unit
When performing stereoscopic observation by displaying each of the images, the gaze position determining means detects the gaze direction of the observer in the observation area by detecting the line-of-sight direction of at least one of the left and right eyes of the observer. Only by determining, the diopter adjustment signal corresponding to the parallax or vergence angle of the image at the gaze position is determined, and the diopter adjustment mechanism receiving the diopter adjustment signal causes the diopter adjustment mechanism of the first and second image display units to Since the diopter is adjusted, the image can be observed at the gaze position at the diopter (depth of the image) corresponding to the parallax or the convergence angle. Therefore, an image in which the diopter corresponds to the parallax or vergence is obtained in the entire region of the image observation from the center of the image to the edge of the image, and the discomfort due to the disparity or the mismatch between the vergence and the diopter is eliminated. Further, since the gaze position determining means includes the diopter adjustment signal selecting means for selecting the diopter adjustment signal from a plurality of diopter adjustment signals or signals related thereto based on the gaze position, The response speed of the diopter adjustment can be increased by selecting the diopter adjustment signal from among the diopter adjustment signals. Here, a plurality of preset diopter adjustment signals may be selected, or a plurality of preset diopter adjustment signals output each time based on the selection status of the diopter adjustment signal selection means may be indirectly selected. Alternatively, the method may be selected. Of course, the plurality of diopter adjustment signals do not necessarily have to be set in advance, and may change with time.

According to a second aspect of the present invention, there is provided the above-mentioned first aspect.
In the above, the gaze position determining means includes a video signal generating means for generating video signals of the first and second video images based on an observation object, and after the gaze position signal is transmitted to the video signal generating means. It is characterized in that the diopter adjustment signal corresponding to the observation object existing at the gaze position is determined.

According to the head-mounted image display apparatus of the second aspect of the present invention, it is sufficient to obtain only one point to be determined, so that the amount of signal transmission in diopter adjustment is reduced and the image display apparatus and The control can be simplified.

According to a third aspect of the present invention, there is provided the above-mentioned first aspect.
In the above, the first and second image display units are liquid crystal display elements, and the diopter adjustment mechanism adjusts the diopter by moving the liquid crystal display elements with respect to the left and right eyes. It is a thing.

It is effective to use a liquid crystal display element (LCD) as an image display unit in order to make the head-mounted display device compact and lightweight. However, the liquid crystal display element is more likely to be seen as the viewing angle is inclined from the vertical. Therefore, in the head-mounted image display device, a good image can be obtained by locating the eyeball at the position where the light rays emitted from the liquid crystal display element in the vertical direction are gathered. Therefore, according to the head-mounted image display device having the structure of claim 3 of the present invention, the liquid crystal display element is moved with respect to the left and right eyes.
The diopter can be adjusted while always observing a good image without changing the positional relationship. Further, since the apparent size (field of view) does not change, it is more suitable than the case where the diopter adjustment is performed for the movement of the optical system.

According to a fourth aspect of the present invention, there is provided the above-mentioned first aspect.
In the above, the gaze position determining means determines to which region the gaze position belongs to when the observation region is divided into a plurality of regions, and determines a diopter adjustment signal corresponding to the determined region. It is characterized by.

According to the head-mounted image display device of the fourth aspect of the present invention, since the gaze position is divided into regions, the diopter adjustment signals should be prepared for the number of divided regions. Good. Therefore, as compared with the case where the gaze position is obtained as a point, it is possible to save the recording amount of the diopter adjustment signal and to omit the calculation process for leading it, thereby achieving higher speed and lower cost.

According to a fifth aspect of the present invention, in the first, third and fourth aspects, the first and second parallaxes having the parallax are provided.
2 cameras for generating a video signal of the image of
Any one of the two cameras has a plurality of distance measuring mechanisms, and the diopter adjustment signal is a distance signal output according to the distance to the observation object measured by the plurality of distance measuring mechanisms. It is characterized by being.

According to the head-mounted image display device having the structure of claim 5 of the present invention, with the above structure, the image signals of the first and second images having parallax by the two cameras and the image signals in the images. A plurality of distance signals corresponding to the distance to each observation object are obtained. Therefore, based on the gaze position of the observer, the diopter is adjusted by the distance signal of the image corresponding to the gaze position, so that the head-mounted image display device capable of observing the image in real time is achieved.

The structure of claim 6 of the present invention is the same as that of claim 2 above.
In the video signal generating means, the video signal generating means has two cameras for generating video signals of the first and second video images having the parallax, and one of the two cameras has a plurality of distance measuring mechanisms. However, the diopter adjustment signal is a distance signal output according to the distance to the observation object measured by the plurality of distance measuring mechanisms.

According to the head-mounted image display device having the structure of claim 6 of the present invention, with the above structure, the video signals of the first and second video images having parallax by the two cameras of the video signal generating means. In addition, a plurality of distance signals corresponding to the distance to each observation object in the image are obtained. Therefore, based on the gaze position of the observer, the diopter is adjusted by the distance signal of the image corresponding to the gaze position, so that the head-mounted image display device capable of observing the image in real time is achieved.

According to a seventh aspect of the present invention, there is provided the above-mentioned first aspect.
To 4, the first and second video signals of the first and second video images and the plurality of distance signals provided corresponding to the observation object in the video images are recorded from the recording medium.
And a reproduction device for transmitting the plurality of distance signals as the plurality of diopter adjustment signals as well as transmitting the image signals of the respective images to the first and second image display units, respectively. .

According to the head-mounted image display device having the structure of claim 7 of the present invention, by the above structure, various recording media in which the video signal of the video image with parallax according to the left and right eyeballs of the observer is recorded. While enjoying the stereoscopic image from, the diopter is adjusted based on the gaze position of the observer by the distance signal of the image corresponding to the gaze position.

The structure of claim 8 of the present invention is the same as that of claim 7 above.
In the above, the video signals of the first and second video images and the plurality of distance signals provided corresponding to the observation object in the video images are signals created by a computer. .

According to the head-mounted image display apparatus having the structure of claim 8 of the present invention, since the plurality of distance signals are signals generated by the computer, the distance of the image corresponding to the gaze position of the observer is determined. At the time of setting, the distance can be derived by a calculation process using the signal generated by the computer, which makes it possible to speed up the process and save the amount of information of the distance signal.

According to a ninth aspect of the present invention, there is provided the above-mentioned first aspect.
4 to 4, the plurality of diopter adjustment signals or signals related thereto are signals generated by performing correlation calculation between the video signals of the first and second video images.

According to the head-mounted image display apparatus having the structure of claim 9 of the present invention, since the diopter adjustment signal is generated by performing the correlation calculation between the images, the already-generated image is used. Can also present a video in which the congestion state and the diopter match.

For the above object, the structure of claim 10 of the present invention has a video display unit for displaying a video image having parallax to each of the first and second eyeballs of the observer, and enables stereoscopic observation. In the head-mounted image display device, a diopter adjustment mechanism that adjusts the diopter of the image display unit according to an input diopter adjustment signal, and a plurality of diopter adjustment signals related to the parallax or vergence angle of the image, or A diopter adjustment signal generating means for generating a signal related thereto and a sight line direction of at least one of the first and second eyeballs of the observer are detected to determine a gaze position of the observer in the observation region. Gaze position determining means, and diopter adjustment signal selecting means for selecting a diopter adjustment signal to be input to the diopter adjustment mechanism from the plurality of diopter adjustment signals or signals related thereto based on the gaze position. To have It is an feature.

According to the head-mounted image display device of the tenth aspect of the present invention, the stereoscopic image is displayed by displaying the images having parallax on the image display portions corresponding to the first and second eyes of the observer. When performing the observation, the gaze position determining means only detects the gaze position of the observer in the observation region by detecting the line-of-sight direction of at least one of the first and second eyeballs of the observer. In, the diopter adjustment signal corresponding to the parallax or vergence angle of the image of the gaze position is determined, the diopter adjustment mechanism that receives the diopter adjustment signal adjusts the diopter of the image display unit, the gaze At the position, the image can be observed with the diopter (depth of the image) corresponding to the parallax or the angle of convergence. Therefore, an image in which the diopter corresponds to the parallax or vergence is obtained in the entire region of the image observation from the center of the image to the edge of the image, and the discomfort due to the disparity or the mismatch between the vergence and the diopter is eliminated. Moreover, since the diopter adjustment signal is selected from the plurality of diopter adjustment signals or signals related thereto based on the gaze position, the response speed of the diopter adjustment can be increased.

For the above purpose, the structure of claim 11 of the present invention has an image display section for displaying an image having a parallax to each of the first and second eyeballs of the observer, and stereoscopic observation is possible. In a head-mounted image display device, a diopter adjustment mechanism that adjusts the diopter of the image display unit according to an input diopter adjustment signal, and at least one of the first and second eyeballs of an observer. Gaze position determining means for detecting the gaze direction of the observer to determine the gaze position of the observer in the observation region, and the diopter adjustment signal to be input to the diopter adjustment mechanism is the plurality of diopter adjustment signals or signals related thereto. Of the diopter adjustment signal selecting means for selecting based on the gaze position, a video signal generating means for generating a video signal of the video, a plurality of diopter adjustment signals related to the parallax or vergence angle of the video or Related to it Adjustment signal generating means for generating a signal, a multiplexer for superimposing the plurality of diopter adjustment signals or signals related thereto on the video signal, and a transmission for transmitting the superimposed signal superimposed by the multiplexer. Means for receiving the superimposed signal transmitted by the transmitting means, transmitting the image signal to the image display unit, and transmitting the diopter adjustment signal or a signal related thereto to the diopter adjustment signal. Receiving means for transmitting to the selecting means.

According to the head-mounted image display device of the eleventh aspect of the present invention, since the image signal and the diopter signal are multiplexed and transmitted, the signal is transmitted through one signal line or one channel. Can be sent. Further, it is possible to provide an easy-to-see image in which the image signal and the diopter signal are kept in synchronization.

According to a twelfth aspect of the present invention, in the recording apparatus according to the tenth aspect, the image signal of the image having the parallax and the plurality of diopter adjustment signals or signals related thereto are recorded on a recording medium. A video signal of a video image having parallax recorded in the recording medium is transmitted to the first and second video display units, and the video signal of the video image having the parallax and an observation target in the video image are corresponded to. And a reproducing device for reproducing a plurality of distance signals given as a result as the plurality of diopter adjustment signals.

According to the head-mounted image display device having the structure of claim 12 of the present invention, a recording medium in which a plurality of diopter adjustment signals corresponding to image parallax and congestion are added to a stereoscopic image (stereo image). Can be generated. By reproducing this recording medium and observing it with the head-mounted image display device of the present invention, it is possible to enjoy an image in which diopter and convergence are matched. Further, since it is sufficient to prepare the reproducing device and the main body of the head-mounted image display device when observing the image, the system can be simplified.

According to a thirteenth aspect of the present invention, in the above tenth to twelfth aspects, the plurality of diopter adjustment signals or signals related thereto are associated with coordinates in the image area of the image, The diopter adjustment signal selection means determines coordinates in the corresponding video area based on the gaze position determined by the gaze position determination means, and selects the diopter adjustment signal based on the coordinates. It is a thing.

According to the head-mounted image display apparatus of the thirteenth aspect of the present invention, since it suffices to compare and select the gaze position and preset coordinates, the speed of diopter selection is further increased. be able to.

According to a fourteenth aspect of the present invention, in the tenth aspect, the plurality of diopter adjustment signals related to the parallax or the convergence angle of the image are calculated by a correlation calculation between the first and second images. It is characterized in that it is a generated signal.

According to the head-mounted image display apparatus of the fourteenth aspect of the present invention, since the diopter adjustment signal is generated by performing the correlation calculation between the images, the already-generated image is used. Can also present a video in which the congestion state and the diopter match.

For the above purpose, the structure of claim 15 of the present invention has a video display unit for displaying a video image having parallax to each of the first and second eyeballs of the observer, and enables stereoscopic observation. In the head-mounted image display device, a diopter adjustment mechanism that adjusts the diopter of the image display unit according to an input diopter adjustment signal, and the diopter adjustment mechanism in relation to the parallax or vergence angle of the image. A plurality of diopter adjustment signal generating means for respectively generating a diopter adjustment signal to be operated or a signal related thereto, corresponding to the observation object in the display region of the image, and first and second eyeballs of the observer. Gaze position determining means for detecting the gaze direction of at least one of the eyeballs to determine the gaze position of the observer in the observation area, and one of the plurality of diopter adjustment signal generating means for the gaze position. Diopter adjustment based on Signal generating means selecting means, and the diopter adjusting signal generated by the diopter adjusting signal generating means selected by the diopter adjusting signal generating means selecting means or a signal related thereto is used as the input diopter adjusting signal. The input is made to the diopter adjustment mechanism.

According to the head-mounted image display apparatus of the fifteenth aspect of the present invention, a stereoscopic image is displayed by displaying images having parallax on the image display portions corresponding to the first and second eyes of the observer. When performing the observation, the gaze position determining means only detects the gaze position of the observer in the observation region by detecting the line-of-sight direction of at least one of the first and second eyeballs of the observer. In, the diopter adjustment signal corresponding to the parallax or vergence angle of the image of the gaze position is determined, the diopter adjustment mechanism that receives the diopter adjustment signal adjusts the diopter of the image display unit, the gaze At the position, the image can be observed with the diopter (depth of the image) corresponding to the parallax or the angle of convergence. Therefore, an image in which the diopter corresponds to the parallax or vergence is obtained in the entire region of the image observation from the center of the image to the edge of the image, and the discomfort due to the disparity or the mismatch between the vergence and the diopter is eliminated. Further, since an appropriate diopter adjustment signal generation means is selected from the plurality of diopter adjustment signal generation means based on the gaze position, the response speed of diopter adjustment can be increased.

For the above-mentioned purpose, the structure of claim 16 of the present invention has a video display unit for displaying a video image having parallax to each of the first and second eyeballs of the observer, and enables stereoscopic observation. In a head-mounted image display device, a diopter adjustment mechanism that adjusts the diopter of the image display unit according to an input diopter adjustment signal, and at least one of the first and second eyeballs of an observer. Gaze position determining means for determining the gaze position of the observer in the observation region by detecting the gaze direction of the image, video signal generating means for generating a video signal of the video, in relation to the parallax or vergence angle of the video A plurality of diopter adjustment signal generating means for respectively generating a diopter adjustment signal for operating the diopter adjustment mechanism or a signal related to the diopter adjustment signal corresponding to an observation object in the display area of the image, and the gaze position determination Gaze position from the means One of said plurality of diopter adjustment signal generating means based on the gaze position signal receiving means for receiving, gaze position signal the gaze position signal receiving means has received the No. 1
A diopter adjustment signal generating means selecting means, and a diopter adjusting signal generated by the diopter adjusting signal generating means selected by the diopter adjusting signal generating means selecting means or a signal related thereto. An image creating apparatus comprising a multiplexer for superimposing and a transmitting unit for transmitting the superimposed signal superimposed by the multiplexer, and a superimposed signal transmitted by the transmitting unit is received, and the image signal is displayed as the image. And a receiving means for transmitting the diopter adjustment signal or a signal related thereto to the diopter adjustment mechanism.

According to the head-mounted image display apparatus of the sixteenth aspect of the present invention, since the image forming apparatus multiplexes and transmits the image signal and the diopter adjustment signal, one signal line or A signal can be transmitted to the head-mounted image display device of the present invention on one channel. Further, it is possible to transmit a signal for an easy-to-see video in which the video signal and the diopter adjustment signal are kept in synchronization.

According to a seventeenth aspect of the present invention, in the display area of the image corresponding to the gaze position based on the signal representing the gaze position determined by the gaze position determining means in the first or fifteenth aspect. It is characterized by comprising a resolution improving means for improving the resolution of the observation object.

According to the head-mounted image display apparatus of the seventeenth aspect of the present invention, since it is possible to transmit a high resolution image at the observer's gaze position, it is possible to effectively transmit the image. it can.

According to a eighteenth aspect of the present invention, in the fifteenth or seventeenth aspect, the camera has two cameras for generating video signals of the first and second video images having the parallax,
The plurality of diopter adjustment signal generating means are a plurality of distance measuring mechanisms that are incorporated in one of the cameras and correspond to the gaze position, and the diopter adjustment signals are distance-measured by the plurality of distance measuring mechanisms. The distance signal is output according to the distance to the observation target.

According to the head-mounted image display device of the eighteenth aspect of the present invention, with the above configuration, the image signals of the first and second images having parallax by the two cameras and the image signals in the images. A plurality of distance signals corresponding to the distances to the respective observation objects are set by the observer's gaze position. Since the diopter is adjusted by the distance signal of the image corresponding to the observer's gaze position, the head-mounted image display device capable of observing the image in real time is achieved.

According to a nineteenth aspect of the present invention, in the sixteenth aspect, the video signal generating means has two cameras for generating the video signals of the first and second videos having the parallax, The plurality of diopter adjustment signal generating means are a plurality of distance measuring mechanisms that are incorporated in one of the cameras and correspond to the gaze position, and the diopter adjustment signals are distance-measured by the plurality of distance measuring mechanisms. The distance signal is output according to the distance to the observation target.

According to the head-mounted image display apparatus of the nineteenth aspect of the present invention, with the above configuration, the image signals of the first and second images having parallax by the two cameras of the image signal generating means. In addition, a plurality of distance signals corresponding to the distances to the respective observation objects in the image are set by the observer's gaze position. Since the diopter is adjusted by the distance signal of the image corresponding to the observer's gaze position, the head-mounted image display device capable of observing the image in real time is achieved.

According to a twentieth aspect of the present invention, in the seventeenth aspect, there are provided two cameras for generating video signals of the first and second video images having the parallax, and the plurality of diopter adjustments. The signal generating means is a plurality of distance measuring mechanisms incorporated in any one of the cameras and corresponding to the gaze position, and the diopter adjustment signal is for measuring an object to be observed by the plurality of distance measuring mechanisms. In addition to the distance signal output according to the distance, the resolution improving means is arranged in the two cameras and focuses the observation target object in the display area of the image corresponding to the gaze position. It is characterized by being.

According to the head-mounted image display device having the structure of claim 20 of the present invention, it is possible to transmit an in-focus image with high resolution at the observer's gaze position, so that an image can be effectively displayed. Can be transmitted.

According to a twenty-first aspect of the present invention, in the above-mentioned fifteenth to seventeenth aspects, the plurality of diopter adjustment signal generating means are associated with coordinates in the image area of the image.
The diopter adjustment signal generating means selecting means determines coordinates in the corresponding video region based on the gaze position determined by the gaze position determining means, and selects the diopter adjustment signal generating means based on the coordinates. It is characterized by that.

According to the head-mounted image display apparatus of the twenty-first aspect of the present invention, it is only necessary to compare the gaze position with preset coordinates and select the diopter adjustment signal generating means. The selection speed of the diopter adjustment signal generating means can be further increased.

For the above purpose, the structure of claim 22 of the present invention has a video display unit for displaying a video image having parallax to each of the first and second eyeballs of the observer, and stereoscopic observation is possible. In a head-mounted image display device, a diopter adjustment mechanism that adjusts the diopter of the image display unit, and a visual line direction of at least one of the first and second eyeballs of an observer are detected and observed. A gaze position determining means for determining a gaze position of an observer in the region, and the diopter adjustment mechanism based on the gaze position determined by the gaze position determining means and the correlation calculation between the first and second images. A diopter adjustment signal generating means for outputting a diopter adjustment signal to be operated is provided.

According to the head-mounted image display device of the twenty-second aspect of the present invention, the images having parallax are displayed on the image display portions corresponding to the first and second eyes of the observer, respectively, and stereoscopically displayed. When performing the observation, the gaze position determining means only detects the gaze position of the observer in the observation region by detecting the line-of-sight direction of at least one of the first and second eyeballs of the observer. In, the diopter adjustment signal corresponding to the parallax or vergence angle of the image of the gaze position is determined, the diopter adjustment mechanism that receives the diopter adjustment signal adjusts the diopter of the image display unit, the gaze At the position, the image can be observed with the diopter (depth of the image) corresponding to the parallax or the angle of convergence. Therefore, an image in which the diopter corresponds to the parallax or vergence is obtained in the entire region of the image observation from the center of the image to the edge of the image, and the discomfort due to the disparity or the mismatch between the vergence and the diopter is eliminated. Further, since the diopter adjustment signal is generated by performing the correlation calculation between the first and second images, the image in which the congestion state and the diopter match is presented even if the already created image is used. be able to.

According to a twenty-third aspect of the present invention, in the twenty-second aspect, the diopter adjustment signal generating means is the first
And a parallax distribution signal generation device that generates a parallax distribution signal corresponding to the second video, a transmission unit that transmits the video signal of the first video and the parallax distribution signal, and the parallax distribution of the transmitted signals. The diopter adjustment includes: a distribution unit that distributes a signal; and a video signal generation unit that generates a video signal of the second video from one of the distributed parallax distribution signals and the video signal of the first video. A diopter adjustment signal to be transmitted to the mechanism, the diopter adjustment signal selecting means for determining based on the other of the distributed parallax distribution signals and the gaze position determined by the gaze position determining means. To do.

According to the head-mounted image display device of the twenty-third aspect of the present invention, since the parallax distribution signal for transmitting the diopter adjustment signal as a part of the image signal is used, the transmission capacity can be reduced. it can.

For the above purpose, the structure of claim 24 of the present invention comprises a video signal generating means for generating a video signal of a video image having parallax for displaying on each of the first and second eyes of the observer. , A diopter adjustment signal generation unit that generates a plurality of diopter adjustment signals or signals related to the parallax or vergence angle of the video signal, and the plurality of diopter adjustment signals or related to the video signal It is characterized by comprising a multiplexer for superimposing a signal and a transmitting means for transmitting the superimposed signal superposed by the multiplexer.

According to the image creating apparatus of the twenty-fourth aspect of the present invention, since the video signal and the diopter adjustment signal are multiplexed and transmitted, the head of the present invention is provided by one signal line or one channel. A signal can be transmitted to the part-mounted video display device. Further, it is possible to transmit a signal for an easy-to-see video in which the video signal and the diopter adjustment signal are kept in synchronization.

For the above-mentioned purpose, the structure of claim 25 of the present invention comprises a video signal generating means for generating a video signal of a video image having parallax for displaying on each of the first and second eyes of the observer. , A diopter adjustment signal generating unit that generates a plurality of diopter adjustment signals or signals related thereto, which are related to the parallax or vergence angle of the video signal, and the video signal and the plurality of diopter adjustment signals or related thereto A recording device for recording a signal on a recording medium.

According to the head-mounted image display apparatus of the twenty-fifth aspect of the present invention, it is possible to generate a recording medium in which a plurality of diopter adjustment signals corresponding to image parallax and congestion are added to a stereoscopic image. You can By reproducing this recording medium and observing it with the head-mounted image display device of the present invention, it is possible to enjoy an image in which diopter and convergence are matched.

[0059]

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 is a system diagram showing the configuration of a first embodiment of a head-mounted image display device (HMD) of the present invention. In FIG. 1, 1L and 1R are left and right eye image display units, respectively, and in this example, a liquid crystal display element (LC
D) is used. The LCDs 1L and 1R respectively receive a video signal (hereinafter referred to as a video signal) of a video as illustrated in FIG. 4 from the controllers 2L and 2R and a motor (a diopter adjustment mechanism) to which a diopter adjustment signal is input. ) 3L,
The position is adjusted in the optical axis direction by 3R, and the first and second images are guided to the left and right eyeballs 5L and 5R of the observer through the eyepiece optical systems 4L and 4R. As a result, the first and second images are enlarged and projected in the air as virtual images on the left and right eyes 5L and 5R of the observer respectively, and stereoscopic observation is performed by the binocular parallax.

LE is provided on the opposite side of the eyeball of the eyepiece optical system 4L.
An infrared light source 51 that emits infrared light such as D and a projection lens 52 are arranged, and the infrared light emitted from the infrared light source 51 enters the cornea of the eyeball 4L through the projection lens 52 and the prism portion of the eyepiece optical system 4L, and the cornea The reflected light from is again transmitted through the prism portion and is received by the CCD 54 via the condenser lens 53. At that time, LCD to CCD54
An infrared transmission filter 55 that transmits only infrared rays is provided in front of the CCD 54 so that the reflected light of the image does not enter. In the present embodiment, the line-of-sight detection device including the above elements is provided only in the left-eye optical system, but it may be provided only in the right-eye optical system or in the binocular optical system. According to this line-of-sight detection device, the position at which the infrared reflected light is received differs depending on the rotation angle of the eyeball, so by extracting this light-receiving position signal, the rotation angle of the eyeball, that is, the gaze position in the observation region is detected. be able to.

Next, the operation of this embodiment will be described in principle with reference to the flowchart of FIG. First, in process 1 of FIG. 2, the line-of-sight detection device incorporated in the HMD detects the line-of-sight of the HMD wearer (observer), and determines the gaze region (gaze position) of the HMD wearer in the observation region. . Next, in process 2, the diopter corresponding to the vergence angle of the observation target image existing in the gaze area determined in process 1 is determined. Then, in the next process 3, the eyepiece optical system 4 in the HMD is set so as to obtain the diopter determined in the process 2.
Adjust the diopter of L and 4R. By repeating this series of processes, the parallax or vergence angle and the diopter match when the HMD wearer looks at any region of the observation region, so discomfort due to the disparity or vergence angle and diopter mismatch is eliminated. To be done.

Specifically, in the above stereoscopic observation, the diopter is adjusted according to the relative positional relationship between the object to be observed which the observer is gazing and the left and right eyeballs of the observer. That is,
LCDs 1L and 1R are motors 3 based on the diopter adjustment signal.
As compared with the case where the position of the optical axis direction (the arrow direction in FIG. 1) is adjusted by the operation of L and 3R and the image of the observation target object existing at a long distance is focused as shown in FIG. As shown in FIG. 3B, when the user is gazing at the image of the observation target object that exists at a short distance, the LCD 1L, 1R approaches the state of the concave mirror and the convergence angle increases, and
Diopter increases (changes in the positive direction). Therefore, images with different parallaxes as illustrated in FIG. 4 are displayed by the video signals for the left and right eyes (first and second video signals), and the images that match the parallax of the observation target object that the observer is gazing at are displayed. By moving the LCDs 1L and 1R in the optical axis direction so that the angle becomes equal to the degree, the convergence angle and the diopter can be matched as shown in FIGS. 3 (a) and 3 (b), in which case the observer feels uncomfortable. You will not feel it.

In the present embodiment, the diopter adjustment is performed by moving the positions of the LCDs 1L and 1R with respect to the left and right eyeballs 5L and 5R, but the present invention is not limited to this, and for example, the eyepiece optical system 4L, 4R position to the left and right eyeballs 5
The refractive index is electrically changed by adjusting the applied voltage and the like by using a material such as liquid crystal that can change the refractive index with respect to L and 5R or changing the refractive index such as liquid crystal, and adjust the diopter. May be performed.

Further, the resolution of the gaze position detection by the line-of-sight detection is 3 in the horizontal direction in the entire area as shown in FIG.
It can be appropriately adjusted by dividing into areas or by dividing the entire area into three areas in the vertical and horizontal directions as shown in FIG. In that case, the higher the resolution, the more the convergence angle (parallax) and the diopter can be matched, but the higher the resolution, the more complicated the diopter determination process described later. In other words, the plurality of diopter adjustment signals or signals related thereto are associated with the coordinates in the video area, and the diopter adjustment signal selection means selects the corresponding video based on the gaze position determined by the gaze position determination means. It is possible to adopt a configuration in which the coordinates in the area are determined and the diopter adjustment signal is selected based on the coordinates.

Next, a system for generating the above diopter adjustment signal will be described with reference to FIG. FIG. 6 shows a system in which a stereoscopic image pickup camera is configured by using two left and right cameras 6L and 6R, and an image of an observation target object is picked up by two left and right cameras to obtain an image for left and right eyeballs with parallax. You can This stereoscopic imaging camera outputs video signals for the left and right eyes, and also uses a plurality of distance measuring mechanisms 6a incorporated in one of the left and right cameras (left in the illustrated example) to detect a plurality of objects to be observed. Distance signals corresponding to the distances are output. For example, as shown in FIG. 7, when there are nine distance measuring points in the imaging area, nine distance signals are output.

FIG. 8 is a block diagram showing a system in which the above-described stereoscopic image pickup camera and the head-mounted image display device of FIG. 1 are combined. A system including this head-mounted image display device includes an image creation device 10 and an image processing device 11.
The image creation apparatus 10 includes a stereoscopic imaging camera 1
2 (including a plurality of distance measuring mechanisms 12a), a multiplexer 14 and a transmitter 15. The plurality of distance signals output from the plurality of distance measuring mechanisms are associated with each distance measuring point, and are superimposed on the video signal input from the stereoscopic imaging camera 12 in the multiplexer 14. At that time, a method of superimposing the signals in the vertical blanking period of the video signal is effective as a method of superimposing the signals. The video signal on which the distance signal is superimposed is transmitted by the transmitter 15 to the video processing device 11 together with the audio signal input from the stereoscopic imaging camera 12.

The video processing device 11 includes a receiver 16 and video / video
Audio detector 17, video / distance demultiplexer 18, LCD controller 19, diopter controller 20, distance signal selector 5
6 and an audio signal processing circuit 21. The video signal and the audio signal including the distance signal received by the receiver 16 are
First, only the audio signal is extracted by the video / audio detector 17 and input to the audio signal processing circuit 21, then the distance signal in the video signal is extracted by the video / distance demultiplexer 18, and finally the video signal. Only that is input to the LCD controller 19 and transmitted to the LCD of FIG. The audio signal processing circuit 21 performs signal processing on the input audio signal, and then, the speaker (see FIG.
0)).

The plurality of distance signals extracted by the video / distance demultiplexer 18 are input to the distance signal selector 56. Here, based on the gaze position signal from the CCD 54 of FIG.
The distance signal of the distance measuring point corresponding to the gaze position in the observation area is selected. For example, when the observer is gazing at a certain point in the LCD display area, the distance signal of the distance measuring point in the imaging area corresponding to the point is selected. The distance signal selected in this way is converted into a diopter adjustment signal by the diopter controller 20, and is input to the motors 3L and 3R for driving the LCDs 1L and 1R of FIG. 1, respectively.

FIG. 9 is a system diagram showing the configuration of the second embodiment of the head-mounted image display device of the present invention. This second
The embodiment is different from the first embodiment in the method of transmitting a video signal. That is, in the configuration of FIG. 8 of the first embodiment, the video created by the video creating apparatus 10 is directly transmitted to the video processing apparatus 11. However, in the present embodiment, as shown in FIG. The image including the distance signal, the image signal and the audio signal created by the creating device 10 is once recorded on the recording medium (for example, a video tape) 23 by the recording device 22, and the recording medium is recorded when the observer actually observes. 23 is reproduced by the reproducing device 24. In that case, on the viewer side, as shown in the perspective view of FIG.
24, video processing device 11, and display device 2
5, it is only necessary to prepare a head-mounted image display device 28 including a headphone (having a speaker) 26, a support member 27, etc., and to configure a compact image display system in which the image creation device 10 is separated. You can

FIG. 11 is a system diagram showing the configuration of the third embodiment of the head-mounted image display device of the present invention. The third embodiment is similar to the second embodiment shown in FIG.
Is replaced with a computer graphics data (CG data) input device 30 and a data creation device 31, and an image for stereoscopic observation is created from an image captured by a camera or the like as in the second embodiment. Instead, the image is created by image processing using CG technology.

In FIG. 11, first, when CG data corresponding to a desired CG image is input to the data creating device 31 from the CG data input device 30, the data creating device 31 determines a predetermined interpupillary distance based on the CG data. Left and right video data when viewed from the left and right eyeballs, and a plurality of distance data representing depth are created. Next, the left and right video data and distance data are recorded by the recording device 22 into a recording medium (magneto-optical disk; MO, floppy disk, etc.) 32.
Record it in. Then, the recording medium 32 is inserted into the reproducing device 24 to reproduce the respective data, convert them into CG image signals, and then output to the video processing device 11.

The video display system of the third embodiment is
It can be made compatible with virtual reality as follows. That is, as shown in FIG. 12, a control device (feedback glove, mouse, mouse, etc.) that an observer operates while viewing the displayed image (CG image).
A joystick or the like) 33 is provided and a CG image control signal from the control device 33 is input to the CG image data processing device 34. With the input of this CG image control signal, C
The G image data processing device 34 selects desired three-dimensional data corresponding to the CG image control signal from the plurality of three-dimensional image data read from the recording medium 32 and inputs it to the data creation device 31. The data creating device 31 creates left and right video data and distance data based on the three-dimensional data and inputs them to the CG image signal converting device 35, and the CG image signal converting device 35 converts each of the above data into a CG image signal. After that, it outputs to the video processing device 11.

FIG. 13 is a diagram showing the configuration of the fourth embodiment of the head-mounted image display device of the present invention. The fourth embodiment corresponds to the configuration of the second embodiment shown in FIG. 9, and in the above-described respective embodiments, the distance signal, which is a signal independent of the video signal, is omitted, and the distance signal is calculated from the video signal. Is automatically generated by.

In FIG. 13, a reproducing device 40 reproduces a recording medium (video tape or the like) 41 in which images (including audio) for the left and right eyes are recorded to extract left and right image data and audio data, and an arithmetic processing device 42. To enter. The arithmetic processing unit 42 performs correlation processing on the video data to calculate distances to a plurality of objects to be observed, and outputs the calculated distance signals to the video processing unit 43 together with the left and right video signals.
Therefore, since it is not necessary to record the distance signal in the recording medium 41, the image creation device and the recording device can be simplified.

FIG. 14 is a view showing the arrangement of the fifth embodiment of the head-mounted image display device of the present invention. In each of the above-described embodiments, the distance signal for the image area of each observation target object is prepared in advance, and the distance signal of the gaze position is selected from them and the diopter adjustment is performed based on the distance signal. However, in the present embodiment, only when the gaze area (gaze position) within the observation area is determined, the diopter at the gaze position is measured or calculated, and the diopter adjustment is performed by the obtained gaze position signal. .

The head-mounted image display device of the fifth embodiment has the following modifications to the configuration of the first embodiment shown in FIG. That is, as the stereoscopic imaging camera 12 in the image creating apparatus 10, a multi-autofocus (AF) mechanism 12b and an autofocus (AF) point selection mechanism 12c are provided in place of the plurality of distance measuring mechanisms 12a, and at different points in the imaging area. In addition to using a focusable device, a receiver 58 is provided in the image creating device 10 in association with a transmitter 57 provided in the image processing device 11.
And a distance signal selector 5 in the image processing device 11.
6 is omitted.

In the fifth embodiment, the CCD 54 of FIG.
The gaze position signal input from the transmitter to the transmitter 57 in the image processing apparatus 11 is input to the AF point selection mechanism 12c via the transmitter 57 and the receiver 58 in the image creating apparatus 10. The AF point selection mechanism 12c selects a point to be focused based on this gaze position signal, and inputs the AF point signal to the multi AF mechanism 12b. The multi AF mechanism 12b inputs a lens drive signal to the stereoscopic imaging camera 12 based on the AF point signal. As a result, the stereoscopic imaging camera 12 performs focusing at the point selected as described above and, at the same time, outputs the distance signal at that point. This distance signal is used by the multiplexer 1
4 and the transmitter 15 to the video processing device 11, and the diopter adjustment is performed based on the distance signal.

In the fifth embodiment, not only the diopter and the vergence angle match at the gaze position of the HMD wearer (observer), but the image also comes into focus. In addition, a large number (plural) for diopter adjustment as in the above-described embodiment.
Since it is not necessary to transmit the distance signal of the HMD, the HMD and its control are simplified.

FIG. 15 is a diagram showing the configuration of the sixth embodiment of the head-mounted image display device of the present invention. The sixth embodiment is different from the third embodiment in FIG. 12 in that the CCD 54
The input position of the gaze position signal from is changed from the video processing device 11 to the data creation device 31. In the sixth embodiment, the data creation device 31 to which the gaze position signal is input creates the image data and simultaneously creates the distance data of the image of the observation target object in the gaze area (gaze position). 1 is input to the motor of FIG. 1 via the CG image signal / signal converter 35 and the image processor 11, and the HMD
Since the diopter of the eyepiece optical system of is adjusted,
Since it is not necessary to create the distance data of, the data calculation speed in the data creation device 31 can be increased.

In addition, in the data creating device 31, at the same time as creating the image data, the amount of the image data is increased only in the gazing area to increase the resolution, and the amount of the image data in the other areas is decreased to increase the resolution. If the value is set to a low value, it will appear that only the part where the observer is gazing, as in the fifth embodiment, the amount of image data as a whole can be reduced.

FIG. 16 is a diagram showing the configuration of the seventh embodiment of the head-mounted image display device of the present invention. This seventh embodiment is different from the fourth embodiment in FIG. 13 in that the CCD 54
The input position of the gaze position signal from is changed from the video signal device 43 to the arithmetic processing device 42. In the seventh embodiment, the arithmetic processing unit 42 to which the gaze position signal is input.
Is the distance of the image of the observation target object obtained by correlating the left and right video signals only with respect to the image region of the observation target object existing in the fixation region (gaze position), and adjusting the diopter based on the obtained distance signal. Therefore, the arithmetic processing speed in the arithmetic processing device 42 can be increased.

FIG. 17 is a diagram showing the configuration of an eighth embodiment of the head-mounted image display device of the present invention. In the eighth embodiment, in contrast to the configuration of FIG. 8 of the first embodiment, instead of sending two left and right video signals, either the left or right video signal and the parallax distribution signal are sent, and a part of this parallax distribution signal is sent. It is changed so as to be selected and used as a diopter adjustment signal. In the image creation device 10 of FIG. 17, the left and right cameras 61L, 61
The left and right video signals from each R are input to the parallax distribution signal generation device 62. Here, first, the left and right video signals are divided into sub blocks, and the sub block having the highest correlation in the left video signal is detected for each sub block of the right video signal. Then, the amount of positional displacement between both sub-blocks, that is, the distribution of the parallax amount is obtained. The left video signal and the parallax distribution signal output from the parallax distribution signal generation device 62 are signal-compressed by the left and right signal compressors 63L and 63R by an appropriate compression method to be a compressed left video signal and a compressed parallax distribution signal, respectively. It is input to the wave filter 14. In this way, the method of compressing either the left or right image and the parallax distribution signal can reduce the amount of information as compared with the method of compressing each of the left and right images, and can suppress the transmission cost. 3-292093).

The compressed parallax distribution signal and the compressed left video signal are combined by the combiner 14, and the transmitter 1 together with the audio signal.
In step 5, it is transmitted to the video processing device 11. These signals are received by the receiver 16 of the video processing device 11, and first, only the audio signal is extracted by the video / audio detector 17 and input to the audio signal processing circuit 21, where the signal processing is applied to the speaker and then the speaker. Sent. On the other hand, the compressed left video signal and the compressed parallax distribution signal are demultiplexed by the video / parallax distribution demultiplexer 64, and then decompressed by the left and right signal decompressors 65L and 65R by appropriate decompression methods to obtain the left image signal and the parallax distribution. One of the parallax distribution signals that has become a signal and is divided into two by the left video signal and the distributor 66 is input to the right video generation device 67, and the other of the parallax distribution signals is input to the signal selector 68. The right image generation device 67, to which the left image signal and the parallax distribution signal are input, reconstructs the right image from the amount of positional deviation of each left image sub-block. Then, the left video signal and the right video signal are input to the left and right LCDs via the LCD controllers 19L and 19R, respectively, and are displayed there. On the other hand, the signal selector 68, to which the diopter distribution signal distributed by the distributor 66 is input, selects a sub-block based on the gaze position signal from the CCD 54 of FIG. 1 and is associated with the sub-block. A parallax signal representing the amount of parallax is called, and this parallax signal is converted by the diopter controller 20 into a diopter adjustment signal representing the diopter amount and output to the motor. Then, the diopter is adjusted by the motor.

In the present embodiment, the diopter adjustment is performed using the parallax distribution signal received as a part of the video signal.
There is an advantage that the transmission cost can be reduced as compared with the embodiment.

In the present embodiment, the example of reconstructing the right video signal is taken, but it goes without saying that the left video signal may be reconstructed. Further, although the camera is used as the means for generating the video signal of the video, a computer for generating the left and right CGs may be used instead, or a video reproducing device for reproducing the stereoscopic video that has already been recorded may be used. .

It should be noted that the present invention is not limited to the above-mentioned examples, and various changes and modifications can be added. For example, in the configuration of claim 1, a plurality of diopter adjustment signals or signals related thereto are transmitted to the diopter adjustment signal selecting means in synchronization with the first and second images. Of course, in that case, since the image and the diopter adjustment signal are synchronized, the relation between the image and the diopter adjustment becomes strong, and the disparity (or the convergence angle) and the diopter do not match. Further, in the configuration of claim 2, the image generation means may generate the image of the observation object existing at the gaze position so as to have a higher resolution than the image of the observation object existing in the other region. Well, in that case,
Since the resolution of the image is increased only in the part where the observer is gazing, the amount of the image data as a whole can be reduced. Further, the first and second video display units do not have to be a plurality of video display elements independent of each other as shown in the above embodiment, and a single video display having the first and second video display units is provided. It can be achieved by any means. For example, if the first image on the first image display unit and the second image
And the second image of the image display unit are periodically and alternately displayed on the display surface of the single image display unit, and the first image and the second image are displayed by the observer in accordance with the period. A means for sorting according to the left and right eyeballs (for example, a liquid crystal shutter that divides the optical path into two with a half mirror, and is arranged in the optical path after the division and alternately blocks the optical path according to the display cycle of the destination) Various modifications such as installation can be made.

[Brief description of drawings]

FIG. 1 is a system diagram showing a configuration of a first embodiment of a head-mounted image display device of the present invention.

FIG. 2 is a flowchart explaining the principle of the operation of the first embodiment.

3 (a) and 3 (b) are views for explaining the diopter when displaying an image of an observation target object at a long distance and when displaying an image of an observation target object at a short distance in the first embodiment. It is a figure.

FIG. 4 is a diagram illustrating a video signal used in the first embodiment.

5A and 5B are diagrams for explaining the resolution of gaze position detection by the line-of-sight detection device in the first embodiment.

FIG. 6 is a diagram showing a system for generating a diopter adjustment signal in the first embodiment.

FIG. 7 is a diagram exemplifying an arrangement of distance measuring points in an imaging area according to the first embodiment.

FIG. 8 is a system diagram showing a configuration of a second embodiment of the head-mounted image display device of the present invention.

FIG. 9 is a system diagram showing a configuration in the case where the created video is once recorded in the second embodiment.

FIG. 10 is a perspective view showing an apparatus installed on the observer side in the second embodiment.

FIG. 11 is a system diagram showing the configuration of a third embodiment of the head-mounted image display device of the present invention.

FIG. 12 is a system diagram showing a configuration when a third embodiment is adapted to computer graphics.

FIG. 13 is a diagram showing a configuration of a fourth embodiment of the head-mounted image display device of the present invention.

FIG. 14 is a diagram showing the configuration of a fifth embodiment of the head-mounted image display device of the present invention.

FIG. 15 is a diagram showing the configuration of a sixth embodiment of the head-mounted image display device of the present invention.

FIG. 16 is a diagram showing the configuration of a seventh embodiment of the head-mounted image display device of the present invention.

FIG. 17 is a diagram showing the configuration of an eighth embodiment of the head-mounted image display device of the present invention.

[Explanation of symbols]

 1L image display unit (LCD; first image display unit) 1R image display unit (LCD; second image display unit) 2L, 2R controller 3L, 3R motor (diopter adjustment mechanism) 4L, 4R eyepiece optical system 5L, 5R Left and right eyes of observer 51 Infrared light source 52 Projection lens 53 Condensing lens 54 CCD 55 Infrared transmission filter

Claims (25)

[Claims] 1. A first and a second video display unit corresponding to the left and right eyes of an observer, and the first and second video images having parallax on the first and second video display units, respectively. In a head-mounted image display device capable of displaying and stereoscopically observing, the gaze position of the observer in the observation area is determined by detecting the line-of-sight direction of at least one of the left and right eyes of the observer. Then, a gaze position determining means for determining a diopter adjustment signal corresponding to the parallax or vergence angle of the image at the gaze position, and the diopter of the first and second image display units for receiving the diopter adjustment signal. A diopter adjustment mechanism for adjusting is provided, and the gaze position determining means selects the diopter adjustment signal from a plurality of diopter adjustment signals or signals related thereto based on the gaze position. Degree adjustment signal selection means Characteristic head-mounted video display device. 2. The gaze position determining means includes a video signal generating means for generating video signals of the first and second video images based on an observation object, and the gaze position signal is transmitted to the video signal generating means. The head-mounted image display device according to claim 1, wherein the diopter adjustment signal corresponding to the observation object existing at the gaze position is determined after the adjustment. 3. The first and second image display units are liquid crystal display elements, and the diopter adjustment mechanism adjusts diopter by moving the liquid crystal display elements with respect to the left and right eyes. The head-mounted image display device according to claim 1. 4. The gaze position determining means determines which region, when the observation region is divided into a plurality of regions, to which the gaze position belongs, and outputs a diopter adjustment signal corresponding to the determined region. The head-mounted image display device according to claim 1, wherein the determination is made. 5. The camera has two cameras for generating video signals of the first and second video images having the parallax, and one of the two cameras has a plurality of distance measuring mechanisms. 5. The diopter adjustment signal is a distance signal output according to the distance to the observation target object measured by the plurality of distance measuring mechanisms. The head-mounted image display device described. 6. The video signal generating means has two cameras for generating video signals of the first and second videos having the parallax, and one of the two cameras has a plurality of distance measuring units. The head according to claim 2, further comprising a mechanism, wherein the diopter adjustment signal is a distance signal output according to a distance to an observation target object measured by the plurality of distance measuring mechanisms. Part-mounted video display device. 7. A first recording medium and a second recording medium from which a video signal of the first and second video images and a plurality of distance signals provided corresponding to an observation object in the video image are recorded.
A video signal of the video image is transmitted to the first and second video image display units, respectively, and a reproduction device for reproducing the plurality of distance signals as the plurality of diopter adjustment signals. 4. The head-mounted image display device according to any one of items 1 to 4. 8. The image signals of the first and second images and the plurality of distance signals provided corresponding to the observation object in the images are signals created by a computer. The head-mounted image display device according to claim 7. 9. The plurality of diopter adjustment signals or signals related thereto are signals generated by performing correlation calculation between the video signals of the first and second videos. 4. The head-mounted image display device according to any one of items 1 to 4. 10. A head-mounted image display device capable of stereoscopic observation, comprising a video display unit for displaying a video image having parallax to each of a first eyeball and a second eyeball of an observer. Diopter adjustment mechanism that adjusts the diopter of the image display unit according to a diopter adjustment signal, and a plurality of diopter adjustment signals related to the parallax or vergence angle of the image or a diopter adjustment signal generation unit that generates signals related thereto. And a gaze position determining means for determining the gaze position of the observer in the observation region by detecting the line-of-sight direction of at least one of the first and second eyeballs of the observer, and the diopter adjustment mechanism. A head-mounted image, comprising: diopter adjustment signal selecting means for selecting an input diopter adjustment signal from the plurality of diopter adjustment signals or signals related thereto based on the gaze position. Display device. 11. A head-mounted image display device capable of stereoscopic observation, comprising a video display unit for displaying a video image having parallax to each of a first eyeball and a second eyeball of an observer. A diopter adjustment mechanism that adjusts the diopter of the image display unit according to a diopter adjustment signal, and an observer in the observation region by detecting the line-of-sight direction of at least one of the first and second eyes of the observer. Gaze position determining means for determining the gaze position, and a diopter adjustment signal to be input to the diopter adjustment mechanism is selected from the plurality of diopter adjustment signals or signals related thereto based on the gaze position. Adjustment signal selection means, video signal generation means for generating the video signal of the video, and diopter adjustment signal generation means for generating a plurality of diopter adjustment signals related to the parallax or vergence angle of the video or signals related thereto. When, A video creating apparatus comprising a multiplexer for superimposing the plurality of diopter adjustment signals or signals related thereto on the video signal, and a transmitter for transmitting the superimposed signal superimposed by the multiplexer, and the transmitter. Receiving means for receiving the superimposition signal transmitted by the above, transmitting the video signal to the video display portion, and transmitting the diopter adjustment signal or a signal related thereto to the diopter adjustment signal selecting means. Head-mounted video display device characterized by: 12. A recording device for recording a video signal of a video image having the parallax and the plurality of diopter adjustment signals or signals related thereto on a recording medium, and a video image of the video image having the parallax recorded on the recording medium. A signal is transmitted to the first and second video display units, and a video signal of the video having the parallax and a plurality of distance signals provided corresponding to an observation object in the video are provided to the plurality of diopters. 2. A reproducing device for reproducing as an adjustment signal.
0 head-mounted image display device. 13. The plurality of diopter adjustment signals or signals related thereto are associated with coordinates in a video region of the video, and the diopter adjustment signal selection means is determined by the gaze position determination means. 13. The coordinates in the corresponding video area are determined based on the gaze position, and the diopter adjustment signal is selected based on the coordinates.
The head-mounted image display device according to claim 1. 14. The plurality of diopter adjustment signals related to the parallax or vergence angle of the images are signals generated by a correlation calculation between the first and second images. The head-mounted image display device described. 15. A head-mounted image display device capable of stereoscopic observation, comprising a video display unit for displaying a video image having parallax to each of the first and second eyeballs of an observer, A diopter adjustment mechanism that adjusts the diopter of the image display unit according to a diopter adjustment signal, and a diopter adjustment signal or a signal related thereto that operates the diopter adjustment mechanism in association with the parallax or convergence angle of the image, A plurality of diopter adjustment signal generating means respectively corresponding to the observation object in the display area of the image, and detecting the line-of-sight direction of at least one of the first and second eyeballs of the observer. Gaze position deciding means for deciding the gaze position of the observer within the observation area, and diopter adjustment signal generating means selecting means for selecting any one of the plurality of diopter adjustment signal generating means based on the gaze position. And the diopter The diopter adjustment signal generated by the diopter adjustment signal generating unit selected by the adjusting signal generating unit selecting unit or a signal related thereto is input to the diopter adjusting mechanism as the input diopter adjusting signal. Head-mounted video display device. 16. A head-mounted image display device capable of stereoscopic observation, comprising an image display unit for displaying an image having parallax on each of the first and second eyes of an observer, A diopter adjustment mechanism that adjusts the diopter of the image display unit according to a diopter adjustment signal, and an observer in the observation region by detecting the line-of-sight direction of at least one of the first and second eyes of the observer. Gaze position determining means for determining the gaze position, a video signal generating means for generating a video signal of the video, and a diopter adjustment signal for operating the diopter adjustment mechanism in association with the parallax or the convergence angle of the video, or A plurality of diopter adjustment signal generating means for respectively generating signals related thereto corresponding to the observation object in the display area of the image, and gaze position signal reception for receiving gaze position signals from the gaze position determining means. Means and before Diopter adjustment signal generating means selecting means for selecting any one of the plurality of diopter adjusting signal generating means based on the gaze position signal received by the gaze position signal receiving means,
A multiplexer that superimposes a diopter adjustment signal generated by the diopter adjustment signal generation unit selected by the diopter adjustment signal generation unit selection unit or a signal related thereto on the video signal, and is superimposed by the multiplexer. An image creating apparatus including a transmitting unit that transmits the superimposed signal, and the superimposed signal transmitted by the transmitting unit is received, the image signal is transmitted to the image display unit, and the diopter adjustment signal or the related signal is received. A head-mounted image display device, comprising: a receiving unit that transmits a signal to the diopter adjustment mechanism. 17. A resolution improving means for improving the resolution of the observation object in the display area of the image corresponding to the gaze position based on the signal representing the gaze position determined by the gaze position determining means. The head-mounted image display device according to claim 1 or 15. 18. The camera has two cameras for generating video signals of the first and second video images having the parallax, and the plurality of diopter adjustment signal generating means are incorporated in any one of the cameras. It is a multiple distance measuring mechanism corresponding to the gaze position,
The head-mounted type according to claim 15 or 17, wherein the diopter adjustment signal is a distance signal output according to a distance to an observation target object measured by the plurality of distance measuring mechanisms. Video display device. 19. The video signal generating means has two cameras for generating the video signals of the first and second video images having the parallax, and the plurality of diopter adjustment signal generating means includes one of the cameras. A plurality of distance measuring mechanisms incorporated in the camera corresponding to the gaze position, and the diopter adjustment signal is output according to a distance to an observation target object measured by the plurality of distance measuring mechanisms. The head-mounted image display device according to claim 16, which is a signal. 20. Two cameras for generating video signals of the first and second video images having the parallax are provided, and the plurality of diopter adjustment signal generating means are incorporated in one of the cameras. It is a multiple distance measuring mechanism corresponding to the gaze position,
The diopter adjustment signal is a distance signal output according to the distance to the observation object measured by the plurality of distance measuring mechanisms, and the resolution improving means is arranged in the two cameras. 18. The head-mounted image display device according to claim 17, which is a focusing mechanism that focuses an observation target object in a display region of the image corresponding to the gaze position. 21. The plurality of diopter adjustment signal generating means are associated with coordinates in the image area of the image, and the diopter adjustment signal generating means selecting means is determined by the gaze position determining means. The coordinates in the corresponding video area are determined based on the gaze position, and the diopter adjustment signal generating means is selected based on the coordinates.
The head-mounted image display device according to claim 1. 22. A head-mounted image display device, which has a video display unit for displaying a video image having parallax to each of the first and second eyeballs of an observer and enables stereoscopic observation, wherein the video display unit. Diopter adjusting mechanism that adjusts the diopter of the eye, and a gaze position that determines the gaze position of the observer in the observation region by detecting the line-of-sight direction of at least one of the first and second eyeballs of the observer A diopter adjustment signal that outputs a diopter adjustment signal for operating the diopter adjustment mechanism based on a determining unit and a calculation of a correlation between the gaze position determined by the gaze position determining unit and the first and second images. A head-mounted image display device comprising: a generation unit. 23. The parallax adjustment signal generating means generates a parallax distribution signal corresponding to the first and second images, and a video signal of the first image and the parallax distribution. Transmitting means for transmitting a signal, distributing means for distributing the parallax distribution signal in the transmitted signal, one of the distributed parallax distribution signals and the video signal of the first video to the video of the second video Video signal generating means for generating a signal, and a diopter adjustment signal to be transmitted to the diopter adjusting mechanism, to the other of the distributed parallax distribution signal and the gaze position determined by the gaze position determining means. 23. The head-mounted image display device according to claim 22, further comprising: a diopter adjustment signal selection unit that is determined based on the above. 24. Video signal generating means for generating a video signal of a video image having parallax for display on each of the first and second eyeballs of an observer, and relating to the parallax or vergence angle of the video signal, Diopter adjustment signal generating means for generating a plurality of diopter adjustment signals or signals related thereto, a multiplexer for superimposing the plurality of diopter adjustment signals or signals related thereto on the video signal, and the multiplexer And a transmitting unit that transmits the superimposed signal superimposed by the image forming apparatus. 25. Video signal generating means for generating a video signal of a video image having parallax for displaying on each of the first and second eyeballs of an observer, and relating to the parallax or vergence angle of the video signal, A diopter adjustment signal generating unit that generates a plurality of diopter adjustment signals or signals related thereto, and a recording device that records the video signal and the plurality of diopter adjustment signals or signals related thereto on a recording medium. An image creation device characterized by the above.