JP2021051180A - Display device, display system, method for adjusting display, and display adjustment program - Google Patents

Abstract

To provide a display device, a display system, a method for adjusting a display, and a display adjustment program that can reduce burden on a user.SOLUTION: The display device includes: a left-eye display unit and a right-eye display unit, which are arranged in a longitudinal direction, can transmit light partially, and also can display an image; a line-of-vision detection unit for detecting an object line-of-vision of eyeballs of a user when the user gazes an object in front of the user in a front-back direction beyond the left-eye display unit and the right-eye display unit and detecting an image line-of-vision of the eyeballs of the user when the user gazes a target image while the target image is being displayed in the positions in the left-eye display unit and in the right-eye display unit that correspond to the object; and an adjustment unit for adjusting the display position where the left-eye display unit and the right-eye display unit display an image according to the difference between the object line-of-vision and the image line-of-vision in a vertical direction intersecting with the front-back direction and the longitudinal direction.SELECTED DRAWING: Figure 5

Description

The present invention relates to a display device, a display system, a display adjustment method, and a display adjustment program.

A head-mounted display (HMD: Head Mounted Display) that is worn by the user on the head as a technology to realize virtual reality (VR) or augmented reality (AR). Is known (see, for example, Patent Document 1). In such a display device, for example, displays corresponding to the left eye and the right eye of the user are arranged, and the image of the display for the left eye is displayed on the left eye and the image of the display for the right eye is displayed on the right eye. It is configured to be shown to the user. In addition, the object in the real space is gazed, and the preset virtual space image is displayed on the left eye display and the right eye display by superimposing the object in the real space, respectively, and the image of the object in the real space and the image in the virtual space. It is possible to adjust so that and is properly overlapped.

Japanese Unexamined Patent Publication No. 2001-211403

In a display device as described above, the line of sight when the user gazes at an object in the real space and the line of sight when the user gazes at an image in the virtual space may deviate in the vertical direction. In this case, if you try to gaze at an object in the real space, the image in the virtual space will not be imaged. On the contrary, when trying to gaze at an image in virtual space, an object in real space does not form an image. Therefore, the eyes of the user are burdened. Further, in the above-mentioned display device, the line of sight when the left eye display is viewed with the left eye and the line of sight when the right eye display is viewed with the right eye may be displaced in the vertical direction. In this case, the image is not formed at the moment when the target image is viewed, but is formed by moving the left and right eyeballs in the vertical direction according to the command of the brain. However, in this case, the eyes of the user are burdened.

The present invention has been made in view of the above, and an object of the present invention is to provide a display device, a display system, a display adjustment method, and a display adjustment program capable of reducing the burden on the user.

The display devices according to the present invention are arranged side by side in the left-right direction, and include a left-eye display unit and a right-eye display unit capable of transmitting a part of light and displaying an image, and a user using the left eye. When the user's left and right eyeballs gaze at an object in front of the user through the display unit for the right eye and the display unit for the right eye, the display unit for the left eye and the display unit for the right eye. The line-of-sight detection unit that detects the image line-of-sight of the left and right eyeballs of the user when the user gazes at the target image while the target image is displayed at a position corresponding to the object, and the left-right direction. And an adjustment unit that adjusts the display position for displaying an image on the left eye display unit and the right eye display unit according to the difference between the object line of sight and the image line of sight in the vertical direction orthogonal to the front-back direction. And.

The display system according to the present invention is arranged side by side in the left-right direction, and has a left-eye display unit and a right-eye display unit capable of transmitting a part of light and displaying an image, and a user can use the left eye. When the user's left and right eyeballs gaze at an object in front of the user through the display unit for the right eye and the display unit for the right eye, the display unit for the left eye and the display unit for the right eye. The line-of-sight detection unit that detects the image line-of-sight of the left and right eyeballs of the user when the user gazes at the target image while the target image is displayed at a position corresponding to the object, and the left-right direction. A display device having an output unit for outputting the difference between the object line of sight and the image line of sight in the vertical direction orthogonal to the front-back direction, and the left eye display unit based on the output result of the output unit. The right eye display unit is provided with an external processing device that generates image data in which the display position for displaying the image is adjusted and inputs the image data to the display device.

The display adjustment method according to the present invention is arranged side by side in the left-right direction, and is transmitted in the front-rear direction through the left-eye display unit and the right-eye display unit capable of transmitting a part of light and displaying an image. The target image is displayed at a position corresponding to the object in the left eye display unit and the right eye display unit, respectively, in a state where the object line of sight of the left and right eyeballs of the user when gazing at the object in front is displayed. When the user gazes at the target image, the image line-of-sight of the left and right eyeballs of the user is detected, and the object line-of-sight and the image line-of-sight in the vertical direction orthogonal to the left-right direction and the front-back direction. This includes adjusting the display position for displaying an image on the left eye display unit and the right eye display unit according to the difference between the two.

The display adjustment program according to the present invention is arranged side by side in the left-right direction, and is transmitted in the front-rear direction through the left-eye display unit and the right-eye display unit capable of transmitting a part of light and displaying an image. The target image is displayed at a position corresponding to the object in the left eye display unit and the right eye display unit, respectively, in a state where the object line of sight of the left and right eyeballs of the user when gazing at the object in front is displayed. The process of detecting the image line-of-sight of the left and right eyeballs of the user when the user gazes at the target image, and the object line-of-sight and the image line-of-sight in the vertical direction orthogonal to the left-right direction and the front-back direction. The computer is made to execute a process of adjusting the display position for displaying an image on the left eye display unit and the right eye display unit according to the difference between the two.

According to the present invention, it is possible to reduce the burden on the user.

FIG. 1 is a diagram schematically showing an example of a display device according to the present embodiment. FIG. 2 is a diagram schematically showing a configuration of a display unit in a display device. FIG. 3 is a diagram schematically showing an example of an object line of sight. FIG. 4 is a diagram schematically showing an example of an image line of sight. FIG. 5 is a functional block diagram showing an example of a display device. FIG. 6 is a diagram schematically showing an example of a line memory. FIG. 7 is a diagram schematically showing an example of the detection result of the object line of sight and the image line of sight. FIG. 8 is a flowchart showing an example of the display adjustment method according to the present embodiment. FIG. 9 is a diagram schematically showing an example of the detection results of the left image line of sight and the right image line of sight. FIG. 10 is a flowchart showing another example of the display adjustment method. FIG. 11 is a functional block diagram showing another example of the display device. FIG. 12 is a diagram showing an example of the moving mechanism. FIG. 13 is a diagram showing another example of the motor mechanism. FIG. 14 is a functional block diagram showing another example of the display device. FIG. 15 is a functional block diagram showing an example of a display system including a display device.

Hereinafter, embodiments of a display device, a display system, a display adjustment method, and a display adjustment program according to the present invention will be described with reference to the drawings. The present invention is not limited to this embodiment. In addition, the components in the following embodiments include those that can be easily replaced by those skilled in the art, or those that are substantially the same.

[Display device]
FIG. 1 is a diagram schematically showing an example of a display device 100 according to the present embodiment. As shown in FIG. 1, the display device 100 is, for example, a head-mounted display that can be worn on the head by a user.

In the following description, each of the left-right, front-back, and up-down directions is the direction in which the user wears the display device 100 on the head. The left-right direction is a direction corresponding to the left and right eyeballs of the user, and the left eye side is the left side and the right eye side is the right side. In the anterior-posterior direction, the crown side of the user's head is upward, and the chin side of the user's head is downward.

As shown in FIG. 1, the display device 100 includes a main body unit 10, a display unit 20, a line-of-sight detection unit 30, and a control unit 40. The main body 10 has a housing 11, a connector 12, and a power supply 13. The housing 11 houses the optical system OS described later. The housing 11 is provided with a display unit 20, which will be described later. The power supply unit 13 supplies electric power to the main body 10 via the connector 12, transmits and receives electric signals, and the like.

The display unit 20 includes a left eye display unit 20L and a right eye display unit 20R. The left eye display unit 20L and the right eye display unit 20R are arranged side by side in the left-right direction so as to correspond to the left and right eyeballs of the user.

FIG. 2 is a diagram schematically showing the configuration of the display unit 20 in the display device 100. As shown in FIG. 2, the display unit 20 includes a display panel 21, a half mirror 22, a combiner mirror 23, and a line-of-sight detection unit 30. As the display panel 21, various display panels such as a liquid crystal panel, an organic EL panel, and a plasma panel can be applied. When the user wears the display device 100, the display unit 20 is arranged in front of the user's left and right eyeballs. The display panel 21 has a display surface 21a for displaying an image of the virtual space.

The half mirror 22 reflects, for example, a part of light and transmits a part of the light. The half mirror 22 reflects a part of the display light Lb emitted from the display panel 21 toward the combiner mirror 23. Further, the half mirror 22 transmits a part of the light reflected by the combiner mirror 23.

The combiner mirror 23 transmits the real image light La that constitutes the image of the object M existing in the actual space to the half mirror 22 side. The real image light La can reach the left and right eyeballs of the user through the combiner mirror 23 and the half mirror 22. As a result, the user can gaze at the object M through the left eye display unit 20L and the right eye display unit 20R. Further, the combiner mirror 23 reflects the display light Lb reflected by the half mirror 22 toward the half mirror 22. The half mirror 22 and the combiner mirror 23 constitute an optical system OS that guides the real image light La and the display light Lb. In the present embodiment, the optical system OS guides the real image light La and the display light Lb to the eyeballs (right eye ER and left eye EL: see FIGS. 3 and 4) of the user wearing the display device 100. ..

The line-of-sight detection unit 30 detects the line of sight of the user's left and right eyes. The line-of-sight detection unit 30 is, for example, a line-of-sight detection device capable of detecting the line of sight based on the position of the user's pupil and the position of the corneal reflex image, or the line of sight based on the position of the inner corner of the user's eye and the position of the iris. Various devices capable of detecting the user's line of sight, such as a detectable line-of-sight detection device, can be used.

The line-of-sight detection unit 30 includes an irradiation unit 31, a light receiving unit 32, and a processing unit 33 (see FIGS. 2 and 5). The irradiation unit 31 irradiates the left and right eyeballs of the user with infrared rays. The light receiving unit 32 receives infrared rays reflected by the left and right eyeballs of the user and generates images of the left and right eyeballs of the user. The processing unit 33 detects the user's line of sight as a line-of-sight vector defined by the three-dimensional global coordinate system based on the generated image.

The processing unit 33 can detect the object line of sight and the image line of sight of the left and right eyeballs of the user. The processing unit 33 transmits the detected object line of sight and image line of sight to the storage unit 45, which will be described later. FIG. 3 is a diagram schematically showing an example of an object line of sight. As shown in FIG. 3, the object line of sight E1 is the left and right eyeballs (left eye EL, left eye EL,) of the user when the user gazes at the object M through the left eye display unit 20L and the right eye display unit 20R. The line of sight of the right eye ER). When distinguishing the object line of sight E1 of the left and right eyeballs, the object line of sight E1 of the left eye EL is referred to as the left object line of sight E1L, and the object line of sight E1 of the right eye ER is referred to as the right object line of sight E1R. FIG. 4 is a diagram schematically showing an example of an image line of sight. As shown in FIG. 4, in the image line-of-sight E2, the user displays the target image I at the position PM corresponding to the object M on the left eye display unit 20L and the right eye display unit 20R, respectively. This is the line of sight of the user's left and right eyeballs (left eye EL, right eye ER) when gazing. When distinguishing the image line-of-sight E2 of the left and right eyeballs, the image line-of-sight E2 of the left eye EL is referred to as the left image line-of-sight E2L, and the image line-of-sight E2 of the right eye ER is referred to as the right image line-of-sight E2R. When the user gazes at the target image I, the left and right target images I appear to be formed as if they exist at the position Ma overlapping the object M.

FIG. 5 is a functional block diagram showing an example of the display device 100. As shown in FIG. 5, the control unit 40 includes a difference detection unit 41, an adjustment unit 42, a storage unit 45, and an image processing circuit 46. The control unit 40 is, for example, an arithmetic processing unit composed of a CPU (Central Processing Unit) or the like. The control unit 40 loads the stored program into the memory and executes the instructions included in the program. The control unit 40 includes an internal memory (not shown) and the like. In the internal memory, a program for realizing each part of the control unit 40 is stored. In this case, the control unit 40 realizes the functions of each unit by expanding and executing the program stored in the internal memory or the like. The internal memory is also used for temporary storage of data in the control unit 40.

The difference detection unit 41 obtains the difference of the detection result based on the detection result of the line-of-sight detection unit 30. The difference detection unit 41 can obtain the difference using the information stored in the storage unit 45. The storage unit 45 stores the information of the object line-of-sight E1 and the image line-of-sight E2 detected by the line-of-sight detection unit 30. The storage units 45 are arranged side by side in the left-right direction, and pass through the left-eye display unit 20L and the right-eye display unit 20R, which can transmit a part of light and display an image, in the front-rear direction. A state in which the target image I is displayed at a position corresponding to the object M in the object line-of-sight E1 of the left and right eyes of the user when gazing at the object M in front, and the left eye display unit 20L and the right eye display unit 20R, respectively. The process of detecting the image line-of-sight E2 of the user's left and right eyeballs when the user gazes at the target image I, and the object line-of-sight E1 and the image line-of-sight E2 in the vertical direction orthogonal to the left-right direction and the front-back direction. A display adjustment program for causing the computer to execute a process of adjusting the display position when displaying an image on the left eye display unit 20L and the right eye display unit 20R according to the difference is stored.

The difference detection unit 41 obtains the difference between the object line of sight E1 and the image line of sight E2 based on the object line of sight E1 and the image line of sight E2 detected by the line of sight detection unit 30. In this case, the difference detection unit 41 obtains the difference between the object line of sight E1 and the image line of sight E2 in the vertical direction orthogonal to the left-right direction and the front-back direction. This difference can be, for example, the length in the vertical direction of the vector obtained as the difference between the line-of-sight vectors. The difference detection unit 41 independently obtains the difference between the object line-of-sight E1 and the image line-of-sight E2 on the left and right sides. That is, the difference detection unit obtains the difference between the left object line of sight E1L and the left image line of sight E2L for the left eye and the difference between the right object line of sight E1R and the right image line of sight E2R for the right eye, respectively.

When the difference detection unit 41 obtains the difference between the object line-of-sight E1 and the image line-of-sight E2, the difference detection unit 41 may obtain the difference in the position of the user's gazing point. In this case, the difference detection unit 41 sets the intersection of the object line of sight E1 and the predetermined virtual plane set in the display unit 20 as the object gazing point P1 (see FIG. 7). Further, the difference detection unit 41 sets the intersection of the image line-of-sight E2 and the predetermined virtual plane set in the display unit 20 as the image gazing point P2 (see FIG. 7). Examples of the virtual plane include a plane that is perpendicular to the front-back direction and is separated from the left eye and the right eye of the subject by a predetermined distance. In this way, the object gazing point P1 corresponds to the object line of sight E1. Further, the image gazing point P2 corresponds to the image line-of-sight E2. The difference detection unit 41 calculates the difference in position between the object gazing point P1 and the image gazing point P2 in the vertical direction. This difference can be, for example, the distance between the object gazing point P1 and the image gazing point P2 in the vertical direction.

Further, when the user gazes at the target image I in a state where the target image I is displayed at a position corresponding to the object M on the left eye display unit 20L and the right eye display unit 20R, the left eyeball of the user. When the left image line-of-sight E2L and the right image line-of-sight E2R of the right eyeball are detected by the line-of-sight detection unit 30, the difference detection unit 41 obtains the difference between the left image line-of-sight E2L and the right image line-of-sight E2R in the vertical direction. This difference can be, for example, the length in the vertical direction of the vector obtained as the difference between the line-of-sight vectors.

Further, the difference detection unit 41 may obtain the difference in the position of the gazing point of the user when obtaining the difference between the left image line-of-sight E2L and the right image line-of-sight E2R. In this case, the difference detection unit 41 sets the intersection of the left image line-of-sight E2L and the display surface 21a as the left image gazing point PL (see FIG. 9). Further, the difference detection unit 41 sets the intersection of the right image line-of-sight E2R and the display surface 21a as the right image gazing point PR (see FIG. 9). In this way, the left image gazing point PL corresponds to the left image line of sight E2L. Further, the right image gazing point PR corresponds to the right image line-of-sight E2R. The difference detection unit 41 calculates the difference in position between the left image gazing point PL and the right image gazing point PR in the vertical direction. This difference can be, for example, the distance in the vertical direction between the left image gazing point PL and the right image gazing point PR.

The adjusting unit 42 adjusts the display position when displaying an image on the left eye display unit 20L and the right eye display unit 20R according to the difference detected by the difference detecting unit 41. The adjusting unit 42 can adjust the display position step by step according to the difference in the vertical direction. For example, the magnitude of the detected difference is divided stepwise, and the adjustment amount classification is set stepwise so as to correspond to the difference classification. As a result, the larger the difference, the larger the adjustment amount stepwise. The adjusting unit 42 may detect only the presence or absence of a difference, and when the difference is detected, adjust by a preset adjustment amount.

The adjusting unit 42 adjusts the display position of the image by correcting the image data input to the left eye display unit 20L and the right eye display unit 20R, for example. The adjusting unit 42 is provided for the left eye display unit 20L and the right eye display unit 20R, respectively. The adjusting unit 42 has a line memory 43 and an address control unit 44. The line memory 43 stores image data to be displayed on the left eye display unit 20L and the right eye display unit 20R for each line. The address control unit 44 controls the reference address at which the image data output from the line memory 43 starts to be read.

FIG. 6 is a diagram schematically showing an example of the line memory 43. As shown in FIG. 6, an address corresponding to each line is set in the line memory 43. For example, the address of the top line (first line) in the figure is set to 0, and 1, 2, ..., Are set in order as it reaches the lower line, and the address of the bottom line is set to Z. Will be done. The number of lines and the address of the line memory 43 are set so as to correspond to the left eye display unit 20L and the right eye display unit 20R.

A write address W and a read address R are set in the line memory 43. The write address W indicates the address of the line on which the image data input from the outside is written. The read address R indicates the address of the line on which the image data written in the line memory 43 is read. When image data is input from the outside, for example, it is sequentially written from the line at address 0 to the line at address Z, and returns to 0 after reaching the maximum value Z.

The relationship between the write address W and the read address R will be described. Assuming that the reference address a is used, the read address R is relative to the write address W.
R = W-a (However, if R <0, R = Z-a)
It can be expressed as.

By setting the read address R in this way, the read address R becomes 0 when W = a, that is, when the image data is written up to the line corresponding to the reference address a in the line memory 43. In this case, the image data written in the uppermost line (the line having the address 0) of the line memory 43 is read out. In this way, the image data of the line delayed by a line with respect to the writing of the image data is output.

On the other hand, when the value of the reference address a is reduced by one line, the timing at which the uppermost line is read is advanced by one line. For this reason, the displayed image is apparently displayed with a shift of one line upward. Further, when the value of the reference address a is increased by one line, the timing at which the uppermost line is read is delayed by one line. For this reason, the displayed image is apparently displayed with a shift of one line downward. Therefore, by adjusting the value of the reference line a by the address control unit 44, the positions of the display images displayed on the left eye display unit 20L and the right eye display unit 20R can be moved in the vertical direction.

[Display adjustment method]
Next, a display adjustment method according to the present embodiment will be described. In the display adjustment method according to the present embodiment, the display position when the user displays an image on the left eye display unit 20L and the right eye display unit 20R with the above display device 100 attached to the head is set. adjust.

When the user wears the above display device 100 on his / her head, the left eye display unit 20L is arranged in front of the user's left eye, and the right eye display unit is arranged in front of the user's right eye. 20R is arranged. In the display adjustment method according to the present embodiment, the object line-of-sight E1 when the object M in front is gazed through the display unit 20L for the left eye and the display unit 20R for the right eye, and the display unit 20L for the left eye and the right eye. To reduce the difference between the image line-of-sight E2 of the left and right eyes of the user when the user gazes at the target image I while the target image I is displayed at a position corresponding to the object M on the display unit 20R. Adjust to.

First, the line-of-sight detection unit 30 starts line-of-sight detection of the user's left eye and right eye. When the user is made to gaze at the object M in this state, it is preferable that the display unit 20 does not display an image on, for example, the left eye display unit 20L and the right eye display unit 20R. The display unit 20 may display information or the like for urging the user to gaze at the object M. The line-of-sight detection unit 30 detects the user's object line-of-sight E1 with the user gazing at the object M.

Subsequently, the user is made to gaze at the target image I. In this case, the display unit 20 displays the target image I at a position corresponding to the object M (for example, a position overlapping the object M) of the left eye display unit 20L and the right eye display unit 20R. Similar to the above, the display unit 20 may display information or the like for urging the user to pay attention to the target image I. The line-of-sight detection unit 30 detects the user's image line-of-sight E2 with the user gazing at the target image I.

FIG. 7 is a diagram schematically showing an example of the detection results of the object line of sight E1 and the image line of sight E2. In the example shown in FIG. 7, the line-of-sight detection unit 30 has a position (X1, Y1) of the user's object gazing point P1 corresponding to the object line-of-sight E1 and a position of the user's image gazing point P2 corresponding to the image line-of-sight E2. (X2, Y2) can be detected as an object line of sight E1 and an image line of sight E2.

In the present embodiment, the object gazing point P1 is an intersection of a plane perpendicular to the front-back direction and separated from the left eye and the right eye of the subject by a predetermined distance and the line-of-sight vector of the object line-of-sight E1. Further, the image gazing point P2 is an intersection of the virtual plane and the line-of-sight vector constituting the image line-of-sight E2. When obtaining such an object gazing point P1 and an image gazing point P2, the processing unit 33 first detects the object line of sight E1 and the image line of sight E2 as line-of-sight vectors based on the information obtained by the light receiving unit 32. After that, for example, the intersections of the object line of sight E1 and the image line of sight E2 and the predetermined virtual plane are set as the object gaze point P1 and the image gaze point P2. The processing unit 33 obtains the coordinates of the object gazing point P1 and the image gazing point P2 with reference to the coordinates of the reference position on the virtual plane. The virtual plane may be provided on the surface of the half mirror 22, for example, or may be provided in the space between the left and right eyeballs of the user and the half mirror 22. The processing unit 33 stores the line-of-sight vectors of the object line-of-sight E1 and the image line-of-sight E2 and the coordinates of the object gaze point P1 and the image gaze point P2 in the storage unit 45. The processing unit 33 first stores the line-of-sight vector of the object line-of-sight E1 and the coordinates of the object gazing point P1 acquired when the user gazes at the object M in the storage unit 45, and the user stores the target image I. The line-of-sight vector of the image line-of-sight E2 and the coordinates of the image gaze point P2 acquired when gazing may be directly output to the difference detection unit 41.

For example, when the left-eye display unit 20L and the right-eye display unit 20R are attached in a vertically displaced state, the line of sight when the user gazes at the object M and the target image I when the user gazes at the object M. The line of sight may shift in the vertical direction. In this case, when the object M is gazed at, the target image I is not formed. On the contrary, when the target image I is gazed at, the object M is not imaged. Therefore, the eyes of the user are burdened. Therefore, in the present embodiment, when there is a difference in the vertical direction between the user's object line of sight E1 and the image line of sight E2, the left eye display unit 20L and the right eye display unit 20L and the right eye display unit are designed to reduce the difference. By adjusting the position of the image displayed on the 20R, the burden on the user is reduced.

The difference detection unit 41 detects the difference between the object line of sight E1 and the image line of sight E2 in the vertical direction based on the information stored in the storage unit 45 or the information output from the processing unit 33. As shown in FIG. 7, the difference detection unit 41 can detect, for example, the distance between the object gazing point P1 and the image gazing point P2 in the vertical direction as the difference S1. When detecting the difference between the line-of-sight vector of the object line-of-sight E1 and the line-of-sight vector of the image line-of-sight E2, the difference detection unit 41 detects, for example, the vector amount in the vertical direction obtained as the difference between the line-of-sight vectors as the difference. be able to. The difference detection unit 41 outputs the detected difference S1.

The adjusting unit 42 adjusts the display position when displaying an image on the left eye display unit 20L and the right eye display unit 20R according to the difference S1 output from the difference detecting unit 41. For example, the adjusting unit 42 may adjust the display position when the difference S1 is equal to or greater than a preset threshold value. The adjustment unit 42 can adjust the display position by, for example, the address control unit 44 selecting the line for starting reading the image data in the line memory 43.

FIG. 8 is a flowchart showing an example of the display adjustment method according to the present embodiment. After the display device 100 is attached to the user's head, as shown in FIG. 8, the line-of-sight detection unit 30 starts detecting the user's left and right line-of-sight (step S101), and in this state, the user receives an object. Gaze at M (step S102). In step S102, the line-of-sight detection unit 30 detects the user's object line-of-sight E1 with the user gazing at the object M.

Next, the target image I is displayed at a position corresponding to the object M on the left eye display unit 20L and the right eye display unit 20R, respectively, and the user is made to gaze at the target image I (step S103). In step S103, the line-of-sight detection unit 30 detects the user's image line-of-sight E2 with the user gazing at the target image I.

Next, the difference detection unit 41 detects the difference between the object line of sight E1 and the image line of sight E2 in the vertical direction (step S104). When the difference is detected by the difference detection unit 41 (Yes in step S104), the adjustment unit 42 adjusts the display position when displaying an image on the left eye display unit 20L and the right eye display unit 20R (Yes). Step S105), the process is terminated. If the difference detection unit 41 does not detect the difference (No in step S104), the process ends without adjusting the display position.

As described above, the display devices 100 according to the present embodiment are arranged side by side in the left-right direction, and the left eye display unit 20L and the right eye display unit 20L capable of transmitting a part of light and displaying an image can be displayed. 20R, the object line of sight E1 of the left and right eyes of the user when the user gazes at the object M in front of the front and rear through the display unit 20L for the left eye and the display unit 20R for the right eye, and for the left eye. When the user gazes at the target image I with the target image I displayed at a position corresponding to the object M on the display unit 20L and the display unit 20R for the right eye, the image lines of sight E2 of the left and right eyes of the user are displayed. An image is displayed on the left eye display unit 20L and the right eye display unit 20R according to the difference between the detectable line-of-sight detection unit 30 and the object line-of-sight E1 and the image line-of-sight E2 in the vertical direction orthogonal to the left-right direction and the front-back direction. It is provided with an adjusting unit 42 for adjusting a display position when displaying.

The display adjustment method according to the present embodiment is arranged side by side in the left-right direction, and transmits a part of the light to the left eye display unit 20L and the right eye display unit 20R capable of displaying an image. The target image I is set at the position corresponding to the object M in the object line-of-sight E1 of the left and right eyes of the user when gazing at the front object M in the front-rear direction, and in the left eye display unit 20L and the right eye display unit 20R, respectively. Detecting the image line-of-sight E2 of the user's left and right eyeballs when the user gazes at the target image I in the displayed state, and the object line-of-sight E1 and the image line-of-sight in the vertical direction orthogonal to the left-right direction and the front-back direction. This includes adjusting the display position when displaying an image on the left eye display unit 20L and the right eye display unit 20R according to the difference from E2.

The display adjustment program according to the present embodiment is arranged side by side in the left-right direction, and transmits a part of the light to the left eye display unit 20L and the right eye display unit 20R capable of displaying an image. The target image I is set at the position corresponding to the object M in the object line-of-sight E1 of the left and right eyes of the user when gazing at the object M in front of the front-rear direction, and in the left-eye display unit 20L and the right-eye display unit 20R, respectively. The process of detecting the image line-of-sight E2 of the user's left and right eyeballs when the user gazes at the target image I in the displayed state, and the object line-of-sight E1 and the image line-of-sight in the vertical direction orthogonal to the left-right direction and the front-back direction. The computer is made to execute a process of adjusting the display position when displaying an image on the left eye display unit 20L and the right eye display unit 20R according to the difference from E2.

According to the present embodiment, when there is a difference in the vertical direction between the user's object line of sight E1 and the image line of sight E2, the left eye display unit 20L and the right eye display unit 20L and the right eye display unit are used to reduce the difference. The position of the image displayed on 20R is adjusted. Therefore, when displaying the image corresponding to the object M, the user can gaze at the image with the same line of sight as when the object M is gazed. As a result, the burden on the user can be reduced.

In the display device 100 according to the present embodiment, the adjustment unit 42 adjusts the display position stepwise according to the difference in the vertical direction. According to this configuration, the display position can be adjusted stepwise according to the difference, so that efficient adjustment is possible.

In the display device 100 according to the present embodiment, the adjusting unit 42 determines the difference in the vertical direction between the position of the object gazing point P1 corresponding to the object line of sight E1 and the position of the image gazing point P2 corresponding to the image line of sight E2. Adjust the display position according to. According to this configuration, the display position can be adjusted more accurately by calculating the difference based on the object gazing point P1 and the image gazing point P2.

In the display device 100 according to the present embodiment, the adjusting unit 42 has a line memory 43 in which the image data of the image is written, and selects a line for starting reading the image data in the line memory 43 according to the difference. Adjust the display position. According to this configuration, by selecting the line for starting reading the image data in the line memory 43, it is possible to easily adjust the display position without changing the positional relationship of the constituent members constituting the display unit 20. It becomes.

[Other display adjustment methods]
Next, another example of the display adjustment method will be described. When the user wears the above display device 100 on his / her head, the left eye display unit 20L is arranged in front of the user's left eye, and the right eye display unit is arranged in front of the user's right eye. 20R is arranged. In the display adjustment method according to another example, the target image I is displayed in front of the user on the left eye display unit 20L and the right eye display unit 20R, respectively, and the user gazes at the target image I. The difference between the left image line-of-sight E2L of the left eyeball and the line-of-sight detection unit capable of detecting the right image line-of-sight E2R of the right eyeball is adjusted to be reduced.

First, the line-of-sight detection unit 30 starts line-of-sight detection of the user's left eye and right eye. In this state, the user is made to gaze at the target image I. In this case, the display unit 20 displays the target image I at positions corresponding to each other on the left eye display unit 20L and the right eye display unit 20R. Examples of such a position include a position in which the left eye display unit 20L and the right eye display unit 20R are symmetrical. The display unit 20 may display information or the like for urging the user to pay attention to the target image I. The line-of-sight detection unit 30 detects the left image line-of-sight E2L of the user's left eyeball and the right image line-of-sight E2R of the right eyeball while the user is gazing at the target image I.

FIG. 9 is a diagram schematically showing an example of the detection results of the left image line-of-sight E2L and the right image line-of-sight E2R. In the example shown in FIG. 9, the line-of-sight detection unit 30 includes the position (XL, YL) of the user's left image gaze point PL corresponding to the left image line-of-sight E2L and the user's right image note corresponding to the right image line-of-sight E2R. The position of the viewpoint PR (XR, YR) can be detected as the left image line of sight E2L and the right image line of sight E2R.

In the present embodiment, the left image gazing point PL is an intersection of a plane perpendicular to the front-back direction and separated from the left and right eyeballs of the subject by a predetermined distance and the line-of-sight vector of the left image line-of-sight E2L. The right image gazing point PR is an intersection of the virtual plane and the line-of-sight vector constituting the right image line-of-sight E2R. When obtaining such a left image gaze point PL and a right image gaze point PR, the processing unit 33 first uses the left image gaze E2L and the right image gaze E2R as gaze vectors based on the information obtained by the light receiving unit 32. To detect. After that, for example, the intersections of the left image line-of-sight E2L and the right image line-of-sight E2R and the predetermined virtual plane are designated as the left image gaze point PL and the right image gaze point PR. The processing unit 33 obtains the coordinates of the left image gazing point PL and the right image gazing point PR with reference to the coordinates of the reference position on the virtual plane. The processing unit 33 stores the line-of-sight vectors of the left image line-of-sight E2L and the right image line-of-sight E2R and the coordinates of the left image gaze point PL and the right image gaze point PR in the storage unit 45. The processing unit 33 directly obtains the coordinates of the left image gaze E2L and the right image gaze E2R gaze vector and the left image gaze point PL and the right image gaze point PR acquired when the user gazes at the target image I. It may be output to the difference detection unit 41. Further, the storage units 45 are arranged side by side in the left-right direction, and the left eye display unit 20L and the right eye display unit 20R capable of displaying images display the target image I in front of the user, respectively, and use the storage unit 45. The process of detecting the left image line of sight E2L of the user's left eyeball and the right image line of sight E2R of the right eyeball when the person gazes at the target image I, and the left image of the vertical direction orthogonal to the left-right direction and the front-back direction. A display adjustment program that causes a computer to perform a process of adjusting the display position when displaying an image on the left eye display unit 20L and the right eye display unit 20R according to the difference between the line of sight E2L and the right image line of sight E2R. Remember.

For example, as in the above embodiment, when the left eye display unit 20L and the right eye display unit 20R are attached in a vertically displaced state, the line of sight when the left eye display unit 20L is viewed with the left eye. In addition, the line of sight when the right eye display unit 20R is viewed with the right eye may be displaced in the vertical direction. In this case, the image is not formed at the moment when the target image is viewed, but is formed by moving the left and right eyeballs in the vertical direction according to the command of the brain. However, in this case, the eyes of the user are burdened. Therefore, in the present embodiment, when there is a difference in the vertical direction between the user's left image line of sight E2L and the right image line of sight E2R, the left eye display unit 20L and the right eye display unit 20L and the right eye are used so as to reduce the difference. By adjusting the position of the image displayed on the display unit 20R, the burden on the user is reduced.

The difference detection unit 41 detects the difference between the left image line-of-sight E2L and the right image line-of-sight E2R in the vertical direction based on the information stored in the storage unit 45 or the information output from the processing unit 33. As shown in FIG. 9, the difference detection unit 41 can detect, for example, the distance between the left image gazing point PL and the right image gazing point PR in the vertical direction as the difference S2. When the difference detection unit 41 detects the difference between the line-of-sight vector of the left image line-of-sight E2L and the line-of-sight vector of the right image line-of-sight E2R, for example, the length of the vector obtained as the difference of the line-of-sight vectors in the vertical direction is used as the difference. Can be detected. The difference detection unit 41 outputs the detected difference S2.

The adjusting unit 42 adjusts the display position when displaying an image on the left eye display unit 20L and the right eye display unit 20R according to the difference S2 output from the difference detecting unit 41. For example, the adjusting unit 42 may adjust the display position when the difference S2 is equal to or greater than a preset threshold value. In this case, the adjusting unit 42 can adjust the display position in the vertical direction to a position intermediate between the left image gazing point PL and the right image gazing point PR. As a result, the adjustment amount of the display position can be distributed to both the left eye display unit 20L and the right eye display unit 20R. The adjustment unit 42 can adjust the display position by, for example, the address control unit 44 selecting the line for starting reading the image data in the line memory 43. The adjusting unit 42 may adjust the display position so that either the left eye display unit 20L or the right eye display unit 20R is aligned with the other.

FIG. 10 is a flowchart showing another example of the display adjustment method. After the display device 100 is attached to the user's head, as shown in FIG. 10, the line-of-sight detection unit 30 starts detecting the user's left and right line-of-sight (step S201), and in this state, the display for the left eye. The target image I is displayed on the unit 20L and the display unit 20R for the right eye, and the user is made to gaze at the target image I (step S202). In step S202, the line-of-sight detection unit 30 detects the left image line-of-sight E2L and the right image line-of-sight E2R of the user with the user gazing at the target image I.

Next, the difference detection unit 41 detects the difference between the left image line-of-sight E2L and the right image line-of-sight E2R in the vertical direction (step S203). When the difference is detected by the difference detection unit 41 (Yes in step S203), the adjustment unit 42 adjusts the display position when displaying an image on the left eye display unit 20L and the right eye display unit 20R (Yes). Step S204), the process is terminated. If the difference detection unit 41 does not detect the difference (No in step S203), the process ends without adjusting the display position.

The display devices 100 according to the present embodiment are arranged side by side in the left-right direction, and are capable of displaying images, a left-eye display unit 20L and a right-eye display unit 20R, and a left-eye display unit 20L and a right-eye display unit. When the user gazes at the target image I with the target image I displayed in front of the user in the front-rear direction in 20R, the left image line of sight E2L of the left eyeball of the user and the right image line of sight E2R of the right eyeball. The left eye display unit 20L and the right eye display unit 20R according to the difference between the line-of-sight detection unit 30 for detecting the above and the left image line-of-sight E2L and the right image line-of-sight E2R in the vertical direction orthogonal to the left-right direction and the front-back direction. It is provided with an adjusting unit 42 for adjusting a display position for displaying an image.

In the display adjustment method according to the present embodiment, the target image I is set in front of the user in the front-rear direction in the left-eye display unit 20L and the right-eye display unit 20R, which are arranged side by side in the left-right direction and can display images. Displaying, detecting the left image line of sight E2L of the user's left eyeball and the right image line of sight E2R of the right eyeball when the user gazes at the target image I, and orthogonal to the left-right direction and the front-back direction. This includes adjusting the display position for displaying an image on the left eye display unit 20L and the right eye display unit 20R according to the difference between the left image line of sight E2L and the right image line of sight E2R in the vertical direction.

The display adjustment program according to the present embodiment is arranged side by side in the left-right direction, and the target image I is set in front of the user in the front-rear direction in the left-eye display unit 20L and the right-eye display unit 20R capable of displaying images, respectively. The process of displaying and the process of detecting the left image line of sight E2L of the user's left eyeball and the right image line of sight E2R of the right eyeball when the user gazes at the target image I are orthogonal to the left-right direction and the front-back direction. Causes the computer to perform a process of adjusting the display position for displaying an image on the left eye display unit 20L and the right eye display unit 20R according to the difference between the left image line of sight E2L and the right image line of sight E2R in the vertical direction. ..

According to the present embodiment, when there is a difference in the vertical direction between the user's left image line of sight E2L and the right image line of sight E2R, the left eye display unit 20L and the right eye are used so as to reduce the difference. The position of the image to be displayed on the display unit 20R is adjusted. Therefore, when displaying an image on the left eye display unit 20L and the right eye display unit 20R, the image can be gazed so that the left and right eyes have the same line of sight. As a result, the burden on the user can be reduced.

In the display device 100 according to the present embodiment, the adjustment unit 42 moves up and down between the position of the left image gaze point PL corresponding to the left image gaze E2L and the position of the right image gaze point PR corresponding to the right image gaze E2R. The display position is adjusted according to the difference in direction. According to this configuration, the display position can be adjusted more accurately by calculating the difference based on the left image gazing point PL and the right image gazing point PR.

In the display device 100 according to the present embodiment, the adjusting unit 42 adjusts the display position in the vertical direction at a position intermediate between the left image gazing point PL and the right image gazing point PR. According to this configuration, the adjustment amount of the display position can be distributed to each of the left eye display unit 20L and the right eye display unit 20R. As a result, it is possible to prevent a part of the display image from being hidden from the display area of the left eye display unit 20L and the right eye display unit 20R.

The technical scope of the present invention is not limited to the above-described embodiment, and modifications can be made as appropriate without departing from the spirit of the present invention. For example, in the display device 100 of the above embodiment, the configuration in which the adjustment unit 42 adjusts the display position by selecting the line for starting reading the image data in the line memory 43 has been described as an example, but the present invention is limited to this. Not done.

FIG. 11 is a functional block diagram showing another example of the display device. As shown in FIG. 11, the display device 100A includes a line-of-sight detection unit 30 and a control unit 140. The display device 100 shown in FIG. 11 moves the position of the display image in the vertical direction by moving the display panel 21 of the display unit 20. The configuration of the line-of-sight detection unit 30 is the same as described above.

The control unit 140 includes a difference detection unit 41, a motor control unit 142, and a storage unit 45. The configurations of the difference detection unit 41 and the storage unit 45 are the same as described above. The motor control unit 142 controls the motor 143M. The motor control unit 142 and the movement mechanism 143 constitute an adjustment unit 141 for moving the display panel 21.

FIG. 12 is a diagram showing an example of the moving mechanism 143. The moving mechanism 143 includes a motor 143M, an output shaft 144, a first gear 145, a second gear 146, and a moving member 147. The motor 143M applies a rotational driving force to the output shaft 144 under the control of the motor control unit 142. The output shaft 144 transmits the rotational driving force from the motor 143M to the first gear 145. The first gear 145 rotates integrally with the output shaft 144. The first gear 145 meshes with the second gear 146. The second gear 146 has teeth on the outer circumference and the inner circumference. The outer teeth are in mesh with the first gear 145. The inner peripheral teeth mesh with the moving member 147. The moving member 147 has a columnar shape, and teeth are formed on the outer periphery thereof. The outer teeth of the moving member 147 mesh with the second gear 146. The moving member 147 can move in the front-rear direction by rotating the second gear 146. The moving member 147 is connected to the display panel 21. When the moving member 147 moves in the front-rear direction, the display panel 21 moves in the front-rear direction integrally with the moving member 147, so that the display position of the image displayed on the display panel 21 moves in the front-rear direction. The image displayed on the display panel 21 is reflected by the half mirror 22 and the combiner mirror 23 and reaches the user. In this case, when the user wears the display device 100, the display panel 21 moves in the front-rear direction, so that the display position of the displayed image moves in the up-down direction. The motor control unit 142 can adjust the movement amount of the display panel 21 stepwise by adjusting the rotation amount of the motor 143M stepwise according to the difference in the vertical direction. As a result, the display position can be adjusted stepwise according to the difference in the vertical direction.

FIG. 13 is a diagram showing another example of the motor mechanism. As shown in FIG. 13, the moving mechanism 143A includes a motor 143M, an output shaft 144, a first gear 145, a second gear 148, and a rotating shaft 149. The configuration of the motor 143M, the output shaft 144, and the first gear 145 can be the same as the example shown in FIG. The second gear 148 has teeth on the outer circumference and meshes with the first gear 145. The rotation shaft 149 rotates integrally with the second gear 148. The rotating shaft 149 is connected to the half mirror 22. Note that FIG. 13 partially shows a state in which the half mirror 22 is viewed from the direction of the white arrow. As the rotating shaft 149 rotates, the half mirror 22 rotates integrally with the rotating shaft 149. As the half mirror 22 rotates, the direction of the light directed to the user's eyeball changes in the vertical direction. Therefore, the positions of the display images displayed on the left eye display unit 20L and the right eye display unit 20R can be moved in the vertical direction. Even in this case, the motor control unit 142 can adjust the rotation angle of the half mirror 22 stepwise by adjusting the rotation amount of the motor 143M stepwise according to the difference in the vertical direction. As a result, the display position can be adjusted stepwise according to the difference in the vertical direction.

As described above, in the display device 100A, the adjustment unit 141 adjusts the display position by adjusting the relative positional relationship between the left eye display unit 20L and the right eye display unit 20R in the vertical direction. As a result, the area that can be used for display is not limited by directly adjusting the relative positional relationship between the left eye display unit 20L and the right eye display unit 20R in the vertical direction.

Further, in the configuration in which the adjusting unit 141 adjusts the display position by adjusting the relative positional relationship in the vertical direction with respect to the left eye display unit 20L and the right eye display unit 20R, the difference in the vertical direction is directly obtained. Can be adjusted to. Further, in the configuration in which the adjustment unit 141 adjusts the display position by adjusting the half mirror 22, the display position is adjusted without changing the positions of the left eye display unit 20L and the right eye display unit 20R. Can be done.

The moving mechanism 143 shown in FIGS. 12 and 13 may not be provided with the motor 143M and may have a configuration in which the output shaft 144 is manually rotated. In this case, for example, the difference between the object line of sight E1 and the image line of sight E2, or the difference between the left image line of sight E2L and the right image line of sight E2R may be displayed on the display unit 20. This makes it possible for the user to easily grasp the adjustment amount when manually adjusting the position of the display image in the vertical direction. Hereinafter, a specific description will be given.

FIG. 14 is a functional block diagram showing another example of the display device, showing a configuration in which the output shaft 144 is manually rotated. As shown in FIG. 14, the display device 100B has a line-of-sight detection unit 30 and a control unit 240. The configuration of the line-of-sight detection unit 30 is the same as described above. The control unit 240 includes a difference detection unit 41, a deviation amount display image generation unit 241, an image superimposition unit 242, a storage unit 45, and an image processing circuit 46. The difference detection unit 41, the storage unit 45, and the image processing circuit 46 are the same as described above. The deviation amount display image generation unit 241 displays a deviation amount display image for displaying the difference between the object line-of-sight E1 and the image line-of-sight E2 or the difference between the left image line-of-sight E2L and the right image line-of-sight E2R as a shift amount on the display unit 20. Generate. Any image can be adopted as the deviation amount display image. The deviation amount display image generation unit 241 can change the deviation amount display image according to the detection result of the difference detection unit 41. For example, when the image line-of-sight E2 is shifted downward with respect to the object line-of-sight E1, the shift amount display image is displayed in blue, and when the image line-of-sight E2 is shifted upward with respect to the object line-of-sight E1, the shift amount is displayed. The displayed image can be displayed in red, and if there is no deviation, it can be displayed in colorless. Further, the deviation amount display image generation unit 241 can display the deviation amount display image darker as the deviation amount is larger. The image superimposition unit 242 displays the target image I so as to superimpose the deviation amount display image. In this configuration, the difference between the object line-of-sight E1 and the image line-of-sight E2 can be easily adjusted by having the user adjust the color of the shift amount display image so that the color is light and colorless.

[Display system]
FIG. 15 is a functional block diagram showing an example of a display system including a display device. As shown in FIG. 15, the display system SYS includes a display device 100C and an external processing device 350. The display device 100C includes a display unit 20, a line-of-sight detection unit 30, and a control unit 340. The configuration of the display unit 20 and the line-of-sight detection unit 30 is the same as described above.

The control unit 340 includes a difference detection unit 41, a storage unit 45, and an image processing circuit 46. The configurations of the difference detection unit 41, the storage unit 45, and the image processing circuit 46 are the same as described above. In the configuration shown in FIG. 15, the difference detection unit 41 has a function as an output unit that outputs the result of detecting the difference to the external processing device 350.

The external processing device 350 generates image data in which the display position when displaying an image on the left eye display unit 20L and the right eye display unit 20R is adjusted based on the output result of the difference detection unit 41. The external processing device 350 inputs the generated image data to the display device 100C. This image data is input to, for example, the image processing circuit 46. The image processing circuit 46 outputs the input image data to the display unit 20 (20L, 20R).

As described above, the display system SYS according to the present embodiment outputs the difference between the object line-of-sight E1 and the image line-of-sight E2 in the vertical direction from the display device 100, and based on the output result, the external processing device 350 causes the left eye. Since image data whose display position is adjusted when displaying an image on the display unit 20L and the display unit 20R for the right eye is generated and input to the display device 100, the display position of the image can be adjusted without causing image chipping. it can.

Further, the display system SYS outputs the difference between the left image line-of-sight E2L and the right image line-of-sight E2R in the vertical direction from the display device 100, and based on the output result, the external processing device 350 causes the left-eye display unit 20L. Since the image data whose display position is adjusted when the image is displayed on the right eye display unit 20R is generated and input to the display device 100, the display position of the image can be adjusted without causing image chipping.

In the above description, the display position when displaying an image on the left eye display unit 20L and the right eye display unit 20R is adjusted according to the difference between the left image line-of-sight E2L and the right image line-of-sight E2R in the vertical direction. This aspect is not limited to a display device (so-called augmented reality (AR) type) in which the real image light La of the real object M can pass through the display unit 20. For example, it may be a display device (so-called virtual reality (VR) type) that does not transmit the real image light La and shows the image to be displayed on the display unit 20 to the user.

E ... Eyeball, E1 ... Object line of sight, E2 ... Image line of sight, EL ... Left image line of sight, I ... Target image, ER ... Right image line of sight, M ... Object, P1 ... Object gaze point, P2 ... Image gaze point, PL ... Left Image gaze point, PR ... Right image gaze point, S1, S2 ... Difference, OE ... Optical element, PM, Ma ... Position, OS ... Optical system, La ... Real image light, Lb ... Display light, SYS ... Display system, P185273JP01 ... Your company's prior application, 10 ... main body, 11 ... housing, 12 ... connector, 13 ... power supply, 20 ... display, 20L ... left eye display, 20R ... right eye display, 21a ... display surface, 21 ... Display panel, 22 ... Half mirror, 23 ... Combiner mirror, 30 ... Line-of-sight detection unit, 31 ... Irradiation unit, 32 ... Light receiving unit, 33 ... Processing unit, 40, 140, 240, 340 ... Control unit, 41 ... Difference Detection unit, 42, 141 ... Adjustment unit, 43 ... Line memory, 44 ... Address control unit, 45 ... Storage unit, 46 ... Image processing circuit, 100, 100A, 100B, 100C ... Display device, 142 ... Motor control unit, 143 , 143A ... moving mechanism, 143M ... motor, 144 ... output shaft, 145 ... first gear, 146, 148 ... second gear, 147 ... moving member, 149 ... rotating shaft, 241 ... deviation amount display image generator, 242 ... Image superimposition unit, 350 ... External processing device

Claims (9)

A left-eye display unit and a right-eye display unit that are arranged side by side in the left-right direction and can transmit a part of light and display an image.
When the user gazes at an object in front of the left eye through the left eye display unit and the right eye display unit, the object line of sight of the left and right eyeballs of the user, the left eye display unit, and the left eye display unit. Line-of-sight detection that detects the image line-of-sight of the left and right eyes of the user when the user gazes at the target image while the target image is displayed at a position corresponding to the object on the right-eye display unit. Department and
The display position for displaying an image on the left eye display unit and the right eye display unit is adjusted according to the difference between the object line of sight and the image line of sight in the vertical direction orthogonal to the left-right direction and the front-back direction. A display device that includes an adjustment unit. The display device according to claim 1, wherein the adjusting unit adjusts the display position stepwise according to the difference in the vertical direction. The adjusting unit responds to the difference in the vertical direction between the position of the user's gaze point corresponding to the object line of sight and the position of the user's gaze point corresponding to the image line of sight. The display device according to claim 1 or 2, wherein the display position is adjusted. The adjusting unit has a line memory in which the image data of the image is written, and adjusts the display position by selecting a line for starting reading the image data in the line memory according to the difference. The display device according to any one of claims 1 to 3. Any one of claims 1 to 3, wherein the adjusting unit adjusts the display position by adjusting the relative positional relationship between the left eye display unit and the right eye display unit in the vertical direction. The display device according to paragraph 1. The left-eye display unit and the right-eye display unit have an optical system that guides light including the image.
The display device according to any one of claims 1 to 3, wherein the adjusting unit adjusts the display position by adjusting the optical system. A left-eye display unit and a right-eye display unit that are arranged side by side in the left-right direction and can transmit a part of light and display an image.
When the user gazes at an object in front of the left eye through the left eye display unit and the right eye display unit, the object line of sight of the left and right eyeballs of the user, the left eye display unit, and the left eye display unit. Line-of-sight detection that detects the image line-of-sight of the left and right eyes of the user when the user gazes at the target image while the target image is displayed at a position corresponding to the object on the right-eye display unit. Department and
A display device having an output unit that outputs a difference between the object line of sight and the image line of sight in the up-down direction orthogonal to the left-right direction and the front-back direction.
Based on the output result of the output unit, an external processing device that generates image data whose display position for displaying an image on the left eye display unit and the right eye display unit is adjusted and inputs the image data to the display unit. Display system with. The above-mentioned case where the objects arranged side by side in the left-right direction are arranged side by side, and a part of the light can be transmitted and the image can be displayed through the left-eye display unit and the right-eye display unit to gaze at the front object in the front-rear direction. The user gazes at the target image in a state where the object line of sight of the left and right eyeballs of the user and the target image are displayed at positions corresponding to the object on the left eye display unit and the right eye display unit, respectively. In the case of detecting the image line of sight of the left and right eyeballs of the user,
The display position for displaying an image on the left eye display unit and the right eye display unit is adjusted according to the difference between the object line of sight and the image line of sight in the vertical direction orthogonal to the left-right direction and the front-back direction. How to adjust the display, including what to do. The above-mentioned case where the objects arranged side by side in the left-right direction are arranged side by side, and a part of the light can be transmitted and the image can be displayed through the left-eye display unit and the right-eye display unit to gaze at the front object in the front-rear direction. The user gazes at the target image in a state where the object line of sight of the left and right eyeballs of the user and the target image are displayed at positions corresponding to the object on the left eye display unit and the right eye display unit, respectively. In the case, the process of detecting the image line of sight of the left and right eyeballs of the user, and
The display position for displaying an image on the left eye display unit and the right eye display unit is adjusted according to the difference between the object line of sight and the image line of sight in the vertical direction orthogonal to the left-right direction and the front-back direction. A display adjustment program that causes the computer to perform the processing to be performed.

Images