JP2019083385A - Head-up display unit - Google Patents

Abstract

To provide a HUD device capable of facilitating distance perception of a virtual image by a driver by effectively generating a motion parallax in an eye box.SOLUTION: The HUD device, capable of changing a virtual display distance, includes: a viewpoint position detection section 320 for detecting a viewpoint position of a driver; an image generating section 33; and a virtual image display control section 306 which changes a position of a virtual image to emphasize a change in an appearance of a virtual image by a motion parallax by controlling the image generating section 33 when a viewpoint position of a driver moves, or changes a position of a virtual image to emphasize a change in an appearance of a virtual image by a motion parallax and changes a three-dimensional shape of an object displayed as a virtual image to meet the change in the virtual image.SELECTED DRAWING: Figure 4

Description

  The present invention relates to, for example, a head-up display (HUD) device mounted on a vehicle such as a car.

  In the optical design of the HUD device, the virtual image can be viewed (in other words, the virtual image can be viewed) based on the position of the eyes (specifically, for example, the pupil) of the driver (the user of the HUD device) It is normal that the eyebox which is the range is set.

  Therefore, for example, from the HUD device stored in the dashboard of the vehicle, the display light (light ray) of the image is projected onto the projection target member, for example, with a predetermined solid angle. A portion of the display light is reflected by the projected member toward the driver and collected in the eyebox. Therefore, within the range of the eye box, it is possible to visually recognize the virtual image even if the position of the eye (pupil) of the driver moves up and down and to the left and right.

  As “the range where the virtual image can be visually recognized”, distortion of the virtual image is increased in a range in the sense that a part of the virtual image is not visible when the virtual image is out of that range, and proper visual recognition can not be performed. There is a range in the meaning of, but in the present specification, any may be used, but if the eye box is to be interpreted in a broad sense, it is considered that it is general to mean the former. The setting of the eye box in the HUD device is described, for example, in Patent Document 1.

  Further, for example, in Patent Document 2, in a HUD device that enables display of an image (virtual image) with a sense of depth using virtual image display surfaces of two surfaces having different virtual image display distances (virtual image forming distances), It describes about the relationship between the "eye box visible area" corresponded to the image of the range corresponding to the display light which reaches | attains an eye box among the images projected on glass, and the magnitude | size of a display image.

JP, 2015-87698, A JP, 2017-116724, A

  The inventor of the present invention can further enhance the stereoscopic effect of display and display in a HUD device that displays an image (virtual image) with a sense of depth using virtual image display surfaces with different virtual image display distances (virtual image forming distances). As a result of various examinations from the viewpoint of making it easier to distinguish, we recognized the importance of "motion parallax".

  Here, “motion parallax” generally refers to parallax caused by movement of a viewpoint of an observer (specifically, a driver who is a user of the HUD device). In other words, when the viewpoint position of the driver changes, the position of the object in the field of view relatively changes, and the appearance thereof changes. Here, even when the viewpoint position is changed by the same amount, the change of the position in the field of view becomes larger as the object is closer, while the change of the position becomes smaller as the object is farther. The driver can estimate the distance to the object based on the amount of change in position.

  Specifically, the driver perceives the distance in the depth direction also from the positional change in the field of view of the object when moving the viewpoint such as up, down, left, or right, and by using this perception in combination, the driver That is, it is possible to sense the sense of distance of the object more dynamically, which increases the recognition of the object.

  For example, in a 3D (three-dimensional) HUD device or the like, virtual images can be displayed in the space in front of the driver with different distances in the depth direction. Here, not only the difference in the simple display distance, but also the motion parallax helps the driver to perceive the display distance of the virtual image, but in the HUD device, as described above, it corresponds to the driver's viewpoint. The range in which the virtual image of the eye box can be viewed is set, and this eye box is quite small.

  Therefore, there is a limit to viewpoint movement which is a factor that generates motion parallax. In other words, in the conventional HUD device, there is a problem that the benefit of motion parallax that helps distance perception is not sufficiently obtained.

  Increasing the area of the eyebox (in other words, enlarging the eyebox) is also conceivable, however, when trying to enlarge the eyebox, for example, it is necessary to enlarge the aperture for projecting the display light (light ray) of the HUD device. In this case, the problem of expanding more natural light (sunlight) into the HUD device arises, so the expansion of the eyebox can not be easily achieved.

  As described above, when the driver's viewpoint moves, for example, a plurality of virtual images displayed at different positions in the depth direction naturally change relative positions due to motion parallax, and are displayed as a three-dimensional object A virtual image changes its viewing angle naturally due to motion parallax (for example, when only the front is seen, the side also becomes visible), however, the amount by which the viewpoint can be moved is limited because the eyebox is small. The present inventors recognized the problem that the display change due to motion parallax (the display change that can enhance the stereoscopic effect) can not be sufficiently displayed.

  The above-mentioned Patent Documents 1 and 2 do not consider the relationship between the eyebox and the motion parallax at all, and neither disclose nor suggest the above problem.

  One object of the present invention is to provide a HUD device capable of effectively generating motion parallax in an eye box to facilitate distance perception of a virtual image by a driver.

  Other objects of the present invention will become apparent to those skilled in the art by referring to the following exemplified aspects and best embodiments, as well as the attached drawings.

  In the following, in order to facilitate an understanding of the summary of the invention, an embodiment according to the invention is illustrated.

In a first aspect, a head-up display (HUD) device comprises
It is mounted on a vehicle and projects an image onto a projection target member provided on the vehicle to make the driver visually recognize a virtual image of the image and to the virtual image starting from a predetermined position of the driver or the vehicle A head-up display device capable of changing a virtual image display distance, which is a distance between the two, and a viewpoint position detection unit detecting a viewpoint position of the driver;
An image generation unit,
When the viewpoint position of the driver moves, the amount of change of the viewpoint position and the direction of the change of the viewpoint position are detected based on the information of the viewpoint position detected by the viewpoint position detection unit, and the detected amount of change And controlling the image generation unit based on the virtual image display distance and the direction of change to change the position of the virtual image so as to emphasize the change in appearance of the virtual image due to motion parallax, or A virtual image that changes the position of the virtual image so as to emphasize the change in appearance of the virtual image due to parallax, and changes the three-dimensional shape of the object displayed as the virtual image so as to correspond to the change in the position of the virtual image A display control unit,
Have
Or
When the viewpoint position of the driver moves, the direction of the change of the viewpoint position is detected based on the information of the viewpoint position detected by the viewpoint position detection unit, and the direction of the change of the detected viewpoint position; The image generation unit is controlled based on the virtual image display distance to change the position of the virtual image so as to emphasize the change in appearance of the virtual image due to motion parallax, or the appearance of the virtual image due to motion parallax A virtual image display control unit which changes the position of the virtual image so as to emphasize the change of the image, and changes the three-dimensional shape of the object displayed as the virtual image so as to correspond to the change of the position of the virtual image;
Have.

  In the first aspect, in the HUD device (3DHUD device or the like) capable of changing the virtual image display distance (virtual image forming distance) and capable of displaying a virtual image with a sense of depth, the viewpoint position of the driver is moved within the eyebox In this case, change control of the virtual image position by the virtual image display control unit is performed, and the position of the virtual image is changed so as to emphasize the change in appearance of the virtual image due to the motion parallax. At this time, when the object displayed as a virtual image is a three-dimensional object (three-dimensional object), the three-dimensional shape of the object so as to correspond to the change of the position of the virtual image as well as the change of the position of the virtual image (E.g., changing the shape so that the side can be seen as well as the one seen only in the front) may be changed.

  In addition, when the virtual image display control unit performs change control of the virtual image position, “change amount of detected viewpoint position”, “change of detected viewpoint position” as information to be the basis for change control of the virtual image position. When adopting three of "direction of virtual object" and "virtual image display distance of the object to be displayed", adopt two of "direction of change of detected viewpoint position" and "virtual image display distance of object to be displayed" It can be considered that In the former case, for example, the virtual image position (virtual image display position) is changed by the change amount calculated based on the change amount of the viewpoint position and the virtual image display distance in the direction opposite to the change direction of the viewpoint position. Can. At this time, control may be performed to increase (decrease) the amount of change in the virtual image position as the amount of change in the viewpoint position increases (decreases), or the amount of change in the viewpoint position may Control may be performed such that the change amount of the virtual image position is uniquely determined according to which zone the detected change amount belongs to. Also, in the latter case, the amount of change in the viewpoint position does not matter, and for example, when there is a change in the viewpoint position above the threshold in the eyebox, the virtual image position (virtual image display position) is determined in advance. Control may be performed to change the predetermined amount.

  According to the first aspect, a change in the appearance of the object is brought about by the motion parallax exceeding the relative motion parallax naturally generated by the movement of the viewpoint position of the driver. In other words, even in a HUD device with a restricted eyebox area, sufficient display change (including display change capable of emphasizing stereoscopic effect) due to motion parallax is realized, and the benefits of motion parallax to support distance perception are sufficiently obtained be able to. From another point of view, it is possible to obtain the same effect as the area of the eye box is substantially expanded. Therefore, it is possible to provide a HUD device capable of effectively causing motion parallax in the eyebox to facilitate the distance perception of the virtual image by the driver.

In a second aspect dependent on the first aspect,
As the virtual image display distance, a first virtual image display distance and a second virtual image display distance shorter than the first virtual image display distance can be selected, and the position of the virtual image at the first virtual image display distance Where L1 is the amount of change of L, and L2 is the amount of change of the position of the virtual image at the second virtual image display distance.
The virtual image display control unit may change the position of the virtual image such that L1 ≧ 0 and L2> L1.

  In the second aspect, when the first virtual image display distance and the second virtual image display distance shorter than the first virtual image display distance can be selected as the virtual image display distance, the second virtual image display distance is selected. (In other words, when the virtual image of the object is displayed closer to the driver as viewed from the driver), the first virtual image display distance is selected (in other words, as viewed from the driver) The position of the virtual image is controlled such that the amount of change of the virtual image is larger (in other words, L2> L1) than when the virtual image of the object is displayed farther away. Thus, distance perception by motion parallax facilitates distance perception of an object by the driver.

  Further, when the first virtual image display distance is selected, the change amount L1 of the position of the virtual image is L1L0. In other words, when the virtual image of the object is far from the driver, the change control of the virtual image position may not be performed (L1 = 0). Even in this case, as for the virtual image of the object whose virtual image of the object is close to the driver's eyes, the display change due to the motion parallax exceeding the naturally occurring motion parallax is realized. You can get the effect.

In a third aspect dependent on the first or second aspect,
The virtual image display control unit may change the position of the virtual image in the direction opposite to the direction of change of the viewpoint position.

  In the third aspect, the position of the virtual image is in the direction (eg, left, right, bottom, top) opposite to the direction of change of the detected viewpoint position (eg, right, left, top, bottom) Change. By this, control of the virtual image position which emphasizes motion parallax more is realized.

In a fourth aspect dependent on any one of the first to third aspects,
The virtual image display control unit may detect a change in the viewpoint position of the driver in the eye box in the lateral direction which is the width direction of the vehicle or in the vertical direction orthogonal to the lateral direction.

  In the fourth aspect, it is considered that the face (eye) of the driver driving the vehicle moves mainly in the left and right (and upper and lower) directions, and therefore, detection of a change in the gaze position in these directions There is. However, for example, a modification such as detecting only viewpoint movement in the left-right direction can be made as appropriate. Also, for example, when the face (eye) of the driver moves obliquely, the movement may be decomposed into left, right, upper and lower components, and each component may be detected as a variation in each direction.

In a fifth aspect dependent on any one of the first to fourth aspects,
When changing the position of the virtual image, the virtual image display control unit may make the amount of change different according to the direction of the change of the viewpoint position.

  In the fifth aspect, it is possible to make the amount of change of the virtual image position different (in other words, adjust the amount of change) based on the direction of the change of the viewpoint. By this, it is possible to reduce the burden of change control of the virtual image position in the HUD device while keeping the effect of facilitating the distance perception by enhancing the motion parallax as it is. For example, since the frequency at which the viewpoint moves up and down is considered to be smaller than the frequency at which the viewpoint moves left and right, the amount of change in virtual image position when the viewpoint moves up and down (even if the amount of change is zero) It is conceivable to increase the change amount of the virtual image position when the viewpoint moves to the left and right, rather than the above. Moreover, when the viewpoint moves to the left and right, when the viewpoint of one eye moves so as to approach the other eye, the distance between the eyebrows is limited, so the expansion of the eyebox has a limit. Therefore, it is conceivable to reduce the degree of enhancement of motion parallax and to increase the degree of enhancement of motion parallax when moving in a direction away from the other eye.

In a sixth aspect dependent on any one of the first to fifth aspects,
The virtual image may be a virtual image of an image of non-overlapping content that does not need to be displayed superimposed on an object that is a real scene.

  In the sixth aspect, a virtual image to be subjected to change control of a virtual image position is a virtual image of an image of non-overlapping content that does not need to be displayed superimposed on an object that is a real scene. As an example, the content displayed by the HUD device is superimposed on the real scene with the superimposed content to be superimposed on the real scene (for example, a reminder mark superimposed on the vehicle position according to the movement or movement of the vehicle ahead) Non-superimposed contents (for example, vehicle speed display, speed limit display, or, for example, “Tokyo” characters and traveling direction) which are not necessary (do not need to dynamically change the display position according to movement or movement of the object) Arrows, etc.) and. Here, when the change control of the virtual image position for emphasizing motion parallax is performed for the virtual image of the superimposed content, the accuracy of the superposition on the object of the real view may be reduced, so the display location is determined relatively freely. Preferably, change control of virtual image position is performed on the virtual image of non-overlapping content that can be

In a seventh aspect dependent on any one of the first to sixth aspects,
In a state in which the first virtual image and the second virtual image having a virtual image display distance smaller than the first virtual image are displayed together, the first virtual image is displayed at the virtual image position by the virtual image display control unit. In the case where the change control of the virtual image position is performed only for the second virtual image without performing the change control,
The virtual image display control unit
When the image generation unit generates a first image and a second image corresponding to the first virtual image and the second virtual image,
Even after the change control of the virtual image position for the second virtual image is performed, an interval as a change margin of the virtual image is secured so that overlapping with the first and second virtual images does not occur. The first and second images may be generated.

  In the seventh aspect, it is assumed that the first and second virtual images are displayed together (displayed simultaneously). The virtual image display distance of the second virtual image is smaller than the first virtual image display distance. In other words, the first virtual image is displayed far from the driver, and the second virtual image is displayed near the driver. In addition, here, the change control of the virtual image position is not performed for the first virtual image (corresponding to the case of L1 = 0 in the second aspect described above), and the change control of the virtual image position is performed only for the second virtual image. It shall carry out. In such a case, only the second virtual image is transformed, so if the distance between the first and second virtual images is narrow, the driver may see that the first and second virtual images overlap. possible. Therefore, in the sixth aspect, even after the change control of the virtual image position for the second virtual image is performed, the change margin of the virtual image is prevented so as not to overlap with the first and second virtual images. The first and second images are generated by securing an interval as As a result, it is possible to reliably prevent the occurrence of the problem that the virtual images overlap and the visibility of the virtual image is reduced.

In an eighth aspect dependent on any one of the first to sixth aspects,
In a state in which the first virtual image and the second virtual image having a virtual image display distance smaller than the first virtual image are displayed together, the first virtual image is displayed at the virtual image position by the virtual image display control unit. In the case where the change control of the virtual image position is performed only for the second virtual image without performing the change control,
The virtual image display control unit
When the image generation unit generates first and second images corresponding to the first and second virtual images,
From the first image, when it is predicted from the driver that duplication of the first and second virtual images is expected to occur when change control of the virtual image position of the second virtual image is performed. The deletion of the overlapping portion may generate a partially missing first image.

  The conditions of the premise in the eighth aspect are the same as the sixth condition described above. However, in the seventh aspect, when generating the first and second images corresponding to the first and second virtual images, the first image corresponding to the first virtual image located farther from the driver , Eliminating duplicates to generate a partially missing image, thereby preventing duplication of the first and second virtual images. Here, since the second virtual image is at a closer position and is considered to have a large influence on the driver's vision, the second virtual image corresponding to the second virtual image is prioritized, and the first virtual image is considered. The image generation unit is controlled to perform image processing for deleting a part of the first image corresponding to. As a result, it is possible to reliably prevent the occurrence of the problem that the virtual images overlap and the visibility of the virtual image is reduced.

  Those skilled in the art will readily understand that the illustrated embodiments of the present invention can be further modified without departing from the spirit of the present invention.

It is a figure which shows the example of a display of two virtual images from which a virtual image display distance differs in the driving | running | working scene in which the vehicle is drive | working the linear road. It is a figure which shows the example of a setting of the virtual image display surface in the head-up display (HUD) apparatus which can control virtual image display distance. FIG. 3 (A) shows a normal eye box, FIG. 3 (B) shows a substantially expanded eye box as a result of implementing the change control of the virtual image position, FIG. 3 (C) to FIG. FIG. 3E is a diagram showing an example of changing the position of each virtual image so as to emphasize motion parallax (change in appearance of virtual image due to motion parallax). It is a figure which shows an example of the whole structure of the HUD apparatus of this invention. It is a figure which shows an example of an internal structure of the virtual image display control part of the HUD apparatus of this invention, and an image generation part. It is a figure which shows the example of a display of a three-dimensional target object (three-dimensional object) using a parallax image. It is a flowchart which shows an example of the main operation | movement procedure of the HUD apparatus shown by FIG. 4, FIG. 8 (A) and 8 (B) are diagrams showing an example in which overlapping of virtual images may occur when two virtual images are displayed together, and FIGS. 8 (C) and 8 (D) are diagrams. FIG. 8 is a diagram showing an example in which an interval as a change margin of a virtual image is secured to prevent duplication of virtual images. FIG. 17 is a diagram illustrating an example in which overlapping of virtual images is not generated by deleting (not displaying) a part of virtual images displayed farther when two virtual images are displayed together.

  The preferred embodiments described below are used to easily understand the present invention. Accordingly, one of ordinary skill in the art should note that the present invention is not unduly limited by the embodiments described below.

  FIG. 1 is a view showing a display example of two virtual images having different virtual image display distances in a driving scene in which a vehicle travels on a straight road. The vehicle 10 travels on a straight paved road 2 at a speed of 60 km / h. White lines (a left side line E1, a center line E2, and a right side line E3) are drawn on the road 2. The vehicle 10 is provided with a windshield (front glass) 3 as a projection target member. The projection target may be a combiner or the like. The display of a virtual image by a head-up display (HUD) device (not shown in FIG. 1) is possible within the virtual image display area 5. In the example of FIG. 1, the virtual image display area 5 is shown as a rectangular area indicated by a broken line.

  In the example of FIG. 1, a first virtual image NV1 (a navigation display consisting of the characters "Tokyo" and "an arrow indicating the traveling direction") is displayed in the left back, and a second virtual image NV2 (in the front of the right) Here, the speed limit display described as "60" is displayed inside the double circle. The instrument panel 11 of the vehicle 10 is provided with a display (display unit) 13 such as a liquid crystal display device. In the example of FIG. 1, the display (display unit) 13 displays vehicle speed information (here 60 km / h ") is displayed. Further, the steering wheel (handle) 7 is provided with an operation unit 9 for performing on / off of the HUD device 100, mode setting, and the like. The driver (the user of the HUD device) operates the operation unit 9 to, for example, determine whether or not to perform change control of the virtual image position to emphasize motion parallax (the appearance of the virtual image by the motion parallax), It is possible to select as appropriate.

  FIG. 2 is a diagram showing a setting example of a virtual image display surface in the HUD device capable of controlling the virtual image display distance. In FIG. 2, the forward direction of the driver (user of the HUD device 100) is taken as the Z-axis direction, the width direction of the vehicle 10 is taken as the X direction, and the vertical direction (the direction orthogonal to the X direction or the vertical direction) is taken. The Y direction is taken (this point is common to other drawings).

  The HUD device 100 of FIG. 2 is basically referred to as a "two-surface HUD device", but here, the virtual image display distance L102 of the virtual image display surface PS2 on the near side is fixed, while For the virtual image display surface PS1 on the side, it is possible to switch the virtual image display distance to L100 and L101 (L101 <L100). Therefore, it is possible to display a more dynamic virtual image with a sense of depth. The virtual image display surface when the virtual image display distance is L100 is described as PS1 (a), and the virtual image display surface when the virtual image display distance is L101 is described as PS1 (b).

  The HUD device 100 is installed, for example, in a dashboard (not shown) of the vehicle 10, and projects (projects) an image (display light of an image) K1 and K2 from the lower side to the upper side. A part of display light K1 and K2 of an image (hereinafter, may be simply referred to as display light) is reflected by a windshield (may be a combiner etc.) 3 as a projection target member, and the driver (User) It is collected in the area of the eye box EB set at the position of the eye 15 (pupil) 1. Thereby, the driver (user) 15 can visually recognize the virtual images NV1 and NV2.

  Here, the first virtual image NV1 (navigation display consisting of the characters “Tokyo” and the “arrow indicating the traveling direction”) is displayed on the rear virtual image display surface PS1 (a) or PS1 (b), The second virtual image NV2 (in this case, the speed limit indicated by "60" inside the double circle) is displayed on the near side virtual image display surface PS2 (the virtual image display distance L102 is fixed).

  Next, the eyebox EB will be described. In the optical design of the HUD device 100, an eye box in which the virtual image can be viewed (the virtual image can be viewed) with reference to the position of the eye (pupil) 1 of the driver (user of the HUD device 100). Usually, (Eyebox) is set. Here, the “eye box” is, for example, the upper, lower, left, and right areas having a predetermined width including the position of the driver's eyes.

  As described above, from the HUD device 100 stored in the dashboard or the like of the vehicle 10, for example, the display light (light rays) K1 and K2 of an image having a predetermined solid angle is used as the windshield 3 as a projection target member Projected (projected). A part of the display lights K1 and K2 is reflected by the windshield 3 as a projection target member, travels to the driver (user) 15, and is collected in the eye box EB. Therefore, within the range of the eye box EB, it is possible to visually recognize the virtual image even if the position of the eye (specifically, for example, the pupil) 1 of the driver (user) 15 moves vertically and horizontally. .

  As “the range where the virtual image can be seen (the virtual image can be seen)”, distortion of the virtual image is increased in the range in the sense that the virtual image disappears outside the range and outside the range There is a range in the sense that it will not be able to be properly viewed, but in this specification it may be any, but if the eyebox is to be interpreted in a broad sense, it is generally used in the former sense It is thought that it will be.

  FIG. 3 (A) shows a normal eye box, FIG. 3 (B) shows a substantially expanded eye box as a result of implementing the change control of the virtual image position, FIG. 3 (C) to FIG. FIG. 3E is a diagram showing an example of changing the position of each virtual image so as to emphasize motion parallax (change in appearance of virtual image due to motion parallax).

  In FIG. 3A, the eye box (conventional eye box) EB before the change control of the virtual image position in the present invention is Q1a, Q2a, Q3a in the left, right, upper, and lower directions with the pupil of eye 1 as the center. , Q4a change allowance is provided. For example, Q1a, Q2a, Q3a, and Q4a are set to 50 mm. If the position of the viewpoint (the pupil of the eye 1) changes beyond this variation, for example, the virtual image can not be viewed. Therefore, in the setting of the eye box EB as shown in FIG. 3A, the motion parallax (change in appearance due to the motion parallax) which can be obtained in the HUD device 100 is the change margin of each of Q1a, Q2a, Q3a, Q4a. It is limited to motion parallax equivalent to distance.

  Here, FIG. 3C to FIG. 3E will be referred to. In the example of FIG. 3C, it is assumed that the eye (pupil) 1 has moved in the right direction by a distance L0 (L0 ≦ Q1a) without departing from the eye box EB (it is assumed that the eye (temporarily) If the movement of the pupil 1) deviates from the eye box EB, the deviated part is ignored, for example. At this time, the virtual image NV1 displayed in the left back (more distant with respect to the position of the driver) is L1 (L1 ≧ 0) so that motion parallax (change in appearance of virtual image due to motion parallax) is emphasized. It moves in the left direction (the direction opposite to the movement direction of the eye 1). In addition, the virtual image NV2 displayed in front of the right (closer to the position of the driver) is moved leftward (a direction opposite to the movement direction of the eye 1) by L2 (L2> L1). Reference numeral 300 indicates the visual field range of the eye (pupil) 1.

  Since the virtual image position is actively changed, motion parallax exceeding the motion parallax naturally occurring with the movement of the eye 1 is realized, which causes a larger change in appearance. Therefore, the sense of distance between the far virtual image NV1 and the near virtual image NV2 becomes clear, and the distance perception by the driver (user) 15 due to the motion parallax is facilitated.

  In the example of FIG. 3D, the virtual image NV1 is displayed in the back right, the virtual image NV2 is displayed in front of the left, and the eye (pupil) 1 is moved by L0 in the left direction. Also in the example of FIG. 3D, similarly to the example of FIG. 3C, the virtual image position is positively changed in the direction (here, the right direction) opposite to the moving direction of the eye (pupil) 1 The same effect as the above can be obtained.

  In the example of FIG. 3E, the virtual images NV1 and NV2 are distant from the eye (pupil) 1 by the same distance. In other words, the virtual images NV1 and NV2 are displayed on the virtual image display surface of the same virtual image display distance. When the eye (pupil) 1 is moved rightward by L0, both virtual images NV1 and NV2 are moved leftward (in the direction opposite to the movement direction of the eye (pupil) 1) by L1. Here, when L1 is not zero (in the case of L1 ≠ 0), it is possible to obtain the above-mentioned effect by positively changing the virtual image position.

  By performing the change control of the virtual image position as shown in FIG. 3 (C) to FIG. 3 (E), the motion parallax exceeding the naturally occurring motion parallax is realized. As shown in FIG. 3B, it can be said that the enlarged eye box EB (W) is realized. In the eye box EB (W), the variation margins Q1b, Q2b, Q3b, Q4b provided in the left, right, upper, and lower directions with the pupil of the eye 1 as the center are set to 100 mm, for example, and compared with the example of FIG. The cost of change has been doubled.

  Thus, according to the present embodiment, a change in the appearance of the object is brought about by the motion parallax exceeding the relative motion parallax naturally generated by the movement of the viewpoint position of the driver. In other words, even in the HUD device 100 in which the area of the eye box is restricted, sufficient display change (including display change capable of emphasizing the three-dimensional effect) is realized due to motion parallax, and the benefits of motion parallax aiding distance perception are sufficiently achieved. You can get it. From another viewpoint, it is possible to obtain the same effect as the area of the eye box EB is substantially expanded. Therefore, the HUD device 100 capable of effectively generating motion parallax in the eye box EB and facilitating the distance perception of the virtual image by the driver 15 is realized.

  FIG. 4 is a diagram showing an example of the entire configuration of the HUD device of the present invention. In FIG. 4, the same reference numerals are given to parts common to the above-mentioned drawings (this point is the same for the other drawings).

  The HUD device 100 includes mirrors 70 and 71, a mirror 72 which is a concave mirror capable of rotating at a predetermined angle around a rotating portion 73, screens 46a and 46b constituting an image forming portion, and a lens for light distribution control. 44 and a control unit 300. The screen 46 a and the lens 44 for light distribution control are movable. The display light K1 is generated by the emitted light of the image Ma displayed on the image display surface 47a of the screen 46a, and the display light K2 is generated by the emitted light of the image Mb displayed on the image display surface 47b of the screen 46b. The display lights K1 and K2 (in other words, an image) are projected on the windshield 3 as a projection target member (in other words, the image is projected), and part of the display lights K1 and K2 are reflected by the windshield 3 Collected in eye box EB.

  In FIG. 4, the example described in FIG. 2 is used as an example of virtual image display. In addition, when the viewpoint position of the driver (user) 15 is shifted in the left-right direction (X-axis direction), for example, the change amount of the virtual image NV2 on the virtual image display surface PS2 with the shortest virtual image display distance is largest. . The amount of change of the virtual image NV1 on the virtual image display surface PS1 (b) is smaller than the amount of change of the virtual image NV2. Further, the virtual image NV1 on the virtual image display surface PS1 (a) is not changed here.

  The HUD device 100 also includes a control unit 300. The control unit 300 includes a mirror angle control unit 301, a mirror angle detection unit 302, a virtual image display control unit 306, and a captured image sent from a real scene imaging camera (for example, an infrared stereo camera etc.) 200 provided in the vehicle 10. An image analysis unit 314 to analyze, a driving scene determination unit 316 that determines a driving scene based on vehicle information and the like sent from a vehicle information acquisition unit 312 of the vehicle 10, and a viewpoint imaging camera (pupil camera of the vehicle 10 A viewpoint information input unit 318 to which viewpoint information from the) 202 is input, a viewpoint position detection unit 320, a virtual image display control unit 306 (having a viewpoint transition detection unit 340, a depth information generation unit 31 and the like) 306, and image generation And a virtual image display distance control unit 50.

  The virtual image display distance control unit 50 includes a lens drive unit 51 and a screen drive unit 53. The position of the lens 44 and the screen 46a is moved by the lens driving unit 51 and the screen driving unit 53 along the optical path, in other words, in the direction along the optical axis of the lens 44 (and the screen 46a). (A) and (b) can be switched as appropriate. The screen 46b is fixed in position. As described above, in the example of FIG. 4, the display light K2 is used to display the speed limit.

  In addition, when the mirror 72 which is a concave mirror is rotated about the rotation unit 73, information on the rotation angle is supplied from the mirror angle control unit 301 to the mirror angle detection unit 302. The detected mirror angle information is supplied to the virtual image display control unit 306 and the image generation unit 33.

  Further, in the example of FIG. 4, the vehicle 10 performs wireless communication with the driving support system 402, the road-vehicle communication system 404, and the like to acquire various information, the ECU 310, the bus BUS, and the vehicle. An information acquisition unit (or vehicle information input unit) 312 is provided.

  FIG. 5 is a diagram showing an example of an internal configuration of a virtual image display control unit and an image generation unit of the HUD device of the present invention.

  The virtual image display control unit 306 includes a viewpoint shift detection unit 340 (including a viewpoint change amount detection unit 342 and a viewpoint change direction detection unit 344), a control information generation unit 331, and a depth information generation unit 31. Have. The image generation unit 33 further includes an image shift control unit or an image rendering unit 335 that generates a three-dimensional image after shift.

  The viewpoint shift detection unit 340 of the virtual image display control unit 306 determines the viewpoint position based on the information on the viewpoint position detected by the viewpoint position detection unit 320 when the viewpoint position of the driver 15 moves in the eyebox EB. The amount of change and the direction of the change in viewpoint position are detected.

  The control information generation unit 331 includes information (first information) of the change amount of the viewpoint position from the change amount detection unit 342 and information (second information) of the change direction of the viewpoint position from the change direction detection unit 344. And depth information (in other words, virtual image display distance: third information) generated by the depth information generation unit 31 are input.

  The control information generation unit 331 detects the amount of change, the direction of the change, and the depth information (virtual image display distance) (in other words, based on the first to third pieces of information) or the detection Control information is generated based on the direction of change of the viewpoint position and the virtual image display distance (in other words, based on the second and third information), and the image generation unit 33 is controlled by this. Positions of virtual images NV1 and NV2 to change positions of virtual images NV1 and NV2 so as to emphasize changes in appearance of virtual images due to motion parallax, or to emphasize changes in appearance of virtual images NV1 and NV2 due to motion parallax And change the three-dimensional shape of the object (three-dimensional object) displayed as a virtual image so as to correspond to the change in position of the virtual images NV1 and NV2.

  The image shift control unit or the image rendering unit 335 of the image generation unit 33 shifts the image (and generates a three-dimensional shape of the three-dimensional object after shift) according to the control information sent from the virtual image display control unit 306. Run.

  As described above, when the viewpoint position of the driver 15 moves in the eyebox EB, the change control of the virtual image position by the virtual image display control unit 306 is performed to emphasize the change in the appearance of the virtual image due to motion parallax. The position of the virtual image changes. At this time, when the object displayed as a virtual image is a three-dimensional object (three-dimensional object), the three-dimensional shape of the object so as to correspond to the change of the position of the virtual image as well as the change of the position of the virtual image (For example, changing the shape so that the side can be seen as well as the one seen from the front) is also performed.

  Further, as described above, when the virtual image display control unit 306 performs change control of the virtual image position, “the amount of change of the detected viewpoint position (first information ")", "Direction of change of detected viewpoint position (second information)", and "virtual image display distance of object to be displayed (third information)" and "detected" It is conceivable to adopt two cases of the direction of change of the viewpoint position (second information) and the virtual image display distance of the object to be displayed (third information).

  In the former case, for example, the virtual image position (virtual image display position) is changed by the change amount calculated based on the change amount of the viewpoint position and the virtual image display distance in the direction opposite to the change direction of the viewpoint position. Can. At this time, control may be performed to increase (decrease) the amount of change in the virtual image position as the amount of change in the viewpoint position increases (decreases), or the amount of change in the viewpoint position may Control may be performed such that the change amount of the virtual image position is uniquely determined according to which zone the detected change amount belongs to.

  In the latter case, the amount of change in the viewpoint position does not matter. For example, when there is a change in the viewpoint position above the threshold in the eyebox EB, the virtual image position (virtual image display position) is determined in advance. The control may be performed to change by a predetermined amount.

  The driving scene information from the driving scene determination unit 316 is input to the viewpoint shift detection unit 340 of the virtual image display control unit 306. This is because, for example, when the vehicle 10 travels, for example, on an unpaved road with large unevenness or travels on a slope where curves continue, the distance perception by enhancement of the motion parallax is particularly important. Since it is not important, in such a driving scene, no control information is generated, and it is effective in a driving scene suitable for emphasizing motion parallax, as in the case of stably traveling on a straight road. It is intended to execute the above-mentioned change control of the virtual image position. By this, unnecessary change control of the virtual image position can be avoided.

  The change control of the virtual image position brings about a change in the appearance of the object due to the motion parallax exceeding the relative motion parallax naturally generated by the movement of the viewpoint position of the driver 15. In other words, even in the HUD device 100 in which the area of the eye box EB is restricted, sufficient display change (including display change capable of emphasizing the three-dimensional effect) is realized due to motion parallax, and the benefit of motion parallax assisting distance perception is sufficient Can be obtained. From another viewpoint, it is possible to obtain the same effect as the area of the eye box EB is substantially expanded. Therefore, it is possible to provide the HUD device 100 capable of effectively generating the motion parallax in the eyebox EB to facilitate the distance perception of the virtual image by the driver 15.

Further, as the virtual image display distance, it is possible to select the first virtual image display distance and the second virtual image display distance shorter than the first virtual image display distance, and at the position of the virtual image at the first virtual image display distance. Assuming that the amount of change is L1, and the amount of change in position of the virtual image in the second virtual image display distance is L2,
The virtual image display control unit 306 may change the position of the virtual image so that L1 ≧ 0 and L2> L1.

  In other words, when the first virtual image display distance and the second virtual image display distance shorter than the first virtual image display distance can be selected as the virtual image display distance, the second virtual image display distance is selected (In other words, when the virtual image of the object is displayed closer to the driver 15 as viewed from the driver 15), the first virtual image display distance is selected (in other words, it is farther from the driver) Preferably, the position of the virtual image is controlled such that the amount of change of the virtual image is larger (in other words, L2> L1) than when the virtual image of the object is displayed. Thus, distance perception by the motion parallax facilitates the distance perception of the distance between the driver 15 and the object.

  Further, when the first virtual image display distance is selected, the change amount L1 of the position of the virtual image is L1L0. In other words, when the virtual image of the object is far from the driver 15, the change control of the virtual image position may not be performed (L1 = 0). Even in this case, as for the virtual image of the object whose virtual image of the object is close to the driver 15 as seen from the driver 15, the display change due to the motion parallax exceeding the naturally occurring motion parallax is realized as in the above. You can get the effect of

  Further, as described above, the virtual image display control unit 306 may change the position of the virtual image in the direction opposite to the direction of the change of the viewpoint position. In other words, the position of the virtual image is changed in the direction (for example, left, right, lower, upper) opposite to the direction of change of the detected viewpoint position (for example, right, left, upper, lower). By this, control of the virtual image position which emphasizes motion parallax more is realized.

  In addition, the virtual image display control unit 306 is a horizontal direction that is the width direction (X-axis direction) of the vehicle 10 or a vertical direction (Y-axis that is orthogonal to the horizontal direction) of the viewpoint position of the driver 15 in the eyebox EB. Changes in direction) may be detected. Since it is considered that the face (eye) of the driver 15 driving the vehicle 10 moves mainly in the left and right (and upper and lower) directions, it is decided to detect the change in the gaze position in these directions. However, for example, a modification such as detecting only viewpoint movement in the left-right direction can be made as appropriate. Further, for example, when the face (eye) of the driver 15 moves obliquely, the movement may be decomposed into left, right, upper and lower components, and each component may be detected as a variation in each direction.

  Further, when changing the position of the virtual image, the virtual image display control unit 306 may make the amount of change different according to the direction of the change of the viewpoint position. The variation amount of the virtual image position is allowed to differ based on the direction of the change of the viewpoint (in other words, the variation amount is weighted and adjusted according to the direction of the variation). As a result, it is possible to reduce the burden of change control of the virtual image position in the HUD device 100 while keeping the effect of facilitating the distance perception by emphasizing the motion parallax as it is.

  For example, since the frequency at which the viewpoint moves up and down is considered to be smaller than the frequency at which the viewpoint moves left and right, the amount of change in virtual image position when the viewpoint moves up and down (even if the amount of change is zero) It is conceivable to increase the change amount of the virtual image position when the viewpoint moves to the left and right, rather than the above. In addition, when the viewpoint moves to the left and right, when the viewpoint of one eye moves so as to approach the other eye, the distance between the eyebrows is limited and the expansion of the eye box EB has a limit. Therefore, it is conceivable to reduce the degree of enhancement of motion parallax and to increase the degree of enhancement of motion parallax when moving away from the other eye.

  In addition, a virtual image to be subjected to change control of the virtual image position may be, for example, a virtual image of an image of non-overlapping content which does not need to be displayed superimposed on an object as a real scene. The content displayed by the HUD device 100 includes, as an example, superimposed content to be superimposed on the real scene (for example, a warning mark superimposed on the vehicle position according to the movement or movement of the vehicle ahead) and the real landscape Non-overlapping content (for example, vehicle speed display, speed limit display, or, for example, “Tokyo” characters and traveling direction). And arrows) and the like.

  Here, when the change control of the virtual image position for emphasizing motion parallax is performed for the virtual image of the superimposed content, the accuracy of the superposition on the object of the real view may be reduced, so the display location is determined relatively freely. It is preferable to perform change control of virtual image position regarding the virtual image of the non-overlapping content which can be. However, this does not exclude the execution of the change control of the virtual image position for the superimposed content.

  FIG. 6 is a view showing a display example of a three-dimensional object (three-dimensional object) using parallax images. In the above description, although it has been described that an object to be displayed as a virtual image may be a stereoscopic object, here, a method of generating a virtual image of the stereoscopic object will be briefly described.

  In FIG. 6, the left-eye parallax image QP4L is displayed corresponding to the left-eye 1L, and the right-eye parallax image QP4R is displayed corresponding to the right-eye 1R. When the parallax images QP4L and QP4R are viewed simultaneously by the eyes 1L and 1R, the parallax images are combined, and a stereoscopic virtual image QP4 (I) is visually recognized. Here, when each eye 1L, 1R, for example, shifts to the left or right, motion parallax occurs by the amount of the shift, but each parallax image QP4L, QP4R is positively set so as to emphasize the motion parallax. By shifting, the position of the three-dimensional virtual image QP4 (I) and the three-dimensional shape change. Therefore, the virtual image display control unit 306 in FIG. 5 generates control information and the image rendering unit 335 in FIG. 5 generates each parallax image after the change so as to cause such a change in position and three-dimensional shape. By doing this, the driver (user) 15 can clearly perceive a sense of depth (sense of distance) of a three-dimensional object.

  FIG. 7 is a flow chart showing an example of the main operation procedure of the HUD device shown in FIG. 4 and FIG. When the viewpoint shift detection unit 340 of the virtual image display control unit 306 detects a viewpoint shift in the eyebox (step S1), the viewpoint shift detection unit 340 detects the current driving scene based on the driving scene information. It is determined whether the virtual image position change control is an effective driving scene (for example, a driving scene as if traveling on a straight paved road) (step S2). In the case of N in steps S1 and S2, the process returns to step S1 in the case of N, and proceeds to step S3 in the case of Y in step S2.

  In step S3, the amount of change in the viewpoint and the direction of change in the eye box EB (the amount of displacement of the viewpoint and the amount of displacement) are detected by the viewpoint change amount detection unit 342 and the viewpoint change direction detection unit 344 of the viewpoint shift detection unit 340. Direction) is detected.

  Next, in step S4, the control information generation unit 331 of the virtual image position change control unit 406 determines the amount of change in the viewpoint, the direction of the change, and the virtual image display distance, or the change direction of the viewpoint and the virtual image display distance. Control information for change control of virtual image position is generated.

  Next, in step S5, the image shift control unit or image rendering unit 335 shifts the image to shift the virtual image position, or renders the image of the three-dimensional object after shift.

  8 (A) and 8 (B) are diagrams showing an example in which overlapping of virtual images may occur when two virtual images are displayed together, and FIGS. 8 (C) and 8 (D) are diagrams. FIG. 8 is a diagram showing an example in which an interval as a change margin of a virtual image is secured to prevent duplication of virtual images.

  In the display example of the virtual image of FIG. 1 described above, since the first and second virtual images NV1 and NV2 are displayed separately on the left and right sides of the road, the intervals between the virtual images are sufficient. However, it can also be envisaged that two virtual images are displayed simultaneously and that they are displayed close to one another. In this case, it may be assumed that the distances between the virtual images are quite narrow.

  In the example shown in FIGS. 8A and 8B, both the first virtual image NV1 and the second virtual image NV2 having a virtual image display distance smaller than the first virtual image NV1 are displayed. Thus, with regard to the first virtual image NV1, the virtual image display control unit does not execute the change control of the virtual image position by the control unit 306, and the change control of the virtual image position is performed only for the second virtual image NV2.

  Here, in the case of FIG. 8A, the eye 1 of the driver (user) 15 moves leftward (the + X axis direction) by the distance L0, and correspondingly, the position of the second virtual image NV2 Is shifted rightward (in the −X axis direction) by the distance L2. In this case, duplication of each virtual image NV1 and NV2 seen from the driver (user) 15 does not occur.

  On the other hand, in the case of FIG. 8B, the eye 1 of the driver (user) 15 moves in the right-left direction (−X axis direction) by the distance L0, and correspondingly, the second virtual image The position of NV2 is shifted leftward (+ X axis direction) by the distance L2. In this case, overlapping of the virtual images NV1 and NV2 as viewed from the driver (user) 15 occurs, which causes a problem that the visibility of the virtual image of the driver (user) 15 is reduced.

  Therefore, as a countermeasure for this, the virtual image display control unit 306 sets the first image and the second image corresponding to the first virtual image NV1 and the second virtual image NV2 (the screen 46a as the image display unit in FIG. When the image generation unit 33 generates the images Ma and Mb formed on the image display surfaces 47a and 47b of 46b, even after the change control of the virtual image position of the second virtual image NV2 is performed, In order to prevent duplication between the first and second virtual images NV1 and NV2, the first and second images Ma and Mb are generated with an interval as a change margin of the virtual image secured.

  In both the examples shown in FIGS. 8C and 8D, a variation margin corresponding to the distance L2 (or L2 '), which is the variation amount of the second virtual image NV2, is secured. Even when the change control is performed, duplication of each virtual image NV1 and NV2 seen from the driver (user) 15 does not occur.

  Here, in the case of FIG. 8C, the virtual image display distance of the second virtual image NV2 is L5, and in the case of FIG. 8D, the virtual image display distance of the second virtual image NV2 is L5 '(L5' <L5 Accordingly, in the case of FIG. 8C, the amount of change of the position of the second virtual image NV2 is L2, and in the case of FIG. 8D, the position of the second virtual image NV2 is The amount of change is L2 ′ (L2 ′> L2). Therefore, the virtual image display control unit 306 adaptively changes the change margin in accordance with the change amount of the position of the second virtual image NV2.

  As described above, even after the change control of the virtual image position for the second virtual image NV2 is performed, the change amount of the virtual image is set so that overlapping with the first and second virtual images NV1 and NV2 does not occur. As the first and second images Ma and Mb are generated by securing the interval between the virtual images, it is possible to reliably prevent the problem that the virtual images overlap and the visibility of the virtual image is reduced. .

  FIG. 9 is a diagram showing an example in which overlapping of virtual images is not generated by deleting (not displaying) a part of virtual images displayed farther when two virtual images are displayed together.

  The preconditions in the example of FIG. 9 are the same as the conditions in FIG. In other words, also in the example of FIG. 9, the first virtual image NV1 and the second virtual image NV2 whose virtual image display distance is smaller than the first virtual image are both displayed. In this case, the change control of the virtual image position by the virtual image display control unit 306 is not performed, and the change control of the virtual image position is performed only for the second virtual image NV2.

  However, in the case of FIG. 9, when generating the first and second images (Ma and Mb in FIG. 4) corresponding to the first and second virtual images NV1 and NV2, the virtual image display control unit 306 To control the first image Ma corresponding to the first virtual image NV1 located farther from the driver 15 by deleting the overlapping portion to generate the partially missing image, , And prevent overlapping of the first and second virtual images NV1 and NV2.

  In FIG. 9, the second virtual image NV1 has a large visual influence by deleting the overlapping portion with the second virtual image NV2 (the area Z1 displayed in black in the figure). With regard to the virtual image NV2, there is no reduction in the visibility of the virtual image due to the overlapping of the virtual images. In addition, although the first virtual image NV1 is partially removed, the first virtual image NV1 appears far, so that the driver (user) 15's discomfort caused by the lack of a part of the image is reduced. There is no particular problem.

  As described above, according to the present invention, for example, it is possible to provide a HUD device capable of facilitating distance perception of a virtual image by a driver by effectively generating motion parallax in an eye box. It becomes possible.

  As mentioned above, although this invention was demonstrated based on embodiment, this invention is not limited to these embodiment, A various deformation | transformation and application are possible. For example, the present invention can be applied to a HUD device (multilayer-3 DHUD device) capable of setting more virtual image display surfaces having different virtual image display distances. Further, the change control of the virtual image position implemented in the present invention can also be applied to a driving simulator or the like of a vehicle.

  The invention is not limited to the above-described exemplary embodiments, and one of ordinary skill in the art could easily modify the above-described exemplary embodiments to the extent that they are included in the claims. .

  2 · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · depth information generator, 33 · · · image generator, 50 ... virtual Display distance control unit, 100: HUD device, 200: real scene imaging camera (for example, infrared stereo camera etc.) 202: viewpoint imaging camera (pupil camera) 300: control unit 301 Mirror angle control unit 301, 302: mirror angle detection unit 306: virtual image display control unit 314: image analysis unit 316: driving scene determination unit 318: viewpoint information input unit 320: viewpoint position detection unit 331: control information generation unit 335: image shift control unit or image rendering unit 340: viewpoint transition detection unit NV1, NV2 first Second virtual image, PS1 ( , PS1 (b), PS2 ... virtual image display surface, L0 ... change amount of viewpoint (movement amount), L1, L2 ... change amount of virtual image position (movement amount, shift amount), L100 to L102 , L5, L5 '... virtual image display distance (virtual image forming distance).

Claims (8)

It is mounted on a vehicle and projects an image onto a projection target member provided on the vehicle to make the driver visually recognize a virtual image of the image and to the virtual image starting from a predetermined position of the driver or the vehicle A head-up display device capable of changing a virtual image display distance which is a distance of
A viewpoint position detection unit configured to detect the viewpoint position of the driver;
An image generation unit,
When the viewpoint position of the driver moves, the amount of change of the viewpoint position and the direction of the change of the viewpoint position are detected based on the information of the viewpoint position detected by the viewpoint position detection unit, and the detected amount of change And controlling the image generation unit based on the virtual image display distance and the direction of change to change the position of the virtual image so as to emphasize the change in appearance of the virtual image due to motion parallax, or A virtual image that changes the position of the virtual image so as to emphasize the change in appearance of the virtual image due to parallax, and changes the three-dimensional shape of the object displayed as the virtual image so as to correspond to the change in the position of the virtual image A display control unit,
Have
Or
When the viewpoint position of the driver moves, the direction of the change of the viewpoint position is detected based on the information of the viewpoint position detected by the viewpoint position detection unit, and the direction of the change of the detected viewpoint position; The image generation unit is controlled based on the virtual image display distance to change the position of the virtual image so as to emphasize the change in appearance of the virtual image due to motion parallax, or the appearance of the virtual image due to motion parallax A virtual image display control unit which changes the position of the virtual image so as to emphasize the change of the image, and changes the three-dimensional shape of the object displayed as the virtual image so as to correspond to the change of the position of the virtual image;
Have
Head-up display device characterized in that. As the virtual image display distance, a first virtual image display distance and a second virtual image display distance shorter than the first virtual image display distance can be selected, and the position of the virtual image at the first virtual image display distance Where L1 is the amount of change of L, and L2 is the amount of change of the position of the virtual image at the second virtual image display distance.
2. The head-up display device according to claim 1, wherein the virtual image display control unit changes the position of the virtual image so that L100 and L2> L1.   3. The head-up display device according to claim 1, wherein the virtual image display control unit changes the virtual image position in a direction opposite to a direction of change of the viewpoint position.   The virtual image display control unit is characterized in that a change in the viewpoint position of the driver in the eye box in the lateral direction which is the width direction of the vehicle or the vertical direction orthogonal to the lateral direction is detected. The head up display apparatus according to any one of claims 1 to 3.   5. The virtual image display control unit according to claim 1, wherein when changing the position of the virtual image, the virtual image display control unit changes the amount of change according to the direction of change of the viewpoint position. Head-up display device.   The head-up display device according to any one of claims 1 to 5, wherein the virtual image is a virtual image of an image of non-overlapping content which does not have to be displayed superimposed on an object which is a real scene. In a state in which the first virtual image and the second virtual image having a virtual image display distance smaller than the first virtual image are displayed together, the first virtual image is displayed at the virtual image position by the virtual image display control unit. In the case where the change control of the virtual image position is performed only for the second virtual image without performing the change control,
The virtual image display control unit
When the image generation unit generates a first image and a second image corresponding to the first virtual image and the second virtual image,
Even after the change control of the virtual image position for the second virtual image is performed, an interval as a change margin of the virtual image is secured so that overlapping with the first and second virtual images does not occur. The head-up display device according to any one of claims 1 to 6, wherein the first and second images are generated. In a state in which the first virtual image and the second virtual image having a virtual image display distance smaller than the first virtual image are displayed together, the first virtual image is displayed at the virtual image position by the virtual image display control unit. In the case where the change control of the virtual image position is performed only for the second virtual image without performing the change control,
The virtual image display control unit
When the image generation unit generates first and second images corresponding to the first and second virtual images,
From the first image, when it is predicted from the driver that duplication of the first and second virtual images is expected to occur when change control of the virtual image position of the second virtual image is performed. The head-up display device according to any one of claims 1 to 6, wherein a first image lacking a part is generated by deleting the overlapping part.

Images