JP6874769B2 - Vehicle display device - Google Patents

Description

The present invention relates to a vehicle display device. The present invention particularly relates to a vehicle display device capable of providing appropriate information to a user without being affected by a change in the position of the user's viewpoint.

As a vehicle display device, by projecting a display image onto a translucent member such as the front window shield of a vehicle, a virtual image is visually recognized by a user sitting in the driver's seat using the light of the display image reflected by the front window shield. There is a so-called head-up display. In such a vehicle display device, the virtual image is visually recognized by the user sitting in the driver's seat so that the virtual image is formed on the vehicle traveling direction side (vehicle front side) with reference to the front window shield of the vehicle. .. As a general configuration of such a vehicle display device, for example, an image display unit for displaying a display image and a projection unit composed of an optical system including a concave mirror for projecting the display image on the front window shield of the vehicle. ,including.

A user sitting in the driver's seat of a vehicle equipped with such a vehicle display device can see, for example, a virtual image that gives information on the existence of other vehicles, obstacles, etc. on the road in front of the vehicle through the front window shield. Can be visually recognized in a state of being superimposed on. As the position where the virtual image is visually recognized becomes the upper side in the vertical direction of the front window shield, the virtual image is visually recognized superimposed on the scenery on the far side of the scenery seen through the front window shield. On the other hand, as the position where the virtual image is visually recognized becomes the lower side in the vertical direction of the front window shield, the virtual image is superimposed on the landscape on the side closer to the distance seen through the front window shield.

Here, the position of the viewpoint of the user sitting in the driver's seat is not constant depending on the sitting height of the user, the sitting posture of the user, and the like. For example, when the position where the displayed image is projected is fixed, as the position of the viewpoint of the user sitting in the driver's seat becomes higher, the virtual image becomes the scenery on the closer side of the scenery seen through the front window shield. It is superimposed. In this way, the position of the viewpoint of the user sitting in the driver's seat changes, so that the object in the landscape on which the virtual image is superimposed shifts, which may give the user a sense of discomfort.

Therefore, for example, in Patent Document 1, a head-up display device (vehicle display) that adjusts the projection direction of an optical system including a concave mirror of a projection unit according to the position in the vertical direction of the viewpoint of a user sitting in the driver's seat of a vehicle. Device) is shown. The vehicle display device shown in Patent Document 1 includes a concave mirror actuator that adjusts the projection angle of the concave mirror of the projection unit, and a viewpoint detection camera that acquires the position of the viewpoint of a user sitting in the driver's seat of the vehicle.

In the vehicle display device shown in Patent Document 1, when the position of the viewpoint of the user sitting in the driver's seat of the vehicle acquired by the viewpoint detection camera is high, the displayed image is projected on the upper side in the vertical direction of the front window shield. As such, the concave mirror actuator is controlled. On the other hand, in the vehicle display device shown in Patent Document 1, when the position of the viewpoint of the user sitting in the driver's seat of the vehicle acquired by the viewpoint detection camera is low, the display image is vertically below the front window shield. Control the concave mirror actuator so that it is projected to the side. Therefore, in the vehicle display device shown in Patent Document 1, even when the position of the viewpoint of the user sitting in the driver's seat of the vehicle changes, the object on which the virtual image is superimposed in the scenery seen through the front window shield is It is configured to prevent large deviations.

Japanese Unexamined Patent Publication No. 2014-210537

However, the present inventor has recognized that the vehicle display device described in Patent Document 1 may give the user a sense of discomfort when the position of the user's viewpoint changes. This point will be described below with reference to FIG. FIG. 10 describes the relationship between the viewpoint position of the user, the virtual image visually recognized by the user, and the range of distance on the road surface of the landscape on which the virtual image is superimposed in the vehicle display device described in Patent Document 1. It is a schematic diagram for. Note that FIG. 10 is for explaining in an easy-to-understand manner the relationship between the user's viewpoint position in the vertical direction, the virtual image region displaying the virtual image visually recognized by the user, and the distance range on the road surface of the landscape on which the virtual image region is superimposed. In addition, the amount of change in the user's viewpoint position is exaggerated. Specifically, the vertical distance between the user viewpoint position 101u, the user viewpoint position 101r, and the user viewpoint position 101d shown in FIG. 10 is actually closer than the example shown in FIG. Further, in the coordinate axes shown in FIG. 10, the z-axis positive direction represents the vehicle front direction, the y-axis positive direction represents the vertical upper side, and the x-axis positive direction (vertical upward direction with respect to the drawing) represents the vehicle left. Indicates the direction.

FIG. 10 shows three viewpoint positions, that is, the user viewpoint position 101u, the user viewpoint position 101r, and the user viewpoint position 101d, as examples of the viewpoint positions of the user sitting in the driver's seat of the vehicle. In the virtual image region 301u shown in FIG. 10, for example, when the viewpoint of the user sitting in the driver's seat of the vehicle is the user viewpoint position 101u, the projection angle of the displayed image is adjusted by the vehicle display device described in Patent Document 1. As a result, it is an area where a virtual image visually recognized by the user is displayed. In the virtual image region 301r shown in FIG. 10, for example, when the viewpoint of the user sitting in the driver's seat of the vehicle is the user viewpoint position 101r, the projection angle of the displayed image is adjusted by the vehicle display device described in Patent Document 1. As a result, it is an area where a virtual image visually recognized by the user is displayed. In the virtual image region 301d shown in FIG. 10, for example, when the viewpoint of the user sitting in the driver's seat of the vehicle is the user viewpoint position 101d, the projection angle of the displayed image is adjusted by the vehicle display device described in Patent Document 1. As a result, it is an area where a virtual image visually recognized by the user is displayed. In the vehicle display device described in Patent Document 1, when the position of the viewpoint of the user sitting in the driver's seat of the vehicle changes, the direction in which the display image is projected is changed, for example, a display device ( The area where the image display unit) displays the displayed image is not changed. Therefore, the sizes of the virtual image region 301u, the virtual image region 301r, and the virtual image region 301d in the vertical direction are all the same.

The superimposed distance range 401u shown in FIG. 10 is, for example, a landscape in which the virtual image region 301u is superimposed among the landscapes seen through the front window shield 2 when the viewpoint of the user sitting in the driver's seat of the vehicle is the user viewpoint position 101u. It is the range of the distance on the road 91. The superimposed distance range 401r shown in FIG. 10 is, for example, a landscape in which the virtual image region 301r is superimposed among the landscapes that can be seen through the front window shield 2 when the viewpoint of the user sitting in the driver's seat of the vehicle is the user viewpoint position 101r. It is the range of the distance on the road 91. The superimposed distance range 401d shown in FIG. 10 is, for example, a landscape in which the virtual image region 301d is superimposed among the landscapes that can be seen through the front window shield 2 when the viewpoint of the user sitting in the driver's seat of the vehicle is the user viewpoint position 101d. It is the range of the distance on the road 91.

As in the example shown in FIG. 10, the amount of change in the vertical direction of the virtual image is smaller than the amount of change in the vertical direction of the user's viewpoint position. Then, as the user's viewpoint position moves upward in the vertical direction, the angle between the line of sight of the user looking at the virtual image and the horizontal plane increases. On the other hand, as the user's viewpoint position moves downward in the vertical direction, the angle between the line of sight of the user looking at the virtual image and the horizontal plane becomes smaller. Therefore, the length of the superimposition distance range 401u at the user viewpoint position 101u, which is higher than the user viewpoint position 101r, is smaller than the length of the superimposition distance range 401r at the user viewpoint position 101r. Further, the length of the superimposition distance range 401d at the user viewpoint position 101d, which is lower than the user viewpoint position 101r, is larger than the length of the superimposition distance range 401r at the user viewpoint position 101r. In FIG. 10, it is shown that the positions of the ends of the superposed distance range 401u, the superposed distance range 401r, and the superposed distance range 401d only on the rear side of the vehicle are fluctuating, but in reality, the front of the vehicle is shown. The position of the side edge can also fluctuate.

As described above, in the vehicle display device described in Patent Document 1, a virtual image is displayed in the landscape seen through the front window shield by changing the position of the viewpoint of the user sitting in the driver's seat. The range of distance on the road surface of the landscape where is superimposed changes. As a result, in the vehicle display device described in Patent Document 1, for example, when the position of the user's viewpoint changes to the upper side in the vertical direction, a virtual image of the landscape seen through the front window shield is superimposed on the object. Therefore, a situation may occur in which a virtual image that is too small is visually recognized by the user. Similarly, in the vehicle display device described in Patent Document 1, for example, when the position of the user's viewpoint changes downward in the vertical direction, a virtual image in the landscape seen through the front window shield is superimposed. On the other hand, a situation may occur in which a virtual image that is too large is visually recognized by the user. As described above, the present inventor has recognized that the vehicle display device described in Patent Document 1 may give a sense of discomfort to the user by changing the position of the user's viewpoint.

One object of the present invention is to provide a vehicle display device capable of providing appropriate information to a user without being affected by a change in the position of the user's viewpoint. Other objects of the invention will become apparent to those skilled in the art by reference to the embodiments and preferred embodiments exemplified below, as well as the accompanying drawings.

The vehicle display device of the present invention has a viewpoint position acquisition unit that acquires the position of the viewpoint of a user sitting in the driver's seat of the vehicle, and road shape information that is information on the road shape in front of the vehicle from the traveling path of the vehicle. The image display unit according to the road shape information acquisition unit to be acquired, the image display unit having a display surface capable of displaying an image, and the position of the viewpoint of the user in the vertical direction acquired by the viewpoint position acquisition unit. An image generation unit that determines the position and length of a used area used for displaying the image, which is a part of the display surface, and displays the image in the used area of the display surface, and the display. By projecting light from a surface toward a translucent member, a virtual virtual image region corresponding to the used area is generated, and a projection unit for displaying a virtual image corresponding to the image is provided in the virtual image region. The image generation unit determines the position and length of the used area corresponding to the vertical direction of the virtual image region according to the position of the user's viewpoint in the vertical direction acquired by the viewpoint position acquisition unit. The length of the used area is corrected so that the upper end of the virtual image region approaches the lower end and the vertical direction of the virtual image region becomes shorter according to the road shape information acquired by the road shape information acquisition unit.

It is a block diagram which shows the example of the structure of the display device for a vehicle of this invention. It is a figure which shows the example of the structure of the image display part shown in FIG. 1A. It is sectional drawing of the projection part shown in FIG. 1A. FIG. 3 is a diagram showing an example of a landscape and a virtual image seen by a user sitting in the driver's seat of a vehicle provided with a vehicle display device shown in FIG. 1A. It is a flowchart which shows the example of the operation of the display device for a vehicle shown in FIG. 1A. It is a figure which shows the relationship between the position of a user's viewpoint and the image displayed by the image display part of the vehicle display device shown in FIG. 1A. It is a figure which shows the relationship between the position of a user's viewpoint and the image displayed by the image display part of the vehicle display device shown in FIG. 1A. It is a figure which shows the relationship between the position of a user's viewpoint and the image displayed by the image display part of the vehicle display device shown in FIG. 1A. It is a figure which shows the relationship between the position of a user's viewpoint and the image displayed by the image display part of the vehicle display device shown in FIG. 1A. It is a figure which shows the relationship between the position of a user's viewpoint and the image displayed by the image display part of the vehicle display device shown in FIG. 1A. In the vehicle display device of the present invention, it is a schematic diagram for demonstrating the relationship between the viewpoint position of the user, the virtual image visually recognized by the user, and the range of distance on the road surface of the landscape on which the virtual image is superimposed. It is a figure which shows the relationship between the position of a user's viewpoint and the image displayed by the image display part of the vehicle display device shown in FIG. 1A. It is a figure which shows the relationship between the position of a user's viewpoint and the image displayed by the image display part of the vehicle display device shown in FIG. 1A. It is a figure which shows the relationship between the position of a user's viewpoint and the image displayed by the image display part of the vehicle display device shown in FIG. 1A. In the vehicle display device of the present invention, it is a schematic diagram for demonstrating the relationship between the viewpoint position of the user, the virtual image visually recognized by the user, and the range of distance on the road surface of the landscape on which the virtual image is superimposed. It is a figure which shows the corrected use area set in the image display part of the vehicle display device in 2nd Embodiment. It is a figure which shows the corrected use area and the image set in the image display part of the vehicle display device in 3rd Embodiment. It is a figure which shows the corrected use area and the image set in the image display part of the vehicle display device in 3rd Embodiment. In the vehicle display device shown in Patent Document 1 (Japanese Unexamined Patent Publication No. 2014-210537), the relationship between the viewpoint position of the user, the virtual image visually recognized by the user, and the range of the distance on the road surface of the landscape on which the virtual image is superimposed. It is a schematic diagram for demonstrating.

Hereinafter, examples of the present invention will be described in detail with reference to the drawings as appropriate. However, well-known matters and detailed explanations for substantially the same configuration may be omitted. The gist of the present invention is not limited to the accompanying drawings and the following description, and various modifications can be made without departing from the present invention.

<< First Embodiment >> An example of the overall configuration of the vehicle display device 10 of the present invention will be described with reference to FIGS. 1A, 1B, and 1C. In order to facilitate the following explanation, as shown in FIG. 1A, in the real space, for example, the z-axis is defined in the vehicle front-rear direction with the traveling direction of the vehicle 1 as the vehicle front direction, and the vertical direction (vehicle 1). When the road surface on which the vehicle travels is horizontal, the y-axis is defined in the vertical direction), and the x-axis is defined in the left-right direction (vehicle left-right direction) facing the vehicle front direction. At this time, the x-axis positive direction represents the vehicle left direction, the y-axis positive direction represents the upper side in the vertical direction (upward direction in the real space), and the z-axis positive direction represents the vehicle front direction.

As shown in FIG. 1A, the vehicle display device 10 includes an image display unit 20, an image generation unit 30, a viewpoint position acquisition unit 40, a projection unit 50, and a front information acquisition unit 60.

As shown in FIG. 1B, the image display unit 20 has a display surface 21 capable of displaying an image. The area 210 of the display surface 21 on which an image can be displayed is referred to as, for example, a display area 210. As shown in FIG. 1B, an example of the display surface 21 is, for example, a liquid crystal panel 21 having a plurality of pixels 22. In the liquid crystal panel 21, the display area 210 is, for example, the pixels 22 of the entire liquid crystal panel 21. An example of the image display unit 20 is, for example, a liquid crystal panel module 20 having a liquid crystal panel 21 and a drive circuit 26 of the liquid crystal panel 21.

For example, when the image display unit 20 inputs a signal representing an image generated by the image generation unit 30, at least a part of the display surface 21 in the used area 210 of the display surface 21 according to the input signal. An image is displayed using the pixel 22. In the following description, the liquid crystal panel module 20 will be used as an example of the image display unit 20, but the image display unit 20 may be another display device. For example, the image display unit 20 may be a self-luminous display panel module such as an organic EL (Electro Luminescence) element, or a reflective type such as a DMD (Digital Micromirror Device) or an LCoS (Liquid Crystal on Silicon) (registered trademark). It may be a display panel module, a scanning display device that scans a laser beam, or the like. When the image display unit 20 is a projection type display device such as a reflection type display panel module or a scanning type display device, the display surface 21 is a screen on which an image is generated by the projected light from the projection type display device. Applicable.

In order to facilitate the following description, as shown in FIG. 1B, the Ix axis is defined and displayed in the lateral direction of the display surface 21 from the viewpoint when the display surface 21 of the image display unit 20 is viewed from the front. The Iy axis is defined in the vertical direction of the surface 21. At this time, the positive direction of the Ix axis represents the left direction of the display surface 21, and the positive direction of the Iy axis represents the upward direction of the display surface 21. Further, the Ix-axis positive direction on the display surface 21 corresponds to, for example, the above-mentioned x-axis positive direction, that is, the vehicle left direction in the real space. Similarly, the Iy-axis positive direction on the display surface 21 corresponds to, for example, the y-axis positive direction described above, that is, the upper vertical direction (vertically upward direction) in the real space.

The viewpoint position acquisition unit 40 includes, for example, a vehicle interior image acquisition unit 41 and a vehicle interior image analysis unit 42. The viewpoint position acquisition unit 40 acquires the position 100 of the viewpoint of the user sitting in the driver's seat of the vehicle 1. Hereinafter, the position 100 of the viewpoint of the user sitting in the driver's seat of the vehicle 1 is also referred to as the user viewpoint position 100. The viewpoint position acquisition unit 40 is configured to be able to acquire the user viewpoint position 100 at least in the y-axis direction.

The vehicle interior image acquisition unit 41 is, for example, an in-vehicle camera that captures an image of the vehicle interior. The vehicle interior image acquisition unit 41 may be, for example, a shared in-vehicle camera or the like attached for the purpose of preventing vehicle theft or the like, or may be an in-vehicle camera or the like dedicated to the vehicle display device 10. The vehicle interior image acquisition unit 41 preferably captures the user viewpoint position 100 from below the user viewpoint position 100 in the vertical direction, and may be attached to, for example, a dashboard 4. Further, it is preferable that the vehicle interior image acquisition unit 41 can perform infrared imaging so that the user viewpoint position 100 can be acquired even when the vehicle interior is dark. The vehicle interior image acquisition unit 41 outputs, for example, the acquired vehicle interior image to the vehicle interior image analysis unit 42.

The vehicle interior image analysis unit 42 analyzes the input vehicle interior image by using, for example, known image processing, a pattern matching method, or the like. As a result of analyzing the input image of the front of the vehicle, the vehicle interior image analysis unit 42 analyzes the input image of the vehicle interior, and when the input image of the vehicle interior includes the face of the user sitting in the driver's seat, the user's viewpoint position 100, for example, in the real space. By specifying the coordinates (y), the user viewpoint position 100 is acquired. For example, the vehicle interior image analysis unit 42 outputs the acquired user viewpoint position 100 to the image generation unit 30 via the bus 5 such as CAN (Controller Area Network) bus communication. Here, the vehicle interior image analysis unit 42 may be included in the vehicle interior camera, for example, and the vehicle interior image analysis unit 42 may include the function of the vehicle interior image analysis unit 42. Further, the image generation unit 30 may directly input the user viewpoint position 100 from the vehicle interior image analysis unit 42 without going through the bus 5.

The forward information acquisition unit (road shape information acquisition unit) 60 includes, for example, a front image acquisition unit 61 and a front image analysis unit 62. The front information acquisition unit 60 obtains, for example, information on the front of the vehicle such as the shape of the road in the front direction of the vehicle, position information of other vehicles and obstacles in the front direction of the vehicle, information on road signs in the front direction of the vehicle, and the like. get.

The front image acquisition unit 61 is, for example, an outside camera that captures an image of the front of the vehicle. The front image acquisition unit 61 may be, for example, a shared out-of-vehicle camera used in a drive recorder or the like, or an out-of-vehicle camera or the like dedicated to the vehicle display device 10. The external camera may be a monocular camera, but the external camera is preferably a stereo camera in order to accurately acquire the distance between the object existing in front of the vehicle and the own vehicle 1. Further, the camera outside the vehicle may be capable of infrared imaging so that an image of the front of the vehicle can be captured even when the front of the vehicle is dark. The front image acquisition unit 61 outputs, for example, the acquired image of the front of the vehicle to the front image analysis unit 62.

The front image analysis unit 62 analyzes the input image in front of the vehicle by using, for example, known image processing, a pattern matching method, or the like. By analyzing the input image in front of the vehicle, the front image analysis unit 62 analyzes the road shape information (lane, white line, stop line, pedestrian crossing, road width, number of lanes, intersection, curve, etc.) regarding the road shape in front of the vehicle. Fork road, etc.) is acquired. Further, the front image analysis unit 62 analyzes the input image in front of the vehicle to obtain the position and size of other vehicles and obstacles existing in front of the vehicle, the distance to the own vehicle 1, and the own vehicle 1. Acquire obstacle information such as relative speed of. For example, the forward image analysis unit 62 outputs the acquired forward information to the image generation unit 30 via the bus 5. Here, the front image analysis unit 62 may be provided, for example, in the camera outside the vehicle, and the image generation unit 30 may include the function of the front image analysis unit 62. Further, the image generation unit 30 may directly input forward information including road shape information from the forward image analysis unit 62 without going through the bus 5.

Further, the front information acquisition unit 60 has a laser radar, a millimeter wave radar, an ultrasonic sensor, another known sensor, or the like in place of the front image acquisition unit 61 or in combination with the front image acquisition unit 61. May be good. At this time, the front image analysis unit 62 inputs data output by a laser radar, a millimeter-wave radar, an ultrasonic sensor, a known sensor, or the like in place of the image in front of the vehicle or in combination with the image in front of the vehicle. The forward information as described above may be acquired by the analysis.

Further, in FIG. 1A, the vehicle interior image acquisition unit 41 and the front image acquisition unit 61 are shown to be attached to different locations in the vehicle 1, but this is not necessarily the case. The 41 and the front image acquisition unit 61 may be attached to the same location of the vehicle 1. Further, the vehicle interior image acquisition unit 41 and the front image acquisition unit 61 may be provided in one and the same housing.

The road shape information acquisition unit 60 that acquires the road shape information in front of the vehicle 1 in the present invention can store and read the road shape information in front of the vehicle 1 by itself based on the position information of the vehicle 1 or a network. It may be replaced by a navigation device that can be acquired by the above-mentioned means, or may be configured in combination with the above-mentioned means by image analysis.

The image generation unit 30 includes a processing unit 31 and a storage unit 32. The processing unit 31 has, for example, one or more microprocessors, a microcontroller, an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), an arbitrary other IC (Integrated Circuit), and the like. The storage unit 32 is, for example, a rewritable RAM (Random Access Memory), a read-only ROM (Read Only Memory), an non-erasable program read-only EEPROM (Electrically Erasable Programmable Read-Only Memory), and a non-volatile memory. It has one or more memories capable of storing a program such as a flash memory and / or data.

The image generation unit 30 determines a use area 220, which is a part of the display area 210 of the display surface 21 of the image display unit 20, which is used for displaying an image, according to the user viewpoint position 100 input from the viewpoint position acquisition unit 40. To do. The used area 220 is, for example, the range 220 of the pixels 22 used for displaying an image in the display area 210 which is the entire pixels 22 of the liquid crystal panel 21 in the example of the image display unit 20 shown in FIG. 1B.

For example, the storage unit 32 of the image generation unit 30 stores a table in which the user viewpoint position 100 and the parameters for determining the used area 220 corresponding to the user viewpoint position 100 are associated with each other. The image generation unit 30 determines the use area 220 corresponding to the input user viewpoint position 100 by referring to the table, for example, by the processing unit 31.

Further, for example, the storage unit 32 of the image generation unit 30 stores an arithmetic expression for determining the used area 220 corresponding to the user viewpoint position 100. The image generation unit 30 determines the use area 220 corresponding to the input user viewpoint position 100 by, for example, the processing unit 31 calculating an arithmetic expression. The relationship between the user viewpoint position 100 and the used area 220 corresponding to the user viewpoint position 100 will be described later.

Further, the image generation unit 30 uses the used area 220 so that the upper end of the visible virtual image area 300 is shortened so as to approach the lower end in accordance with the road shape information regarding the road shape in front of the vehicle input from the front information acquisition unit 60. Correct the size of. The process of correcting the size of the used area 220 according to the road shape will be described later.

The projection unit 50 projects the image displayed by the image display unit 20 toward the translucent member 2 such as the front window shield 2 of the vehicle 1. The light 80 constituting the projected image is reflected in the vehicle interior by the front window shield 2. Hereinafter, the light 80 constituting the image is also referred to as an image light 80. The projection unit 50 projects an image so that the image light 80 reflected by the front window shield 2 is incident toward the user viewpoint position 100. Further, the translucent member 2 of the vehicle 1 may be a combiner provided in the vehicle 1.

A user sitting in the driver's seat has a virtual image 310 (see FIG. 2) on a virtual virtual image region 300 generated on the front side of the vehicle with reference to the front window shield 2 when the image light 80 is incident on the user viewpoint position 100. ) Can be visually recognized. For example, the user can visually recognize the virtual image 310 on the virtual image region 300 in a state where at least a part of the scenery seen through the front window shield 2 and the virtual image region 300 are superimposed. In the virtual image region 300, for example, a virtual image 310 which is a virtual image of the image displayed on the display surface 21 of the image display unit 20 is visually recognized.

An example of the structure of the projection unit 50 will be described with reference to FIG. 1C. The projection unit 50 houses, for example, an optical system such as a plane mirror 54 and a concave mirror 55 and an actuator 56 inside the housing 51. The housing 51 includes, for example, an upper case 52 and a lower case 53 that are arranged in the dashboard 4 of the vehicle 1 and are formed of a black light-shielding synthetic resin or the like. An upper case opening 52a is provided substantially in the middle of the upper case 52 in the z-axis direction. The upper case opening 52a is covered with, for example, a transparent cover 57 made of a transparent translucent synthetic resin or the like. For example, a lower case opening 53a is provided on the vehicle rear side of the lower case 53. The lower case opening 53a is provided in the lower case 53, for example, so that the image light 80 emitted from the display surface 21 of the image display unit 20 attached to the outside of the housing 51 can be incident.

The plane mirror 54 is attached to the vehicle rear side of the lower case 53 via, for example, an attachment member (not shown). The mounting position and mounting angle of the plane mirror 54 are fixed so as to reflect the image light 80 emitted from the display surface 21 incident from the lower case opening 53a toward the front of the vehicle, for example.

The concave mirror 55 is attached to the front side of the vehicle from the plane mirror 54 of the lower case 53 via an actuator 56, for example. The mounting angle of the concave mirror 55 can be rotated by the actuator 56, for example, with the x-axis as the rotation axis. The position of the concave mirror 55 is fixed so as to enter the image light 80 reflected by the plane mirror 54, and the mounting angle of the concave mirror 55 is finely adjusted so as to reflect the incident image light 80 toward the front window shield 2. .. Depending on the mounting angle, for example, the table or calculation formula for determining the user viewpoint position 100 stored in the storage unit 32 of the image generation unit 30 and the used area 220 corresponding to the user viewpoint position 100 is corrected. To.

The actuator 56 includes, for example, a motor, a speed reduction mechanism, a concave mirror rotating member, and a supporting member for the concave mirror 55, all of which are not shown. The actuator 56 is attached to the lower case 53 on the lower side of the concave mirror 55 in the vertical direction via, for example, an attachment member (not shown). The actuator 56 rotates the motor in response to a signal input from an actuator control unit (not shown), decelerates the rotation of the motor by a reduction mechanism, transmits the rotation to the concave mirror rotating member, and rotates the concave mirror 55. The actuator 56 does not necessarily have to be provided.

Further, in the upper case 52 of the housing 51 of FIG. 1C, a light-shielding portion 52b is provided between the upper case opening 52a and the plane mirror 54. The light-shielding portion 52b is provided, for example, to prevent light incident from the outside of the housing 51 incident from the upper case opening 52a from traveling to the image display portion 20. The example of the structure of the projection unit 50 described with reference to FIG. 1C is only an example, and does not limit the structure of the projection unit 50 of the vehicle display device 10 at all.

FIG. 2 shows an example of a landscape and a virtual image 310 that a user sitting in the driver's seat of the vehicle 1 can see through the front window shield 2. In the example shown in FIG. 2, as an example of the scenery seen through the front window shield 2, a three-lane road (road 91) extending in front of the vehicle and another vehicle (front vehicle 92) existing in front of the vehicle are shown. .. In the example of the landscape seen through the front window shield 2 shown in FIG. 2, the superimposed object 90 on which the virtual image 310 is superimposed is a road 91 or a vehicle in front 92. In the example shown in FIG. 2, the virtual image 310 is a navigation mark 311 superimposed on the road 91 and visually recognized, and a notification mark 312 superimposed on the vehicle in front 1 and visually recognized by the user.

Further, in the example shown in FIG. 2, the area 300 is an area used for displaying the virtual image 310 corresponding to the used area 220 on the display surface 21 of the image display unit 20. Hereinafter, the area 300 corresponding to the used area 220 on the display surface 21 of the image display unit 20 is also referred to as a virtual image area 300. That is, the virtual image area 300 is an area in which the user can visually recognize the virtual image 310.

Further, the Ix-axis positive direction on the display surface 21 of the image display unit 20 of FIG. 1B corresponds to, for example, the x-axis positive direction in the virtual image region 300, that is, the vehicle left direction. Similarly, the Iy-axis positive direction on the display surface 21 of the image display unit 20 of FIG. 1B corresponds to, for example, the y-axis positive direction, that is, the upper side in the vertical direction in the virtual image region 300.

An example of the operation of the vehicle display device 10 will be described with reference to FIG. The operation of the vehicle display device 10 is, for example, a predetermined standby from when the power of the vehicle 1 is turned on, when an engine (not shown) is driven, or when the power of the vehicle 1 is turned on or the engine is driven. It starts after some time has passed.

In step S01, the forward information acquisition unit 60 acquires forward information (road shape information and obstacle information). In step S02, the viewpoint position acquisition unit 40 acquires the user viewpoint position 100. Note that steps S01 and S02 do not necessarily have to be in this order, and the order may be changed.

In step S03, the image generation unit 30 generates an image including, for example, a notification mark, a navigation mark, and other marks according to the forward information acquired by the forward information acquisition unit 60 in step S01.

In step S04, the image generation unit 30 determines the used area 220 of the display area 210 of the display surface 21 of the image display unit 20 according to the user viewpoint position 100 acquired by the viewpoint position acquisition unit 40 in step S02. .. Note that steps S03 and S04 do not necessarily have to be in this order, and the order may be changed. Further, the image generation unit 30 corrects the size of the used area 220 according to the road shape information acquired by the forward information acquisition unit 60 in step S01.

In step S05, the image display unit 20 displays the image generated in step S03 using the total number of pixels 22 in the used area 220 determined by the image generation unit 30 in step S04. When the process of step S05 is executed, the flow returns to Start. Here, a predetermined wait until the flow returns to Start after the execution of the process of step S05 is completed so that the flowchart shown in FIG. 3 is repeatedly executed at predetermined predetermined intervals. Time may be inserted.

The relationship between the user viewpoint position 100 and the used area 220 corresponding to the user viewpoint position 100 will be described with reference to FIGS. 4A, 4B, 4C, 4D, 4E, and 5. On the left side of FIGS. 4A, 4B, 4C, 4D and 4E, coordinate axes representing the user viewpoint position 100 on the y-axis and z-axis in real space are shown. Further, on the right side of FIGS. 4A, 4B, 4C, 4D and 4E, the display surface 21 of the image display unit 20 is displayed corresponding to the user viewpoint position 100 on the y-axis and z-axis in the real space. Of the areas 210, the used area 220 used for displaying the image, which is determined by the image generation unit 30, is shown.

FIG. 5 is a schematic diagram for explaining the relationship between the user's viewpoint position 100 in the vertical direction, the virtual image region 300, and the distance range on the road 91 of the landscape in which the virtual image region 300 overlaps in the vehicle display device 10. It is a figure. Note that FIG. 5 shows the relationship between the user viewpoint position 100 in the vertical direction, the virtual image region 300, and the distance range on the road 91 of the landscape in which the virtual image region 300 overlaps in an easy-to-understand manner. The amount of change in is exaggerated. Specifically, the distances between the user viewpoint position 100r and the user viewpoint position 100u and the user viewpoint position 100r and the user viewpoint position 100d shown in FIG. 5 in the vertical direction are actually closer. As a result, FIG. 5 shows that the virtual image region 300r, the virtual image region 300u, and the virtual image region 300d do not overlap each other. However, as shown in FIGS. 4B and 4C, in reality, at least a part of the virtual image region 300r and the virtual image region 300u, the virtual image region 300r and the virtual image region 300d overlap. The range of the distance on the road 91 of the landscape in which the virtual image region 300 is superimposed is also hereinafter referred to as the superimposed distance range 400.

5 shows a virtual image region 300r when the user viewpoint position is 100r shown in FIG. 4A, a virtual image region 300u when the user viewpoint position is 100u shown in FIG. 4B, and a user viewpoint position 100d shown in FIG. 4C. The virtual image region of 300d is shown. Further, in FIG. 5, among the landscapes seen through the front window shield 2 when the user viewpoint position is 100r, the superimposed distance range 400r, which is the range of the distance on the road 91 of the landscape overlapping with the virtual image region 300r, and the user viewpoint position. Of the scenery that can be seen through the front window shield 2 at 100u, the overlapping distance range 400u, which is the range of the distance on the road 91 of the scenery that overlaps with the virtual image area 300u, and the front window shield 2 at the user viewpoint position 100d. Of the visible landscapes, the superimposed distance range 400d, which is the range of the distance on the road 91 of the landscape that overlaps with the virtual image region 300d, is shown.

First, the relationship between the user viewpoint position 100 in the vertical direction and the usage area 220 corresponding to the user viewpoint position 100 in the vertical direction will be described. The user viewpoint position 100r shown in FIG. 4A is represented at the intersection of the y-axis and the z-axis in the coordinate axes shown in FIG. 4A. Hereinafter, the user viewpoint position 100r shown in FIG. 4A is also referred to as a reference user viewpoint position 100r. For example, when the user viewpoint position 100 acquired in step S02 shown in FIG. 3 is the reference user viewpoint position 100r, in step S04 shown in FIG. 3, the image generation unit 30 is the display surface 21 of the image display unit 20. Of the display area 210 of the above, the used area 220 is determined to be the used area 220r shown in FIG. 4A. Hereinafter, the used area 220r corresponding to the reference user viewpoint position 100r shown in FIG. 4A is also referred to as a reference used area 220r.

The user viewpoint position 100u shown in FIG. 4B is an example of the user viewpoint position 100 located on the upper side in the vertical direction with respect to the reference user viewpoint position 100r. For example, when the user viewpoint position 100 acquired in step S02 shown in FIG. 3 is the user viewpoint position 100u, in step S04 shown in FIG. 3, the image generation unit 30 is the display surface 21 of the image display unit 20. Of the display area 210, the used area 220 is determined to be the used area 220u shown in FIG. 4B.

The used area 220u shown in FIG. 4B is located on the positive side of the Iy axis as compared with the reference used area 220r. Further, the length 221u in the Iy axis direction in the used area 220u shown in FIG. 4B is longer than the length 221r in the Iy axis direction in the reference used area 220r. As a result, as shown in FIG. 5, the virtual image region 300u corresponding to the used region 220u is located on the upper side in the vertical direction in the real space as compared with the virtual image region 300r corresponding to the reference used region 220r, and The vertical length in real space becomes longer. The used area 220u overlaps with a part of the reference used area 220r.

That is, as the user viewpoint position 100 detected by the viewpoint position acquisition unit 40 moves upward in the vertical direction, the position of the used area 220 of the display surface 21 is determined to be located on the positive side of the Iy axis. Further, as the user viewpoint position 100 detected by the viewpoint position acquisition unit 40 moves upward in the vertical direction, the length of the used area 220 of the display surface 21 in the Iy axis direction is determined to be longer. As a result, as the user viewpoint position 100 detected by the viewpoint position acquisition unit 40 moves upward in the vertical direction, the virtual image region 300 is located on the upper side in the vertical direction in the real space and has a length in the vertical direction in the real space. Becomes longer.

The user viewpoint position 100d shown in FIG. 4C is an example of the user viewpoint position 100 located on the lower side in the vertical direction as compared with the reference user viewpoint position 100r. For example, when the user viewpoint position 100 acquired in step S02 shown in FIG. 3 is the user viewpoint position 100d, in step S04 shown in FIG. 3, the image generation unit 30 is the display surface 21 of the image display unit 20. Of the display area 210, the used area 220 is determined to be the used area 220d shown in FIG. 4C.

The used area 220d shown in FIG. 4C is located on the negative direction side of the Iy axis as compared with the reference used area 220r. Further, the length 221d in the Iy axis direction in the used area 220d shown in FIG. 4C is shorter than the length 221r in the Iy axis direction in the reference used area 220r. As a result, as shown in FIG. 5, the virtual image region 300d corresponding to the used region 220d shown in FIG. 4C is on the lower side in the vertical direction in the real space as compared with the virtual image region 300r corresponding to the reference used region 220r. It is located in the real space and has a short vertical length. The used area 220d overlaps with a part of the reference used area 220r.

That is, as the user viewpoint position 100 detected by the viewpoint position acquisition unit 40 moves downward in the vertical direction, the position of the used area 220 of the display surface 21 is determined to be located on the negative direction side of the Iy axis. Further, as the user viewpoint position 100 detected by the viewpoint position acquisition unit 40 moves downward in the vertical direction, the length of the used area 220 of the display surface 21 in the Iy axis direction is determined to be shorter. As a result, as the user viewpoint position 100 detected by the viewpoint position acquisition unit 40 moves downward in the vertical direction, the virtual image region 300 is located below the vertical direction in the real space and in the vertical direction in the real space. The length of is shortened.

Here, referring to FIG. 5, the superimposition distance range 400r, the superimposition distance range 400u, and the superimposition distance range 400d coincide with each other. As in the example shown in FIG. 5, the amount of change in the virtual image region 300 in the vertical direction is smaller than the amount of change in the user's viewpoint position 100 in the vertical direction. Then, for example, as the user's viewpoint position 100 moves upward in the vertical direction, the angle between the line of sight of the user looking at the virtual image region 300 and the horizontal plane increases. On the other hand, for example, as the user viewpoint position 100 moves downward in the vertical direction, the angle between the line of sight of the user looking at the virtual image region 300 and the horizontal plane becomes smaller.

As a result, in order to keep the superposed distance range 400 constant without being affected by the user viewpoint position 100 in the vertical direction, the vertical position of the virtual image region 300 is vertically moved as the user viewpoint position 100 moves upward in the vertical direction. It is necessary to increase the length in the vertical direction as well as the upper side in the direction. Similarly, in order to keep the superposed distance range 400 constant without being affected by the user viewpoint position 100 in the vertical direction, the vertical position of the virtual image region 300 is set as the user viewpoint position 100 moves downward in the vertical direction. It is necessary to shorten the length in the vertical direction as well as the lower side in the vertical direction.

That is, by appropriately determining the position of the used area 220 on the Iy axis and the length on the Iy axis according to the user viewpoint position 100 in the vertical direction, the superimposition is performed without being affected by the user viewpoint position 100 in the vertical direction. The distance range 400 can be made constant. By making the superimposition distance range 400 constant, it is possible to cope with the deviation of the object in the landscape on which the virtual image 310 visually recognized by the user is superposed.

Subsequently, the relationship between the user viewpoint position 100 in the vehicle front-rear direction and the usage area 220 corresponding to the user viewpoint position 100 in the vehicle front-rear direction will be described. The user viewpoint position 100f shown in FIG. 4D is an example of the user viewpoint position 100 located in the front direction of the vehicle as compared with the reference user viewpoint position 100r. For example, when the user viewpoint position 100 acquired in step S02 shown in FIG. 3 is the user viewpoint position 100f, in step S04 shown in FIG. 3, the image generation unit 30 is the display surface 21 of the image display unit 20. Of the display area 210, the used area 220 is determined to be the used area 220f shown in FIG. 4D.

Both the length 222f in the Ix axis direction and the length 221f in the Iy axis direction in the use area 220f shown in FIG. 4D are compared with the length 222r in the Ix axis direction and the length 221r in the Iy axis direction in the reference use area 220r. And it's getting shorter. As a result, the virtual image region 300 corresponding to the used region 220f shown in FIG. 4D has a length in the vehicle left-right direction and a length in the vertical direction in the real space as compared with the virtual image region 300 corresponding to the reference used region 220r. Both are short.

That is, as the user viewpoint position 100 detected by the viewpoint position acquisition unit 40 moves toward the front of the vehicle, both the length of the used area 220 of the display surface 21 in the Ix axis direction and the length in the Iy axis direction become shorter. Will be decided. As a result, as the user viewpoint position 100 detected by the viewpoint position acquisition unit 40 moves toward the front of the vehicle, the virtual image region 300 becomes shorter in both the left-right direction and the vertical length of the vehicle in the real space. ..

The user viewpoint position 100b shown in FIG. 4E is an example of the user viewpoint position 100 located in the rear direction of the vehicle as compared with the reference user viewpoint position 100r. For example, when the user viewpoint position 100 acquired in step S02 shown in FIG. 3 is the user viewpoint position 100b, in step S04 shown in FIG. 3, the image generation unit 30 is the display surface 21 of the image display unit 20. Of the display area 210, the used area 220 is determined to be the used area 220b shown in FIG. 4E.

Both the length 222b in the Ix axis direction and the length 221b in the Iy axis direction in the use area 220b shown in FIG. 4E are compared with the length 222r in the Ix axis direction and the length 221r in the Iy axis direction in the reference use area 220r. And it's getting longer. As a result, the virtual image region 300 corresponding to the used region 220b shown in FIG. 4E has a length in the vehicle left-right direction and a length in the vertical direction in the real space as compared with the virtual image region 300 corresponding to the reference used region 220r. Both are long.

That is, as the user viewpoint position 100 detected by the viewpoint position acquisition unit 40 moves toward the rear of the vehicle, both the length of the used area 220 of the display surface 21 in the Ix axis direction and the length in the Iy axis direction become longer. Will be decided. As a result, as the user viewpoint position 100 detected by the viewpoint position acquisition unit 40 moves toward the rear of the vehicle, the virtual image region 300 becomes longer in both the left-right direction and the vertical length of the vehicle in the real space. ..

For example, assuming that the virtual image region 300 is constant, the closer the distance between the user viewpoint position 100 and the virtual image region 300 (distance in the front-rear direction of the vehicle) is, the more the scenery seen through the front window shield 2 from the user viewpoint position 100 The range of the landscape that overlaps with the virtual image region 300 becomes wide. On the other hand, the farther the distance between the user viewpoint position 100 and the virtual image area 300 (distance in the front-rear direction of the vehicle) is, the more the scenery seen from the user viewpoint position 100 through the front window shield 2 overlaps with the inside of the virtual image area 300. The range of is narrowed.

As a result, in order to keep the range of the landscape superimposed on the virtual image region 300 without being affected by the user viewpoint position 100 in the vehicle front-rear direction, the virtual image region 300 as the user viewpoint position 100 moves toward the front of the vehicle. It is necessary to shorten both the left-right length and the vertical length of the vehicle. Similarly, in order to keep the range of the landscape superimposed on the virtual image region 300 without being affected by the user viewpoint position 100 in the vehicle front-rear direction, the virtual image region 300 as the user viewpoint position 100 moves toward the rear of the vehicle. It is necessary to increase both the left-right length and the vertical length of the vehicle.

That is, by appropriately determining the length of the used area 220 on the Ix axis and the length on the Iy axis according to the user viewpoint position 100 in the vehicle front-rear direction, the user viewpoint position 100 in the vehicle front-rear direction is affected. However, the range of overlapping landscapes can be made constant. By making the range of the superimposed landscape constant, it is possible to deal with the deviation of the object in the landscape on which the virtual image 310 visually recognized by the user is superimposed.

Next, with reference to FIGS. 6A, 6B, 6C, and 7, the relationship between the user viewpoint position 100 and the used area 220 corresponding to the forward information including the road shape information acquired by the forward information acquisition unit 60. explain. On the left side of FIGS. 6A, 6B, and 6C, coordinate axes representing the user's viewpoint position 100 on the y-axis and z-axis in real space are shown. Further, on the right side of FIGS. 6A, 6B, and 6C, an image of the display area 210 of the display surface 21 of the image display unit 20 corresponding to the user viewpoint position 100 on the y-axis and the z-axis in the real space. The used area 220 used for displaying the image, which is determined by the generation unit 30, is shown. The image generation unit 30 approaches the lower end of the used area 220 determined by the user viewpoint position 100 in the virtual image area 300 according to the forward information including the road shape acquired by the forward information acquisition unit 60 in step S01. The correction is made short so as to obtain the correction use area 221. Specifically, the image generation unit 30 has a road shape in front of the vehicle 1 such as a curve or a T-shaped road based on the road shape information acquired by the front information acquisition unit 60 in step S01, and is one of the virtual image regions 300. When it is determined that the portion does not overlap with the road, the area of the used area 220 corresponding to the upper end side of the virtual image area 300 that does not overlap with the road is set as the unused area 222 that does not display the image, and the other areas are set to the unused area 222. The correction use area 221 that can display an image is set.

FIG. 7 shows a vehicle display device 10, a corrected virtual image region 301 corrected by the user's viewpoint position 100 in the vertical direction, a road shape in front of the vehicle 1, and a landscape road 91 on which the corrected virtual image region 301 overlaps. It is a schematic diagram for demonstrating the relationship with the range of a distance. Note that FIG. 7 shows the relationship between the user viewpoint position 100 in the vertical direction, the corrected virtual image region 301, and the distance range on the road 91 of the landscape on which the corrected virtual image region 300 overlaps in an easy-to-understand manner. The amount of change of 100 is exaggerated.

7 shows a corrected virtual image region 301r at the user viewpoint position 100r shown in FIG. 6A, a corrected virtual image region 301u at the user viewpoint position 100u shown in FIG. 6B, and a user viewpoint position 100d shown in FIG. 6C. The corrected virtual image region 301d at the time of is shown. Further, FIG. 7 shows the corrected superimposed distance range 401r, which is the range of the distance on the road 91 of the landscape that overlaps with the corrected virtual image region 301r, among the landscapes that can be seen through the front window shield 2 when the user's viewpoint position is 100r. Of the scenery that can be seen through the front window shield 2 when the viewpoint position is 100u, the corrected superimposed distance range 401u, which is the range of the distance on the road 91 of the scenery that overlaps with the corrected imaginary image area 301u, and the front window when the user viewpoint position is 100d. Of the landscape seen through the shield 2, the corrected superimposed distance range 401d, which is the range of the distance on the road 91 of the landscape that overlaps with the corrected virtual image region 301d, is shown. Further, in FIG. 7, among the landscapes seen through the front window shield 2 when the user viewpoint position is 100r, the virtual image is displayed by the road shape in front of the vehicle 1 in the virtual image area 300r determined by the user viewpoint position 100r. Of the non-superimposed distance range 402r, which is the range of distances on the road 91, and the landscape that can be seen through the front window shield 2 when the user's viewpoint position is 100u, the virtual image region 300u determined by the user's viewpoint position 100u. Of the non-superimposed distance range 402u, which is the range of the distance on the road 91 of the landscape where the virtual image is not displayed due to the shape of the road in front of the vehicle 1, and the landscape seen through the front window shield 2 when the user's viewpoint position is 100d. Of the virtual image area 300d determined by the user's viewpoint position 100d, the non-superimposed distance range 402d, which is the range of the distance on the landscape road 91 in which the virtual image is not displayed due to the road shape in front of the vehicle 1, is shown. ..

First, the relationship between the user's viewpoint position 100 in the vertical direction and the used area 220 corresponding to the road shape in front of the vehicle 1 will be described. For example, when the user viewpoint position 100 acquired in step S02 shown in FIG. 3 is the reference user viewpoint position 100r, the road and the road are based on the front information indicating the road shape in front of the vehicle 1 acquired in step S01. The area 222r of the used area 220r corresponding to a part of the non-overlapping virtual image area 300r is set to the unused area 222r that does not display an image, and the other area 221r is set to the corrected used area 221r that can display an image. .. Hereinafter, the correction use area 221r corresponding to the reference user viewpoint position 100r shown in FIG. 6A is also referred to as a reference correction use area 221r, and the unused area 222r is also referred to as a reference non-use area 222r.

The user viewpoint position 100u shown in FIG. 6B is an example of the user viewpoint position 100 located on the upper side in the vertical direction with respect to the reference user viewpoint position 100r. For example, when the user viewpoint position 100 acquired in step S02 shown in FIG. 3 is the user viewpoint position 100u, it is superimposed on the road based on the front information indicating the road shape in front of the vehicle 1 acquired in step S01. The area 222u of the used area 220u corresponding to a part of the virtual image area 300u is set to the unused area 222u that does not display the image, and the other area 221u is set to the corrected used area 221u that can display the image.

The length 221ua in the Iy axis direction in the correction use area 221u shown in FIG. 6B is longer than the length 221ra in the Iy axis direction in the reference correction use area 221r. As a result, as shown in FIG. 7, the length of the corrected virtual image region 301u in the real space in the vertical direction becomes long.

That is, as the user viewpoint position 100 detected by the viewpoint position acquisition unit 40 moves upward in the vertical direction, the position of the correction use area 221 of the display surface 21 is determined to be located on the positive direction side of the Iy axis. Further, as the user viewpoint position 100 detected by the viewpoint position acquisition unit 40 moves upward in the vertical direction, the length of the correction use area 221 of the display surface 21 in the Iy axis direction is determined to be longer. As a result, as the user viewpoint position 100 detected by the viewpoint position acquisition unit 40 moves upward in the vertical direction, the corrected imaginary image region 301 is located on the upper side in the vertical direction in the real space and is in the vertical direction in the real space. The length becomes longer.

The user viewpoint position 100d shown in FIG. 6C is an example of the user viewpoint position 100 located on the lower side in the vertical direction as compared with the reference user viewpoint position 100r. For example, when the user viewpoint position 100 acquired in step S02 shown in FIG. 3 is the user viewpoint position 100d, it is superimposed on the road based on the front information indicating the road shape in front of the vehicle 1 acquired in step S01. The area 222d of the used area 220d corresponding to a part of the virtual image area 300d is set to the unused area 222d where the image is not displayed, and the other area 221d is set to the corrected used area 221d where the image can be displayed.

The length 221da in the Iy axis direction in the correction use area 221d shown in FIG. 6C is shorter than the length 221ra in the Iy axis direction in the reference correction use area 221r. As a result, as shown in FIG. 7, the length of the corrected virtual image region 301d in the real space in the vertical direction is shortened.

That is, as the user viewpoint position 100 detected by the viewpoint position acquisition unit 40 moves downward in the vertical direction, the position of the correction use area 221 of the display surface 21 is determined to be located on the negative direction side of the Iy axis. Further, as the user viewpoint position 100 detected by the viewpoint position acquisition unit 40 moves downward in the vertical direction, the length of the correction use area 221 of the display surface 21 in the Iy axis direction is determined to become shorter. As a result, as the user viewpoint position 100 detected by the viewpoint position acquisition unit 40 moves downward in the vertical direction, the corrected imaginary image region 301 is located on the lower side in the vertical direction in the real space and is vertically in the real space. The length of the direction becomes shorter.

That is, according to the road shape, the length in the vertical direction is shortened so that the upper end of the virtual image region 300 approaches the lower end (the size of the used region 220 is reduced to the corrected used region 221) to reduce the size of the used region 220 from the road 91. By displaying the virtual image 310 at an off position (for example, a road shoulder or a wall around the road), it is possible to prevent the viewer from feeling uncomfortable. Further, by appropriately determining the position of the correction use area 221 on the Iy axis and the length on the Iy axis according to the user viewpoint position 100, the correction superimposition distance is not affected by the user viewpoint position 100 in the vertical direction. The range 401 can be constant. By making the correction superimposition distance range 400 constant, it is possible to cope with the deviation of the object in the landscape on which the virtual image 310 visually recognized by the user is superimposed.

As described above, the image generation unit 30 of the vehicle display device 10 of the present invention is used to display the image on the display surface 21 of the image display unit 20 according to the user viewpoint position 100 acquired by the viewpoint position acquisition unit 40. The used area 220 to be used is determined. As a result, not only the position of the virtual image region 300, which is the region corresponding to the used region 220 and the user can visually recognize the virtual image 310, but also the size of the virtual image region 300 can be adjusted. Therefore, the vehicle display device 10 changes the user viewpoint position 100 as compared with the vehicle display device in which only the position of the virtual image region 300 can be adjusted by changing the projection angle of the concave mirror 55 of the projection unit 50, for example. At that time, the object in the landscape on which the virtual image 310 is superimposed is eliminated. Therefore, the vehicle display device 10 of the present invention can provide appropriate information to the user without being affected by the user's viewpoint position 100.

Here, the image generation unit 30 may determine the used area 220 only according to the user viewpoint position 100 in the vertical direction, or determine the used area 220 only according to the user viewpoint position 100 in the vehicle front-rear direction. May be good. However, the change in the user viewpoint position 100 in the vertical direction has a greater effect on the deviation of the object in the landscape on which the virtual image 310 is superimposed than the change in the user viewpoint position 100 in the vehicle front-rear direction. Therefore, it is preferable that the image generation unit 30 determines the use area 220 at least according to the user's viewpoint position 100 in the vertical direction.

Then, in the image generation unit 30 of the vehicle display device 10 of the present invention, the upper end of the virtual image region 300 approaches the lower end according to the road shape information acquired by the road shape information acquisition unit 60, and the vertical direction of the virtual image region 300 is reached. The length of the used area 220 is corrected so that As a result, it is possible to prevent the viewer from feeling uncomfortable by displaying the virtual image 310 at a position off the road 91 (for example, a road shoulder or a wall around the road), and the user's viewpoint in the vertical direction. The corrected superimposed distance range 401, which is the range of the distance where the virtual image region 300 on which the virtual image 310 is displayed overlaps the road 91, can be made constant without being affected by the position 100.

Further, the steps S02 and S04 shown in FIG. 3 described above do not necessarily have to be executed every time. For example, steps S02 and S04 may be executed only when the flow shown in FIG. 3 is executed for the first time after the power of the vehicle 1 is turned on. After that, when the flow shown in FIG. 3 is executed for the second time or later after the power of the vehicle 1 is turned on, the processes of steps S02 and S04 may be omitted. For example, while the user driving the vehicle 1 is not changed, it is unlikely that the user viewpoint position 100 in the vertical direction is significantly changed. Therefore, by acquiring the user viewpoint position 100 that drives the vehicle 1 only once after the power of the vehicle 1 is turned on, for example, it is possible to deal with the shift of the target in the landscape on which the virtual image 310 is superimposed. It is possible to achieve both high speed operation of the vehicle display device 10.

The above is the description of the vehicle display device 10 in the present embodiment, but the present invention is not limited to the above-described embodiment and drawings. Of course, changes can be made to these (including the deletion of components). An example of the modification is shown below.

As shown in FIG. 8, the used area 220 in the present invention is visually recognized as a first used area 230 corresponding to a first virtual image area (not shown) in the virtual image area 300 and located vertically below the first virtual image area. The image generation unit 30 includes at least a second use area 240 corresponding to a second virtual image area (not shown), and the image generation unit 30 has a first position according to the user viewpoint position 100 in the vertical direction acquired by the viewpoint position acquisition unit 40. The position and size of the used area 230 are determined, and the size of the second used area 240 is not changed according to the user's viewpoint position 100 in the vertical direction acquired by the viewpoint position acquisition unit 40. Only the position of 240 may be determined. As a result, when the user viewpoint position 100 changes in the vertical direction, the size of the second virtual image region in the real space corresponding to the second used area 240 hardly changes in the vertical direction. As a result, for example, even when an image composed of characters or the like is displayed in the second used area 240, when the user's viewpoint position changes in the vertical direction, the user moves to the second virtual image area. It is possible to prevent the information displayed in the displayed virtual image from becoming difficult to recognize.

The size of the second used area 240 may be changed according to the user viewpoint position 100 in the vertical direction acquired by the viewpoint position acquisition unit 40. In this case, the rate of change corresponding to the change in the user viewpoint position 100 of the second used area 240 is made smaller than the rate of change of the first used area 230. As a result, the amount of change in the size of the first used area 230 can be suppressed to be smaller than that in the case where only the size of the first used area 230 is changed, and when the user's viewpoint position changes in the vertical direction, It is possible to prevent the user from having difficulty in recognizing the information represented by the virtual image displayed in the first virtual image region.

Further, as shown in FIG. 9A, the image 250 displayed in the display area 210 is from a plurality of images 251 1, 252, and 253 arranged substantially along the Iy axis direction from the Iy axis positive direction side of the display surface 21. When the size of the used area 220 in the Iy axis direction is reduced and corrected to the corrected used area 221 according to the road shape information, only a part of the images 251 and 252 are corrected as shown in FIG. 9B. It may be displayed in the used area 221.

The vehicle display device of the present invention is suitable as a head-up display mounted on a moving body such as a vehicle to allow a viewer to visually recognize a virtual image.

1 ... vehicle, 2 ... front window shield, 10 ... vehicle display device, 20 ... image display unit, liquid crystal panel module, 21 ... display surface, liquid crystal panel, 30 ... image Generation unit, 40 ... viewpoint position acquisition unit, 41 ... vehicle interior image acquisition unit, 42 ... vehicle interior image analysis unit, 50 ... projection unit, 60 ... front information acquisition unit (road shape) Information acquisition unit), 80 ... image light, 100 ... user viewpoint position, 210 ... display area, 220 ... used area, 300 ... virtual image area, 310 ... virtual image, 400 ...・ Superimposed distance range

Claims (5)

The viewpoint position acquisition unit (40) that acquires the position of the viewpoint of the user sitting in the driver's seat of the vehicle, and
A road shape information acquisition unit (60) that acquires road shape information that is information on the road shape in front of the vehicle, and a road shape information acquisition unit (60).
An image display unit (20) having a display surface (21) capable of displaying an image,
Depending on the position of the viewpoint of the user in the vertical direction acquired by the viewpoint position acquisition unit, the position of the area used for displaying the image which is a part of the display surface of the image display unit and the position of the used area. An image generation unit (30) that determines the length and displays the image in the used area of the display surface, and
By projecting the light from the display surface toward the translucent member (2), a virtual virtual image region corresponding to the used area is generated, and the virtual image corresponding to the image is displayed on the virtual image region. With a part (50)
The image generation unit determines the position and length of the used area corresponding to the vertical direction of the virtual image region according to the position of the user's viewpoint in the vertical direction acquired by the viewpoint position acquisition unit. The length of the used area is corrected so that the upper end of the virtual image region approaches the lower end and the vertical direction of the virtual image region becomes shorter according to the road shape information acquired by the road shape information acquisition unit.
A vehicle display device characterized by this. In the image generation unit, as the position of the viewpoint of the user acquired by the viewpoint position acquisition unit moves upward in the vertical direction, the virtual image region moves upward in the vertical direction to the position of the used area on the display surface. On the other hand, the size of the used area is largely determined in the direction corresponding to the vertical direction of the virtual image area.
In the image generation unit, as the position of the viewpoint of the user acquired by the viewpoint position acquisition unit moves downward, the position of the used area becomes lower and the virtual image area becomes lower on the display surface. The vehicle display device according to claim 1, wherein the vehicle display device is determined in a direction, and the size of the used area is determined to be smaller in a direction corresponding to the vertical direction of the virtual image area. The image generation unit is not affected by the change in the position of the viewpoint of the user in the vertical direction, and is the distance on the road surface of the landscape on which the virtual image region is superimposed in the landscape seen by the user through the translucent member. The vehicle display device according to claim 1 or 2, wherein the position and the size of the used area are determined on the display surface so that the range becomes constant. The used area includes a first used area corresponding to the first virtual image area of the virtual image area, and a second used area corresponding to a second virtual image area located below the first virtual image area and visually recognized. , At least including
The image generation unit determines the position and size of the first used area according to the position of the viewpoint of the user in the vertical direction acquired by the viewpoint position acquisition unit, and also determines the position and size of the first used area.
Any one of claims 1 to 3, wherein the image generation unit determines the position of the second used area according to the position of the viewpoint of the user in the vertical direction acquired by the viewpoint position acquisition unit. Display device for vehicles described in. The used area includes a first used area corresponding to the first virtual image area of the virtual image area, and a second used area corresponding to a second virtual image area located below the first virtual image area and visually recognized. , At least including
The image generation unit determines the position and size of the first used area according to the position of the viewpoint of the user in the vertical direction acquired by the viewpoint position acquisition unit, and also determines the position and size of the first used area.
The image generation unit determines the position and size of the second used area according to the position of the viewpoint of the user in the vertical direction acquired by the viewpoint position acquisition unit.
The vehicle according to any one of claims 1 to 3, wherein the rate of change according to the change in the position of the viewpoint of the user in the second used area is smaller than the rate of change in the first used area. Display device.

Images