JP2019127078A - Display device - Google Patents

Abstract

To provide a display device which supports preparation mode of a driver of a movable body for switching from automatic driving to manual driving.SOLUTION: A display device includes mode transition information acquisition part which acquires mode transition information as information relating to transition between control modes relating to automatic traveling of a movable body, operation receiving means which receives operation relating to traveling of the movable body, display means which is arranged on a rear side of the operation receiving means when viewed from a driving position of the movable body and displays operation information as information relating to operation to the operation receiving means based on the mode transition information.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a display device mounted on a moving body.

  Development of devices that support driving when switching from automatic driving to manual driving of a moving body such as an automobile is underway.For example, when switching from automatic driving to manual driving, preparation items necessary for manual driving are displayed on a touch panel, etc. Patent Document 1 discloses an automatic driving support device for displaying on the vehicle.

JP, 2017-097519, A

  However, in the automatic driving support device of Patent Document 1, the driver of the automobile must make preparations regarding manual driving while checking the preparation items displayed on the display.

  That is, immediately after the control mode is switched from the automatic operation control mode to the manual operation control mode in which the driver manually operates, the problem is that the driver cannot easily understand the guide display for making an appropriate preparation posture. An example is given.

  The present invention has been made in view of the above points, and an object of the present invention is to provide a display device that supports a preparation posture in which a driver of a moving body switches from automatic driving to manual driving.

  The display device according to claim 1 of the present application includes a mode transition information acquisition unit that acquires mode transition information that is information regarding transition between control modes regarding automatic traveling of a moving body, and an operation reception that receives an operation regarding traveling of the moving body. And a display unit that is provided behind the operation receiving unit as viewed from the driving position of the moving body and displays operation information that is information related to an operation on the operation receiving unit based on the mode transition information. It is characterized by

FIG. 1 is a top view of a movable body on which a display device according to a first embodiment of the present invention is mounted. It is explanatory drawing which shows the front seat part of the mobile body in which the display apparatus which is Example 1 of this invention is mounted. It is a block diagram which shows an example of a structure of the display apparatus which is Example 1 of this invention. It is a flowchart figure which shows the processing flow which displays the operation information shown on the display area of FIG. It is explanatory drawing which shows the display mode of the operation information shown in the display area of FIG. FIG. 13 is a flowchart showing a process flow of displaying operation information of the display device according to the second embodiment. It is explanatory drawing which shows the aspect which displays operation information on the display area of the display apparatus which is Example 3. FIG. It is explanatory drawing which shows the other aspect which displays operation information on the display area of the display apparatus which is Example 3. FIG. FIG. 10 is a flowchart illustrating a processing flow for displaying operation information of a display device according to the fourth embodiment. FIG. 10 is an explanatory diagram illustrating a mode in which operation information is displayed in a display area of a display device that is Embodiment 4. FIG. 18 is a flowchart illustrating a process flow of displaying operation information of a display device according to a fifth embodiment; It is explanatory drawing which shows the front seat part of the mobile body in which the display apparatus which is Example 6 is mounted. It is explanatory drawing which shows the front seat part of the mobile body in which the display apparatus which is Example 7 is mounted. FIG. 21 is a block diagram illustrating an example of a configuration of a display device according to a seventh embodiment. It is an enlarged view of the expansion part of the dashboard shown in FIG. FIG. 18 is a flowchart illustrating input processing of the display device according to the seventh embodiment; FIG. 10 is a flowchart illustrating input processing of a display device that is Embodiment 8.

  The display device is mounted on a moving body such as an automobile. The moving body may be a moving body other than a car, such as a bicycle, a motorcycle, an airplane, a ship, a moving person, or the like. In this embodiment, a case where a display device is mounted on an automobile which is an example of a moving body will be described.

  FIG. 1 is a top view of the automobile AM. The automobile AM has a plurality of in-vehicle cameras CM as obstacle detection means for detecting obstacles existing around the automobile AM.

  The on-vehicle camera CM includes, for example, a front camera FC that captures an area in front of the car AM, a rear camera RC that captures an area in the back of the car AM, and a right side camera RSC that captures an area on the side of the car AM. And a left side camera LSC.

  The front camera FC, the rear camera RC, the right side camera RSC, and the left side camera LSC are wide-angle cameras having an angle of view of, for example, about 180 °. These in-vehicle cameras CM are arranged so that, for example, the entire circumference of the automobile AM is imaged. Specifically, the front camera FC is installed on the front grill GR of the automobile AM shown in FIG. The rear camera RC is installed in the roof spoiler RS of the automobile AM shown in FIG. The right side camera RSC and the left side camera LSC are respectively installed on the side mirror SM of the automobile AM shown in FIG.

  The obstacle detection means is not limited to the on-vehicle camera CM, and may be, for example, a radar such as a millimeter wave radar, or a sensor that detects an obstacle by irradiating an infrared laser around the automobile AM. Moreover, you may construct | assemble a detection means using these sensors and vehicle-mounted camera CM in combination. Furthermore, the imaging range of the on-vehicle camera CM does not have to be the omnidirectional direction of the automobile AM as long as it can image at least one of the front, rear, right or left of the automobile.

  FIG. 2 is a diagram illustrating a front seat portion of the automobile AM. As shown in FIG. 2, the automobile AM has a dashboard DB arranged between a pair of A pillars P. In other words, the surface S facing the windshield FG of the dashboard DB forms an inclination that rises from the rear of the automobile AM toward the front.

  A steering wheel 11 is provided on the dashboard DB. The steering handle 11 is a part of a steering mechanism and pivots about the axis of a steering shaft (not shown). In the present embodiment, the steering handle 11 has a square frame shape, but may have any shape as long as it rotates around the axis of the steering shaft, and may have, for example, an annular shape.

  The driving position 12 is in the area facing the steering wheel 11. The driving position 12 is provided with a driver's seat (not shown) of the automobile AM.

  In the dashboard DB, a recess RE is formed at a position in front of the steering handle 11 on the surface S facing the windshield FG, that is, on the back side of the steering handle 11 when viewed from the driving position 12. In the recess part RE, for example, an instrument such as a speedometer for displaying the traveling speed of the automobile AM or a tachometer for displaying the number of revolutions of the engine of the automobile AM is provided. In other words, instrument information display means is provided in the recess part RE, and the instrument information display area is in the recess part RE.

  The shade SH is a member that protrudes from the front side to the rear of the automobile AM above the dashboard DB and covers the surface S of the dashboard DB.

  The shade SH is provided with a projection device PJ such as a projector capable of projecting an image on the surface S of the dashboard DB. In other words, the surface S of the dashboard DB is a projection surface onto which an image by the projection device PJ is projected. That is, the display means is formed by the dashboard DB and the projection device PJ. Note that an area in the surface S where an image can be projected by the projection device PJ will be described as a display area 20.

  The shade SH is provided with a position sensor PS that detects the position of the line of sight of the driver of the automobile AM (the height of the eyes and the direction of the line of sight when the driver is seated on the driver's seat). For example, in the information projected on the display area 20 of the dashboard DB as shown in FIG. 2, the position sensor PS specifies the information visually recognized by the driver, and the driver operates the visually recognized information. It is possible to specify that the operation target information is highly likely. The shade SH may be formed with the dashboard DB, or may be provided as a separate member from the dashboard DB.

  In the following description, in the display area 20, an area surrounding the recess part RE of the dashboard DB of the surface S, that is, an area around the recess part RE is an operation information display area for displaying operation information which is information related to the operation of the steering wheel 11. 22a. In other words, the operation information display area 22 a is provided on the back side of the steering wheel 11 when viewed from the driving position 12. An example of displaying the operation information in the operation information display area 22a is that the two arrows point to the steering wheel 11 when viewed from the driving position 12. Thus, by displaying the operation information, it is possible to prompt the driver to hold the steering handle 11.

  Further, in the following description, in the display area 20, an area other than the operation information display area 22a will be described as a multi-information display area 22b for displaying various information including entertainment information and driving support information.

  The operation information is, for example, a recommended operation amount for the steering wheel 11.

  The recess part RE and the operation information display area 22a are provided behind the steering wheel 11 when viewed from the driving position 12 of the automobile AM. The multi-information display area 22b is provided so as to surround the operation information display area 22a.

  FIG. 3 shows functional blocks of the display device 10 according to the first embodiment.

  The automobile AM includes a driving control unit 40 that controls automatic traveling of the automobile AM. The operation control unit 40 has a control mode including an automatic operation mode in which the vehicle AM travels automatically and a manual operation mode in which the driver performs all the travel operations of the vehicle AM.

  The automatic operation mode includes a steering mode in which the steering operation of the automobile AM is automatically performed, an acceleration mode in which the acceleration of the automobile AM is automatically performed, and a deceleration mode in which the deceleration of the automobile AM is automatically performed. The control is performed by combining the acceleration mode and the deceleration mode.

  Specifically, the control mode at least includes a manual steering mode that depends on the driver who is in the driving position 12 to perform an operation related to the steering of the automobile AM. That is, the control mode includes a plurality of control modes that differ depending on the degree of automation of the operation related to traveling of the automobile AM.

  For example, the manual operation mode corresponds to the automatic operation level 0. The automatic operation mode corresponds to automatic operation levels 1 to 5. Here, the autonomous driving level is an autonomous driving level defined by the Japanese government or the Road Traffic Safety Administration (NHTSA) of the US Department of Transportation.

  The data collection unit 30 is an interface unit that is connected so as to be able to acquire data from each of the operation control unit 40, the in-vehicle camera CM, the speed sensor SS that acquires speed information of the car AM, and the position sensor PS. The display device 10 receives data from each of the speed sensor SS, the position sensor PS, and the in-vehicle camera CM via the data collection unit 30.

  The output unit 31 is an interface unit connected to the projection device PJ. It is possible to transmit operation information or image information to the projection device PJ for display.

  The storage device 32 is constituted by, for example, a hard disk device, an SSD (Solid State Drive), a flash memory, or the like. The storage device 32 stores various programs such as BIOS (Basic Input Output System) and software. Further, the storage device 32 can store information for generating operation information. Specifically, the storage device 32 can store a map DB (Data base) storing map information and route information on which the vehicle AM travels.

  The control unit 33 is realized by a computer including a central processing unit (CPU) 33 a as an arithmetic processing unit, a read only memory (ROM) 33 b as a main storage device, and a random access memory (RAM) 33 c. The CPU 33a reads a program corresponding to the processing content from the ROM 33b or the storage device 32, develops it in the RAM 33c, and realizes various functions in cooperation with the developed program.

  Each of the control unit 33, the data collection unit 30, the output unit 31, and the storage device 32 is connected to each other via a system bus 34.

  The control unit 33 can generate operation information based on each data received via the data collection unit 30.

  The control unit 33 can acquire control mode information related to automatic driving of the automobile via the data collection unit.

  In addition, the control unit 33 may control the projection device PJ such that the display position of the operation information in the operation information display area can be changed based on the position data that is the height of the driver's eyes detected by the position sensor PS. Is possible.

  FIG. 4 shows a process flow of displaying operation information generated by the control unit 33. As shown in FIG. 4, the control unit 33 determines whether the control mode is the manual driving mode or the manual steering mode based on the acquired control mode information (step S01).

  In step S01, when the control unit 33 determines that the control mode is the manual operation mode or the manual steering mode (step S01: Y), the control unit 33 detects the vehicle speed data of the automobile AM and the image of the traveling direction of the automobile AM. Based on the data, an operation amount of the steering wheel 11 necessary when the automobile AM travels a curve or the like is calculated (step S02). Specifically, the control unit 33 calculates an ideal trajectory when traveling a curve or the like, and the steering wheel 11 necessary when the vehicle AM travels a curve or the like according to the current vehicle speed of the vehicle AM or the like. The operation amount is calculated.

  The process of calculating the operation amount of the steering wheel 11 is not limited to the case where the vehicle AM travels a curve, but, for example, in the case of lane change, when there is an obstacle on the road and the obstacle is avoided This may be performed when the driver operates the steering handle 11 such as when passing by. In addition, the operation amount calculation process may refer to not only the image data of the car AM but also map information and route information.

  The control unit 33 generates operation information corresponding to the operation amount calculated in step S02 (step S03).

  The control unit 33 acquires position data that is the height of the driver's eyes, and displays the operation information generated by the projection device PJ in the operation information display area 22a (step S04). Specifically, the control unit 33 controls the projection device PJ to change the display position of the operation information in the operation information display area 22a according to the eye height of the driver detected by the position sensor PS.

  In step S01, when the control unit 33 determines that the manual operation mode or the manual steering mode is not set (step S01: N), the control unit 33 ends the process.

  Here, the operation information displayed when a curve exists in the traveling direction of the automobile AM will be described.

  FIG. 5 shows a display mode of the operation information in the operation information display area 22a when the automobile AM travels on a curve. The arrow in the figure indicates the turning direction of the steering wheel 11.

  As shown in FIG. 5, a reference sign 11 a is displayed on the steering handle 11. The reference sign 11a is a mark indicating a position that serves as a reference for the operation of the steering handle 11. The reference mark 11a may be, for example, a steering wheel 11 with a circle or triangle pattern. Further, the reference mark 11a may be provided with a display such as liquid crystal on the steering wheel 11, and the reference mark 11a may be displayed on the display.

  In the operation information display area 22a of the dashboard DB, a position (alignment position) MP to which the reference mark 11a should be aligned is displayed as operation information. The alignment position MP is a symbol or pattern such as ◯ or Δ displayed in the operation display area.

  Therefore, when the driver of the automobile AM rotates the steering handle 11 in accordance with the reference mark 11a and the position MP, the steering angle of the automobile AM becomes an optimum angle with respect to the traveling direction.

  The change of the display position according to the position data which is the height of the driver's eyes by the control unit 33 is performed so as to avoid the position where the entire alignment position MP is not visible by the steering wheel 11. For example, a table (not shown) in which the display position is recorded according to the position of the driver's eyes is stored in advance in the storage device 32, and the control unit 33 refers to the table to display the display position of the operation information. change.

  In addition, even if the driver can not recognize a part of the alignment position MP, it is only required to recognize a position to be aligned with the reference mark 11a. For example, it is assumed that the alignment position MP is represented by a bar symbol (-). At this time, even when a part of the alignment position MP is displayed in the blind spot of the steering wheel, if the remaining alignment position MP is displayed on the extension of the bar, the driver may perform alignment with the reference mark 11a. It becomes possible. Therefore, it is sufficient that the alignment position MP can be displayed at a position at which the steering position of the steering wheel 11 does not become blind when at least the entire alignment position MP looks at the operation information display area 22a from the eye position of the driver.

  As described above, according to the display device 10 of the present embodiment, the operation information display area 22a is provided behind the steering handle 11 when viewed from the driving position 12 of the automobile AM. Therefore, the driver of the automobile AM can perform the steering operation while looking at the operation information on the line of sight of the steering wheel 11 from the driving position 12. As a result, the driver of the automobile AM can appropriately operate the actual steering wheel 11 without moving the eyes greatly. Further, since the steering operation can be performed without depending on the driver's sense of the automobile AM, the steering handle 11 can be operated regardless of the driving skill.

  In addition, when the vehicle AM moves backward, the operation of steering depends on the driver's sense and driving skill rather than the case where the vehicle AM moves forward regardless of whether or not the operation of the steering wheel 11 is involved. Even in such a situation, by displaying the operation information in the operation information display area 22a, the driver can operate the steering with confidence.

  In this embodiment, the operation amount of the steering wheel 11 is displayed as operation information. However, the operation information is not limited to the physical operation amount of the steering wheel 11. The visual line position necessary for the operation amount of the steering wheel 11 may be detected to guide the visual line position of the driver. For example, a gaze sensor for detecting the driver's gaze is provided, and an arrow or a mark is displayed as operation information so as to guide the driver's gaze direction in an appropriate direction according to the operation amount of the steering wheel 11. Also good.

  In this embodiment, each information is displayed in the display area using the projection device PJ. However, without using the projection device PJ, for example, a display such as liquid crystal may be provided in the display area 20, and each information may be displayed on the display.

  FIG. 6 is a flowchart illustrating a processing flow for displaying operation information according to the second embodiment. The display device 10 according to the second embodiment has the same configuration as that of the first embodiment, and the processing flow for generating operation information is different.

  As shown in FIG. 6, the control unit 33 determines whether the control mode is the manual operation mode or the manual steering mode based on the acquired control mode information (step S21).

  When it is determined in step S21 that the control unit 33 is not in the manual operation mode or the manual steering mode (step S21: N), the process ends.

  If the control unit 33 determines that the control mode is the manual operation mode or the manual steering mode in the determination of step S21 (step S21: Y), the control unit 33 acquires image data from the on-vehicle camera CM, and the vehicle It is determined whether there is an obstacle in the traveling direction of AM (step S22).

  In the determination of step S22, when the controller 33 does not detect an obstacle and determines that there is no obstacle (step S22: N), the process ends.

  In the determination of step S22, when the controller 33 detects an obstacle and determines that there is an obstacle (step S22: Y), based on the vehicle speed data of the car AM and the image data of the traveling direction of the car AM An operation amount of the steering wheel 11 necessary for traveling while avoiding an object is calculated (step S23).

  The subsequent processing flow is the same as the processing in steps S02 to S04 in the processing flow of FIG.

  As described above, according to the display device 10 of the present embodiment, the operation information is not always displayed in the operation information display area 22a in the manual operation mode or the manual steering mode. Therefore, the operation information is displayed in the operation information display area 22a only when the steering operation is necessary, that is, when an obstacle is detected, so that the processing load of the display device 10 can be reduced.

  The alignment position MP may be displayed as a region (alignment region) in which the reference marking 11 a including the minimum steering angle including the optimum steering angle and the maximum steering angle should be aligned. The display device 10 according to the third embodiment has the same configuration as that of the first embodiment, and is different in a mode of displaying operation information.

  That is, when the control unit 33 generates operation information, the minimum steering angle necessary for traveling within a range that does not deviate from the traveling lane and the maximum steering angle within a range that does not deviate from the traveling lane It is possible to calculate a certain maximum steering angle.

  FIG. 7 shows a mode in which the area MR is displayed in accordance with the operation information display area 22a. The arrow in the figure indicates the turning direction of the steering wheel 11. As shown in FIG. 7, the matching region MR is a region defined by the minimum steering angle and the maximum steering angle when traveling in the lane in which the automobile AM travels.

  Here, the alignment area MR may simultaneously display the alignment position MP. FIG. 8 shows a mode in which the alignment area MR and the alignment position MP are displayed on the operation information display area 22a. The arrow in the figure indicates the turning direction of the steering wheel 11.

  As shown in FIG. 8, the driver of the automobile AM recognizes the optimal steering angle as the target position by displaying the matching area MR and the aligning position MP in the operation information display area 22a, and the steering wheel. 11 operations can be performed.

  As described above, according to the display device 10 according to the present embodiment, the driver of the automobile AM can adjust the reference mark 11a to the alignment area MR by displaying the area MR in the operation information display area 22a. By operating 11, an appropriate steering operation can be performed. Therefore, the driver of the automobile AM can quickly operate to an appropriate steering angle. In addition, the driver of the automobile AM can finely adjust to the most appropriate steering angle while operating to the appropriate steering angle quickly.

  In the display device 10 according to the present embodiment, as a display indicating that the steering angle is optimal with respect to the alignment region MR and the alignment position MP, for example, the reference mark 11a is set to the alignment region with respect to the alignment region MR. The color of the MR in the matching area may be changed depending on whether it is within the MR or outside the matching area MR.

  For example, if the reference mark 11a is within the alignment area MR, the alignment area MR may be displayed in blue, and if the reference mark 11a is outside the alignment area MR, the alignment area MR may be displayed in red.

  By doing this, the driver of the car AM can recognize that the steering angle for the car AM to move properly by the peripheral vision of the driver while confirming the front of the car AM It becomes.

  In addition, the above Examples 1 to 3 are examples assuming that the automobile AM moves in the forward direction. When the car AM moves backward, the driver needs to confirm the safety behind. In that case, the fact that the steering angle is optimal with respect to the combined region MR and the combined position MP may be notified by sound, or the driver's seat may be vibrated. The driver of the automobile AM can recognize that the steering angle for the automobile AM to correctly move backward can be recognized through sound and vibration while confirming the safety to the rear.

  The display device 10 according to the fourth embodiment has the same configuration as the display device 10 according to the first to third embodiments, and is different from the display device 10 according to the first to third embodiments in that operation information is displayed in a different manner. .

  FIG. 9 illustrates a processing flow for displaying operation information of the display device 10 according to the third embodiment. As shown in FIG. 9, the control unit 33 sets the control mode to the manual operation mode or the manual steering mode in which the operation related to the steering of the automobile AM depends on the driver who rides the driving position 12 based on the acquired mode transition information. It is determined whether or not to move (step S31). If it is determined in step S31 that the mode does not shift to the manual driving mode or the manual steering mode (step S31: N), the control unit 33 ends the process.

  If the control unit 33 determines to shift to the manual operation mode or the manual steering mode (step S31: Y), the information for prompting the driver of the vehicle AM to get in the driving position 12 to grip the steering wheel 11 as operation information is Generate (step S32).

  The control unit 33 refers to the position data which is the height of the driver's eyes, and causes the projection device PJ to prompt the user to hold the steering wheel 11 in the operation information display area 22a (step S33).

  In other words, the display unit displays the operation information based on the mode transition information indicating that the manual steering mode is to be shifted.

  FIG. 10 shows the operation information displayed in the operation information display area 22a in step S33. As shown in FIG. 10, two arrows AR1 and AR2 are displayed in the operation information display area 22a so as to indicate the direction on the driving position 12 side. The operation information displayed in the operation information display area 22a means that the driver is urged to hold the steering wheel 11. The operation information may be displayed a few minutes before the control mode shifts.

  Further, the operation information is not limited to an arrow, and may be image information that actually shows a human hand, or may be character information such as “hold the handle”. Furthermore, in addition to prompting to hold the steering wheel 11, the display may prompt to put a foot on the accelerator pedal or the brake pedal.

  As described above, according to the display device 10 of the present embodiment, when a transition is made from the state in which the steering operation is performed automatically to the control mode in which the steering operation is manually performed, By urging the user to hold the steering wheel 11, it is possible to intuitively inform the driver of the preparation for switching to either the manual operation mode or the manual steering mode. As a result, the driver can perform the steering operation with a margin, and can perform the operation more safely.

  FIG. 11 shows a processing flow for displaying operation information of the display device 10 according to the third embodiment. The display device 10 according to the fifth embodiment has the same configuration as the display device 10 according to the fourth embodiment, and is different from the display device 10 according to the fourth embodiment in that contents for displaying operation information are different. Specifically, it differs from the display device 10 according to the fourth embodiment in that the operation information displayed by the display device 10 according to the present embodiment is the recommended operation amount of the steering wheel 11.

  The storage device 32 stores route information on which the automobile AM travels and map information.

  The control unit 33 determines whether it has detected that the control mode shifts to the manual operation mode or the manual steering mode based on the mode shift information (step S41). When it is determined in step S41 that the control unit 33 does not shift to the manual operation mode or the manual steering mode (step S41: N), the control unit 33 ends the process.

  The control unit 33 reads out the map information and the route information from the storage device 32, and specifies the position to be switched to the manual operation mode or the manual steering mode (step S42).

  Based on the extracted information, the control unit 33 calculates an operation amount necessary for steering the automobile AM at the position where the manual operation mode or the manual steering mode is switched (step S43).

  The control unit 33 generates operation information according to the operation amount (step S44).

  The control unit 33 refers to the position data that is the eye level of the driver, and displays the operation information generated by the projection device PJ in the operation information display area 22a (step S45).

  In the process of step S45, map information corresponding to the position of the operation information may be displayed on the operation information display area 22a together with the operation information. By displaying in this way, the driver can grasp the shape of the road such as a curve.

  As described above, according to the display device 10 of the present embodiment, the driver can operate the steering with confidence by indicating the required operation amount of the steering wheel 11 immediately after shifting to the manual operation mode or the manual steering mode. It can be carried out.

  FIG. 12 shows a display device 10 according to a sixth embodiment mounted on an automobile AM.

  The display device 10 according to the sixth embodiment has the same configuration as that of the display device 10 according to the first to third embodiments, and is different from the display device 10 according to the first to third embodiments in that contents for displaying information in the display area are different. Is different.

  As shown in FIG. 12, the display area 20 on the dashboard DB is provided with an image display area 23 for displaying an image around the car. The image display area 23 is formed around the operation information display area 22a. Specifically, the image display area 23 is an area behind the steering wheel 11, and is a right display area provided between the A pillar PR on the right side when viewed from the driving position 12 and the operation information display area 22a. A left display area 23L is provided between the A pillar PL on the left side when viewed from the driving position 12 and the operation information display area 22a.

  The control unit 33 can acquire an image around the automobile acquired from the in-vehicle camera CM. That is, the control unit 33 functions as an image acquisition unit.

  The control unit 33 can display operation information in the operation information display area 22a and can also display an image around the automobile AM in the image display area 23.

  That is, the control unit 33 displays the operation information generated by referring to the position data which is the height of the driver's eyes stored in the storage device 32 in the operation information display area 22a, and displays the image data as an image. The image is displayed on the projection device PJ so as to be displayed in the area 23. Specifically, the control unit 33 controls the projection device PJ to change the display position of the operation information in the operation information display area 22a according to the eye height of the driver detected by the position sensor PS.

  The operation information and the image data are preferably displayed when the automobile AM moves backward. In that case, the control part 33 is good to acquire the image of at least one among the back of the motor vehicle AM, or the side of the motor vehicle AM.

  As described above, according to the display device 10 of this embodiment, an image around the automobile AM can be displayed together with the operation information. Therefore, the driver can check the recommended operation amount of the steering wheel 11 and perform the steering operation while confirming the safety around the automobile AM without moving the eyes greatly.

  FIG. 13 shows the configuration of the display apparatus 10 according to the seventh embodiment. The display device 10 according to the seventh embodiment has the same configuration as the display device 10 according to the first to sixth embodiments, and includes an object detection device as a detection unit that detects the movement of an object on the dashboard DB. This is different from the display device 10 according to the first to sixth embodiments.

  As shown in FIG. 13, the dashboard DB has an extension ET that protrudes forward from the dashboard DB of the automobile AM when viewed from the driving position 12 of the automobile AM.

  The extension part ET is located around the driving position 12. More specifically, the extension part ET is provided in an intermediate region of the dashboard DB located intermediate between the pair of A pillars PR and PL. For example, when the steering wheel 11 is provided on the right side with respect to the front direction of the automobile AM, the extension part ET is provided on the left side of the steering wheel 11. Further, when the steering handle 11 is provided on the left side with respect to the front direction of the automobile AM, the extension part ET is provided on the right side of the steering handle 11.

  The extension part ET is formed in a rectangular plate shape in the present embodiment. The predetermined region R of the surface of the extension ET is recessed. A vibrator (not shown) that oscillates in response to pressure is embedded in the predetermined region R of the extended portion ET.

  The input information is displayed on the predetermined area R of the extension part ET. Examples of the input information include an input operation such as music playback and an input operation of an audio device such as a movie.

  Note that the extension part ET may be formed so as to be housed in the dashboard DB. For example, it may be slid and stored inside the dashboard DB. Further, the extension portion ET may be formed to be foldable by a hinge or the like. For example, in the manual operation mode or the manual steering mode, the extension portion ET may be accommodated.

  The object detection device 60 detects the movement of an object on the surface of the extension part ET of the dashboard DB. The movement of the object is, for example, the movement of a hand or a finger of a passenger boarding the automobile AM. The object detection device 60 is, for example, a camera. The camera captures the extension ET of the dashboard DB and detects the movement of the captured object. Therefore, the object detection device 60 detects the movement of the passenger's hand when the passenger of the automobile AM touches the predetermined area R that is depressed on the extension ET or performs a gesture on the predetermined area R. At this time, as the vibrator embedded in the extension part ET vibrates, the passenger who has performed the input operation can receive feedback on the input.

  FIG. 14 shows the configuration of the display apparatus 10 according to the seventh embodiment. As shown in FIG. 14, the input unit 35 is an interface unit connected so as to be capable of receiving detection data transmitted from the object detection device 60. The display device 10 can receive detection data from the object detection device 60 via the input unit 35.

  The output unit 31 is, for example, connected so as to be capable of data communication with the audio device AE. The display device 10 transmits the input data received via the output unit 31 to the audio device AE. The output unit 31 may be connected to a device other than the audio device AE. For example, the output unit 31 may be connected to a device such as a DVD (Digital Versatile Disk) player or a BD (Blu-ray (registered trademark) Disk) player. .

  The control unit 33 can accept an input based on the detection result of the movement of the passenger's finger by the object detection device 60.

  FIG. 15 shows the expanded portion ET in an enlarged manner. The object detection device 60 may detect the movement of each occupant's finger on the surface of the extension ET. As shown in FIG. 15, input information for operating music reproduction or the like is displayed in the predetermined area R of the extension unit ET.

  The predetermined area R includes an operation area RO having an arcuate outer edge, an input information display area RI provided around the outer edge of the operation area RO, and a content information display area RC for displaying information on the content to be operated. And having.

  In the input information display area RI, operation buttons as input information are displayed according to the position of the passenger's finger. Specifically, a play button is displayed at the little finger position, a stop button at the ring finger position, a pause button at the middle finger position, a rewind button at the index finger position, and a fast-forward button at the thumb position.

  In the content information display area RC, for example, the artist name (AAAA) of the song being reproduced and the song name (BBBB) being reproduced are displayed.

  The object detection device 60 detects the type of input data of the operation button pressed at the position of each finger, and transmits the input information to the display device.

  Further, the detection by the object detection device 60 may be, for example, a gesture performed by the passenger on the extension part ET in addition to the user of the automobile AM touching the predetermined region R of the extension part ET. The object detection device 60 may have a camera or the like as a sensor for detecting a gesture.

  FIG. 16 shows an input processing flow of the display device 10 according to the seventh embodiment. As shown in FIG. 16, the control unit 33 determines whether the passenger's hand is present on the dashboard DB based on detection data of the object detection device 60 (step S 51).

  When it is determined that there is no hand on the dashboard DB (step S51: N), the control unit 33 ends the process.

  When it is determined that there is a hand on the dashboard DB (step S51: Y), the control unit 33 determines whether the detected hand is performing an input operation with a finger (step S52).

  When the control unit 33 determines that the operation with the finger is not performed (step S52: N), the process ends.

  When it is determined that the action by the finger is being performed (step S52: Y), the control unit 33 receives an input operation by the action of the finger (step S53). Specifically, the control unit 33 accepts an input operation that varies depending on the movement of each finger of the passenger and the gesture. That is, the control unit 33 functions as an input receiving unit.

  The control unit 33 transmits input information to the audio device AE based on the received input operation (step S54).

  The control unit 33 can receive not only the operation information of the device such as the audio device AE connected to the display device 10 but also the operation information of the display device 10.

  In addition, the display device 10 may display entertainment information in the multi-information display area 22b in response to the input operation performed by the passenger in step S53. For example, the display device 10 may display a list of music pieces to be played back in the multi-information display area 22b. Further, the display device 10 may appropriately change the display content based on detecting the hand in step S51. Specifically, a menu list that can be input by the passenger may be displayed.

  In the present embodiment, the object detection device 60 is configured by a camera. However, the object detection device 60 is not limited to a camera, and may detect movement of an object by using, for example, a touch pad having a resistance pressure sensor. Further, the object detection device 60 may detect the movement of the object using a light position detection type sensor.

  As described above, according to the display device 10 according to the present embodiment, the passenger of the automobile AM looks at the extension portion ET because the movement on the extension portion ET of the dashboard DB is detected and the input is accepted. It is possible to perform an input operation without it. In particular, it is possible for the passenger to perform the input operation instinctively by associating the content that allows different input operations with each of the five fingers. Therefore, since the input operation can be performed according to the sensation of the passenger, the operability can be improved. That is, the display device 10 can also function as an input device.

  As a result, the passenger can perform intuitive input operation, and it is not necessary to reach for the center console or gaze at the center console at the time of input operation. An input operation can be performed. Furthermore, in response to the reception of the input reception unit, that is, according to the detection of the movement of the passenger's hand of the object detection device 60, the vibrator embedded in the extension unit ET vibrates, and the passenger who performed the input operation , It is possible to receive feedback on the input operation. In particular, when the driver performs an input operation, the driver can surely perform the desired input operation by receiving feedback by vibration even if the driver does not look directly at a response display etc. at the time of the input operation. Can be recognized.

  FIG. 17 shows an input processing flow of the display device 10 according to the eighth embodiment. The display device 10 according to the eighth embodiment has the same configuration as the display device 10 according to the seventh embodiment, but differs from the display device 10 according to the seventh embodiment in that the aspect of receiving input content is different.

  As shown in FIG. 17, the control unit 33 determines whether the hand of the passenger is on the dashboard DB based on detection data of the object detection device 60 (step S 61).

  When it is determined that there is no hand on the dashboard DB (step S61: N), the control unit 33 ends the process.

  When determining that there is a hand on the dashboard DB (step S61: Y), the control unit 33 determines whether the detected hand is the hand of the driver who performs the driving operation of the automobile AM (step S62). Whether the hand is a driver's hand can be determined, for example, based on whether the detected hand is the right hand or the left hand. Specifically, when the driving position 12 is provided on the right side with respect to the front of the automobile AM, when the left hand is detected, it can be determined that it is the hand of the driver.

  When judging that the detected hand is the hand of the driver who performs the driving operation of the automobile AM (step S62: Y), the control unit 33 restricts the input operation to be received (step S63).

  As an example of restricting the input operation to be accepted, it is mentioned that only the music reproduction button, the stop button and the pause button are accepted, and the other input operations are not accepted.

  Subsequent processing in steps S64 to S66 is the same as that in steps S52 to S54 in FIG.

  When the control unit 33 determines that the detected hand is not the hand of the driver who performs the driving operation of the automobile AM (step S62: N), the process proceeds to step S64.

  It should be noted that the restriction on acceptance of the input by the control unit 33 may be performed at least in the automatic operation mode, in the control mode in which the driver's operation intervenes. For example, the control unit may limit the reception of the entertainment information when the driver performs an input operation with the driver's hand under the situation where the driver is operating the vehicle AM.

  As described above, according to the display device 10 according to the present embodiment, the input mode to be accepted is varied depending on whether the input is made by the driver. As a result, it is possible to urge the driver to concentrate on driving the vehicle AM. In addition, since passengers other than the driver can freely perform the input operation, it is possible to maintain the comfort of the input operation.

AM automobile 10 Display device 11 Steering handle 11a Reference sign 12 Driving position MP Matching position MR Matching area

Claims (12)

A mode transition information acquisition unit that acquires mode transition information that is information related to transition between control modes related to automatic traveling of the mobile object;
Operation receiving means for receiving an operation related to traveling of the mobile body;
Display means provided behind the operation receiving means as viewed from the driving position of the movable body and displaying operation information which is information related to an operation on the operation receiving means based on the mode shift information And a display device.   The display device according to claim 1, wherein the control mode includes a control mode that varies depending on a degree of automation of an operation related to traveling of the moving body.   The display device according to claim 1, wherein the operation information is information related to steering of the moving body. The control mode includes a manual steering mode in which an operation relating to steering of the mobile body depends on a driver who gets into the driving position,
3. The display device according to claim 1, wherein the display unit displays the operation information based on the mode transition information indicating transition to a manual steering mode.   The display device according to any one of claims 1 to 4, wherein the display means displays a recommended operation amount for the operation reception means as the operation information.   The steering reception means is a steering handle that rotates, and the display means displays a recommended amount of rotation to the steering handle as the operation information. The display device according to one item. The steering handle has a reference mark;
The display device according to claim 6, wherein the display means displays a position where the reference marking should be aligned as the operation information. The steering handle has a reference mark;
The display device according to claim 6, wherein the display unit displays a region where the reference sign should be matched as the operation information. The steering reception means has a steering handle that rotates.
9. The display device according to any one of claims 1 to 8, wherein the display means displays as the operation information to urge the driver of the mobile body in the driving position to grip the steering wheel. Display device. Detecting means for detecting an object existing around the moving body;
The display device according to claim 1, wherein the display unit displays the operation information based on a detection result of the detection unit.   The display device according to claim 10, wherein the display unit displays the operation information based on a detection result of the detection unit. Position detecting means for detecting the position of the eyes of the passenger present at the driving position of the mobile body that boardes the driving position;
The display device according to any one of claims 1 to 11, wherein the display means changes a position at which the operation information is displayed according to the detected eye position of the passenger.

Images