[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

WO2018163535A1 - Dispositif d'alarme, système d'alarme, procédé d'alarme et programme de commande d'alarme - Google Patents

Dispositif d'alarme, système d'alarme, procédé d'alarme et programme de commande d'alarme Download PDF

Info

Publication number
WO2018163535A1
WO2018163535A1 PCT/JP2017/042559 JP2017042559W WO2018163535A1 WO 2018163535 A1 WO2018163535 A1 WO 2018163535A1 JP 2017042559 W JP2017042559 W JP 2017042559W WO 2018163535 A1 WO2018163535 A1 WO 2018163535A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
notification
driver
unit
determination
Prior art date
Application number
PCT/JP2017/042559
Other languages
English (en)
Japanese (ja)
Inventor
初美 青位
匡史 日向
芽衣 上谷
Original Assignee
オムロン株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by オムロン株式会社 filed Critical オムロン株式会社
Publication of WO2018163535A1 publication Critical patent/WO2018163535A1/fr

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/09—Arrangements for giving variable traffic instructions
    • G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems

Definitions

  • the present invention relates to a notifying device, a notifying system, a notifying method, and a notifying control program for notifying a driver of a takeover operation required when switching the driving mode of a vehicle from an automatic driving mode to a manual driving mode.
  • the automatic driving mode includes, for example, navigation system information using GPS (Global Positioning System), traffic information acquired by road-to-vehicle communication, and information on a surrounding monitoring system that monitors the position and movement of surrounding people and vehicles.
  • GPS Global Positioning System
  • the vehicle can be automatically driven by controlling a power unit, a steering device, a brake, and the like (see, for example, JP-A-2015-141053).
  • Such an automatic driving mode is expected to reduce the burden on the driver's driving operations and reduce traffic congestion.
  • the vehicle can always grasp the distance from the current position to the exit of the expressway and the general road.
  • the time required to leave the highway and reach a general road can also be estimated. And, for example, when the time to reach the general road is 60 seconds, “I will enter the general road soon. After 60 seconds, switch to manual operation mode. Please let me know "is output.
  • countdown displays such as “60 seconds remaining”, “59 seconds remaining”,... Are displayed on the screen of the car navigation device, the tablet screen, the meter screen, and the like.
  • time for preparation for switching from the automatic operation mode to the manual operation mode is appropriately set individually by an automobile manufacturer or the like, and the above-described 60 seconds is an example and is not limited. .
  • the driver takes the driving posture, holds the steering wheel (handover of the steering wheel), and adjusts the pedals such as the accelerator and the brake until the countdown ends, that is, in the state where the automatic driving is performed (handing over the pedal). ), Confirming front and rear, left and right, and turning the line of sight forward (handing over the line of sight) must be completed a series of hand over necessary for manual operation.
  • the automatic operation mode steering of the steering wheel and depression of a pedal such as an accelerator or a brake are automatically performed.
  • the driver since the steering wheel is not automatically steered when the mode is switched to the manual driving mode, the driver needs to grasp the steering wheel himself and prepare for manual steering.
  • the pedal depressing position also returns to the initial position.Therefore, if the brake is depressed in the automatic operation mode immediately before entering the manual operation mode, the brake pedal Return to the initial position and suddenly no longer decelerates.
  • the accelerator pedal returns to the initial position and is not suddenly accelerated. As a result, the operation becomes unstable as soon as the manual operation mode is switched. Therefore, in order to prevent this from happening, the driver completes the takeover of the pedal by putting his / her foot on the pedal depression position that has been made in the automatic operation mode before entering the manual operation mode. It is necessary to keep.
  • handing over of the steering wheel and handing over of the pedal can be performed by following the state of automatic driving.
  • taking over of the line of sight is not performed simply by following automatic driving.
  • taking over of the line of sight is performed by confirming the front, back, left and right, and then turning the line of sight forward. That is, the left and right side mirrors are viewed to confirm the left and right, the rear view mirror is viewed to confirm the rear, and then the line of sight is directed forward.
  • Such an extra voice announcement is not preferable because it gives the driver extra frustration and may disturb the driver's state of mind.
  • For drivers who have already confirmed the left and right side mirrors by looking at the left and right side mirrors “Look at the rear view mirror and check the back.”, “Look forward.” Only a voice announcement may be added, and for drivers who have also confirmed the rear view by looking at the rearview mirror, only a voice announcement “Please look forward” is added. Just do it.
  • the notification for encouraging the confirmation operation of the takeover by looking at the eyes should be appropriately performed with appropriate contents in consideration of not only the driver's confirmation results but also the surrounding circumstances at that time.
  • the present invention has been made in view of such circumstances, and among the takeover operations necessary for switching from the automatic operation mode to the manual operation mode, in particular, the confirmation operation of takeover by the line of sight is the current situation. It aims at providing the alerting
  • the present invention takes the following measures.
  • the first aspect of the present invention is an apparatus for informing information for prompting a driver to take over when the vehicle operation mode is switched from the automatic operation mode to the manual operation mode.
  • a first acquisition unit that acquires first sensing data representing the state of the driver from a first monitoring sensor that monitors the state of the driver of the vehicle, and a second monitoring sensor that monitors the surroundings of the vehicle From the second acquisition unit that acquires the second sensing data representing the surrounding state of the vehicle, the first sensing data acquired by the first acquisition unit, and the second acquisition unit Based on the acquired second sensing data, a determination unit that determines the content of the information that prompts the takeover operation, and a notification that is provided in the vehicle with the information determined by the determination unit And a control unit for controlling so as to output from.
  • the determination unit determines whether the driver has seen a predetermined mirror of the vehicle based on the first sensing data. A first determination is made, a second determination is made from the second sensing data to determine whether there is a confirmation object within a predetermined distance from the vehicle, and the first determination When it is determined that the driver is not looking at the predetermined mirror of the vehicle, and the second determination determines that the object to be confirmed is present, the driver is prompted to perform the predetermined mirror And the content of the notification is determined so as to include prompting attention to the confirmation object, and the driver does not look at the predetermined mirror of the vehicle by the first determination.
  • the content of the notification is determined so as to include only prompting to see the predetermined mirror, and the operation is performed according to the first determination. Only when it is determined that the person has seen the predetermined mirror of the vehicle, and the second determination determines that the confirmation target is present, only to call attention to the confirmation target.
  • the content of the notification is determined as described above, and it is determined by the first determination that the driver has seen the predetermined mirror of the vehicle, and the confirmation target does not exist by the second determination. If it is determined, it is decided not to make the notification.
  • the determination unit further includes the content of the notification determined by the determination unit from the time when the notification unit is output from the notification unit. Based on the first sensing data acquired by the first acquisition unit and the second sensing data acquired by the second acquisition unit during a period until the operation mode is switched to the manual mode. The content of the notification that prompts the takeover operation is redetermined.
  • a fourth aspect of the present invention is a notification control program that causes a computer to execute each unit included in the notification device according to any one of the first to third aspects.
  • a system for informing information for prompting a driver to take over when the vehicle operation mode is switched from the automatic operation mode to the manual operation mode A first monitoring sensor that monitors the state of the driver, a first acquisition unit that acquires first sensing data representing the state of the driver from the first monitoring sensor, and monitors the surroundings of the vehicle.
  • the second monitoring sensor that acquires the second sensing data representing the state of the surroundings of the vehicle from the second monitoring sensor, and the second acquisition sensor that is acquired by the first acquisition unit.
  • a determination unit that determines the content of the information that prompts the takeover operation, and the content by the determination unit
  • a control unit which performs control for outputting a constant information under the control of the control unit, and a notification unit for outputting the determined information.
  • a method for informing a takeover operation required when the vehicle operation mode is switched from the automatic operation mode to the manual operation mode is performed by a monitoring sensor, and a notification device acquires first sensing data representing the state of the driver from the first monitoring sensor, monitors the surroundings of the vehicle by a second monitoring sensor, and performs the notification.
  • a device acquires second sensing data representing a state around the vehicle from the second monitoring sensor, and the notification device is based on the first sensing data and the second sensing data.
  • the notification content that prompts the handover operation is determined, and the notification device controls the notification unit provided in the vehicle so as to notify the driver of the determined notification content. It is the law.
  • the takeover operation is urged based on the first sensing data representing the driver's state and the second sensing data representing the surrounding state of the vehicle.
  • the notification contents can be notified with appropriate contents according to the current situation.
  • the second aspect of the present invention it is possible to perform only necessary notification without giving excessive frustration to the driver by finely determining the notification content.
  • the third aspect of the present invention it is possible to reliably follow the execution of the takeover operation by the driver while taking into consideration the surrounding conditions that change from moment to moment.
  • FIG. 1 is a diagram illustrating an overall configuration example of an automatic operation control system including a takeover operation notification system according to the present embodiment.
  • FIG. 2 is a block diagram illustrating a functional configuration example of the takeover operation notification system according to the present embodiment.
  • FIG. 3 is a flowchart (1/2) showing an operation example of the handover operation notification system according to the present embodiment.
  • FIG. 4 is a flowchart (2/2) illustrating an operation example of the handover operation notification system according to the present embodiment.
  • FIG. 1 is a diagram illustrating an example of the overall configuration of an automatic operation control system including a takeover operation notification system 10 according to the present embodiment.
  • This automatic driving control system is mounted on a vehicle 1 such as a passenger car.
  • the takeover operation notification system 10 is an example of a notification system in the present invention, and realizes the notification method in the present invention.
  • the takeover operation notification system 10 includes a takeover operation notification device 6.
  • the takeover operation notification device 6 is an example of a notification device in the present invention.
  • the vehicle 1 includes, as basic equipment, a power unit 2 including a power source and a transmission, and a steering device 3 equipped with a steering wheel 4, and further includes a manual operation mode and an automatic operation mode as operation modes. .
  • An engine and / or a motor is used as the power source.
  • the manual driving mode is a mode in which the vehicle 1 is driven mainly by a driving operation manually performed by a driver (hereinafter also referred to as “driver”).
  • the manual operation mode includes, for example, an operation mode for driving the vehicle based only on the driver's driving operation, and an operation mode for performing driving operation support control for supporting the driving operation of the driver while mainly driving the driver's driving operation. Is included.
  • the driving operation support control assists the steering torque so that the driver's steering becomes an appropriate steering amount based on the curvature of the curve when the vehicle 1 is traveling on the curve, for example.
  • the driving operation support control includes control for assisting a driver's accelerator operation (for example, operation of an accelerator pedal) or brake operation (for example, operation of a brake pedal), manual steering (manual operation of steering), and manual speed adjustment (speed). Adjustment manual operation) is also included.
  • a driver's accelerator operation for example, operation of an accelerator pedal
  • brake operation for example, operation of a brake pedal
  • manual steering manual operation of steering
  • speed manual speed adjustment
  • Adjustment manual operation is also included.
  • manual steering the vehicle 1 is steered mainly by the driver's operation of the steering wheel 4.
  • manual speed adjustment the speed of the vehicle is adjusted mainly by the driver's accelerator operation or brake operation.
  • the driving operation support control does not include control for forcibly intervening in the driving operation of the driver to automatically drive the vehicle 1.
  • the driving operation of the driver is reflected in the driving of the vehicle within a preset allowable range, but forcibly intervenes in the driving of the vehicle under certain conditions (for example, deviation from the lane of the vehicle). Control to do is not included.
  • the automatic operation mode is a mode for realizing an operation state in which the vehicle 1 is automatically driven along the road on which the vehicle 1 is traveling, for example.
  • the automatic driving mode includes, for example, a driving state in which the vehicle 1 is automatically driven toward a preset destination without driving by the driver.
  • the automatic driving mode it is not always necessary to automatically control all of the vehicle 1, and the driving state in which the driving operation of the driver is reflected in the traveling of the vehicle 1 within a preset allowable range is also included in the automatic driving mode. That is, the automatic driving mode includes a control in which the driving operation of the driver is reflected in the traveling of the vehicle 1 within a preset allowable range, but forcibly intervenes in the traveling of the vehicle under a certain condition.
  • reference numeral 5 denotes an automatic operation control device for executing operation control in the automatic operation mode.
  • the automatic driving control device 5 acquires sensing data from the accelerator pedal sensor 12, the brake pedal sensor 13, the GPS receiver 14, the gyro sensor 15, the vehicle speed sensor 16, and the steering sensor 17, respectively. And these sensing data, route information generated by a navigation system (not shown), traffic information acquired by road-to-vehicle communication, information obtained by a surrounding monitoring system that monitors the position and movement of surrounding people and vehicles Based on this, the traveling of the vehicle 1 is automatically controlled.
  • Automatic control includes, for example, automatic steering (automatic steering operation) and automatic speed adjustment (automatic driving of speed).
  • Automatic steering is an operating state in which the steering device 3 is automatically controlled.
  • Automatic steering includes LKA (Lane Keeping Assist).
  • LKA Li Keeping Assist
  • the LKA automatically controls the steering device 3 so that the vehicle 1 does not deviate from the traveling lane even when the driver does not perform the steering operation.
  • the driver's steering operation may be reflected in the steering of the vehicle within a range (allowable range) in which the vehicle 1 does not deviate from the traveling lane.
  • automatic steering is not limited to LKA.
  • Automatic speed adjustment is an operating state in which the speed of the vehicle 1 is automatically controlled.
  • Automatic speed adjustment includes ACC (Adaptive Cruise Control). For example, when there is no preceding vehicle ahead of the vehicle 1, ACC performs constant speed control that causes the vehicle 1 to travel at a constant speed at a preset speed, and when the preceding vehicle exists ahead of the vehicle 1. Is a follow-up control that adjusts the vehicle speed of the vehicle 1 in accordance with the inter-vehicle distance from the preceding vehicle.
  • the automatic operation control device 5 decelerates the vehicle 1 according to the driver's brake operation (for example, operation of the brake pedal) even when ACC is being executed.
  • the automatic operation control device 5 can perform the driver's accelerator operation (for example, accelerator) up to a preset maximum allowable speed (for example, the maximum speed legally determined on the traveling road) even during execution of ACC.
  • the vehicle 1 can be accelerated according to the pedal operation.
  • the automatic speed adjustment is not limited to ACC but also includes CC (Cruise Control).
  • the takeover operation notification system 10 is a system for notifying the driver of the takeover operation necessary for switching the operation mode of the vehicle 1 traveling in the automatic operation mode to the manual operation mode, in particular, the takeover operation of the line of sight. .
  • the takeover operation notification system 10 includes a takeover operation notification device 6, a driver monitoring sensor 7, which is a driver camera as an example, a speaker 8, a display screen 9, and an external monitoring sensor 11.
  • the external monitoring sensors 11 are, for example, four cameras provided in the vehicle 1 for imaging the front, rear, right side, and left side of the vehicle 1, and in FIG. Only the sensor 11 (# 1) and the external monitoring sensor 11 (# 2) provided behind the vehicle 1 are illustrated. The external monitoring sensors 11 on the right and left sides of the vehicle 1 are not shown in FIG.
  • the four cameras that are the external monitoring sensors 11 respectively image the front, rear, right side, and left side of the vehicle 1 and output video signals C (# 1 to # 4) that are the imaging results to the takeover operation notification device 6. To do.
  • the ambient monitoring system described above may also serve as the external monitoring sensor 11.
  • the driver monitoring sensor 7 that is a driver camera is installed at a position in front of the driver, for example, on a dashboard, images the driver, and sends the video signal E to the takeover operation notification device 6. Output.
  • the speaker 8 outputs a voice announcement for prompting a takeover operation necessary when switching from the automatic operation mode to the manual operation mode based on the audio signal I output from the takeover operation notification device 6. For example, “Please check the left and right side mirrors to check the left and right.” “Look at the rear view mirror and check the back.”, “Please look forward.” “There are vehicles approaching from the right lane. Check the right side mirror.” “There are vehicles approaching from the back. Check the rear view mirror.” However, it is not limited to these.
  • the display screen 9 displays characters, images, and the like based on the display signal K output from the takeover operation notification device 6.
  • the display screen 9 may correspond to, for example, a meter of the vehicle 1 or a display screen of a car navigation system mounted on the vehicle 1, but is not necessarily limited thereto, and is a monitor screen such as a driving monitor mounted on the vehicle 1. Or a head-up display may be used.
  • the displayed characters and images correspond to the contents of the voice announcement output from the speaker 8, for example, “Please check the left and right side mirrors to check the left and right.” You may use characters such as "Please turn your gaze forward.” Also, even if it is not necessarily the same content as the voice announcement, for example, “side mirror”, “room mirror”, and “forward direction”, only necessary keywords are displayed, or the side mirror is displayed.
  • An arrow, an arrow indicating a rearview mirror, or an arrow indicating the forward direction may be used.
  • FIG. 2 is a block diagram illustrating a functional configuration example of the takeover operation notification system 10 according to the present embodiment.
  • the takeover operation notification device 6 is a device that comprehensively controls switching of operation modes, and includes a control unit 61, an input / output interface unit 62, and a storage unit 63.
  • the input / output interface unit 62 receives the manual operation switching request signal A output from the automatic operation control device 5 and outputs it to the control unit 61.
  • the automatic driving control device 5 requests the manual driving switching at the timing of starting preparation for switching (for example, 60 seconds before switching to the manual driving mode).
  • Signal A is output.
  • the automatic operation control device 5 always knows the position of the vehicle 1 by the GPS receiver 14 and the speed of the vehicle 1 by the vehicle speed sensor 16. Therefore, it is necessary to drive in the manual operation mode by taking into account a preset travel plan, the position of the vehicle 1 grasped by the GPS receiver 14, and the speed of the vehicle 1 grasped by the vehicle speed sensor 16.
  • the time required to reach a general road for example, another 300 seconds
  • a manual operation switching request signal A is output.
  • the time required for preparation for switching from the automatic operation mode to the manual operation mode is not limited to 60 seconds, and may be another time.
  • automatic driving control such as 60 seconds when switching to manual driving mode by exiting from a highway, 30 seconds when switching due to bad weather, and 4 seconds when switching due to an emergency.
  • the apparatus 5 may set different preparation times according to each case.
  • the input / output interface unit 62 receives the manual operation switching request signal A and outputs it to the control unit 61.
  • the input / output interface unit 62 also receives the video signal C output from the external monitoring sensor 11, which is a camera, converts it into video digital data D, and outputs the video digital data D to the control unit 61. Furthermore, the video signal E output from the driver monitoring sensor 7 which is a driver camera is received and converted into video digital data F, and the video digital data F is output to the control unit 61.
  • the input / output interface unit 62 further converts the audio announcement data H output from the control unit 61 into an audio signal I, and outputs the audio signal I to the speaker 8.
  • the input / output interface unit 62 further converts the display data J output from the control unit 61 into a display signal K, and outputs the display signal K to the display screen 9.
  • the storage unit 63 uses, as a storage medium, a non-volatile memory that can be written and read at any time, such as SSD (Solid State Drive) or HDD (Hard Disk Drive), and is used to realize this embodiment.
  • a non-volatile memory that can be written and read at any time, such as SSD (Solid State Drive) or HDD (Hard Disk Drive)
  • SSD Solid State Drive
  • HDD Hard Disk Drive
  • an external monitoring data storage unit 631, a driver monitoring data storage unit 632, a voice announcement information storage unit 633, and a display information storage unit 634 are provided.
  • the control unit 61 has a CPU (Central Processing Unit) and a program memory that constitute a computer, and as control functions necessary for realizing the present embodiment, an operation mode switching signal receiving unit 611, an external monitoring data acquiring unit 612 are provided. A driver monitoring data acquisition unit 613, a notification content determination unit 614, and an output control unit 615 are provided. All of these control functions are realized by causing the CPU to execute a program stored in the program memory.
  • CPU Central Processing Unit
  • the operation mode switching signal receiving unit 611 When receiving the manual operation switching request signal A output from the input / output interface unit 62, the operation mode switching signal receiving unit 611 generates an activation signal B for starting the operation of the notification content determining unit 614. Then, activation signal B is output to notification content determination unit 614.
  • the external monitoring data acquisition unit 612 receives the video digital data D output from the input / output interface unit 62, outputs it to the external monitoring data storage unit 631, and stores it in the external monitoring data storage unit 631.
  • the driver monitoring data acquisition unit 613 receives the video digital data F output from the input / output interface unit 62, outputs it to the driver monitoring data storage unit 632, and stores it in the driver monitoring data storage unit 632.
  • the notification content determination unit 614 When the notification content determination unit 614 receives the activation signal B output from the operation mode switching signal reception unit 611, the notification content determination unit 614 acquires the video digital data D from the external monitoring data storage unit 631 and the video digital data from the driver monitoring data storage unit 632. Data F is acquired. Then, based on the video digital data D and the video digital data F, the content of notification to the driver is determined, and the determination result G is output to the output control unit 615. As an example, the following four patterns of the determination result G will be described, but the determination result G is not limited to these.
  • the notification content determination unit 614 performs a first determination from the video digital data F to determine whether or not the driver has seen the side mirror and the rearview mirror of the vehicle 1. Further, a second determination for determining whether or not a confirmation object (for example, another vehicle, a two-wheeled vehicle, a person, etc.) exists within a predetermined distance (for example, within 2 m) from the vehicle 1 from the video digital data D. Do. If it exists, it is further determined in which direction the confirmation object is present. Further, for example, based on the feature amount acquired from the video digital data F, it may be determined whether the object to be confirmed is an ordinary car, a large car, a two-wheeled vehicle, or a person. . Note that it is known to perform type determination based on feature amounts from video digital data D captured by a camera.
  • the first determination determines that the driver has not seen all of the side mirrors and the rear view mirrors of the vehicle 1 (there are mirrors that have not been seen).
  • it is determined that the confirmation target exists within a predetermined distance it is determined to notify the side mirror and the room mirror, to pay attention to the confirmation target, and the direction of the confirmation target.
  • the notification content determination unit 614 outputs such a first determination result G 1 to the output control unit 615.
  • Notification content determination unit 614 outputs such second determination result G 2 to the output control section 615.
  • Notification content determination unit 614 outputs such third decision result G 3 to the output control section 615.
  • Notification content determination unit 614 outputs such fourth determination result G 4 to the output control section 615.
  • the output control unit 615 acquires appropriate voice announcement data H from the voice announcement information storage unit 633 according to the determination result G output from the notification content determination unit 614, and outputs it to the input / output interface unit 62.
  • Appropriate display data J is acquired from the display information storage unit 634 and output to the input / output interface unit 62.
  • the input / output interface unit 62 converts the voice announcement data H into a voice signal I and outputs it to the speaker 8. As a result, a corresponding voice announcement is output from the speaker 8.
  • the input / output interface unit 62 also converts the display data J into a display signal K and outputs it to the display screen 9. As a result, the corresponding character or image is displayed from the display screen 9. In response to this, the driver confirms the mirror or confirms the confirmation object to be approached.
  • the voice announcement information storage unit 633 stores various voice announcement data H.
  • Various voice message information is defined by adding new voice announcement data H to the voice announcement information storage unit 633 or updating the existing voice announcement data H stored in the voice announcement information storage unit 633. It is possible.
  • the display information storage unit 634 stores various display data J.
  • Various display data can be defined by adding new display data J to the display information storage unit 634 or updating existing display data J stored in the display information storage unit 634. ing.
  • voice announcement data H is "Check the left looking at the left and right side mirrors.” As an example, “in particular, large right lane Check that the car is approaching. Check the rear view of the room mirror. Check the rear of the car. Turn the line of sight ahead.
  • the text information may be left as it is, for example, an arrow indicating a side mirror or a rearview mirror, or an arrow indicating the right side mirror in an emphasis, especially if there is an approaching vehicle on the right. May be.
  • voice announcement data H is "Check the left looking at the left and right side mirrors.”
  • the display data J may be the text information as it is, for example, an arrow indicating a side mirror or a room mirror. good.
  • voice announcement data H is, "because we are approaching large vehicles from the right lane, make sure."
  • the display data J may be such character information as it is, for example, an arrow display indicating the right side mirror, or an arrow display pointing out the right side mirror.
  • the output control unit 615 does not acquire any data from the voice announcement information storage unit 633 and the display information storage unit 634. Therefore, no data is output to the input / output interface unit 62. In this way, the output control unit 615 performs control so that nothing is output from the speaker 8 and the display screen 9.
  • the determination results G 1 to G 4 described above are merely examples, and the determination results are defined more finely.
  • the sound announcement data H and the display data J are also prepared in detail, and the sound announcement information storage unit 633 and By storing the information in the display information storage unit 634, more detailed notification can be performed.
  • the first determination result G 1 and the second determination result G 2 is applied to the aforementioned.
  • the determination results G 1 and G 2 when neither one of the side mirror and the rearview mirror is seen, when both the side mirror and the rearview mirror are not seen, If you are looking, but you are not looking at the rear view mirror, you are looking at the rear view mirror, but you are not looking at the side mirror, and you are looking at the right side mirror but not the left side of the side mirror Etc. are not distinguished.
  • the determination result G is further reclassified according to which mirror is being viewed and which mirror is not being viewed, and accordingly, the detailed speech announcement data H and display data J are stored in the speech announcement information storage unit. 633 and the display information storage unit 634. Then, the output control unit 615 obtains appropriate message information H and display data J from the voice announcement information storage unit 633 and the display information storage unit 634, for example, “confirm left and right by looking at the left and right side mirrors”. It is possible to provide more detailed information such as “Please check the right side mirror and check the right.” Instead of “Please do”.
  • the notification content determination unit 614 repeats the determination process as described above for each predetermined interval until the switching from the automatic operation mode to the manual operation mode is completed, and outputs the determination result G to the output control unit 615. To do. Accordingly, the output control unit 615 appropriately acquires the message information H and the display data J corresponding to the progress of the confirmation action by the driver from the voice announcement information storage unit 633 and the display information storage unit 634, and the input / output interface unit 62 It becomes possible to output to the speaker 8 and the display screen 9 via the.
  • This state is captured by the driver monitoring sensor 7 which is a driver camera, and the video digital data F is stored in the driver monitoring data storage unit 632. Based on the video digital data F, in the first determination in the notification content determination unit 614, it is determined that the driver has seen all of the side mirrors and the rearview mirror of the vehicle 1. Therefore, this time, the voice announcement and display that were made last time will not be made.
  • the handover operation notification system 10 reliably follows the confirmation action by the driver.
  • 3 and 4 are flowcharts showing an operation example of the handover operation notification system 10 according to the present embodiment.
  • the surroundings of the vehicle 1 are always imaged by the external monitoring sensors 11 that are four cameras provided on the front side, the rear side, the right side, and the left side of the vehicle 1, respectively.
  • C (# 1 to # 4) is output to the takeover operation notification device 6.
  • These video signals C (# 1 to # 4) are converted into video digital data D (# 1 to # 4) by the input / output interface unit 62, and stored in the external monitoring data storage unit 631 by the external monitoring data acquisition unit 612. ing.
  • the driver's driving state is always imaged by the driver monitoring sensor 7 which is a driver camera installed at a position in front of the driver as on the dashboard, and an image signal E as an imaging result is obtained. It is output to the takeover operation notification device 6.
  • the video signal E is converted into video digital data F by the input / output interface unit 62, output to the driver monitoring data acquisition unit 613, and stored in the driver monitoring data storage unit 632 by the driver monitoring data acquisition unit 613.
  • the manual operation switching request signal is sent from the automatic operation control device 5 to the takeover operation notification system 10. A is output.
  • the manual operation switching request signal A is received by the input / output interface unit 62 and output to the operation mode switching signal receiving unit 611 (S1).
  • the operation mode switching signal receiving unit 611 when the manual operation switching request signal A is received, the activation signal B for starting the operation of the notification content determination unit 614 is generated, and the activation signal B is converted into the notification content determination unit 614. Is output.
  • the notification content determination unit 614 that has received the activation signal B acquires the video digital data D from the external monitoring data storage unit 631 and the video digital data F from the driver monitoring data storage unit 632 (S2).
  • the notification content determination unit 614 determines the notification content to the driver based on the video digital data D and the video digital data F, and outputs the determination result G to the output control unit 615.
  • the notification content determination unit 614 performs a first determination from the video digital data F to determine whether the driver has seen the side mirror and the rearview mirror of the vehicle 1. Further, a second determination for determining from the video digital data D whether or not a confirmation object (for example, another vehicle, a two-wheeled vehicle, a person, etc.) exists within a predetermined distance (for example, within 2 m) from the vehicle 1. Done. If it exists, it is further determined in which direction the confirmation object is present.
  • a confirmation object for example, another vehicle, a two-wheeled vehicle, a person, etc.
  • the first determination it is determined by the first determination that the driver has not seen all of the side mirrors and the rearview mirror of the vehicle 1 (there is a mirror that has not been viewed) (S3: No), and the second determination
  • S4: Yes it is determined that there is a confirmation object within a predetermined distance from the vehicle 1
  • S4: Yes the fact that the side mirror and the rearview mirror of the vehicle 1 are viewed, the attention to the confirmation object, and the confirmation object A determination is made to notify the direction of the object (first determination) (S5).
  • the first determination result G 1 is output from the notification content determination unit 614 to the output control unit 615.
  • the third determination result G 3 is output from the notification content determination unit 614 to the output control unit 615.
  • appropriate audio announcement data H is acquired from the audio announcement information storage unit 633 according to the determination result G output from the notification content determination unit 614 and output to the input / output interface unit 62.
  • Appropriate display data J is acquired from the display information storage unit 634 and output to the input / output interface unit 62 (S10).
  • the output control section 615 audio announcement data H from the voice announcement information storage unit 633 is not acquired, the display information memory No display data J is acquired from the unit 634, no data is output from the output control unit 615 to the input / output interface unit 62, and nothing is output from the speaker 8 or the display screen 9.
  • the voice announcement data H is converted into a voice signal I and output to the speaker 8.
  • a voice announcement corresponding to the voice announcement data H is output from the speaker 8 (S11).
  • the display data J is converted into the display signal K and output to the display screen 9. Thereby, the display corresponding to the display data J is made from the display screen 9 with characters, images, etc. (S12).
  • step S12 is shown after step S11, but step S11 and step S12 are performed in parallel.
  • voice announcement data H is "Check the left looking at the left and right side mirrors.”
  • the display data J may be the text information as it is, for example, an arrow display indicating a side mirror or a rearview mirror, and an arrow pointing out the right side mirror with emphasis, especially if there is an approaching vehicle on the right side. It may be a display. In response to this, the driver confirms the mirror or confirms the confirmation object to be approached.
  • steps S2 to S12 described above are repeated for each predetermined interval until the switching from the automatic operation mode to the manual operation mode is completed (S13).
  • the output control unit 615 appropriately acquires the voice announcement data H and the display data J corresponding to the progress of the confirmation action by the driver from the voice announcement information storage unit 633 and the display information storage unit 634, and the input / output interface
  • the unit 62 converts the sound signal I and the display signal J to the speaker 8 and the display screen 9, respectively.
  • voice announcement and display are made from the speaker 8 and the display screen 9.
  • the second determination result G 2 is output by the notification content determining section 614, from the speaker 8, "Check the left looking at the left and right side mirrors.” Look at "room mirror behind ”(S11), and a display related to that is made from the display screen 9 (S12). In response, the driver sees the left and right side mirrors and the room mirror. .
  • step S3 it is determined by the notification content determination unit 614 that the driver has seen all of the side mirrors and the rearview mirror of the vehicle 1 (S3: Yes).
  • the external monitoring sensor 11 before takeover to the manual operation mode is completed.
  • a confirmation object for example, another vehicle, a two-wheeled vehicle, a person, etc.
  • a predetermined distance for example, within 2 m
  • the surroundings of the vehicle 1 are imaged by the external monitoring sensor 11 that is a camera, and the other is within a predetermined distance from the vehicle 1 based on the imaging result. It can be determined whether or not a confirmation target exists.
  • operator monitoring sensor 7 which is a driver camera can image a driver
  • the takeover operation necessary for taking over the line of sight is given to the driver with an appropriate content according to the current situation. It is possible to notify.
  • the determination result made in the notification content determination unit 614 is finely defined, and the sound announcement data H and the display data J are prepared in detail accordingly, and are stored in the sound announcement information storage unit 633 and the display information storage unit 634. This makes it possible to provide more detailed notification information.
  • the driver since the driver is not informed of unnecessary information but only necessary information is provided, the driver can surely concentrate on the takeover operation of the line of sight without feeling excessive frustration. It becomes like this.
  • radar transceivers are provided at the front, rear, right and left sides of the vehicle 1 in place of the cameras. Then, the front radar transceiver emits a radar in front of the vehicle 1 and receives a reflected wave of this radar. On the other hand, a rear radar transceiver emits a radar behind the vehicle 1 and receives a reflected wave of the radar. Similarly, the right radar transceiver emits a radar on the right side of the vehicle 1 and receives a reflected wave of the radar, and the left radar transceiver emits a radar on the left side of the vehicle 1 and reflects the radar. Receive waves.
  • Each radar transceiver outputs a received signal to the takeover operation notification device 6.
  • the input / output interface unit 62 receives the received signal and outputs it as external monitoring data to the external monitoring data acquisition unit 612.
  • the external monitoring data acquisition unit 612 stores the external monitoring data in the external monitoring data storage unit 631.
  • the notification content determination unit 614 acquires the external monitoring data from the external monitoring data storage unit 631, and determines whether or not a confirmation target exists within a predetermined distance from the vehicle 1 based on the acquired external monitoring data. To do. For example, if the received signal strength is higher than a predetermined value, it is determined that the confirmation target exists within a predetermined distance from the vehicle 1. Furthermore, when the confirmation target exists, the size of the confirmation target can also be determined according to the received signal strength. This makes it possible to distinguish between a small car and a large car.
  • Modification 2 instead of the display screen 9 in the above embodiment, a light source provided on a cover of a side mirror or a room mirror can be used.
  • the output control unit 615 turns on the light source provided on the cover of the right side mirror. Also, if it is a notification that the left side mirror is to be viewed, the output control unit 615 turns on the light source provided on the cover of the left side mirror, and if it is a notification that the rear view mirror is to be viewed, the output is output. The control unit 615 turns on the light source provided on the cover of the room mirror. When there are a plurality of mirrors to be viewed, the light sources provided on the covers of all the corresponding mirrors are turned on.
  • An apparatus for informing information for prompting a driver to take over when switching the driving mode of the vehicle from the automatic driving mode to the manual driving mode comprising a processor and a memory
  • the memory is A first storage unit that stores first sensing data representing the state of the driver;
  • a second storage unit that stores second sensing data representing a surrounding state of the vehicle,
  • the processor is Obtaining the first sensing data from the first monitoring sensor and storing it in the first storage unit, Obtaining the second sensing data from a second monitoring sensor and storing it in the second storage unit;
  • Based on the first sensing data and the second sensing data determine the content of the information that prompts the takeover operation,
  • a notification device that controls to output the information whose content is determined from a notification unit provided in the vehicle.
  • a system for notifying a driver of information necessary for a takeover operation when a vehicle driving mode is switched from an automatic driving mode to a manual driving mode the processor, a memory, a first monitoring sensor, A second monitoring sensor and a notification unit
  • the memory is A first storage unit that stores first sensing data representing the state of the driver;
  • a second storage unit that stores second sensing data representing a surrounding state of the vehicle,
  • the first monitoring sensor monitors a state of a driver of the vehicle;
  • the second monitoring sensor monitors the surroundings of the vehicle,
  • the processor is Obtaining the first sensing data from the first monitoring sensor and storing it in the first storage unit; Obtaining the second sensing data from the second monitoring sensor and storing it in the second storage unit; Based on the first sensing data and the second sensing data, determine the content of the information that prompts the takeover operation, Performing control to output the information whose contents are determined;
  • the notification unit is configured to output the determined notification content under the control.
  • Appendix 3 A method for notifying a takeover operation required when switching a driving mode of a vehicle from an automatic driving mode to a manual driving mode, Monitoring the condition of the driver of the vehicle by a first monitoring sensor; Monitoring the surroundings of the vehicle by a second monitoring sensor; The processor obtains first sensing data representing the state of the driver from the first monitoring sensor, and obtains second sensing data representing the surrounding state of the vehicle from the second monitoring sensor. Then, based on the first sensing data and the second sensing data, a notification content that prompts the takeover operation is determined, and the vehicle is notified to the driver in order to notify the determined content to the driver.
  • a notification method for controlling a provided notification unit Monitoring the condition of the driver of the vehicle by a first monitoring sensor; Monitoring the surroundings of the vehicle by a second monitoring sensor; The processor obtains first sensing data representing the state of the driver from the first monitoring sensor, and obtains second sensing data representing the surrounding state of the vehicle from the second monitoring sensor. Then, based on the first sensing data and the second sens

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Human Computer Interaction (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Traffic Control Systems (AREA)
  • Control Of Driving Devices And Active Controlling Of Vehicle (AREA)

Abstract

L'invention concerne un dispositif d'alarme (6) comprenant : une première unité d'acquisition (613) qui acquiert des premières données de détection indiquant l'état d'un conducteur à partir d'un premier capteur de surveillance (7) ; une seconde unité d'acquisition (612) qui acquiert des secondes données de détection indiquant l'état de l'environnement du véhicule à partir d'un second capteur de surveillance (11) ; une unité de détermination (614) qui détermine la nature des informations demandant un fonctionnement continu d'après des premières données de détection et des secondes données de détection ; et une unité de commande (615) qui effectue une commande pour générer, à partir des unités d'alarme (8 9) fournies au véhicule, des informations dont la nature a été déterminée.
PCT/JP2017/042559 2017-03-10 2017-11-28 Dispositif d'alarme, système d'alarme, procédé d'alarme et programme de commande d'alarme WO2018163535A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2017-046334 2017-03-10
JP2017046334A JP2018151763A (ja) 2017-03-10 2017-03-10 報知装置、報知システム、報知方法、および報知制御プログラム

Publications (1)

Publication Number Publication Date
WO2018163535A1 true WO2018163535A1 (fr) 2018-09-13

Family

ID=63448519

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/042559 WO2018163535A1 (fr) 2017-03-10 2017-11-28 Dispositif d'alarme, système d'alarme, procédé d'alarme et programme de commande d'alarme

Country Status (2)

Country Link
JP (1) JP2018151763A (fr)
WO (1) WO2018163535A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110562269A (zh) * 2019-08-08 2019-12-13 驭势科技（北京）有限公司 一种智能驾驶车辆故障处理的方法、车载设备和存储介质
US20210295073A1 (en) * 2018-01-29 2021-09-23 Futurewei Technologies, Inc. Primary preview region and gaze based driver distraction detection
CN113879320A (zh) * 2020-07-01 2022-01-04 丰田自动车株式会社 驾驶员监视系统以及驾驶员监视方法

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015185088A (ja) * 2014-03-26 2015-10-22 日産自動車株式会社 情報呈示装置及び情報呈示方法
US20160209840A1 (en) * 2015-01-20 2016-07-21 Lg Electronics Inc. Apparatus for switching driving mode of vehicle and method thereof
JP2017001563A (ja) * 2015-06-11 2017-01-05 パナソニックＩｐマネジメント株式会社 車両制御装置、車両制御方法および車両制御プログラム
JP2017021731A (ja) * 2015-07-15 2017-01-26 日立オートモティブシステムズ株式会社 運転状態監視方法，装置，およびそれを備えた車両
JP2017030555A (ja) * 2015-07-31 2017-02-09 トヨタ自動車株式会社 車両制御装置

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6508095B2 (ja) * 2016-03-11 2019-05-08 トヨタ自動車株式会社 車両の自動運転制御システム

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015185088A (ja) * 2014-03-26 2015-10-22 日産自動車株式会社 情報呈示装置及び情報呈示方法
US20160209840A1 (en) * 2015-01-20 2016-07-21 Lg Electronics Inc. Apparatus for switching driving mode of vehicle and method thereof
JP2017001563A (ja) * 2015-06-11 2017-01-05 パナソニックＩｐマネジメント株式会社 車両制御装置、車両制御方法および車両制御プログラム
JP2017021731A (ja) * 2015-07-15 2017-01-26 日立オートモティブシステムズ株式会社 運転状態監視方法，装置，およびそれを備えた車両
JP2017030555A (ja) * 2015-07-31 2017-02-09 トヨタ自動車株式会社 車両制御装置

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20210295073A1 (en) * 2018-01-29 2021-09-23 Futurewei Technologies, Inc. Primary preview region and gaze based driver distraction detection
US11977675B2 (en) * 2018-01-29 2024-05-07 Futurewei Technologies, Inc. Primary preview region and gaze based driver distraction detection
CN110562269A (zh) * 2019-08-08 2019-12-13 驭势科技（北京）有限公司 一种智能驾驶车辆故障处理的方法、车载设备和存储介质
CN113879320A (zh) * 2020-07-01 2022-01-04 丰田自动车株式会社 驾驶员监视系统以及驾驶员监视方法
CN113879320B (zh) * 2020-07-01 2024-04-09 丰田自动车株式会社 驾驶员监视系统以及驾驶员监视方法

Also Published As

Publication number Publication date
JP2018151763A (ja) 2018-09-27

Similar Documents

Publication Publication Date Title
JP7115270B2 (ja) 自動運転システム
CN110341695B (zh) 车辆控制装置、包括该装置的系统及其方法
US20190004513A1 (en) Driving assistance control apparatus
JP6350468B2 (ja) 運転支援装置
JP6524129B2 (ja) 運転支援装置
US20200377126A1 (en) Information output control device and information output control method
JP6690666B2 (ja) 警報装置、警報システム及び携帯端末
JP6494782B2 (ja) 報知制御装置及び報知制御方法
JP2016090274A (ja) 警報装置、警報システム及び携帯端末
US11062598B2 (en) Method, mobile user device, and computer program for producing visual information for at least one occupant of a vehicle
CN110582436B (zh) 转向辅助系统和方法
CN109844842B (zh) 驾驶模式切换控制装置、系统、方法以及存储介质
JP7314991B2 (ja) 運転支援方法及び運転支援装置
JP7151495B2 (ja) 自動運転システム
WO2018163470A1 (fr) Dispositif, système, et procédé de commande de commutation de mode de conduite
JP5838547B2 (ja) 運転支援装置
JP2005332297A (ja) 運転者意志通知装置
WO2018163535A1 (fr) Dispositif d'alarme, système d'alarme, procédé d'alarme et programme de commande d'alarme
JP2019116244A (ja) 車両
JP6949288B2 (ja) 運転支援装置、運転支援システムおよび運転支援方法
US20220100190A1 (en) Method For Operating A Motor Vehicle As A Road User On A Road And Motor Vehicle
JP7573672B2 (ja) 車両制御装置、車両制御方法、およびプログラム
JP7445696B2 (ja) 制御装置
JP7478052B2 (ja) 車両用運転支援装置
JP2019175077A (ja) 車両用警報装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17899808

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17899808

Country of ref document: EP

Kind code of ref document: A1