JP2020095421A - Information presentation system, and information presentation processor and program of the same - Google Patents

Abstract

To properly transmit information to an object person such as a driver of an automobile according to a condition of any of various sensory loads incurred by the object person.SOLUTION: An information presentation system 10 includes: input information acquisition means 11 that acquires input information; information transmission means 12 that acts to be able to transmit output information through some sensations of an object person; and an information presentation processor 13 that generates the output information on the basis of the input information, and activates the information transmission means 12 according to the output information. The input information acquisition means 11 acquires, as the input information, factor information representing a factor for use in identifying the contents of presentation of the output information, and transmission influence information that affects transmission of the output information. The information presentation processor 13 infers for each sensation the condition of a load, which is associated with a capacity of an information absorption ability for each sensation of the object person, from the transmission influence information, adjusts the timing of presenting the output information according to the type of the output information, and presents the output information through a sensation bringing about a little load.SELECTED DRAWING: Figure 1

Description

The present invention relates to an information presentation system, an information presentation processing device, and a program thereof for effectively transmitting various information to a predetermined target person through various senses of the target person.

In the recent automobile society, the limit of the number of traffic accident reductions has become a big issue, and as a countermeasure against it, in recent years, highly intelligent driving technology from the viewpoint of realizing fully automatic driving has been attracting attention. Until now, not only realization of automatic driving in a limited environment but also a variety of technologies that support driver's recognition, judgment, and operation have been implemented. Are expected to reduce traffic accidents and the burden on drivers. However, it is said that more than 70% of the causes of automobile accidents are lack of awareness of the driver's dangerous state, and although the driver assistance system provides various assistance, a traffic accident occurs. The limit of the driver's attention capacity can be considered as a factor causing this. For example, in a situation in which there is a large amount of traffic and there is a large amount of information based on visual recognition such as signs and pedestrians, the driver's visual attention amount increases relative to other senses. In such a situation, if visual assistance such as alerting using a video image is provided, the visual cognitive load of the driver is further increased, and the performance of the driver is deteriorated. Moreover, although there are individual differences, if the attention capacity exceeds the limit, the support to the driver may be overlooked.

Patent Document 1 discloses a vehicle alerting device. This alerting device estimates the driver's attention level from the running state of the vehicle, and when abnormal behavior of the vehicle is detected, it presents the alerting information by hearing, sight and touch to the driver. There is.

JP, 2016-162015, A

However, in the alerting device of Patent Document 1, the attention level is lowered and the abnormal behavior of the vehicle may occur without considering various situations that affect information transmission, such as the state of the driver and the surrounding environment. When detected, a uniform alert is issued. Therefore, depending on the situation of the driver, the surrounding environment, and the like, if there is a sense that the driver has a high load at the time of alerting, the alert information is also given to the sense. As a result, the attention of the turning point cannot be effectively transmitted to the driver effectively, which is not always sufficient as driving support. That is, for example, when the density of surrounding cars and pedestrians is high, or when the visibility is poor such as driving at night or in the rain, the load on the driver's visual recognition is high, and in this case, the visual display such as display is displayed. The effect of transmitting the warning to the driver is low. In addition, for example, when the volume inside and outside the vehicle is high, or when the position of the sound source heard by the driver and the number of types of sounds are large, the load on the driver's auditory perception is high. The effect of transmitting attention to the driver through the hearing such as the generation of the sound is low. As in these cases, if more information is presented to the sense of high load, the psychological burden on the driver increases, and conversely, the driver's consciousness may become even more distracting.

The present invention has been devised by focusing on such a problem, and its purpose is to appropriately suit the target person according to the state of various sensory loads of the target person such as a driver of an automobile. An object of the present invention is to provide an information presentation system capable of transmitting information, an information presentation processing device, and a program thereof.

In order to achieve the above-mentioned object, the present invention is mainly an information presenting system for presenting output information generated based on predetermined input information to a subject, and an input information obtaining unit that obtains the input information, and the subject. Information transmission means that operates to transmit the output information to the target person through some senses of the person, and information presentation that generates the output information based on the input information and operates the information transmission means according to the output information. The input information acquisition means comprises, as the input information, element information made up of elements for specifying presentation content of the output information, and transmission influence information that influences transmission of the output information. Obtained, the information presentation processing means, from the transmission influence information, to estimate the state of the load corresponding to the capacity of the information absorption capacity in each sense of the subject for each of the senses, depending on the type of the output information While adjusting the timing of presenting the output information, the output information is transmitted from the information transmitting means to the target person through the sensation with the small load.

In the present invention, the transmission influence information that influences the transmission of the output information is acquired as the input information, the state of the sensory load of the subject is estimated for each sense from the transmission influence information, and the result is used. The output information presentation is adjusted accordingly. In other words, when the target person receives the information, a sensation that the target person has a sufficient information absorption capacity is specified, and the output information is presented to the target person through the sensation, and the output information is It will be easier to reach the target person properly. Further, by determining the presentation timing according to the type of output information, the output information can be effectively transmitted to the target person.

It is a block diagram showing the whole composition of the information presentation system concerning this embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

FIG. 1 is a block diagram showing the overall configuration of the information presentation system according to this embodiment. In this figure, the information presentation system 10 generates various kinds of driving support information (output information) including attention information for driving a vehicle based on predetermined input information and presents it to a driver (target person). It is a system that does.

The information presentation system 10 includes an input information acquisition unit 11 that acquires various input information, an information transmission unit 12 that operates so as to transmit driving support information through various senses of a driver, and an input information acquisition unit 11. The information presenting processing device 13 functions as information presenting processing means that generates driving assistance information based on input information and operates the information transmitting means 12 according to the driving assistance information.

The input information acquisition unit 11 acquires, as the input information, element information that is an element for specifying the presentation content of the driving support information and transmission influence information that influences the transmission of the driving support information.

The input information acquisition means 11 includes an environment information acquisition unit 15 that acquires environment information related to the driving environment of the driver, a driver information acquisition unit 16 that acquires driver information related to the state of the driver, and a driving behavior of the driver. It is configured by an action information acquisition unit 17 that obtains action information regarding the above and an external information acquisition unit 18 that obtains external information transmitted to the driver from the outside.

The environment information acquisition unit 15 includes sensors such as a range sensor that can detect vehicle surrounding information indicating the existence and positional relationship of objects such as people and objects existing around the automobile, and map information generated externally. Receiving devices that can receive road traffic information such as traffic information and congestion information, microphones that are placed at multiple locations to detect the volume and number of sound sources inside the car, vibrations and centrifugal force applied to the car, etc. And sensors such as an acceleration sensor and a vibration sensor capable of detecting The environment information acquired and detected by these is used as the element information and the transmission influence information according to the type.

The driver information acquisition unit 16 includes a camera, a sensor, and the like that can detect the driver's state, and peripheral devices thereof. Based on the detection result, the driver's face orientation and the driver can be identified by a known method. It is possible to determine sleepiness based on eye movements and to estimate the mental burden on the driver based on vital data such as heart rate and brain waves. The driver information acquired here is mainly used as the element information.

The action information acquisition unit 17 detects the driver's turn signal operation, the steering angle by the driver's steering wheel operation, the speed change at the time of driving due to the operation of the brake or the accelerator, etc. by various in-vehicle sensors, thereby It is possible to estimate the state of driving behavior. The action information acquired here is mainly used as the element information.

The external information acquisition unit 18 includes a terminal such as a smartphone, and can receive external information at a predetermined timing. The external information acquired here is mainly used as the element information.

The information transmitting means 12 transmits the visual assistance device 20 for transmitting the driving assistance information through the sight of the driver, the auditory transmission device 21 for transmitting the driving assistance information through the hearing of the driver, and the driving assistance information through the tactile sense of the driver. And a tactile transmission device 22 for transmitting.

The visual transmission device 20 is an image display device that displays visual information including predetermined characters and images that can be visually recognized by the driver. The image display device is not particularly limited, but a head-up display or the like capable of presenting visual information on the lower side of the front window of an automobile can be exemplified. For example, when the driving support information is attention information, the front, rear, left, and right sides of the vehicle can be divided into eight directions, and a mark or the like for the driver to visually recognize in which direction the attention can be displayed. ing.

The auditory sense transmission device 21 is a sound generation device that emits auditory information consisting of a predetermined sound that the driver can hear. The sound generating device is not particularly limited, but a speaker that generates a predetermined sound independently from each of the eight directions around the driver can be exemplified, and for example, when the driving support information is attention information, It is arranged at a plurality of locations inside the vehicle so that the driver can identify in which direction the attention is directed.

The tactile transfer device 22 is a vibration generator that applies a predetermined vibration to the driver as tactile information. This vibration generating device is not particularly limited, but is arranged so as to be able to vibrate independently at each of eight places in the seat on which the driver is seated. For example, when the driving support information is attention information, The driver is provided so that the driver can detect in which of the eight directions corresponding to the eight locations the attention is directed.

As the information transmission means 12, various other human interfaces can be applied as long as various driving support information can be transmitted through various senses.

The information presentation processing device 13 is composed of a computer having an arithmetic processing device such as a CPU and a storage device such as a memory or a hard disk, and a program for causing the computer to function as the following units is installed.

The information presentation processing device 13 estimates, for each sensation, the state of the load corresponding to the capacity of the information absorbing capacity in each sensation of the driver from the transmission influence information, and according to the type of the driving assistance information, the driving assistance information. The driving support information is transmitted from the predetermined information transmission means 12 to the driver through a feeling of less load while adjusting the timing of presenting.

That is, the information presentation processing device 13 includes a presentation content identification unit 24 that identifies the presentation content of the driving support information from the element information, and a load state estimation unit that estimates the load state for each sense of the driver from the transmission influence information. 25, a transmission information adjustment unit 26 that adjusts the presentation content identified by the presentation content identification unit 24 based on the identification by the presentation content identification unit 24 and the estimation by the load state estimation unit 25, and information transmission to the driver. The achievement level determination processing unit 27 that determines the achievement level in step 1 and performs processing according to the achievement level.

In the presentation content specifying unit 24, first, it is determined whether or not there is a need for information presentation based on the element information in the input information. Then, when it is determined that the information presentation is necessary, based on the database stored in advance, from among various element information, the type of the driving support information, the presentation timing, and the information Three types of senses to be transmitted, that is, visual, auditory, and tactile priorities are specified.

For example, when the driver information acquisition unit 16 detects the driver information indicating that the driver is in the dozing state as the element information, the presentation content is specified as follows. That is, from the database, as the driving support information, attention information that serves as a warning for the driver to cancel the dozing state is selected, and as information presentation timing, information presentation is selected immediately, and further. , It is specified that the priority order of the sense of presenting information is the order of hearing and tactile sense, and that information is not presented visually.

Further, for example, when the environmental information acquisition unit 15 acquires the environmental information indicating that there is traffic congestion, road closure, etc. at a predetermined point on the traveling route to some extent, as the element information, it is presented as follows. The content is specified. That is, from the database, route suggestion information for proposing a detour route to the driver is selected as driving support information, and information presentation is selected as information presentation timing within a predetermined time until the next intersection. Further, it is specified that the priority order of the sense of presenting information is the order of sight and hearing, and that information is not presented by tactile sense.

The load state estimation unit 25 uses a database stored in advance, and as a sensory load of the driver, a visual load that is a visual load, an auditory load that is an auditory load, and a tactile sense. Is estimated to be a tactile load. Each of these loads is specified by the database in a plurality of stages from a low state to a high state, a numerical value, or the like, according to each parameter described later that is grasped by the transmission influence information in the input information.

The parameters in the visual load are not particularly limited, but include the traffic volume around the vehicle, the number of pedestrians around the vehicle, the number of signs around the vehicle, the rainfall amount, and the difference between daytime and nighttime. It can be illustrated.

The parameter in the tactile load is not particularly limited, but the volume heard by the driver and the number of sound sources can be exemplified.

The parameter for the tactile load is not particularly limited, but examples thereof include the vibration state of the vehicle body on the road and the magnitude of inertial force.

The transmission information adjusting unit 26 presents driving assistance information for the presentation content identified by the presentation content identifying unit 24, based on the sensory load states of the driver estimated by the load state estimating unit 25. One of the devices 20 to 22 of the power information transmission means 12 is determined, and a command to operate the device 20 to 22 is issued. Here, the relations stored in the database by the data based on the experiment conducted in advance, that is, the respective levels (sizes and stages) of the visual load, the auditory load, and the tactile load, and the state of each of these loads are integrated. Then, the relationship with the priority of the feeling transmitted to the driver is used.

For example, when driving at night in the rain with poor visibility, there are many objects such as traffic volume, pedestrians, signs, etc. in the driver's field of view, but the volume heard by the driver is low and the load condition estimation unit According to 25, the auditory sense and the tactile sense have more room for absorbing information than the visual sense. Therefore, the transmission information adjusting unit 26 performs the following processing in comparison with the presentation content identified by the presentation content identifying unit 24. For example, in the presentation content specifying unit 24, when the visual sense is given the highest priority as a sensation of presenting the corresponding driving support information, and the tactile transmission is inappropriate, the transmission information adjusting unit 26 causes the load state estimating unit. From the estimation result of No. 25, the sense of the object for which information is presented is changed from visual to auditory, and the driving support information by sound is transmitted to the auditory transfer device 21.

That is, in the transmission information adjusting unit 26, the load priority of each sense of the driver estimated by the load state estimating unit 25 at the information presentation timing identified by the presentation content identifying unit 27 and the presentation content identifying unit 27 determine. In consideration of the priority of each sense to be transmitted, the sense having the least load that is optimal for information presentation is selected at the timing, and any of the devices 20 to 22 of the information transmitting means 12 corresponding to the sense is selected. Information is presented depending on the situation.

In the achievement degree determination processing unit 27, after the driving support information such as the alert information is presented from the information transmission unit 12, it is already presented at predetermined time intervals based on the element information from the input information acquisition unit 11. It is determined whether the driving assistance information is effectively transmitted. Then, when it is determined that the driving assistance information has not been effectively transmitted to the driver, for example, the dangerous state to be alerted has not been avoided, the load state estimation unit 25 and the transmission information adjustment are performed again. The information presentation is performed again through the above-described processing in the unit 26. In addition, when the same driving support information is repeatedly presented to the driver with the same feeling, the transmission information adjusting unit 26 may further increase the intensity of information transmission as compared with the previous stage. On the other hand, if it is determined that the driving assistance information has been effectively transmitted to the driver, such as the avoidance of a dangerous state to be alerted, the same driving assistance information is not presented thereafter.

Driver assistance by the information presentation system 10 having the above configuration will be described below with reference to assistance cases.

The first example of assistance is the presentation of driving assistance information that calls attention when changing lanes. In this case, when the driver changes the lane, the driver operates the turn signal to enter the target lane without noticing the vehicle behind the target lane. At this time, the input information acquisition unit 11 acquires the environment information regarding the existence and positional relationship of the rear vehicle and the action information regarding the turn signal operation as the element information. Then, the presentation content identifying unit 24 identifies, as the type of the alerting information, warning information indicating that another vehicle, which is a dangerous object, exists behind the turn signal operation direction. In addition, here, it is determined that the attention information should be transmitted at an immediate timing, and the attention information is prioritized in the order of sight, hearing, and tactile as the priority order of the sense of transmitting information to the driver. It However, from the transmission influence information, as the current situation, when the vehicle is traveling at night under heavy rain and the density of other vehicles is high, the load state estimating unit 25 determines that the load of sight and hearing is high. To be done. Therefore, the transmission information adjusting unit 26 changes the priority order of presenting the attention information specified by the presentation content specifying unit 24, and selects the haptic that can be transmitted to the driver most effectively according to the current situation. It Then, the tactile transmission device 22 vibrates the portion of the seat corresponding to the position of the vehicle behind the target lane, thereby making it easier for the driver to notice the presence of another vehicle.

A second example of assistance is the presentation of driving assistance information that alerts the driver while looking aside. In this case, the driver information relating to the driver's inattentive driving state detected from the driver's face orientation is acquired by the input information acquisition unit 11 as the element information. Then, the presentation content identifying unit 24 identifies, as the type of the alerting information, warning information to the effect that the driver will stop looking aside and pay attention to the front. In addition, here, it is determined that the attention information should be transmitted at an immediate timing, and regarding this attention information, the order of hearing and tactile is prioritized as the priority order of the sense of transmitting information to the driver. It is said that the communication will not be carried out. However, based on the transmission influence information, as the current situation, when the amount of traffic is small but music is ringing in the vehicle, the load state estimation unit 25 determines that the hearing load is high. Therefore, the transmission information adjusting unit 26 excludes the selection of auditory sense from the senses identified by the presentation content identifying unit 24, and selects the tactile sense that can be transmitted to the driver most effectively according to the current situation. .. Then, by vibrating all parts of the tactile transmission device 22 provided on the seat, the driver is alerted to stop the inattentive driving.

A third example of assistance is the presentation of driving assistance information that suggests a detour route based on traffic congestion information. In the case, environment information including traffic congestion information and the like is acquired by the input information acquisition unit 11 as the element information. Then, in the presentation content identifying unit 24, the searched detour route is identified as the driving assistance information, and the presentation timing of the information is identified according to the situation such as the approaching point to be detoured. Further, in this case, since it is assumed that the time for the driver to understand the visual information is longer than that for the auditory sense, it is considered that the auditory sense and the visual sense order are prioritized for the sense of transmitting information to the driver. Due to the nature of, tactile transmission is excluded. Here, from the transmission influence information, when the traffic at the time of presentation is small and the environmental sound inside the vehicle is quiet, the load state estimation unit 25 does not have a high load on all senses. To be judged. Therefore, in the transmission information adjusting unit 26, from the above-mentioned senses identified by the presentation content identifying unit 24, the sense of hearing that can be immediately transmitted to the driver is the sense that can be most effectively transmitted to the driver in the present situation. To be selected. Then, the detour route is proposed by the sound generated from the auditory sense transmission device 21.

As described above, according to the present embodiment, when presenting the driving assistance information for calling attention to the driver, the state of the attention capacity of the driver is estimated according to the situation such as the environment at the information presentation timing, It is possible to select a sensation with a small capacity and effectively transmit the reminder information to the driver, and it is possible to suppress useless information transmission for a sensation that exceeds the caution capacity limit.

Note that the various input information and the driving support information described above are merely examples, and the contents of these information are not particularly limited.

Further, in the above-described embodiment, the case where the driver of the automobile is targeted and various driving support information including the alert information is presented and described, but the present invention is not limited to this, and various output information is predetermined. It can be applied to all systems presented to the target person.

In addition, the configuration of each part of the device in the present invention is not limited to the illustrated configuration example, and various modifications can be made as long as substantially the same action is exhibited.

10 information presentation system 11 input information acquisition means 12 information transmission means 13 information presentation processing device (information presentation processing means)
24 presentation content specifying unit 25 load state estimating unit 26 transmission information adjusting unit 27 achievement level determination processing unit

Claims (9)

In an information presentation system that presents output information generated based on predetermined input information to a subject,
Input information acquisition means for acquiring the input information, information transmission means operable to transmit the output information to the target person through some sense of the target person, and the output information is generated based on the input information. An information presentation processing unit that operates the information transmission unit according to the output information,
In the input information acquisition means, as the input information, element information including an element for specifying the presentation content of the output information, and transfer influence information that affects the transfer of the output information are acquired,
In the information presentation processing means, from the transmission influence information, the state of the load corresponding to the capacity of the information absorbing ability in each sense of the subject is estimated for each sense, and the output information is determined according to the type of the output information. The information presenting system characterized in that the output information is transmitted from the information transmitting means to the target person through the sensation with the small load while adjusting the timing of presenting. In an information presentation system that presents output information generated based on predetermined input information to a subject,
Input information acquisition means for acquiring the input information, information transmission means operable to transmit the output information to the target person through some sense of the target person, and the output information is generated based on the input information. An information presentation processing unit that operates the information transmission unit according to the output information,
In the input information acquisition means, as the input information, element information including an element for specifying the presentation content of the output information, and transfer influence information that affects the transfer of the output information are acquired,
The information presentation processing means, based on the presentation content identification unit that identifies the presentation content from the element information, and the transmission influence information, the state of the load corresponding to the capacity of the information absorbing ability in each sense of the subject is the sense. A load state estimating unit that estimates each time, and a transmission information adjusting unit that adjusts the presentation content based on the specification in the presentation content identifying unit and the estimation in the load state estimating unit,
The information presentation system, wherein the transmission information adjustment unit operates the information transmission means so as to transmit the adjusted output information to the target person through a feeling that the load is small. In the presentation content specifying unit, the type of the output information, the presentation timing thereof, and the priority of each sense to be transmitted as the presentation content correspond to the element information by the database stored in advance. The information presentation system according to claim 2, wherein the information presentation system is specified. In the load state estimating unit, a visual visual load, an auditory auditory load, and a tactile tactile load correspond to the transfer influence information as the loads by using a database stored in advance. The information presentation system according to claim 2, wherein the information presentation system is estimated as In the transmission information adjusting unit, the relationship between the degree of the load in each of the sensations and the priority of the sensation that is transmitted to the target person by integrating the states of these loads is stored in advance, and the priority is stored. 3. The information presenting system according to claim 2, wherein the sensation for which the output information is to be presented is specified from the presentation content, and the information transmitting means is operated so that information is transmitted through the sensation. The information presentation processing means further comprises an achievement level determination processing unit that determines an achievement level in information transmission to the target person and performs processing according to the achievement level. Presentation system. In an information presentation system that generates various driving support information including attention information for driving a vehicle based on predetermined input information and presents it to the driver,
Input information acquisition means for acquiring the input information, information transmission means operable to transmit the driving support information to the driver through some sense of the driver, and the output information is generated based on the input information. And an information presentation processing unit that operates the information transmission unit according to the output information,
In the input information acquisition means, the input information is acquired by including element information including elements for specifying the presentation content of the driving support information, and transfer influence information that affects the transfer of the drive support information. ,
In the information presentation processing means, the state of the load corresponding to the capacity of the information absorbing ability in each sense of the driver is estimated for each sense from the transmission influence information, and the driving is performed according to the type of the driving support information. An information presenting system characterized in that the driving support information is transmitted from the information transmission means to the driver through the sensation with the light load while adjusting the timing of presenting the support information. In an information presentation processing device that performs processing for presenting predetermined output information to the target person through some sense of the target person based on predetermined input information,
A load state estimation unit that estimates a state of a load corresponding to the capacity of the information absorbing ability in each sense of the subject for each sense, and a transmission that selects the sense that presents the output information based on the estimation of the load. With an information adjustment unit,
In the load state estimation unit, the state of the load is estimated based on the input information that affects the transmission of the output information to the target person,
The information presentation processing device, wherein the transmission information adjusting unit selects the sensation used for presenting the output information so that the output information is transmitted to the target person through the sensation with the small load. .. In a program of an information presentation processing device that performs processing for presenting predetermined output information to the target person through some sense of the target person based on predetermined input information,
A load state estimation unit that estimates a state of a load corresponding to the capacity of the information absorbing ability in each sense of the subject for each sense, and a transmission that selects the sense that presents the output information based on the estimation of the load. Let the computer function as an information adjustment unit,
In the load state estimation unit, the state of the load is estimated based on the input information that affects the transmission of the output information to the target person,
The information presentation processing device, wherein the transmission information adjusting unit selects the sensation used for presenting the output information so that the output information is transmitted to the target person through the sensation with the small load. Program of.

Images