JP2020047129A - Information processor, information processing method, information processing program, and storage medium - Google Patents

Abstract

To provide an information processor capable of effectively assisting driver's auditory recognition for an external situation of a moving body; an information processing method; an information processing program; and a storage medium.SOLUTION: A second information processor 120 includes: a sound obtaining unit 113 for obtaining an outer sound of a moving body 1; a driving information obtaining unit 121 for obtaining driving information related to both behavior of the moving body 1 and behavior of a driver of the moving body 1; and a storage processing unit 122 for storing, in a storage unit 130, information related to a sound which the driver easily fails to hear, on the basis of the outer sound and the driving information.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an information processing apparatus for performing information processing on a moving object, an information processing method, an information processing program, and a storage medium storing the information processing program.

  2. Description of the Related Art Conventionally, as an example of information processing on a moving body, information processing for determining whether or not there is a target that is difficult for a driver to visually recognize is present outside the moving body (for example, see Patent Document 1). . In the information processing described in Patent Literature 1, it is determined whether or not there is an object that is difficult to visually recognize based on an image or the like outside the moving object. According to such information processing, by notifying the driver of various types according to the determination result, the driver can be appropriately alerted.

JP 2014-30212 A

  Here, when the driver recognizes the external situation of the moving body, the driver often frequently recognizes the external situation aurally. However, auditory perception is currently left to the driver's individual auditory ability and concentration, and information processing that effectively assists the driver's auditory perception of the situation outside the moving object is not considered. It has not been done yet.

  Therefore, an object of the present invention is to provide an information processing apparatus, an information processing method, an information processing program, and a storage medium that can effectively assist a driver's auditory recognition of a situation outside a moving object. Etc. are mentioned as an example.

  In order to solve the above-described problems and achieve the object, an information processing device of the present invention includes a sound acquisition unit that acquires a sound outside a moving object, a behavior of the moving object, and a behavior of a driver of the moving object. A driving information acquisition unit that acquires driving information relating to at least one of the above, and a processing unit that stores information about sounds that the driver easily misses in a storage unit based on the external sound and the driving information. It is characterized by the following.

  Further, in order to solve the above-described problem and achieve the object, an information processing method of the present invention includes a sound acquisition step of acquiring a sound outside a moving body, and a behavior of the moving body and a driver of the moving body. A driving information acquisition step of acquiring driving information relating to at least one of the behaviors, and a processing step of storing, in a storage unit, information relating to a sound that is easily missed by the driver based on the external sound and the driving information. It is characterized by having.

  In order to solve the above-described problems and achieve the object, an information processing program according to the present invention causes a computer to execute the above-described information processing method according to the present invention.

  In order to solve the above-mentioned problems and achieve the object, a storage medium of the present invention stores the above-described information processing program of the present invention.

FIG. 2 is a schematic block diagram illustrating the information processing apparatus according to the first embodiment, which is mounted on a moving body. FIG. 2 is a schematic diagram illustrating information stored in a storage unit illustrated in FIG. 1. FIG. 2 is a schematic diagram illustrating an information table used by a determination unit illustrated in FIG. 1 for determination. FIG. 2 is a schematic diagram illustrating an information table used by a storage processing unit illustrated in FIG. 1 to determine driving information. 3 is a flowchart illustrating a flow of a process in an information processing method executed by the first information processing apparatus illustrated in FIG. 1. 3 is a flowchart illustrating a flow of a process in an information processing method executed by the second information processing apparatus illustrated in FIG. 1. FIG. 11 is a schematic diagram illustrating a moving object and a server according to a second embodiment. FIG. 8 is a schematic block diagram illustrating an information processing device in each of the moving object and the server illustrated in FIG. 7.

  Hereinafter, embodiments of the present invention will be described. An information processing device according to an embodiment of the present invention includes a sound acquisition unit, a driving information acquisition unit, and a processing unit. The sound acquisition unit acquires a sound outside the moving object. The driving information acquisition unit acquires driving information relating to at least one of a behavior of the moving body and a behavior of a driver of the moving body. The processing unit causes the storage unit to store information on sounds that the driver easily misses, based on external sounds and driving information.

  According to the information processing apparatus of the present embodiment, information on sounds that the driver easily misses is stored in the storage unit based on external sounds and driving information. Accordingly, it is possible to perform operations such as prompting the driver to pay attention to the presence of a sound that is easily overlooked outside the moving object based on the information in the storage unit. As described above, according to the information processing apparatus of the present embodiment, it is possible to effectively assist the driver's auditory recognition of the situation outside the moving object.

  Here, in the present embodiment, the processing unit extracts, from the external sound obtained by the sound obtaining unit, a predetermined cautionary sound as a sound that the driver should pay attention to, and the driving information obtaining unit When the driving information related to the dangerous driving is acquired in the above, the following processing is performed. That is, at the time of the above, the processing unit stores the extracted information on the cautionary sound as information on the sound that the driver easily misses.

  According to the present embodiment, by associating a predetermined cautionary sound with a dangerous driving, it is possible to grasp, with high accuracy, a sound that is easily missed by the driver, and to store information on such a sound.

  Further, in the present embodiment, the dangerous driving may be a sudden braking as a behavior of the moving body, and the dangerous driving indicates that the driver does not pay attention to the caution sound. It may be behavior.

  According to the present embodiment, it is necessary to grasp with high accuracy a cautionary sound that the driver has noticed immediately before he noticed or a cautionary sound that he completely missed, and to store information about such a sound. Can be.

  The information processing method according to the present embodiment includes a sound acquisition step, a driving information acquisition step, and a processing step. The sound acquisition step is a step of acquiring sound outside the moving body. The driving information acquisition step is a step of acquiring driving information relating to at least one of the behavior of the moving body and the behavior of the driver of the moving body. The processing step is a step of causing the storage unit to store information on sounds that the driver easily misses, based on external sounds and driving information.

  According to the information processing method of the present embodiment, information on sounds that the driver easily misses is stored in the storage unit based on external sounds and driving information. Accordingly, it is possible to perform operations such as prompting the driver to pay attention to the presence of a sound that is easily overlooked outside the moving object based on the information in the storage unit. As described above, according to the information processing method of the present embodiment, it is possible to effectively assist the driver's auditory recognition of the situation outside the moving object.

  An information processing program according to an embodiment of the present invention causes a computer to execute the above-described information processing method.

  According to the information processing program according to the present embodiment, by causing the computer to execute the above-described information processing method, it is possible to effectively assist the driver's auditory recognition of the situation outside the moving object.

  Further, a storage medium according to the embodiment of the present invention stores the above-described information processing program.

  According to the storage medium of the present embodiment, the above-described information processing method can be executed by a computer using the stored information processing program. As a result, it is possible to effectively assist the driver's auditory recognition of the situation outside the moving object.

  Hereinafter, an embodiment for solving the problem of effectively assisting the driver's auditory recognition of the situation outside the moving object will be specifically described with reference to the drawings. First, a first embodiment will be described.

  FIG. 1 is a schematic block diagram illustrating the information processing apparatus according to the first embodiment, which is mounted on a moving body.

  The moving body 1 shown in FIG. 1 is a passenger car, and includes a first information processing device 110, a second information processing device 120, and a storage unit 130.

  The first information processing device 110 is a device that recognizes, based on the content stored in the storage unit 130, that a sound that is easily missed by the driver exists outside the moving body 1, and notifies the driver. Further, the second information processing device 120 is a device that grasps a sound that the driver of the mobile unit 1 easily misses and stores information on such a sound in the storage unit 130. The information stored in the storage unit 130 by the second information processing device 120 is used for processing in the first information processing device 110.

  In the present embodiment, the components of the first information processing device 110 and the second information processing device 120, except for a part thereof, are configured in a car navigation device mounted on the moving body 1. Further, as the storage unit 130, a part of the storage unit included in the car navigation device is used.

  Before describing each component of the first information processing apparatus 110 and the second information processing apparatus 120, first, information stored in the storage unit 130 will be described.

  FIG. 2 is a schematic diagram showing information stored in the storage unit shown in FIG.

  As shown in FIG. 2, the storage unit 130 stores information on sounds that are easily missed by the driver. Specifically, an information table 131 is stored in which the personal name of a person assumed as a driver of the mobile unit 1 and information about sounds that each person easily misses are associated with each other.

  In the example of FIG. 2, the driver “Mr. A” easily hears “children's voice” and “skateboard sound”, and the personal name “Mr. "Children's voice" and "skateboarding sound" are associated as names including the source of the skateboarding. Further, in this example, the “skateboarding sound” is a sound that is easily missed by an unspecified number of people in the age group to which “Mr. A” belongs.

  Since the driver "Mr. B" has a different age group from "Mr. A", "Skateboarding sound" is not associated with it. “Sound” is associated with the personal name “Ms. B”.

  The driver “Mr. C” who belongs to the same age group as “Mr. A” does not have a sound that is easily overlooked personally, but the sound that an unspecified number of persons in the “Mr. C” age group easily misses. Is associated with the personal name "Mr. C".

  Here, as examples of sounds that are easy to miss, "children's voice", "bicycle sound", and "skateboarding sound" are exemplified, and an unspecified number of people in the age group to which the driver belongs are easily missed. As an example of the sound, "skateboard sound" is exemplified. However, these are merely examples, and sounds that are easy to overlook and sounds that are easily overlooked by an unspecified number of persons in the age group to which the driver belongs can be appropriately set according to actual situations.

  The first information processing device 110 illustrated in FIG. 1 grasps the presence of a sound that is easily overlooked outside the moving body 1 based on the storage content of the storage unit 130 and notifies the driver. The first information processing device 110 includes an information acquisition unit 111, an individual identification unit 112, a sound acquisition unit 113, a determination unit 114, and a correspondence processing unit 115. The correspondence processing unit 115 includes a reproduction unit 115a and a notification unit 115b.

  The information obtaining unit 111 obtains, from the storage unit 130, information on sounds that are easily missed by the driver of the mobile unit 1. Here, in the present embodiment, as will be described later, a sound that is easily missed by the individual driver specified by the individual specifying unit 112 is read from the information table 131 of the storage unit 130 and acquired.

  The individual identification unit 112 identifies the individual driver of the mobile unit 1. Although specific methods are not specified here, for example, a method in which a driver inputs a name or the like by a key, a method in which identification is performed by fingerprint authentication, a method in which personal authentication information is read from a smartphone, etc. owned by the driver And the like.

  The sound acquisition unit 113 has microphones installed at various points on the moving body 1 and acquires sounds outside the moving body 1 through these microphones.

  The determination unit 114 determines whether the external sound acquired by the sound acquisition unit 113 includes a sound corresponding to the information acquired by the information acquisition unit 111, that is, a sound that the driver of the mobile unit 1 easily misses. Determine whether or not. The determination unit 114 stores an information table described below, and makes a determination using the information table.

  FIG. 3 is a schematic diagram illustrating an information table used by the determination unit illustrated in FIG. 1 for determination.

  The information table 114a shown in FIG. 3 is a table in which the name of the cautionary sound predetermined as the sound to which the driver should pay attention and the extraction condition of the cautionary sound are associated with each other. . In the example of FIG. 3, “children's voice”, “bicycle sound”, and “skateboard sound” are given as names of the cautionary sounds. The conditions for extracting each cautionary sound are defined by a frequency range and a sound level range specific to each cautionary sound.

  Note that the cautionary sound is not limited to the above-mentioned "children's voice", "bicycle sound", and "skateboarding sound", but may be set as appropriate. In addition, the extraction conditions are not limited to the frequency range and the sound level range, and do not ask the specific conditions as long as the conditions for extracting the cautionary sound can be satisfied.

  The determination unit 114 illustrated in FIG. 1 first performs a frequency analysis on the external sound acquired by the sound acquisition unit 113, and satisfies the extraction condition defined in the information table 114a based on the analysis result. Extracts cautionary sounds. Then, some cautionary sound is extracted from the external sound, and the extracted cautionary sound matches the sound that is easily missed by the driver of the mobile unit 1 acquired by the information acquiring unit 111. It is determined whether or not. When both match, the determination unit 114 determines that the external sound includes a sound that the driver easily misses.

  The reproduction unit 115a of the correspondence processing unit 115 has a speaker installed inside the moving body 1, and reproduces the external sound acquired by the sound acquisition unit 113 through the speaker. At this time, the reproduction unit 115a reproduces the external sound in a reproduction mode according to the determination result of the determination unit 114. In the present embodiment, when the determination unit 114 determines that a sound that is easily missed by the driver is included, the reproduction unit 115a reproduces an external sound in a reproduction mode in which the sound is emphasized with respect to other sounds. Reproduce.

  The reproduction mode in which the easily overlooked sound is emphasized with respect to the other sounds, which is performed by the reproduction unit 115a, is not specified here. For example, the reproduction mode is to increase the volume of the easily overlooked sound and to reproduce the easily overlooked sound. One example is a mode in which a sound is echoed and reproduced.

  The notification unit 115b of the correspondence processing unit 115 notifies the driver of the presence of the sound when the determination unit 114 determines that the sound includes a sound that the driver easily misses. The notification method by the notification unit 115b is not specified here, but may be, for example, a method of notifying by a voice message, displaying a message or a message image on a display screen, turning on an LED indicator, or the like.

  Next, the second information processing apparatus 120 shown in FIG. 1 will be described. In the present embodiment, the second information processing apparatus 120 uses the individual identification unit 112 and the sound acquisition unit 113 included in the first information processing apparatus 110 as components of the second information processing apparatus 120. The second information processing device 120 includes a driving information acquisition unit 121 and a storage processing unit 122 in addition to the individual identification unit 112 and the sound acquisition unit 113.

  The driving information acquisition unit 121 acquires driving information relating to both the behavior of the moving body 1 and the behavior of the driver of the moving body 1. For the behavior of the moving body 1, operation information of various devices related to driving such as a steering wheel and a brake is acquired, and for the behavior of the driver, information on a driver's line of sight is acquired with an eye tracker mounted on the moving body 1. doing.

  Note that the acquisition of the driving information is not limited to the above-described acquisition method, and any specific method may be used as long as the information on the behavior of the moving object 1 and the behavior of the driver is acquired. Further, unlike the present embodiment, the driving information regarding only one of the behavior of the moving body 1 and the behavior of the driver may be acquired.

  The storage processing unit 122 causes the storage unit 130 to store information on sounds that are easily missed by the driver based on the external sound obtained by the sound obtaining unit 113 and the driving information obtained by the driving information obtaining unit 121.

  The storage processing unit 122 first tries to extract the above-mentioned cautionary sound from the external sound acquired by the sound acquisition unit 113. The storage processing unit 122 stores an information table similar to the information table 114a (FIG. 3) stored by the determination unit 114 of the first information processing apparatus 110, and extracts a cautionary sound using this information table. Try. Then, when any cautionary sound is extracted, the storage processing unit 122 determines whether the driving information acquisition unit 121 has acquired driving information on dangerous driving. Another information table described below is used to determine the driving information on the dangerous driving.

  FIG. 4 is a schematic diagram illustrating an information table used by the storage processing unit illustrated in FIG. 1 to determine driving information.

  The information table 122a shown in FIG. 4 is a table in which operation names as information relating to various dangerous driving and extraction conditions of each dangerous driving are associated with each other. In the example of FIG. 4, the driving names related to the dangerous driving include “sudden braking”, “looking aside”, and “device operation”. The extraction condition of “sudden braking” includes, for example, that brake operation information regarding sudden braking is obtained by the brake device. Examples of the extraction condition of “looking aside” include that the detection direction of the driver's line of sight with the eye tracker is directed to a direction unrelated to the movement of the moving body 1. Examples of the extraction condition of “device operation” include that device operation information on a device mounted on the moving body 1 such as a car navigation device or an audio device has been obtained.

  In addition, the dangerous driving is not limited to the above-mentioned “sudden braking”, “side-by-side watching”, and “device operation”, and may be appropriately set. In addition, the extraction conditions are not limited to the above-described conditions, and do not ask the specific conditions as long as the conditions for extracting the dangerous driving can be satisfied.

  When the cautionary sound is acquired from the external sound acquired by the sound acquisition unit 113, the storage processing unit 122 illustrated in FIG. 1 causes the driving information acquisition unit 121 to extract the extraction condition in the information table 122a of FIG. It is determined whether or not the driving information on the dangerous driving that matches the above is obtained. When the driving information on the dangerous driving has been obtained, the storage unit 130 stores the information on the cautionary sound extracted from the external sound as the information on the sound that the driver easily misses. The storage at this time is performed in the form of adding an item to the information table 131 shown in FIG. That is, when a sound that is easily missed for the driver “Mr. A” is obtained for the first time, a description column of the personal name “Mr. A” is added to the information table 131, and the listening corresponding to the personal name “Mr. A” is added. Information obtained by the storage processing unit 122 is described in a description column of sounds that are easily missed. If an entry for the personal name "Mr. A" already exists and information about a new sound is obtained as a sound that is easy to overlook, the entry for the easy-to-hear sound corresponding to the personal name "Ms. A" The newly obtained information is additionally described.

  Next, an information processing method executed in each of the first information processing device 110 and the second information processing device 120 described above will be described. First, an information processing method executed in the first information processing apparatus 110 will be described.

  FIG. 5 is a flowchart illustrating a flow of a process in the information processing method executed by the first information processing apparatus illustrated in FIG.

  The process represented by this flowchart starts when the navigation device of the moving body 1 is turned on, and is executed in parallel with the normal navigation process.

  When the process starts, first, a personal identification process is executed by the individual identification unit 112 (step S111). In the individual identification step, the individual driver is identified by a method such as key input of a name or a fingerprint impression as described above.

  Next, the information acquisition unit 111 executes an information acquisition step of acquiring information on sounds that are easily missed from the storage unit 130 for the specified individual driver (step S112). In the information acquiring step, the names including the sound sources that are easily missed and associated with the personal names in the information table 131 shown in FIG. The sound is read from the storage unit 130 such as “board sound”.

  Subsequently, a sound acquisition step is performed by the sound acquisition unit 113 (step S113). In the sound obtaining step, sounds outside the moving body 1 are obtained through microphones of the moving body 1 included in the sound obtaining unit 113.

  Then, the determining unit 114 determines whether or not the acquired external sound includes the cautionary sound specified in the information table 114a illustrated in FIG. 3 (step S114). The determination is made by an extraction process using an extraction condition associated with each caution sound in the information table 114a. If there is a cautionary sound that has been successfully extracted, it is determined that the cautionary sound is included in the external sound, and if no cautionary sound in the information table 114a is extracted, the cautionary sound is required. It is determined that no sound is included.

  When the cautionary sound is included in the external sound (Yes in step S114), the cautionary sound corresponds to the information acquired in the information acquiring step, and is a sound that is easily missed by an individual identified driver. Is determined by the determination unit 114 (step S115).

  The two determination processes of step S114 and step S115 correspond to a determination process of determining whether an external sound includes a sound that is easily overlooked and that corresponds to the information acquired in the information acquisition process.

  When the extracted cautionary sound matches a sound that the driver easily misses (Yes determination in step S115), the reproducing unit 115a of the correspondence processing unit 115 emphasizes the sound that is easy to miss over other sounds. The external sound is reproduced in the reproduction mode (step S116). Further, the notification unit 115b of the correspondence processing unit 115 notifies the driver of the presence of a sound that is easily overlooked (step S117).

  On the other hand, if the external sound does not include the cautionary sound (No determination in step S114), the process returns to the sound acquisition step in step S113, and the subsequent processing is repeated. If the cautionary sound included in the external sound does not match the easily overlooked sound (No in step S115), the reproducing unit 115a reproduces the external sound as it is (step S118).

  Note that, when the external sound does not include the cautionary sound, the reproduction is returned by returning to the sound acquisition step of step S113 as in the processing of the present embodiment shown in the flowchart of FIG. It is not limited to the process of omitting. Unlike the present embodiment, even when the external sound does not include the cautionary sound (No determination in step S114), the process proceeds to step S118, and the reproducing unit 115a reproduces the external sound as it is. Is also good.

  When the notification in step S117 and the reproduction in step S118 are completed, the processing returns to the sound acquisition step in step S113, and the subsequent processing is repeated.

  The processing of the information processing method represented by the flowchart in FIG. 5 is continuously executed until the power of the navigation device is turned off.

  An information processing program for causing a computer to execute the information processing method represented by the flowchart in FIG. 5 is stored in a storage medium of the navigation device or a storage medium of a vehicle-mounted computer device separate from the navigation device. The storage medium for storing the information processing program is not limited to the storage medium of these devices, but may be a known portable storage medium or a storage medium installed in a server connected to these devices via a network. There may be.

  Next, an information processing method executed in the second information processing apparatus 120 will be described.

  FIG. 6 is a flowchart illustrating a flow of processing in an information processing method executed by the second information processing apparatus illustrated in FIG.

  The process represented by this flowchart also starts when the navigation device of the mobile unit 1 is turned on, and is executed in parallel with the normal navigation process.

  When the process is started, the individual identification process similar to the process of the flowchart of FIG. 5 is executed by the individual identification unit 112 (step S121), and the sound acquisition process similar to the process of the flowchart of FIG. (Step S122). In the present embodiment, the processing of the flowchart of FIG. 6 is executed concurrently with the processing of the flowchart of FIG. For this reason, in the present embodiment, the individual identification step (step S111) and the sound acquisition step (step S113) executed in the flowchart of FIG. 5 are different from the individual identification step (step S121) and the sound acquisition step (step S121) in the flowchart of FIG. Step S122) is also performed.

  In the flowchart of FIG. 6, subsequently, the driving information obtaining unit 121 executes a driving information obtaining step of obtaining driving information on both the behavior of the moving body 1 and the behavior of the driver of the moving body 1 (step S123). . In the driving information acquisition step, operation information of various devices in the moving body 1 is acquired with respect to the behavior of the moving body 1, and information regarding the driver's line of sight is acquired with respect to the behavior of the driver using an eye tracker.

  Next, the storage processing unit 122 determines whether the external sound acquired in the sound acquisition step (step S122) includes a cautionary sound (step S124). The determination here is made by extracting a cautionary sound from an external sound based on an information table similar to the information table 114a in FIG. 3 used in step S114 of the flowchart in FIG.

  When the cautionary sound is included in the external sound (Yes in step S124), the storage processing unit 122 determines whether the driving information on the dangerous driving is acquired by the driving information acquisition unit 121 (step S124). S125). For this determination, the information processing unit 122 refers to the information table 122a shown in FIG. 4, and determines whether or not the information on dangerous driving specified in the information table 122a has been obtained by the driving information obtaining unit 121. 122.

  If the information on the dangerous driving has been acquired (Yes determination in step S125), the storage processing unit 122 executes the following storage processing step (step 126). In the storage processing step, the name including the source of the cautionary sound extracted in the processing of step S124 is described in the information table 131 of the storage unit 130 as information on sounds that are easily missed by the driver identified individually. . At this time, if the name including the extracted source of the cautionary sound has already been described in the information table 131 in association with the driver, the description is omitted. If the personal name of the driver who has been identified is not described in the information table 131, a new entry field for the personal name is provided, and the source of the caution sound is associated with the personal name. Are described.

  When this storage processing step (Step S126) ends, the processing returns to Step S122, and the subsequent processing is repeated. In addition, when the cautionary sound is not included in the external sound (No in Step S124) or when the information regarding the dangerous driving is not obtained (No in Step S125), the process returns to Step S122. Subsequent processing is repeated.

  The processing of the information processing method represented by the flowchart of FIG. 6 is also executed until the power of the navigation device is turned off, together with the processing of the information processing method represented by the flowchart of FIG.

  An information processing program for causing a computer to execute the information processing method represented by the flowchart of FIG. 6 is also stored in a storage medium of the navigation device or a storage medium of a vehicle-mounted computer device separate from the navigation device. The storage medium for storing the information processing program is not limited to the storage medium of these devices, but may be a known portable storage medium or a storage medium installed in a server connected to these devices via a network. There may be.

  According to the first embodiment described above, the following effects can be obtained. First, according to the first information processing apparatus 110 shown in FIG. 1, the information processing method, the information processing program, and the storage medium represented by the flowchart in FIG. 5, the following determination is made. That is, it is determined whether or not a sound corresponding to the information acquired from the storage unit 130, that is, a sound that is easily missed by the driver of the moving body 1 is included in the sound outside the moving body 1. Thereby, based on the result of the determination, it is possible to perform an operation such as prompting the driver to pay attention to a sound that is easy to miss. As described above, according to the present embodiment, it is possible to effectively assist the driver's auditory recognition of the situation outside the moving body 1.

  Here, in the present embodiment, a reproduction unit 115a that reproduces an external sound in a reproduction mode according to the above determination result is provided. As a result, an external sound can be reproduced inside the mobile unit 1 in a manner that makes it easy for the driver to hear a sound that is easily overlooked, and can alert the driver.

  In the present embodiment, the reproduction unit 115a reproduces an external sound in a reproduction mode in which a sound that the driver easily misses is emphasized with respect to other sounds. According to this, the driver can be alerted by a reproduction mode with a small processing load that emphasizes sounds that are easily overlooked.

  Further, in the present embodiment, a notifying unit 115b that notifies the driver of the presence of a sound that is easily missed by the driver is provided. With this notification, the driver can be directly alerted to sounds that are easy to miss.

  In the present embodiment, the storage unit 130 stores information on sounds that are easily missed by an individual driver. According to this, it is possible to make a detailed determination of sounds that may be different from person to person, which may be easily overlooked, for each individual driver based on the storage contents of the storage unit 130.

  In the present embodiment, the storage unit 130 stores information on sounds that are easily missed by an unspecified number of persons in the age group to which the driver belongs. According to this, it is possible to determine finely the sounds that may easily be missed that may differ depending on the age group, for each age group of the driver, based on the storage contents of the storage unit 130.

  In addition, according to the second information processing apparatus 120 shown in FIG. 1, the information processing method, the information processing program, and the storage medium represented by the flowchart in FIG. 6, driving is performed based on external sounds and driving information. Information about sounds that are easily missed by the user is stored in the storage unit 130. Accordingly, it is possible to perform an operation such as prompting the driver to pay attention to the presence of a sound that is easily overlooked outside the moving object 1 based on the information in the storage unit 130. According to the present embodiment, in terms of information storage in the storage unit 130 as well, it is possible to effectively assist the driver's auditory recognition of the situation outside the moving body 1.

  Here, in this embodiment, when the cautionary sound is extracted from the external sound and the driving information on the dangerous driving is acquired, the extracted information on the cautionary sound is related to the sound that the driver is likely to miss. It is stored as information. By associating the cautionary sound with the dangerous driving as described above, it is possible to grasp, with high accuracy, a sound that the driver easily misses, and to store information on such a sound.

  Further, in the present embodiment, the above-mentioned dangerous driving is defined as a sudden braking as a behavior of the moving body 1 or a behavior indicating that the driver does not pay attention to the caution sound. According to this, it is possible to grasp, with high accuracy, a cautionary sound that the driver noticed immediately before he noticed or a cautionary sound that he completely missed, and to store information on such a sound. .

  Next, a second embodiment will be described.

  In the first embodiment described above, the determination and storage of sounds that are easy to miss are all performed by the mounted device of the moving body 1, whereas in the second embodiment described below, a part of the processing is performed The operation is performed by a body-mounted device, and the other part is performed by a server device wirelessly connected to the mobile object.

  FIG. 7 is a schematic diagram illustrating a moving object and a server according to the second embodiment, and FIG. 8 is a schematic block diagram illustrating an information processing device in each of the moving object and the server illustrated in FIG. .

  In the present embodiment, as shown in FIG. 7, a plurality of moving bodies 2, each of which is a passenger car, are wirelessly connected to one server 3. Information on sounds that are easily missed by the driver is stored in the storage unit 320 provided in the server 3. The storage unit 320 stores information on sounds that the driver easily misses in a table format equivalent to the information table 131 shown in FIG. However, in the present embodiment, the storage unit 320 stores an information table in which a personal name of a driver of each of the plurality of moving objects 2 is associated with a name including a sound source that is easily missed by each driver. .

  The process of determining a sound that is easy to miss is performed by the mobile information processing device 210 mounted on each mobile 2 based on information acquired from the storage unit 320 via wireless. The determination here is performed using the information table 114a of the cautionary sound shown in FIG. 3 which is shared by the mobile object information processing devices 210 of the plurality of mobile objects 2.

  In the mobile object information processing device 210, the individual identification of the driver of the mobile object 2, acquisition of external sound, and acquisition of driving information are performed. The personal name of the driver specified, the information on the acquired external sound, and the driving information are sent to the server 3 via wireless communication.

  In the server 3, the server information processing device 310 obtains a sound that is easily missed by the driver of each mobile unit 2 based on various information transmitted from each mobile unit 2, and stores information regarding the sound in the storage unit 320. Remember. The process of finding a sound that is easy to miss is performed using the dangerous driving information table 122a of the server information processing device 310 shown in FIG.

  As shown in FIG. 8, the mobile information processing apparatus 210 includes a first information acquisition unit 211, a first individual identification unit 212, a first sound acquisition unit 213, a determination unit 214, a correspondence processing unit 215, a first An operation information acquisition unit 216 and a first communication unit 217 are provided. The correspondence processing unit 215 includes a reproduction unit 215a and a notification unit 215b.

  The first information acquisition unit 211 acquires information about sounds that are easily missed by the driver of the mobile unit 2 from the server 3 via the first communication unit 217. The first individual identification unit 212 identifies the individual of the driver of the mobile unit 2 and sends the identified individual name of the driver to the server 3 via the first communication unit 217. The first sound acquisition unit 213 acquires a sound outside the moving object 2 and sends information about the acquired outside sound to the server 3 via the first communication unit 217. The determination unit 214 determines whether the external sound acquired by the first sound acquisition unit 213 includes a sound that is easily missed by the driver and corresponds to the information acquired by the first information acquisition unit 211. The determination is made using the information table 114a of the cautionary sound. When the external sound includes a sound that is easily overlooked, the reproducing unit 215a of the correspondence processing unit 215 reproduces the external sound in a reproduction mode in which the sound is emphasized with respect to other sounds. The notification unit 215b notifies the driver of the presence of the sound that is easily missed. The first driving information acquisition unit 216 acquires driving information relating to both the behavior of the moving body 2 and the behavior of the driver. The first communication unit 217 performs wireless communication with the server 3. The wireless communication by the first communication unit 217 is performed by attaching an identifier such as a vehicle body number for identifying the mobile unit 2 on which the first communication unit 217 is mounted, to various types of information to be communicated.

  Further, the server information processing device 310 includes a second sound acquisition unit 311, a second individual identification unit 312, a second driving information acquisition unit 313, a storage processing unit 314, a second information acquisition unit 315, and a second communication unit 316. Have.

  The second sound acquisition unit 311 receives, via the second communication unit 316, information about a sound outside the moving object 2 acquired and transmitted by the first sound acquisition unit 213 of the moving object 2. The second individual identification unit 312 receives, via the second communication unit 316, the individual name of the driver identified and transmitted by the first individual identification unit 212 of the mobile unit 2. The second operation information acquisition unit 313 receives the operation information acquired and transmitted by the first operation information acquisition unit 216 of the moving body 2 via the second communication unit 316. The storage processing unit 314 is based on the external sound received as information by the second sound obtaining unit 311 and the driving information received by the second driving information obtaining unit 313, and the individual received by the first individual specifying unit 212 Ask for information about sounds that the named driver is likely to miss. The dangerous driving information table 122a is used for the processing in the storage processing unit 314. The storage processing unit 314 causes the storage unit 320 to store the information about the sound that is easily found and missed. The second information acquisition unit 315 acquires information about sounds that are easily overlooked corresponding to the personal name of the driver of the mobile unit 2 from the storage unit 320 in response to the request from the first information acquisition unit 211 in the mobile unit 2. , To the mobile unit 2 via the second communication unit 316. The second communication unit 316 performs wireless communication with each mobile unit 2. Further, when transmitting information to each mobile unit 2, the second communication unit 316 attaches an identifier for identifying the mobile unit 2 of the transmission destination to the information and transmits the information.

  Next, processing of an information processing method executed by the mobile information processing apparatus 210 and the server information processing apparatus 310 will be described.

  Here, the processing of the information processing method executed by the mobile information processing apparatus 210 is substantially the same as the processing represented by the flowchart of FIG. 5 except that the elements that execute the respective steps of the processing are different. The processing of the information processing method executed by the server information processing apparatus 310 is substantially the same as the processing represented by the flowchart in FIG. 6 except that the elements for executing the steps of the processing are different. Therefore, hereinafter, the processing of the information processing method executed by the mobile information processing apparatus 210 will be described with reference to the flowchart of FIG. 5, and the processing of the information processing method executed by the server information processing apparatus 310 will be described with reference to FIG. This will be described with reference to a flowchart.

  First, processing of the information processing method executed by the mobile information processing apparatus 210 will be described.

  This process starts when the navigation device of the mobile unit 2 is turned on. First, in step S111, the first individual identification unit 212 identifies the individual of the driver, and sends the identified individual name of the driver to the server 3 via the first communication unit 217. In the server 3, the sent personal name is received by the second individual specifying unit 312 via the second communication unit 316.

  In step S112, the first information acquisition unit 211 requests the server 3 to acquire information from the storage unit 320 via the first communication unit 217. Then, in the server 3, in response to the request, the second information obtaining unit 315 obtains, from the storage unit 320, information on the sound that the driver of the personal name received by the second individual specifying unit 312 easily misses, and 2 to the requesting mobile unit 2 via the communication unit 316. In the mobile unit 2, the first information acquisition unit 211 receives the transmitted information via the first communication unit 217.

  In step S113, the first sound acquisition unit 213 acquires the sound outside the moving body 2 and sends information about the sound to the server 3 via the first communication unit 217. In the server 3, the transmitted information is received by the second sound acquisition unit 311 via the second communication unit 316.

  In step S114, the determination unit 214 determines whether or not the acquired external sound includes the cautionary sound using the cautionary sound information table 114a illustrated in FIG. If the cautionary sound is included (Yes determination in step S114), in step S115, the determination unit 214 determines whether the cautionary sound matches a sound that is easily missed by the driver identified by the individual. Is determined.

  When the sound requiring attention coincides with the sound that is easily overlooked (Yes determination in step S115), in step S116, the reproduction unit 215a emphasizes the sound that is easily overheard and reproduces the external sound. In step S117, the notification unit 215b notifies the driver of the presence of a sound that is easily missed. If the external sound does not include a cautionary sound (No in Step S114) or if the cautionary sound does not match a sound that is likely to be overlooked (No in Step S115), the reproducing unit 215a outputs the external sound in Step S118. Play the sound as it is. After the processing of step S117 or step S118, the process returns to step S113 and the subsequent processing is repeated.

  In the present embodiment, the processing of the flowchart in FIG. 5 is continuously executed until the navigation device of the mobile unit 2 is turned off.

  In the present embodiment, an information processing program for causing a computer to execute the information processing method represented by the flowchart of FIG. 5 is executed by a storage medium of a navigation device of each mobile unit 2 or an in-vehicle computer device separate from the navigation device. It is stored in a storage medium. The storage medium for storing the information processing program is not limited to the storage medium of these devices, but may be a known portable storage medium or a storage medium installed in a server connected to these devices via a network. There may be.

  Next, processing of the information processing method executed by the server information processing apparatus 310 will be described with reference to the flowchart of FIG.

  This process starts when the server 3 is powered on. First, in step S121, the second individual identification unit 312 waits for the driver's individual name to be sent from the first individual identification unit 212 of the mobile unit 2. When this personal name is sent, the second individual specifying unit 312 receives this via the second communication unit 316. When the second individual identification unit 312 receives the driver's personal name from the mobile unit 2, it is determined that various types of information have been obtained in the mobile unit 2 indicated by the identifier attached to the personal name, and the subsequent movement The processing corresponding to the body 2 starts to move.

  In step S <b> 122, the second sound acquisition unit 311 receives, via the second communication unit 316, information regarding a sound outside the moving object 2 transmitted from the first sound acquisition unit 213 of the moving object 2. In step S123, the second driving information acquisition unit 313 receives the driving information transmitted from the first driving information acquisition unit 216 of the mobile unit 2 via the second communication unit 316.

  In step S124, the storage processing unit 314 determines whether the sound of the information received by the second sound acquisition unit 311 includes a cautionary sound, using the cautionary sound information table 114a in FIG. . If the cautionary sound is included (Yes in step S124), in step 125, the storage processing unit 314 determines whether the second driving information acquisition unit 313 has acquired driving information on dangerous driving. The determination is made using the dangerous driving information table 122a of No. 4.

  If the driving information of the dangerous driving has been acquired (Yes determination in step S125), in step S126, the storage processing unit 314 uses the extracted name including the generation source of the cautionary sound as information regarding sounds that are easily overlooked. Is stored in the storage unit 130 in association with the personal name of the driver.

  When the storage processing step in step S126 ends, the processing returns to step S122, and the subsequent processing is repeated. In addition, when the sound of the information received by the second sound obtaining unit 311 does not include the cautionary sound (No in Step S124), or when the information regarding the dangerous driving is not obtained (No in Step S125). Also, the process returns to step S122, and the subsequent processes are repeated.

  In the present embodiment, the processing of the information processing method represented by the flowchart of FIG. 6 is continuously executed until the power of the server is turned off.

  In the present embodiment, an information processing program for causing a computer to execute the information processing method represented by the flowchart of FIG. 6 includes a storage medium that forms a part of the storage unit 320 provided in the server 3, Are stored in a separate storage medium. The storage medium for storing the information processing program is not limited to the storage medium installed in the server 3, but may be installed in a known portable storage medium or another server connected to the server 3 via a network. Storage medium may be used.

  The mobile information processing apparatus 210, the server information processing apparatus 310, the information processing method, the information processing program, and the storage medium described in the flowcharts of FIGS. The same effects as in the first embodiment can be obtained. That is, also in the present embodiment, it is possible to determine whether or not a sound that the driver of the moving body 2 easily misses is included in the external sound, and perform an operation such as prompting the user to pay attention as appropriate. That is, similarly to the first embodiment, it is needless to say that the driver can effectively assist the auditory recognition of the situation outside the moving body 2 in the present embodiment.

  Also, in the present embodiment, similarly to the first embodiment, information on sounds that are easily missed by the driver is stored in the storage unit 320 based on sounds outside the mobile unit 2 and driving information. Based on the information in the storage unit 320, operations such as prompting the user to pay attention to each mobile unit 2 can be performed. That is, also in the present embodiment, similarly to the first embodiment, in terms of information storage in the storage unit 320, it is possible to effectively assist the driver's auditory recognition of the situation outside the moving body 2. It goes without saying that you can do it.

  It should be noted that the present invention is not limited to the embodiments described above, but includes other configurations and the like that can achieve the object of the present invention, and the following modifications and the like are also included in the present invention.

  For example, in the above-described first and second embodiments, the moving bodies 1 and 2 as a passenger car are illustrated. However, the moving object is not limited to a passenger car, but may be a motorcycle, a large vehicle such as a truck or a bus, and does not matter the specific type of the moving object.

  Further, in the first and second embodiments described above, the first information processing device 110, the second information processing device 120, and the mobile object information processing device 210 each include the components constructed in the navigation device mounted on the moving object. Is exemplified. However, the information processing apparatus that performs processing on a moving object is not limited to these, and may include a component provided in a computer provided separately from the navigation apparatus.

1, 2 mobile 3 server 110 first information processing device 111 information acquisition unit 112 personal identification unit 113 sound acquisition unit 114, 214 determination unit 114a, 122a information table 115, 215 correspondence processing unit 115a, 215a reproduction unit 115b, 215b Unit 120 second information processing device 121 driving information acquisition unit 122,314 storage processing unit 130,320 storage unit 131 information table 210 mobile information processing device 310 server information processing device 211 first information acquisition unit 212 first personal identification unit 213 First sound acquisition unit 216 First operation information acquisition unit 217 First communication unit 311 Second sound acquisition unit 312 Second individual identification unit 313 Second operation information acquisition unit 315 Second information acquisition unit 316 Second communication unit

Claims (7)

A sound acquisition unit for acquiring sound outside the moving object;
A driving information acquisition unit that acquires driving information on at least one of the behavior of the moving body and the behavior of a driver of the moving body,
Based on the external sound and the driving information, a processing unit that stores information about sounds that the driver easily misses in a storage unit,
An information processing apparatus comprising:   The processing unit is configured to extract, from the external sound obtained by the sound obtaining unit, a predetermined cautionary sound as a sound to which the driver should pay attention, and perform a dangerous driving by the driving information obtaining unit. The information processing apparatus according to claim 1, wherein when the driving information relating to the driver is acquired, information relating to the cautionary sound is stored as information relating to a sound that is easily missed by the driver.   The information processing apparatus according to claim 2, wherein the dangerous driving is a sudden braking as a behavior of the moving body.   The information processing apparatus according to claim 2, wherein the dangerous driving is a behavior of the driver indicating that the driver is not paying attention to the caution sound. A sound acquisition step of acquiring a sound outside the moving body,
A driving information acquisition step of acquiring driving information on at least one of the behavior of the moving body and the behavior of the driver of the moving body,
Based on the external sound and the driving information, a processing step of storing information about a sound that the driver easily misses in a storage unit,
An information processing method comprising:   An information processing program for causing a computer to execute the information processing method according to claim 5.   A storage medium storing the information processing program according to claim 6.

Images