JP2016166457A - Opening/closing controller, opening/closing control program, and opening/closing control method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To limit an operator capable of opening/closing a lock or a door of a vehicle by using voice.SOLUTION: An opening/closing controller 101 comprises a directional microphone 110. The directional microphone 110 comprises a sound collection unit 120 mounted on a vehicle 130 to collect voice outside the vehicle and has directivity above a horizontal plane LS including the sound collection unit 120's mounting position P. The sound collection unit 120 is mounted on a position on the vehicle at a predetermined height H. The opening/closing controller 101 controls opening/closing action of a lock or a door of the vehicle 130 on the basis of a recognition result obtained by performing voice recognition on a voice signal detected by the directional microphone 110.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an open / close control device, an open / close control program, and an open / close control method.

  2. Description of the Related Art Conventionally, there is a technology for recognizing a voice such as “open” or “close” issued by a user to control an opening / closing operation of a vehicle sliding door. Further, as related prior art, for example, there is a technique for reducing the influence of noise existing around a vehicle in recognition of a voice command for controlling a vehicle function spoken by a vehicle user.

JP 2008-037419 A

  However, in the related art, when the door of the vehicle can be opened and closed by voice, the door is opened and closed even when a person other than the operator of the door emits a specific voice such as “open”. There is a fear.

  In one aspect, an object of the present invention is to provide an open / close control device, an open / close control program, and an open / close control method capable of limiting an operator who can open and close a vehicle key or door by voice.

  According to one aspect of the present invention, a voice signal detected by a directional microphone having directivity above a horizontal plane including a mounting position of a sound collecting unit that is attached to a vehicle and collects sound outside the vehicle is recognized by voice. An open / close control device, an open / close control program, and an open / close control method for controlling the opening / closing operation of the key or door of the vehicle based on the recognition result obtained in this way are proposed.

  According to one aspect of the present invention, it is possible to limit operators who can open and close a vehicle key or a door by voice.

FIG. 1 is an explanatory diagram of an example of the opening / closing control device 101 according to the first embodiment. FIG. 2 is an explanatory diagram (part 1) of a control example of the opening / closing control device 101 according to the first embodiment. FIG. 3 is an explanatory diagram (part 2) of a control example of the opening / closing control device 101 according to the first embodiment. FIG. 4 is an explanatory diagram illustrating a hardware configuration example of the opening / closing control apparatus 101. FIG. 5 is an explanatory diagram showing an example of the contents stored in the command table 500. FIG. 6 is a block diagram of a functional configuration example of the opening / closing control apparatus 101 according to the first embodiment. FIG. 7 is a flowchart of an example of an opening / closing control processing procedure of the opening / closing control apparatus 101 according to the first embodiment. FIG. 8 is a block diagram of a functional configuration example of the opening / closing control device 101 according to the second embodiment. FIG. 9 is an explanatory diagram showing a specific example of the entry detection information 900. FIG. 10 is an explanatory diagram (part 1) of a control example of the opening / closing control device 101 according to the second embodiment. FIG. 11 is an explanatory diagram (part 2) of a control example of the opening / closing control device 101 according to the second embodiment. FIG. 12 is a flowchart of an example of an update process procedure of the opening / closing control apparatus 101 according to the second embodiment. FIG. 13 is a flowchart of an example of an opening / closing control processing procedure of the opening / closing control apparatus 101 according to the second embodiment. FIG. 14 is a block diagram of a functional configuration example of the opening / closing control apparatus 101 according to the third embodiment. FIG. 15 is an explanatory diagram of a specific example of the person detection information 1500. FIG. 16 is an explanatory diagram (part 1) of a control example of the opening / closing control device 101 according to the third embodiment. FIG. 17 is an explanatory diagram (part 2) of a control example of the opening / closing control apparatus 101 according to the third embodiment. FIG. 18 is a flowchart of an example of an update process procedure of the opening / closing control apparatus 101 according to the third embodiment. FIG. 19 is a flowchart of an example of an opening / closing control processing procedure of the opening / closing control apparatus 101 according to the third embodiment.

  Hereinafter, embodiments of an opening / closing control device, an opening / closing control program, and an opening / closing control method according to the present invention will be described in detail with reference to the drawings.

(Embodiment 1)
FIG. 1 is an explanatory diagram of an example of the opening / closing control device 101 according to the first embodiment. In FIG. 1, an opening / closing control device 101 is a computer mounted on a vehicle and capable of controlling the opening / closing operation of a key or door of the vehicle. Specifically, the opening / closing control device 101 includes a directional microphone 110, and performs an opening / closing operation of a vehicle key or door based on a recognition result obtained by voice recognition of a sound signal detected by the directional microphone 110. Control.

  The vehicle is, for example, an automobile such as a passenger car, a truck, or a bus. The vehicle key is a door lock for locking and unlocking the door of the vehicle, and can be opened and closed by remote operation. A vehicle door is a door that can be opened and closed by remote control, such as a slide door or a luggage compartment door. The sliding door is a door that can be opened and closed in parallel with the vehicle body. A luggage compartment door is a door of a luggage compartment (trunk) of a vehicle.

  Here, there is an electronic key system capable of opening and closing a vehicle key and a door by remote operation using the electronic key. According to the electronic key system, the user can open and close the vehicle key and door by operating the electronic key. However, if the user's hands are blocked by luggage or the like, it becomes difficult to operate the electronic key, and convenience is reduced.

  For this reason, it is conceivable to use the voice recognition to control the opening / closing operation of the vehicle key or door. In this case, even if both hands are blocked by luggage, the user can open the vehicle key or door simply by saying “open”. However, if you can open and close the door of the vehicle and the door by voice, when the person who is away from the vehicle talks or a young child makes a specific voice such as “open”, the door There is a risk that the door may be opened and closed without the operator's intention.

  Therefore, in the first embodiment, an open / close control method for limiting operators who can open / close a vehicle key or door by voice using the directivity of the directional microphone 110 provided in the open / close control device 101 will be described.

  Specifically, the directional microphone 110 includes a sound collecting unit 120 that is attached to a vehicle and collects sound outside the vehicle. The sound collection unit 120 is attached at a predetermined height H of the vehicle. In the example of FIG. 1, the sound collection unit 120 includes two microphones 120 a and 120 b and is attached at a predetermined height H around the slide door 131 of the vehicle 130.

  In addition, the directional microphone 110 has directivity above a horizontal plane including the mounting position of the sound collection unit 120. In the example of FIG. 1, the directional microphone 110 controls the directivity so that the sensitivity of sound from a specific range above the horizontal plane LS including the mounting position P of the sound collecting unit 120 attached to the vehicle 130 is increased. It is a possible microphone array.

  In the following description, a specific range above the horizontal plane LS including the attachment position P of the sound collecting unit 120 attached to the vehicle 130 may be referred to as “directivity range X”. The directivity range X is set so as to cover the height of a general adult's mouth, for example. In the example of FIG. 1, the directivity range X when the vehicle 130 is viewed from above, the directivity range X when the vehicle 130 is viewed from the front, and the directivity range X when the vehicle 130 is viewed from the side. Is displayed.

  According to the opening / closing control device 101, even if a person speaks outside the directivity range X, the sound signal is hardly detected by the directivity microphone 110, and the sound from outside the directivity range X is recognized and the key of the vehicle 130 is And opening / closing of the door can be prevented.

(Control example of the open / close control device 101)
Here, a control example of the opening / closing control apparatus 101 according to the first embodiment will be described using FIG. 2 and FIG. 3 as an example of controlling the opening / closing operation of the slide door 131 of the vehicle 130.

  FIG. 2 is an explanatory diagram (part 1) of a control example of the opening / closing control device 101 according to the first embodiment. In FIG. 2, it is assumed that the user utters “open” within the directivity range X. In this case, the opening / closing control device 101 detects a speech and performs voice recognition. The opening / closing control device 101 performs control to open the slide door 131 based on the recognition result (opened) obtained by voice recognition.

  Thus, even if both hands are blocked by the luggage, the user can open the slide door 131 of the vehicle 130 only by saying “open” within the directivity range X.

  FIG. 3 is an explanatory diagram (part 2) of a control example of the opening / closing control device 101 according to the first embodiment. In FIG. 3, it is assumed that the user utters “open” outside the directivity range X. This user is a child whose height is lower than a predetermined height H. In this case, since the voice uttered by the child is from outside the directivity range X, the utterance is not detected by the opening / closing control device 101. For this reason, the voice uttered by the child is not recognized, and the control for opening the slide door 131 is not performed.

  Thus, according to the opening / closing control apparatus 101 according to the first embodiment, the directivity microphone 110 is provided with directivity, and the height H of the position where the sound collection unit 120 is attached is adjusted, so that the sound of the vehicle can be heard. Operators who can open and close keys and doors can be limited. Thereby, it is possible to prevent the key and door of the vehicle 130 from being opened and closed by a child's voice whose height is less than the height H.

(Hardware configuration example of the open / close control device 101)
FIG. 4 is an explanatory diagram illustrating a hardware configuration example of the opening / closing control apparatus 101. In FIG. 4, the opening / closing control apparatus 101 includes a CPU (Central Processing Unit) 401, a memory 402, an I / F (Interface) 403, a disk drive 404, a disk 405, and a directional microphone 110. Each component is connected by a bus 400.

  Here, the CPU 401 governs overall control of the opening / closing control apparatus 101. The memory 402 includes, for example, a ROM (Read Only Memory), a RAM (Random Access Memory), a flash ROM, and the like. Specifically, for example, a flash ROM or ROM stores various programs, and the RAM is used as a work area of the CPU 401. The program stored in the memory 402 is loaded on the CPU 401 to cause the CPU 401 to execute the coded process.

  The I / F 403 is connected to the network 410 via a communication line, and is connected to another computer via the network 410. The I / F 403 controls an internal interface with the network 410 and controls input / output of data from other computers. For example, a modem or a NIC (Network Interface Card) can be used as the I / F 403.

  The disk drive 404 controls reading / writing of data with respect to the disk 405 according to the control of the CPU 401. The disk 405 stores data written under the control of the disk drive 404. Examples of the disk 405 include a magnetic disk and an optical disk.

  The directional microphone 110 includes a sound collection unit 120 including microphones 120 a and 120 b, an audio codec 406, and a DSP (Digital Signal Processor) 407. The audio codec 406 includes, for example, an A / D (Analogue / Digital) converter, an amplifier, a D / A converter, and the like. The DSP 407 is a processor that processes digital signals.

  Note that the opening / closing control apparatus 101 may not include, for example, the disk drive 404 or the disk 405 among the above-described components.

(Storage contents of command table 500)
Next, the contents stored in the command table 500 used by the opening / closing control apparatus 101 will be described. The command table 500 is stored in a storage device such as the memory 402 and the disk 405 shown in FIG.

  FIG. 5 is an explanatory diagram showing an example of the contents stored in the command table 500. In FIG. 5, the command table 500 includes fields for commands and operation contents, and by storing information in each field, command information (for example, command information 500-1 to 500-4) is stored as a record.

  Here, the command indicates a command for instructing a key or door opening / closing operation of the vehicle 130 (see FIG. 1). The operation content indicates the operation content of the vehicle 130 corresponding to the command. For example, the command information 500-1 indicates the operation content “open the sliding door” of the vehicle 130 corresponding to the command “open”.

(Functional configuration example of the open / close control device 101)
FIG. 6 is a block diagram of a functional configuration example of the opening / closing control apparatus 101 according to the first embodiment. In FIG. 6, the open / close control device 101 includes an array microphone processing unit 601, a voice recognition processing unit 602, a control signal generation unit 603, and a communication control unit 604. The array microphone processing unit 601 is realized by, for example, the audio codec 406 and the DSP 407 of the directional microphone 110 illustrated in FIG. The voice recognition processing unit 602 to the communication control unit 604 are functions as control units. Specifically, for example, a program stored in a storage device such as the memory 402 or the disk 405 shown in FIG. The function is realized by executing or by the I / F 403. The processing result of each functional unit is stored in a storage device such as the memory 402 or the disk 405, for example.

  The array microphone processing unit 601 detects an audio signal having directivity above the horizontal plane including the mounting position of the sound collection unit 120. In the following description, as shown in FIG. 1, a case where the sound collection unit 120 is attached to the attachment position P having a predetermined height H around the slide door 131 of the vehicle 130 will be described as an example.

  Specifically, for example, the array microphone processing unit 601 amplifies the analog signal of the sound collected by each microphone 120a, 120b by the audio codec 406, and generates a digitized sound signal. Then, the array microphone processing unit 601 corrects the generated audio signal so that the sensitivity of the audio from the directivity range X (see FIG. 1) is increased by the DSP 407, for example.

  Here, the relationship between the distance between the speaker and each of the microphones 120a and 120b varies depending on the position of the speaker (the height of the mouth). For this reason, a time difference T determined by the distance between the speaker and each microphone 120a, 120b and the speed of sound is generated in the sound collected by each microphone 120a, 120b.

  For example, the DSP 407 detects this time difference T, and the array microphone processing unit 601 corrects the generated sound signal by suppressing the sound whose time difference T is outside a predetermined range. That is, the array microphone processing unit 601 can control the directivity range by adjusting a predetermined range to be compared with the time difference T.

  Thereby, it is possible to detect an audio signal having directivity above the horizontal plane LS including the mounting position P of the sound collection unit 120. For a technique for controlling the directivity of the microphone, reference can be made to, for example, JP-A-2007-318528.

  The voice recognition processing unit 602 performs voice recognition on the voice signal detected by the array microphone processing unit 601. Specifically, for example, the speech recognition processing unit 602 analyzes the detected speech signal at regular time intervals to detect an utterance section in which there is an utterance. When the speech recognition processing unit 602 detects an utterance section, the speech recognition processing unit 602 performs a speech recognition process on the speech signal in the utterance section.

  The control signal generation unit 603 generates a control signal for controlling the key or door opening / closing operation of the vehicle 130 based on the recognition result recognized by the voice recognition processing unit 602. Specifically, for example, the control signal generation unit 603 refers to the command table 500 illustrated in FIG. 5 and identifies a command corresponding to the recognition result that has been voice-recognized. Next, the control signal generation unit 603 specifies the operation content of the vehicle corresponding to the specified command. Then, the control signal generation unit 603 generates a control signal corresponding to the identified operation content of the vehicle.

  For example, it is assumed that “open” is recognized by voice recognition. In this case, the control signal generation unit 603 refers to the command table 500 and identifies the command “open”. Next, the control signal generation unit 603 specifies the operation content “open the sliding door” corresponding to the specified command “open”. Then, the control signal generation unit 603 generates a control signal instructing the operation of the specified operation content “open the sliding door”.

  Further, for example, it is assumed that “open the key” is recognized by voice recognition. In this case, the control signal generation unit 603 refers to the command table 500 and identifies the command “open the key”. Next, the control signal generation unit 603 identifies the operation content “unlock door” corresponding to the identified command “unlock key”. Then, the control signal generation unit 603 generates a control signal instructing an operation of the specified operation content “unlock door”.

  The communication control unit 604 transmits the generated control signal to the operation control unit 610 that controls the operation of the vehicle 130. The operation control unit 610 is, for example, an ECU (Electronic Control Unit) that performs electronic control of the vehicle 130. The operation control unit 610 controls the operation of the vehicle 130 according to the control signal from the communication control unit 604.

  For example, the operation control unit 610 opens the slide door 131 of the vehicle 130 when receiving a control signal instructing an operation of the operation content “open slide door”. Further, for example, when the operation control unit 610 receives a control signal instructing the operation of the operation content “unlock door”, the operation control unit 610 unlocks the door lock of the vehicle 130.

  In the example of FIG. 6, the case where the operation control unit 610 is provided separately from the opening / closing control device 101 has been described as an example, but a configuration included in the opening / closing control device 101 may be used. In this case, for example, the operation control unit 610 realizes its function by causing the CPU 401 to execute a program stored in a storage device such as the memory 402 or the disk 405 or by the I / F 403.

  In the above description, the case where the directivity is controlled by correcting the sound collected by the microphones 120a and 120b has been described as an example. However, the present invention is not limited to this. For example, the directional microphone 110 may have a structure in which the sensitivity of sound from the directivity range X is increased by physically limiting the sound entry path to the microphone, such as a horn or a parabolic type. .

(Open / Close Control Processing Procedure of Open / Close Control Device 101)
Next, an opening / closing control processing procedure of the opening / closing control apparatus 101 according to the first embodiment will be described.

  FIG. 7 is a flowchart of an example of an opening / closing control processing procedure of the opening / closing control apparatus 101 according to the first embodiment. In the flowchart of FIG. 7, first, the speech recognition processing unit 602 analyzes the speech signal detected by the array microphone processing unit 601 at regular time intervals to detect an utterance section in which there is an utterance (step S701).

  Then, the voice recognition processing unit 602 determines whether or not an utterance section has been detected (step S702). Here, when an utterance section is not detected (step S702: No), the speech recognition processing unit 602 returns to step S701. On the other hand, when a speech segment is detected (step S702: Yes), the speech recognition processing unit 602 performs speech recognition processing on the speech signal of the detected speech segment (step S703).

  Next, the control signal generation unit 603 refers to the command table 500 and specifies a command corresponding to the recognition result recognized by the voice recognition processing unit 602 (step S704). Here, when the command corresponding to the recognition result is not specified (step S704: No), the control signal generation unit 603 returns to step S701.

  On the other hand, when the control signal generation unit 603 identifies a command corresponding to the recognition result (step S704: Yes), the control signal generation unit 603 refers to the command table 500 and identifies the operation content of the vehicle corresponding to the identified command (step S705). ). Next, the control signal generation unit 603 generates a control signal corresponding to the identified operation content of the vehicle (step S706).

  And the communication control part 604 transmits the control signal produced | generated by the control signal production | generation part 603 to the operation control part 610 which controls operation | movement of the vehicle 130 (step S707), and complete | finishes a series of processes by this flowchart. .

  Thereby, it is possible to instruct the operation control unit 610 (for example, the ECU of the vehicle 130) to perform an operation corresponding to the recognition result obtained by performing speech recognition on the audio signal detected by the directional microphone 110.

  As described above, according to the opening / closing control apparatus 101 according to the first embodiment, the key or door of the vehicle 130 is determined based on the recognition result obtained by voice recognition of the voice signal detected by the directional microphone 110. The opening / closing operation can be controlled. Thereby, by adjusting the height H of the position where the sound collecting unit 120 for collecting sound outside the vehicle is attached, it is possible to limit operators who can open and close the keys and doors of the vehicle 130 by sound.

  For example, by setting the height H of the position where the sound collecting unit 120 is attached to about 1 m, a child's voice whose height is less than 1 m becomes difficult to be recognized. It can be prevented from opening and closing.

(Embodiment 2)
Next, the opening / closing control apparatus 101 according to the second embodiment will be described. In addition, about the location similar to the location demonstrated in Embodiment 1, the same code | symbol is attached | subjected and illustration and description are abbreviate | omitted.

  Here, if the keys and doors of the vehicle 130 can be opened and closed by voice, even a person who is not the owner of the vehicle 130 can open and close the keys and doors of the vehicle 130, resulting in a decrease in security. End up. Therefore, in the second embodiment, a case will be described in which the operator who can open and close the key and door of the vehicle 130 by voice is further limited to the user who carries the electronic key K (so-called smart key) of the vehicle 130.

(Functional configuration example of the open / close control device 101)
First, a functional configuration example of the opening / closing control apparatus 101 according to the second embodiment will be described.

  FIG. 8 is a block diagram of a functional configuration example of the opening / closing control device 101 according to the second embodiment. In FIG. 8, the opening / closing control apparatus 101 includes an array microphone processing unit 601, a voice recognition processing unit 602, a control signal generation unit 603, a communication control unit 604, and a vehicle information recording unit 801. The array microphone processing unit 601 is realized by, for example, the audio codec 406 and the DSP 407 of the directional microphone 110 illustrated in FIG. The voice recognition processing unit 602 to the communication control unit 604 and the vehicle information recording unit 801 are functions serving as control units. Specifically, for example, they are stored in a storage device such as the memory 402 and the disk 405 shown in FIG. The function is realized by causing the CPU 401 to execute the recorded program or by the I / F 403. The processing result of each functional unit is stored in a storage device such as the memory 402 or the disk 405, for example.

  The communication control unit 604 receives an entry detection signal indicating entry into the effective range of the electronic key K (hereinafter referred to as “effective range Y”) from the entry detection unit 810. Further, the communication control unit 604 receives an exit detection signal indicating that the electronic key K is outside the valid range Y from the entrance detection unit 810.

  Here, the electronic key K is a key that allows the key of the vehicle 130 to be opened and closed by wireless communication with a communication device mounted on the vehicle 130. For example, when the electronic key K receives radio waves intermittently transmitted from the communication device of the vehicle 130, the electronic key K transmits an ID (identification) code to the vehicle side.

  When the communication device of the vehicle 130 receives the ID code from the electronic key K, the ID code is verified by the ECU or the like. If it is verified that the ID code is correct, for example, the key of the vehicle 130 can be opened and closed by a switch or a touch sensor provided on the door handle of the vehicle 130.

  In this state, for example, when a switch or touch sensor provided on the door handle of the vehicle 130 is operated by the user, the door of the vehicle 130 is unlocked by the ECU or the like. The effective range Y of the electronic key K is an area where the electronic key K can receive radio waves transmitted intermittently from the communication device of the vehicle 130, and is set to a range of about 1 to 2 m from the door handle, for example.

  The entry detection unit 810 is a functional unit that detects entry of the electronic key K into the effective range Y, and is realized by, for example, the ECU of the vehicle 130. Specifically, for example, the entry detection unit 810 controls communication of an entry detection signal indicating entry of the electronic key K into the effective range Y when the ID code received from the electronic key K is verified to be correct. To the unit 604. Further, the entry detection unit 810 communicates an exit detection signal indicating that the electronic key K is out of the effective range Y when wireless communication with the electronic key K verified that the ID code is correct cannot be performed. It transmits to the control unit 604.

  The vehicle information recording unit 801 records the entry detection signal or the exit detection signal received by the communication control unit 604. Specifically, for example, when the communication control unit 604 receives an entry detection signal or an exit detection signal, the vehicle information recording unit 801 updates the entry detection information 900 as illustrated in FIG. Here, a specific example of the entry detection information 900 will be described.

  FIG. 9 is an explanatory diagram showing a specific example of the entry detection information 900. In FIG. 9, the entry detection information 900 has an entry flag. The entry flag is information indicating whether or not the electronic key K has entered the effective range Y, and is “0” in the initial state. The entry detection information 900 is stored in a storage device such as the memory 402 or the disk 405, for example.

  For example, the vehicle information recording unit 801 sets “1” in the entry flag when the communication control unit 604 receives an entry detection signal. Further, the vehicle information recording unit 801 sets “0” in the entry flag when the communication control unit 604 receives an exit detection signal. According to the entry flag, it is possible to determine whether or not the electronic key K has entered the effective range Y.

  Returning to the description of FIG. 8, the voice recognition processing unit 602 performs voice recognition of the voice signal detected by the array microphone processing unit 601 when the communication control unit 604 receives an entry detection signal. Specifically, for example, the speech recognition processing unit 602 refers to the approach detection information 900 illustrated in FIG. 9 and, when the approach flag is “1”, the speech signal detected by the array microphone processing unit 601 Perform voice recognition.

  On the other hand, when the entry flag is “0”, the voice recognition processing unit 602 does not perform voice recognition of the voice signal detected by the array microphone processing unit 601. As a result, the voice of a person who does not carry the electronic key K is not recognized, and the operator who can open and close the key of the vehicle 130 or the door by voice is limited to the user carrying the electronic key K, thereby reducing the security. Can be prevented.

  In the example of FIG. 8, the case where the operation control unit 610 and the approach detection unit 810 are provided separately from the opening / closing control device 101 has been described as an example. However, the configuration may be included in the opening / closing control device 101. . In this case, the operation control unit 610 and the entry detection unit 810 realize their functions by causing the CPU 401 to execute a program stored in a storage device such as the memory 402 or the disk 405, or by the I / F 403, for example. .

(Control example of the open / close control device 101)
Next, a control example of the opening / closing control device 101 according to the second embodiment will be described using FIG. 10 and FIG. 11 as an example of controlling the opening / closing operation of the slide door 131 of the vehicle 130.

  FIG. 10 is an explanatory diagram (part 1) of a control example of the opening / closing control device 101 according to the second embodiment. In FIG. 10, it is assumed that the user carrying the electronic key K enters the effective range Y of the electronic key K and utters “open” in the directivity range X. In this case, since the electronic key K exists in the effective range Y, the entry flag of the entry detection information 900 is “1”.

  For this reason, the opening / closing control apparatus 101 performs speech recognition by detecting a speech section. The opening / closing control device 101 performs control to open the slide door 131 based on the recognition result (opened) obtained by voice recognition. As a result, the user carrying the electronic key K can open the slide door 131 of the vehicle 130 only by saying “open” within the directivity range X even if both hands are blocked by the luggage. Can do.

  FIG. 11 is an explanatory diagram (part 2) of a control example of the opening / closing control device 101 according to the second embodiment. In FIG. 11, it is assumed that a user who does not carry the electronic key K enters the effective range Y of the electronic key K and utters “open” within the directivity range X. In this case, since the electronic key K does not exist within the effective range Y, the entry flag of the entry detection information 900 is “0”. For this reason, the opening / closing control apparatus 101 does not perform voice recognition.

  As a result, if the user does not carry the electronic key K, control to open the sliding door 131 is not performed even if the voice is “opened” within the directivity range X, and a reduction in security can be prevented.

(Various processing procedures of the open / close control device 101)
Next, various processing procedures of the opening / closing control apparatus 101 according to the second embodiment will be described. First, the update processing procedure of the entry detection information 900 shown in FIG. 9 will be described.

  FIG. 12 is a flowchart of an example of an update process procedure of the opening / closing control apparatus 101 according to the second embodiment. In the flowchart of FIG. 12, first, the vehicle information recording unit 801 determines whether or not an entry detection signal has been received by the communication control unit 604 (step S1201).

  Here, the vehicle information recording unit 801 waits for an incoming detection signal to be received (step S1201: No). Then, when the approach detection signal is received (step S1201: Yes), the vehicle information recording unit 801 sets “1” in the approach flag of the approach detection information 900 (step S1202).

  Next, the vehicle information recording unit 801 determines whether or not an exit detection signal has been received by the communication control unit 604 (step S1203). Here, the vehicle information recording unit 801 waits for an exit detection signal to be received (step S1203: No).

  Then, when the exit detection signal is received (step S1203: Yes), the vehicle information recording unit 801 sets “0” in the entry flag of the entry detection information 900 (step S1204), and a series of processes according to this flowchart. Exit. As a result, the entry flag indicating whether or not the electronic key K has entered the effective range Y can be updated.

  FIG. 13 is a flowchart of an example of an opening / closing control processing procedure of the opening / closing control apparatus 101 according to the second embodiment. In the flowchart of FIG. 13, first, the voice recognition processing unit 602 reads the entry detection information 900 (step S1301). Then, the speech recognition processing unit 602 determines whether or not the entry flag of the entry detection information 900 is “1” (step S1302).

  If the entry flag is “0” (step S1302: No), the speech recognition processing unit 602 returns to step S1301. On the other hand, when the approach flag is “1” (step S1302: Yes), the speech recognition processing unit 602 analyzes the speech signal detected by the array microphone processing unit 601 at regular intervals, and there is a speech. The detected utterance section is detected (step S1303).

  Then, the speech recognition processing unit 602 determines whether or not an utterance section has been detected (step S1304). Here, when the utterance section is not detected (step S1304: No), the speech recognition processing unit 602 returns to step S1301. On the other hand, when a speech segment is detected (step S1304: Yes), the speech recognition processing unit 602 performs speech recognition processing on the speech signal of the detected speech segment (step S1305).

  Next, the control signal generation unit 603 refers to the command table 500 and specifies a command corresponding to the recognition result recognized by the voice recognition processing unit 602 (step S1306). Here, when the control signal generation unit 603 has not specified a command corresponding to the recognition result (step S1306: No), the control signal generation unit 603 returns to step S1301.

  On the other hand, when the control signal generation unit 603 identifies a command corresponding to the recognition result (step S1306: Yes), the control signal generation unit 603 refers to the command table 500 and identifies the operation content of the vehicle corresponding to the identified command (step S1307). ). Next, the control signal generation unit 603 generates a control signal corresponding to the identified operation content of the vehicle (step S1308).

  And the communication control part 604 transmits the control signal produced | generated by the control signal production | generation part 603 to the operation control part 610 which controls operation | movement of the vehicle 130 (step S1309), and complete | finishes a series of processes by this flowchart. .

  Thereby, when the user carrying the electronic key K exists in the effective range Y, the voice recognition of the voice signal detected by the directional microphone 110 can be started.

  As described above, according to the opening / closing control apparatus 101 according to the second embodiment, the sound of the sound signal detected by the directional microphone 110 when the entry of the electronic key K into the effective range Y is detected. Recognition can be performed. Thereby, the operator who can open and close the key of the vehicle 130 and the door by voice can be limited to the user carrying the electronic key K of the vehicle 130, and the deterioration of the security can be prevented.

(Embodiment 3)
Next, the opening / closing control apparatus 101 according to the third embodiment will be described. In addition, about the location similar to the location demonstrated in Embodiment 1, 2, the same code | symbol is attached | subjected and illustration and description are abbreviate | omitted.

  Here, when a person near the vehicle 130 is talking in a loud voice, the speech recognition processing unit 602 may detect the speech section and perform speech recognition even outside the directivity range X. . At this time, when a person near the vehicle 130 utters a word such as “open” in a loud voice, control for opening the slide door 131 of the vehicle 130 may be performed.

  Therefore, in the third embodiment, a case will be described in which operators who can open and close the keys or doors of the vehicle 130 by voice are further limited to users detected by the human sensor S attached to the vehicle 130.

(Functional configuration example of the open / close control device 101)
First, a functional configuration example of the opening / closing control apparatus 101 according to the third embodiment will be described.

  FIG. 14 is a block diagram of a functional configuration example of the opening / closing control apparatus 101 according to the third embodiment. 14, the opening / closing control apparatus 101 includes an array microphone processing unit 601, a voice recognition processing unit 602, a control signal generation unit 603, a communication control unit 604, and a vehicle information recording unit 801.

  Communication control unit 604 receives a human detection signal from sensor control unit 1410 indicating that a person outside the vehicle has been detected by human sensor S attached to vehicle 130. In addition, the communication control unit 604 receives from the sensor control unit 1410 a human non-detection signal indicating that a person outside the vehicle has not been detected by the human sensor S.

  Here, the human sensor S is a sensor for detecting a person. As the human sensor S, for example, there are sensors using infrared rays, ultrasonic waves, image recognition, and the like. The human sensor S is attached to the vehicle 130 in order to detect a person who speaks within the directivity range X. Therefore, the human sensor S is attached, for example, around the slide door 131 of the vehicle 130 (see, for example, FIG. 16). The detection range of human sensor S (hereinafter referred to as “detection range Z”) is set to a range of about 50 cm to 1 m from human sensor S, for example.

  The sensor control unit 1410 is a functional unit that acquires the detection result of the human sensor S at regular intervals, and is realized by, for example, the ECU of the vehicle 130. Specifically, for example, when the sensor control unit 1410 acquires a detection result indicating that a person has been detected from the human sensor S, the communication control unit transmits a person detection signal indicating that a person outside the vehicle has been detected. To 604. In addition, when the sensor control unit 1410 obtains a detection result indicating that no person has been detected from the human sensor S, the communication control unit 604 transmits a person non-detection signal indicating that no person outside the vehicle has been detected. Send to.

  The vehicle information recording unit 801 records the person detection signal or the person non-detection signal received by the communication control unit 604. Specifically, for example, when the person detection signal or the person non-detection signal is received by the communication control unit 604, the vehicle information recording unit 801 updates the person detection information 1500 as illustrated in FIG. Here, a specific example of the human detection information 1500 will be described.

  FIG. 15 is an explanatory diagram of a specific example of the person detection information 1500. In FIG. 15, the human detection information 1500 includes a human detection flag. The person detection flag is information indicating whether or not a person outside the vehicle has been detected by the human sensor S, and is “0” in the initial state. The person detection information 1500 is stored in a storage device such as the memory 402 or the disk 405, for example.

  For example, the vehicle information recording unit 801 sets “1” to the human detection flag when the communication control unit 604 receives a human detection signal. Further, the vehicle information recording unit 801 sets “0” in the human detection flag when the communication control unit 604 receives a human non-detection signal. According to the person detection flag, it is possible to determine whether or not a person outside the vehicle has been detected by the human sensor S attached to the vehicle 130.

  Returning to the description of FIG. 14, the voice recognition processing unit 602 performs voice recognition of the voice signal detected by the array microphone processing unit 601 when the communication control unit 604 receives a human detection signal. Specifically, for example, the speech recognition processing unit 602 refers to the person detection information 1500 illustrated in FIG. 15, and the sound signal detected by the array microphone processing unit 601 when the person detection flag is “1”. Perform voice recognition.

  On the other hand, when the person detection flag is “0”, the voice recognition processing unit 602 does not perform voice recognition of the voice signal detected by the array microphone processing unit 601. As a result, even if a person near the vehicle 130 speaks in a loud voice, the voice is not recognized unless detected by the human sensor S. Therefore, the key or door opening / closing operation of the vehicle 130 is contrary to the intention of the speaker. Can be prevented.

  In addition, the voice recognition processing unit 602 receives the voice signal detected by the array microphone processing unit 601 when the communication control unit 604 receives a human detection signal and the communication control unit 604 receives an entry detection signal. Voice recognition may be performed. Specifically, for example, when the person detection flag of the person detection information 1500 is “1” and the entry flag of the entry detection information 900 is “1”, the voice recognition processing unit 602 uses the array microphone processing unit 601. Speech recognition of the detected speech signal is performed.

  Thereby, it is possible to prevent the key or door of the vehicle 130 from being opened and closed against the intention of the speaker, and to limit the operator to the user who carries the electronic key K, thereby preventing a decrease in security.

(Control example of the open / close control device 101)
Next, a control example of the opening / closing control apparatus 101 according to the third embodiment will be described using FIG. 16 and FIG. 17 as an example of controlling the opening / closing operation of the slide door 131 of the vehicle 130.

  FIG. 16 is an explanatory diagram (part 1) of a control example of the opening / closing control device 101 according to the third embodiment. In FIG. 16, it is assumed that a user existing within the detection range Z of the human sensor S speaks “open” within the directivity range X. In this case, since the user exists in the detection range Z, the human detection flag of the human detection information 1500 is “1”.

  For this reason, the opening / closing control apparatus 101 performs speech recognition by detecting a speech section. The opening / closing control device 101 performs control to open the slide door 131 based on the recognition result (opened) obtained by voice recognition. As a result, even if both hands are blocked by the luggage, the user simply enters the detection range Z of the human sensor S and speaks “open” in the directivity range X, and the sliding door of the vehicle 130 131 can be opened.

  FIG. 17 is an explanatory diagram (part 2) of a control example of the opening / closing control apparatus 101 according to the third embodiment. In FIG. 17, it is assumed that a user near the vehicle 130 happens to say “open” while talking on the mobile phone. In this case, since the user does not exist within the detection range Z, the human detection flag of the human detection information 1500 is “0”. For this reason, the opening / closing control apparatus 101 does not perform voice recognition.

  Thereby, it is possible to prevent the control to open the slide door 131 of the vehicle 130 against the intention of the user who is talking near the vehicle 130.

(Various processing procedures of the open / close control device 101)
Next, various processing procedures of the opening / closing control apparatus 101 according to the third embodiment will be described. First, the update processing procedure of the person detection information 1500 shown in FIG. 15 will be described.

  FIG. 18 is a flowchart of an example of an update process procedure of the opening / closing control apparatus 101 according to the third embodiment. In the flowchart of FIG. 18, the vehicle information recording unit 801 first determines whether or not a person detection signal is received by the communication control unit 604 (step S1801).

  Here, the vehicle information recording unit 801 waits for a person detection signal to be received (step S1801: No). Then, when the person detection signal is received (step S1801: Yes), the vehicle information recording unit 801 sets “1” in the person detection flag of the person detection information 1500 (step S1802).

  Next, the vehicle information recording unit 801 determines whether or not a person non-detection signal is received by the communication control unit 604 (step S1803). Here, the vehicle information recording unit 801 waits for a person non-detection signal to be received (step S1803: No).

  Then, when the person non-detection signal is received (step S1803: Yes), the vehicle information recording unit 801 sets “0” in the person detection flag of the person detection information 1500 (step S1804), and the series according to this flowchart. Terminate the process. Thereby, the person detection flag indicating whether or not a person outside the vehicle is detected by the human sensor S attached to the vehicle 130 can be updated.

  FIG. 19 is a flowchart of an example of an opening / closing control processing procedure of the opening / closing control apparatus 101 according to the third embodiment. In the flowchart of FIG. 19, first, the speech recognition processing unit 602 reads the person detection information 1500 (step S1901). Then, the speech recognition processing unit 602 determines whether or not the person detection flag of the person detection information 1500 is “1” (step S1902).

  If the human detection flag is “0” (step S1902: NO), the speech recognition processing unit 602 returns to step S1901. On the other hand, when the person detection flag is “1” (step S1902: Yes), the speech recognition processing unit 602 analyzes the speech signal detected by the array microphone processing unit 601 at regular intervals, and the speech is detected. The utterance section that has been detected is detected (step S1903).

  Then, the speech recognition processing unit 602 determines whether or not an utterance section has been detected (step S1904). Here, when the utterance section is not detected (step S1904: No), the speech recognition processing unit 602 returns to step S1901. On the other hand, when a speech segment is detected (step S1904: Yes), the speech recognition processing unit 602 performs speech recognition processing on the speech signal of the detected speech segment (step S1905).

  Next, the control signal generation unit 603 refers to the command table 500 and identifies a command corresponding to the recognition result recognized by the voice recognition processing unit 602 (step S1906). Here, when the control signal generation unit 603 has not specified a command corresponding to the recognition result (step S1906: No), the control signal generation unit 603 returns to step S1901.

  On the other hand, when the control signal generation unit 603 specifies a command corresponding to the recognition result (step S1906: Yes), the control signal generation unit 603 refers to the command table 500 and specifies the operation content of the vehicle corresponding to the specified command (step S1907). ). Next, the control signal generation unit 603 generates a control signal corresponding to the identified operation content of the vehicle (step S1908).

  And the communication control part 604 transmits the control signal produced | generated by the control signal production | generation part 603 to the operation control part 610 which controls operation | movement of the vehicle 130 (step S1909), and complete | finishes a series of processes by this flowchart. .

  Thereby, when a user exists within the detection range Z of the human sensor S, voice recognition of the voice signal detected by the directional microphone 110 can be started.

  As described above, according to the opening / closing control apparatus 101 according to the third embodiment, the sound detected by the directional microphone 110 when a person outside the vehicle is detected by the human sensor S attached to the vehicle 130. Speech recognition of the signal can be performed. Thereby, the operator who can open and close the key and door of the vehicle 130 by voice can be limited to the users detected by the human sensor S attached to the vehicle 130. As a result, even if the conversation is performed near the vehicle 130, the voice is not recognized unless detected by the human sensor S, so that the key or door opening / closing operation of the vehicle 130 is prevented from being performed against the intention of the speaker. be able to.

  The open / close control method described in the present embodiment can be realized by executing a program prepared in advance on a computer such as a personal computer or a workstation. The opening / closing control program is recorded on a computer-readable recording medium such as a hard disk, a flexible disk, a CD-ROM, an MO, and a DVD, and is executed by being read from the recording medium by the computer. The opening / closing control program may be distributed through a network such as the Internet.

  The following additional notes are disclosed with respect to the embodiment described above.

(Supplementary Note 1) A directional microphone having a sound collection unit that is attached to a vehicle and collects sound outside the vehicle, and has directivity above a horizontal plane that includes an attachment position of the sound collection unit;
Based on the recognition result obtained by voice recognition of the audio signal detected by the directional microphone, a control unit that controls the opening / closing operation of the key or door of the vehicle;
An opening / closing control device comprising:

(Additional remark 2) The said control part is the audio | voice of the audio | voice signal detected by the said directional microphone when the approach to the effective range of the electronic key which can be communicated by radio | wireless with the communication apparatus mounted in the said vehicle is detected. The opening / closing control device according to attachment 1, wherein recognition is performed.

(Additional remark 3) The said control part performs voice recognition of the audio | voice signal detected by the said directional microphone, when the person outside a vehicle is detected by the human sensor attached to the said vehicle. The opening / closing control device according to 1 or 2.

(Appendix 4) The door is a sliding door that can be opened and closed parallel to the vehicle body,
The opening / closing control device according to any one of appendices 1 to 3, wherein the sound collecting unit is attached to a position at a predetermined height around the slide door.

(Appendix 5)
Based on a recognition result obtained by voice recognition of a voice signal detected by a directional microphone having a directivity above a horizontal plane including a mounting position of a sound collection unit that is attached to a vehicle and collects sound outside the vehicle, Control the opening or closing operation of the key or door of the vehicle,
An opening / closing control program for executing a process.

(Appendix 6)
Based on a recognition result obtained by voice recognition of a voice signal detected by a directional microphone having a directivity above a horizontal plane including a mounting position of a sound collection unit that is attached to a vehicle and collects sound outside the vehicle, Control the opening or closing operation of the key or door of the vehicle,
An opening / closing control method characterized by executing processing.

DESCRIPTION OF SYMBOLS 101 Opening / closing control apparatus 110 Directional microphone 120 Sound collecting part 120a, 120b Microphone 130 Vehicle 131 Slide door 500 Command table 601 Array microphone processing part 602 Speech recognition processing part 603 Control signal generation part 604 Communication control part 610 Operation control part 801 Vehicle information Recording unit 810 Entry detection unit 900 Entry detection information 1410 Sensor control unit 1500 Person detection information K Electronic key S Human sensor X Directional range Y Effective range Z Detection range

Claims (5)

A directional microphone that has a sound collecting portion that is attached to a vehicle and collects sound outside the vehicle, and that has directivity above a horizontal plane that includes a mounting position of the sound collecting portion;
Based on the recognition result obtained by voice recognition of the audio signal detected by the directional microphone, a control unit that controls the opening / closing operation of the key or door of the vehicle;
An opening / closing control device comprising:   The control unit performs voice recognition of a voice signal detected by the directional microphone when an entry of an electronic key capable of wireless communication with a communication device mounted on the vehicle is detected. The opening / closing control device according to claim 1.   The control unit performs voice recognition of a voice signal detected by the directional microphone when a person outside the vehicle is detected by a human sensor attached to the vehicle. The opening / closing control device described in 1. On the computer,
Based on a recognition result obtained by voice recognition of a voice signal detected by a directional microphone having a directivity above a horizontal plane including a mounting position of a sound collection unit that is attached to a vehicle and collects sound outside the vehicle, Control the opening or closing operation of the key or door of the vehicle,
An opening / closing control program for executing a process. Computer
Based on a recognition result obtained by voice recognition of a voice signal detected by a directional microphone having a directivity above a horizontal plane including a mounting position of a sound collection unit that is attached to a vehicle and collects sound outside the vehicle, Control the opening or closing operation of the key or door of the vehicle,
An opening / closing control method characterized by executing processing.

Images