JP6790483B2 - Authentication method and authentication device - Google Patents

Description

The present invention relates to an authentication method and an authentication device for the use of an in-vehicle device.

As a technique for remotely controlling an in-vehicle device such as a lock on a vehicle door, for example, the technique described in Patent Document 1 is known.
The unlocking / locking system described in Patent Document 1 switches a remote switch by operating a control unit based on a remote signal from a mobile phone. When the LOCK side contact of the remote switch is closed, the electric motor is rotated to the locking side to lock the lock portion. When the UNLOCK side contact of the remote switch is closed, the electric motor is rotated to the unlocking side to unlock the lock portion.

Japanese Unexamined Patent Publication No. 2014-11158

When the mobile information terminal device is operated and used as a remote controller of the vehicle-mounted device as in Patent Document 1, the mobile information terminal device transmits a wireless signal to the vehicle-mounted device via a public line. Therefore, remote control of the in-vehicle device may be difficult when the wireless signal from the mobile information terminal device is difficult to reach the in-vehicle device, such as when it is difficult to connect to a public line.
An object of the present invention is to enable a user of an in-vehicle device to authenticate the use of the in-vehicle device by using a signal other than a wireless signal.

In the method for controlling an in-vehicle device according to one aspect of the present invention, registration information including usage authority information indicating usage authority of the in-vehicle device provided in the vehicle and a reference image is received by the authentication device together with identification information. Then, it is determined whether or not the registration information is valid based on the received identification information, and when it is determined that the registration information is valid, the usage authority information included in the registration information is associated with the reference image. Store in storage device. An in-vehicle vehicle that acquires a collation image of a subject taken by a camera provided in the vehicle and indicates the usage authority by the usage authority information corresponding to the reference image according to the collation result between the collation image and the reference image stored in the storage device. Determine whether the device can be used.

According to the present invention, a user of an in-vehicle device can authenticate the use of the in-vehicle device by using a signal other than a wireless signal.

It is a schematic block diagram which shows an example of the structure of the vehicle-mounted device operation system which concerns on 1st Embodiment. It is explanatory drawing of an example of the 1st reference image displayed on the display device of the 1st mobile information terminal apparatus. It is a schematic block diagram of an example of the 1st mobile information terminal apparatus which concerns on 1st Embodiment. It is a schematic block diagram of an example of the 2nd portable information terminal apparatus which concerns on 1st Embodiment. It is explanatory drawing of the use start procedure of the in-vehicle device operation system which concerns on 1st Embodiment. It is a flowchart of an example of the operation of the authentication apparatus which concerns on 1st Embodiment. It is a schematic block diagram of an example of the 1st mobile information terminal apparatus which concerns on 2nd Embodiment. It is explanatory drawing of the setting example of the usable range of the 1st use authority information and the 2nd use authority information. It is explanatory drawing of the definition example of a usable range. It is a schematic block diagram which shows an example of the structure of the vehicle-mounted device operation system which concerns on 2nd Embodiment. It is explanatory drawing of an example of the 2nd reference image and the 2nd use authority information displayed on the display device of the 2nd mobile information terminal apparatus. It is explanatory drawing of the use start procedure of the in-vehicle device operation system which concerns on 2nd Embodiment. It is a flowchart of an example of the operation of the authentication apparatus which concerns on 2nd Embodiment. It is a schematic block diagram which shows an example of the structure of the vehicle-mounted device operation system which concerns on 3rd Embodiment. It is explanatory drawing of the 1st example of the availability determination in the authentication method which concerns on 4th Embodiment. It is explanatory drawing of the 2nd example of the availability determination in the authentication method which concerns on 4th Embodiment. It is a schematic block diagram of an example of the 2nd mobile information terminal apparatus which concerns on 5th Embodiment. It is the schematic of the operation screen displayed on the display device of the second mobile information terminal device. It is a schematic block diagram which shows an example of the structure of the vehicle-mounted device operation system which concerns on 5th Embodiment. It is a flowchart of an example of the operation of the 2nd mobile information terminal apparatus and the authentication apparatus which concerns on 5th Embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
(First Embodiment)
(Constitution)
Reference numeral 1 indicates a vehicle equipped with an in-vehicle device operated by the in-vehicle device operation system of the embodiment. Reference numeral 2 is the owner of the vehicle 1, a person who has received permission to use the vehicle 1 from the owner of the vehicle 1, a person who is entrusted with the management and operation of the vehicle 1, etc. ) Is shown. The owner 2 has the authority to use the vehicle 1.
Further, the reference code 3 indicates a user who has received the authority to use the vehicle 1 from the owner 2. In the following explanation, owner 2 or user 3 may be referred to as "user authority holder".

Reference numeral 10 indicates a door locking device which is an in-vehicle device provided in the vehicle 1. Reference numeral 11 indicates a door control ECU (Electronic Control Unit) that controls the door locking device 10. Reference numeral 12 indicates an in-vehicle device provided in the vehicle 1. The in-vehicle device 12 may be, for example, an air conditioner, an audio device, a navigation device, an interior light, a headlight, a trunk locking device, a wiper, an electric seat, and a sunroof. Reference numeral 13 indicates a control ECU 13 that controls the in-vehicle device 12.

The in-vehicle device operation system includes an authentication device 100 provided in the vehicle 1, a first portable information terminal device 200 owned by the owner 2, and a second portable information terminal device 300 owned by the user 3.
The user 3 may be the same person as the owner 2. That is, the owner of the second mobile information terminal device 300 may be the owner 2. In the following description and drawings, the first mobile information terminal device and the second mobile information terminal device may be referred to as "first terminal" and "second terminal", respectively.

The authentication device 100 authenticates the use of the door locking device 10 and the in-vehicle device 12 by the user authority holder. The authentication device 100 includes a communication device 101, a camera 102, a storage device 103, and a control device 104.
The communication device 101 communicates with the first terminal 200 and the second terminal 300 via a wired or wireless communication line. The communication device 101 is a first terminal 200 and a second terminal 200 and a second via, for example, short-range wireless communication such as Bluetooth (registered trademark), wireless LAN (Local Area Network) such as Wi-Fi (registered trademark), and public wireless communication. It may communicate with the terminal 300.

The camera 102 captures an object existing around the vehicle 1 and generates image information. The camera 102 inputs the generated image information to the control device 104. The camera 102 may be, for example, any one of a collision prevention camera that shoots the front of the vehicle 1, a rear confirmation camera that shoots the rear, a side confirmation camera that shoots the side, and an automatic driving camera. .. Alternatively, the camera 102 may be a dedicated camera installed for the authentication device 100.

The storage device 103 includes, for example, a ROM (Read Only Memory) and a RAM (Random Access Memory). The storage device 103 may include a non-volatile memory or a hard disk drive device.
The storage device 103 stores an authentication processing program 110 for realizing the function of authenticating the use of the in-vehicle device by the user authority holder in the control device 104. The authentication processing program 110 may be recorded on a machine-readable recording medium, read by a medium reading device (not shown) at the manufacturing plant of the vehicle 1, a dealer, or the like, and installed in the storage device 103. Further, the authentication processing program 110 may be downloaded from the communication line via the communication device 101 and installed in the storage device 103.
Further, the storage device 103 stores the identification information 111 of the owner 2 or the first terminal 200.

Further, the storage device 103 stores the first reference image 112 and the first usage authority information 113.
The first reference image 112 is an image used for authentication of use of an in-vehicle device. At the time of authentication, a collation image is generated by capturing the subject presented by the user authority holder with the camera 102. The availability of the in-vehicle device is determined by collating the collated image with the first reference image 112.
The first reference image 112 may include, for example, a face image of a user authority holder. For example, the first reference image 112 may include a bar code, a two-dimensional bar code such as a QR code (registered trademark), or a graphic pattern such as an arbitrary figure.

The first usage authority information 113 is information indicating the usage authority of the in-vehicle device. The first usage authority information 113 may include information that specifies the usable range of the in-vehicle device by the usage authority holder.
The available range specifies, for example, the range of available in-vehicle devices. For example, the available in-vehicle device among the in-vehicle devices provided in the vehicle 1 is specified.
For example, the available range may specify the available function among the functions of each in-vehicle device. For example, among the functions of an audio device that is an in-vehicle device, only viewing of a sound source or video brought in may be permitted, and viewing of a sound source or video stored in the audio device may be prohibited.
For example, the available range may specify the available period. On the other hand, the information (music and navigation history information) originally stored in the vehicle may not be visible to the user at the same time.
The first reference image 112 and the first usage authority information 113 are set by the first terminal 200 and transmitted from the first terminal 200 to the authentication device 100. The first reference image 112 and the first usage authority information 113 are stored in the storage device 103 in association with each other.

The control device 104 is an electronic circuit device including a processor such as a CPU (Central Processing Unit) and peripheral components. The control device 104 includes a receiving unit 120, a registration availability determination unit 121, a registration unit 122, a collation unit 123, and a availability determination unit 124. The authentication processing program 110 causes the processor of the control device 104 to realize the functions of the receiving unit 120, the registration availability determination unit 121, the registration unit 122, the collation unit 123, and the availability determination unit 124.

Prior to the use of the vehicle-mounted device of the vehicle 1, the receiving unit 120 receives the first registration information including the first reference image 112 and the first usage authority information 113 together with the identification information via the communication device 101.
The registration possibility determination unit 121 compares the identification information received together with the first registration information with the identification information 111 stored in the storage device 103 to determine whether or not the received first registration information is valid. judge.

When the received identification information and the identification information 111 match and the registration possibility determination unit 121 determines that the received first registration information is valid, the registration unit 122 uses the first reference image included in the first registration information. The 112 and the first usage authority information 113 are associated and stored in the storage device 103.
When the received identification information and the identification information 111 do not match and the registration possibility determination unit 121 determines that the received first registration information is not valid, the first reference image 112 and the first usage authority information 113 are stored in the storage device 103. Not remembered in.

At the time of the usage authentication of the in-vehicle device of the vehicle 1, the user authority holder presents the subject predetermined to be presented at the time of the usage authentication to the vehicle 1.
This subject is determined according to the first reference image 112. Hereinafter, the subject determined according to the first reference image 112 may be referred to as "a subject corresponding to the first reference image 112".
For example, when the first reference image 112 is a graphic pattern, the user authority holder causes the display device of the first terminal 200 or the second terminal 300 to display the same graphic pattern as the first reference image 112, and this graphic. The pattern is presented as a subject corresponding to the first reference image 112.
See FIG. For example, the owner 2 displays the same graphic pattern 230 as the first reference image 112 on the display device 202 of the first terminal 200. The owner 2 presents the graphic pattern 230 displayed on the display device 202 as a subject corresponding to the first reference image 112.
Further, for example, a graphic pattern physically attached to the first terminal 200 may be presented.

For example, when the first reference image 112 is a face image of the usage authority holder, the usage authority holder may present his / her own face itself as a subject corresponding to the first reference image 112. You may present your own face image displayed on the display device of the first terminal 200 or the second terminal 300. The face image to be displayed may be the same image as the first reference image 112, or may be a face image of oneself different from the first reference image 112. Although FIG. 2 shows a diagram imitating a smartphone as an example of a mobile terminal, for example, a wristwatch-type terminal or a tablet-type terminal may be used.

See FIG. The collation unit 123 acquires a collation image of the subject presented by the user authority holder taken by the camera 102. The collation unit 123 collates the acquired collation image with the first reference image 112 stored in the storage device 103.
The usability determination unit 124 determines whether or not to use the in-vehicle device whose usage authority is indicated by the first usage authority information 113 stored in association with the first reference image 112 according to the collation result by the collation unit 123.

For example, when the collated image matches the first reference image 112, the availability determination unit 124 permits the use of the in-vehicle device in the usable range specified by the first usage authority information 113.
For example, when the use of the door locking device 10 is permitted by the first usage authority information 113, the availability determination unit 124 controls the door control ECU 11 to operate the door locking device 10 to operate the door of the vehicle 1. Unlock or lock.

Further, for example, when the use of the vehicle-mounted device 12 is permitted by the first usage authority information 113, the availability determination unit 124 releases the usage restriction of the vehicle-mounted device 12 by the control ECU 13.
On the other hand, if the collated image does not match the first reference image 112, the availability determination unit 124 does not permit the use of the vehicle-mounted device in the usable range specified by the first usage authority information 113.

The match between the collation image and the first reference image in the collation process of the collation unit 123 may include a case where the similarity between the collation image and the first reference image is equal to or more than a threshold value, in addition to the perfect match. Further, for example, the matching between the collated image and the first reference image after image processing such as correction processing of distortion of the subject in the collated image according to the shooting angle of the camera 102 may be included. In addition, a match between the feature points extracted from the collation image and the feature points extracted from the first reference image may be included.
Further, when the first reference image 112 is a face image, a plurality of collation images acquired by the camera 102 in a certain period may be collated with the first reference image 112 in order to prevent erroneous recognition.

See FIG. The first terminal 200 includes a communication circuit 201, a display device 202, an operation unit 203, a storage device 204, and a control device 205.
The communication circuit 201 communicates with the communication device 101 of the second terminal 300 and the vehicle 1 via a wired or wireless communication line. The communication circuit 201 communicates with the second terminal 300 and the communication device 101 via, for example, short-range wireless communication such as Bluetooth (registered trademark), wireless LAN such as Wi-Fi (registered trademark), or public wireless communication. You can.

The display device 202 functions as a display means and displays various types of information under the control of the control device 205.
The operation unit 203 functions as an information input means, and may include an input button, a jog dial, a joystick, a touch panel provided on the display screen of the display device 202, and the like.
The storage device 204 includes, for example, a ROM (Read Only Memory) and a RAM (Random Access Memory). The storage device 204 may include a non-volatile memory or a hard disk drive device. The storage device 204 stores the identification information 111 of the owner 2 or the first terminal 200, the first reference image 112, and the first usage authority information 113.

Further, the storage device 204 stores the setting program 210 executed by the control device 205 and the instruction program 211.
The setting program 210 provides the first registration information including the identification information 111, the first reference image 112, the function of setting the first usage authority information 113, and the first reference image 112 and the first usage authority information 113. The control device 205 is provided with a function of transmitting the identification information 111 to the authentication device 100.
Further, the setting program 210 makes the control device 205 realize a function of transmitting the first registration information including the first reference image 112 and the first usage authority information 113 to the second terminal 300.

The instruction program 211 makes the control device 205 realize a function of displaying the first reference image 112 on the display device 202 in response to the operation of the operation unit 203 by the owner 2 when authenticating the use of the in-vehicle device of the vehicle 1.
The setting program 210 and the instruction program 211 may be recorded on a machine-readable recording medium, read by a medium reading device (not shown), and installed in the storage device 204. Further, the setting program 210 and the instruction program 211 may be downloaded from the communication line via the communication circuit 201 and installed in the storage device 204.

The control device 205 is an electronic circuit device including a processor such as a CPU and peripheral components. The control device 205 includes a registration information setting unit 220, a registration information transmission unit 221, an operation detection unit 222, and a display control unit 223. The setting program 210 makes the processor of the control device 205 realize the functions of the registration information setting unit 220 and the registration information transmission unit 221. The instruction program 211 causes the processor of the control device 205 to realize the functions of the operation detection unit 222 and the display control unit 223.

The registration information setting unit 220 uses the first reference image 112 used by the user authority holder to authenticate the use of the in-vehicle device of the vehicle 1 and the first use indicating the use authority of the user authority holder. The first registration information including the combination of the authority information 113 and is set.
For example, the first reference image 112 may be generated by photographing the graphic pattern and the face of the user authority holder with the camera 206. Alternatively, the already generated graphic pattern image or face image may be read by a medium reader (not shown) or downloaded via a communication line to obtain the image.

For example, the first usage authority information 113 may be input by the owner 2 from the operation unit 203. Further, the registration information setting unit 220 may download the first usage authority information 113 prepared in advance from a server such as a manufacturer or a seller of the in-vehicle device. When the vehicle 1 is a rental car or a car sharing vehicle, the first usage authority information 113 may be downloaded from the server of a company that provides the rental car service or the car sharing service.

The registration information setting unit 220 stores the first reference image 112 and the first usage authority information 113 set in this way in the storage device 204.
Further, the registration information setting unit 220 sets the identification information 111 of the owner 2 or the first terminal 200. For example, the owner 2 may input the identification information 111 from the operation unit 203. The registration information setting unit 220 stores the identification information 111 in the storage device 204.

The registration information transmission unit 221 transmits the first registration information including the first reference image 112 and the first usage authority information 113 to the authentication device 100 together with the identification information 111.
Further, the registration information transmission unit 221 transmits the first registration information including the first reference image 112 and the first usage authority information 113 to the second terminal 300.
At the time of authentication of use of the in-vehicle device of the vehicle 1, the owner 2 performs a display instruction operation for displaying the first reference image 112 on the operation unit 203. The operation detection unit 222 detects the display instruction operation performed by the operation unit 203.

When the operation detection unit 222 detects the display instruction operation, the display control unit 223 displays the first reference image 112 on the display device 202. In the example shown in FIG. 2, the graphic pattern 230 is displayed as the first reference image 112.
When the owner 2 presents the display device 202 displaying the first reference image 112 to the camera 102 of the vehicle 1, the authentication device 100 of the vehicle 1 uses the in-vehicle device based on the collation image captured by the display device 202. To authenticate. The owner 2 will be able to use the in-vehicle device after the authentication by the authentication device 100 is completed.

See FIG. The second terminal 300 includes a communication circuit 301, a display device 302, an operation unit 303, a storage device 304, and a control device 305.
The communication circuit 301 communicates with the communication device 101 of the first terminal 200 and the vehicle 1 via a wired or wireless communication line. The communication circuit 301 communicates with the first terminal 200 and the communication device 101 via, for example, short-range wireless communication such as Bluetooth (registered trademark), wireless LAN such as Wi-Fi (registered trademark), or public wireless communication. You can.

The display device 302 functions as a display means and displays various types of information under the control of the control device 305.
The operation unit 303 functions as an information input means, and may include an input button, a jog dial, a joystick, a touch panel provided on the display screen of the display device 302, and the like.
The storage device 304 includes, for example, a ROM and a RAM. The storage device 304 may include a non-volatile memory or a hard disk drive device.
In the storage device 304, the first reference image 112 transmitted from the first terminal 200 and the first usage authority information 113 are stored in association with each other.
Further, the instruction program 310 is stored in the storage device 304. The instruction program 310 causes the control device 305 to display the first reference image 112 on the display device 302 in response to the operation of the operation unit 303 by the user 3 when authenticating the use of the in-vehicle device of the vehicle 1.

The control device 305 is an electronic circuit device including a processor such as a CPU and peripheral parts. The control device 305 includes a registration information receiving unit 320, a registration unit 321 and an operation detection unit 322, and a display control unit 323. The instruction program 310 realizes the functions of the registration information receiving unit 320, the registration unit 321, the operation detection unit 322, and the display control unit 323.
The instruction program 310 may be recorded on a machine-readable recording medium, read by a medium reader (not shown), and installed in the storage device 304. Further, the instruction program 310 may be downloaded from the first terminal 200 or the communication line via the communication circuit 301 and installed in the storage device 304.

Prior to the user 3 using the in-vehicle device of the vehicle 1, the registration information receiving unit 320 first registers the first reference image 112 and the first usage authority information 113 transmitted from the first terminal 200. Information is received by the communication circuit 301.
The registration unit 321 stores the first reference image 112 and the first usage authority information 113 included in the received first registration information in the storage device 304.
The registration unit 122 of the authentication device 100 of the vehicle 1 completes the storage of the first reference image 112 and the first usage authority information 113 in the storage device 103, and then the first reference image 112 and the first usage authority information 113. May be transmitted to the second terminal 300. The registration information receiving unit 320 may receive the first registration information including the first reference image 112 and the first usage authority information 113 transmitted from the authentication device 100.

At the time of authentication of use of the in-vehicle device of the vehicle 1, the user 3 performs a display instruction operation for displaying the first reference image 112 on the operation unit 203. The operation detection unit 322 detects the display instruction operation performed by the operation unit 203.
When the operation detection unit 322 detects the display instruction operation, the display control unit 323 displays the graphic pattern 230 on the display device 302 as the first reference image 112, as in FIG. 2.
When the user 3 presents the display device 302 displaying the first reference image 112 to the camera 102 of the vehicle 1, the authentication device 100 of the vehicle 1 uses the in-vehicle device based on the collation image captured by the display device 302. Authenticate. The user 3 can use the in-vehicle device after the authentication by the authentication device 100 is completed.

(motion)
Next, the procedure for starting the use of the in-vehicle device operation system according to the first embodiment will be described. See FIG.
In step S1, the registration information setting unit 220 of the first terminal 200 sets the first registration information including the first reference image 112 and the first usage authority information 113, and the identification information 111.
In step S2, the registration information transmission unit 221 of the first terminal 200 transmits the first registration information including the first reference image 112 and the first usage authority information 113 to the authentication device 100 together with the identification information 111.

In step S3, the registration possibility determination unit 121 of the authentication device 100 compares the identification information received together with the first registration information with the identification information 111 stored in the storage device 103, so that the first registration information received can be obtained. Determine if it is legitimate. If the received first registration information is valid (step S3: Y), the process proceeds to step S4.
In step 4, the registration unit 122 stores the first reference image 112 included in the first registration information and the first usage authority information 113 in association with each other in the storage device 103. After that, the process proceeds to step S5.

If the received first registration information is not valid (step S3: N), the first reference image 112 and the first usage authority information 113 are not stored in the storage device 103 of the authentication device 100, and the process proceeds to step S5. .. In this case, even if the subject corresponding to the first reference image 112 is presented to the camera 102, the use of the in-vehicle device whose usage authority is indicated by the first usage authority information 113 is not authenticated.
In step S5, the registration information transmission unit 221 of the first terminal 200 transmits the first registration information including the first reference image 112 and the first usage authority information 113 to the second terminal 300. The registration information receiving unit 320 of the second terminal 300 receives the first registration information transmitted from the first terminal 200.

In step S6, the registration unit 321 of the second terminal 300 stores the first reference image 112 and the first usage authority information 113 included in the received first registration information in the storage device 304.
In step S7, when the vehicle 1 is equipped with a plurality of cameras, the owner 2 sets which camera is to be operated as the camera 102. For example, when the vehicle 1 is in the parking lot at home, the camera for photographing the rear is inappropriate as the camera 102, so another camera is selected.

Next, an example of the operation of the authentication device 100 according to the first embodiment will be described. See FIG.
In step S10, the collation unit 123 of the authentication device 100 determines whether or not the camera 102 is operating. When the camera 102 is operating (step S10: Y), the process proceeds to step S11. When the camera 102 is not operating (step S10: N), the process proceeds to step S14.

In step S11, the camera 102 captures a subject presented within the shooting range of the camera 102 by the user authority holder to generate a collation image. The collation unit 123 acquires the generated collation image.
In step S12, the collation unit 123 collates the acquired collation image with the first reference image stored in the storage device 103. When the collated image matches the first reference image 112 (step S12: Y), the process proceeds to step S13. When the collated image does not match the first reference image 112 (step S12: N), the process proceeds to step S14.

In step S13, the availability determination unit 124 permits the use of the in-vehicle device whose usage authority is indicated by the first usage authority information 113. That is, the use of the in-vehicle device within the usable range specified by the first usage authority information 113 is permitted. After that, the process ends.
In step S14, the availability determination unit 124 does not permit the use of the in-vehicle device whose usage authority is indicated by the first usage authority information 113. After that, the process ends.

(Effect of the first embodiment)
(1) The authentication device 100 used for authentication for the use of the in-vehicle device provided in the vehicle 1 is the first registration including the first usage authority information 113 indicating the usage authority of the in-vehicle device and the first reference image 112. The information is received together with the identification information 111. The authentication device 100 determines whether or not the first registration information received together with the identification information 111 is valid based on the received identification information 111. When it is determined that the first registration information is valid, the first usage authority information 113 included in the first registration information and the first reference image 112 are associated and stored in the storage device 103. The authentication device 100 acquires a collation image of the subject taken by the camera 102 provided in the vehicle 1. Use of an in-vehicle device whose usage authority is indicated by the first usage authority information 113 stored in association with the first reference image 112 according to the matching result between the collation image and the first reference image 112 stored in the storage device 103. Judge whether or not.

Therefore, the user authority holder can have the authentication device 100 authenticate the use of the in-vehicle device by presenting the subject to be photographed by the camera 102, that is, by using the visible signal. Therefore, it is possible to authenticate the use of an in-vehicle device based on the use of signals other than wireless signals.
In addition, it is possible to eliminate the waiting time that occurs when a signal is transmitted from the mobile information terminal device to the in-vehicle device via a public line as in the conventional case.

Further, the vehicle-mounted device can be used by the user authority holder within a predetermined usable range without having the vehicle 1 possess the lock key or the ignition key.
Further, since the camera 102 can instantaneously generate a collated image of the subject, the presentation of the subject can be completed in a short time, and the use authentication of the in-vehicle device becomes simple. For example, if you have heavy luggage or in the rain, you will be able to easily unlock the door.
Further, when permitting the user 3 other than the owner 2 to use the in-vehicle device, the user is restricted from a long distance while being used by the owner 2 by limiting the use to a short distance that can be taken by the camera 102. 3 can be prevented from operating the in-vehicle device.

(2) The first reference image 112 may include a face image or an image pattern of a user authority holder.
Therefore, the user authority holder can have the authentication device 100 authenticate the use of the in-vehicle device by presenting the subject corresponding to these first reference images 112, that is, by using the visible signal. .. Therefore, it is possible to authenticate the use of an in-vehicle device based on the use of signals other than wireless signals.
(3) The subject of the collation image may be either the face image or the graphic pattern of the user authority holder displayed on the display device 202 of the first terminal 200 or the display device 303 of the second terminal 300. As a result, the holder of the usage authority can obtain the usage authentication by using the mobile information terminal device.

(4) The face image and the graphic pattern displayed on the display device 303 may be the first reference image 112 included in the first registration information received by the second terminal 300.
As a result, the owner 2 can enable the user 3 to use the in-vehicle device by transmitting the first reference image 112 to the second terminal 300 of the user 3.
(5) When the first reference image 112 includes the face image of the user authority holder, the subject of the collation image may be the face itself of the user authority holder.
As a result, the user authority holder can obtain the user authentication even if he / she does not hold the personal digital assistant device or other keys.
(6) The camera 102 may be a collision prevention camera, a rear confirmation camera, a side confirmation camera, and an automatic driving camera of the vehicle 1. By using the existing camera in the vehicle 1 as the camera 102, the implementation cost of the authentication device 100 can be reduced.

(Second Embodiment)
Subsequently, the in-vehicle device operation system according to the second embodiment will be described. In the second embodiment, the usable range of different in-vehicle devices is set for a plurality of usage authority holders. Here, it is assumed that different usable ranges are set for the owner 2 and the user 3.
For example, the usable range of the owner 2 is the entire range of the in-vehicle device and its function defined by the manufacturer of the vehicle 1 as the range in which the operation by the portable information terminal device is permitted. On the other hand, the usable range of the user 3 is limited to all functions of the air conditioner, audio equipment, door locking device, trunk locking device, and sunroof.

See FIG. 7. The configuration of the first terminal 200 according to the second embodiment has the same configuration as that of the first terminal 200 shown in FIG. 3, and the same reference numerals are given to the same components.
The registration information setting unit 220 includes a first reference image 112 used for authentication of use of the in-vehicle device by the owner 2 and a usable range of the owner 2 prior to the owner 2 starting to use the in-vehicle device of the vehicle 1. The first registration information including the first usage authority information 113 for specifying the above is set.

Further, the registration information setting unit 220 includes a second reference image 114 used for authentication of use of the in-vehicle device by the user 3 and a usable range of the user 3 prior to the user 3 using the in-vehicle device of the vehicle 1. The second registration information including the second usage authority information 115 for specifying the above is set.
The first reference image 112 may include the face image or image pattern of the owner 2. Further, the second reference image 114 may include a face image of the user 3 or an image pattern different from the image pattern of the first reference image 112.

See FIG. 8A. The usable range specified by the first usage authority information 113 is the entire range of the in-vehicle device and its function defined by the manufacturer of the vehicle 1 as the range in which the operation by the portable information terminal device is permitted. On the other hand, the usable range specified by the second usage authority information 115 is limited to all functions of the air conditioner, audio equipment, door locking device, trunk locking device, and sunroof.
In addition, the usable range of various in-vehicle devices can be defined. Definitions of various usable ranges are illustrated in FIG. 8B.

For example, the range of the first usage authority information 113 shown in FIG. 8A is the usable range for the owner 2 of the vehicle 1. The range of the second usage authority information 115 shown in FIG. 8A is defined as the usable range for the family of the owner 2.
In addition, the usable range for the acquaintance of the owner 2 may be defined. This available range covers all functions of air conditioners, door locks, trunk locks and sunroofs, as well as some of the functions of audio equipment. Viewing of music and video recorded on audio equipment is prohibited.
In addition, you may define an availability range that allows only specific functions. Only the locking and unlocking of the door locking device can be used in this usable range, and the validity period is limited to 5 minutes.

See FIG. 7. The registration information setting unit 220 stores the set first reference image 112, the first usage authority information 113, the second reference image 114, and the second usage authority information 115 in the storage device 204.
The registration information transmission unit 221 transmits the first registration information including the first reference image 112 and the first usage authority information 113 to the authentication device 100 together with the identification information 111.
Further, the registration information transmission unit 221 transmits the second registration information including the second reference image 114 and the second usage authority information 115 to the authentication device 100 together with the identification information 111.
Further, the registration information transmission unit 221 transmits the second registration information including the second reference image 114 and the second usage authority information 115 to the second terminal 300.

See FIG. The configuration of the authentication device 100 according to the second embodiment has the same configuration as that of the authentication device 100 shown in FIG. 1, and the same reference numerals are given to the same components.
Prior to the use of the vehicle-mounted device of the vehicle 1, the receiving unit 120 receives the first registration information including the first reference image 112 and the first usage authority information 113 together with the identification information via the communication device 101. Similarly, the receiving unit 120 receives the second registration information including the second reference image 114 and the second usage authority information 115 together with the identification information.

The registration possibility determination unit 121 compares the identification information received together with the first registration information with the identification information 111 stored in the storage device 103 to determine whether or not the received first registration information is valid. judge.
When the received first registration information is valid, the registration unit 122 stores the first reference image 112 included in the first registration information and the first usage authority information 113 in association with each other in the storage device 103. If the received first registration information is not valid, the first reference image 112 and the first usage authority information 113 are not stored in the storage device 103.

Further, the registration possibility determination unit 121 compares the identification information received together with the second registration information with the identification information 111 stored in the storage device 103 to determine whether or not the received second registration information is valid. Is determined.
When the received identification information and the identification information 111 match and the registration possibility determination unit 121 determines that the received second registration information is valid, the registration unit 122 uses the second reference image included in the second registration information. The 114 and the second usage authority information 115 are associated and stored in the storage device 103.
On the other hand, when the received identification information and the identification information 111 do not match and the registration possibility determination unit 121 determines that the received second registration information is not valid, the second reference image 114 and the second usage authority information 115 It is not stored in the storage device 103.

As described above, the first reference image 112 is different from the second reference image 114. Further, the usable range of the vehicle-mounted device specified by the first usage authority information 113 is different from the usable range of the vehicle-mounted device specified by the second usage authority information 115. Therefore, each available range specified by the first usage authority information 113 and the second usage authority information 115 is the first reference image 112 and the first reference image 112 associated with the first usage authority information 113 and the second usage authority information 115, respectively. 2 It differs depending on the reference image 114.

When authenticating the use of the in-vehicle device, the owner 2 presents the subject corresponding to the first reference image 112 to the vehicle 1 as in the first embodiment.
On the other hand, when authenticating the use of the in-vehicle device, the user 3 presents to the vehicle 1 a subject predetermined to be presented at the time of the user authentication.
This subject is determined according to the second reference image 114. Hereinafter, the subject determined according to the second reference image 114 may be referred to as "the subject corresponding to the second reference image 114".

For example, when the second reference image 114 is a graphic pattern, the subject corresponding to the second reference image 114 has the same graphic pattern as the second reference image 114 displayed on the display device 302 of the second terminal 300. Good.
See FIG. For example, the user 3 displays the same graphic pattern 330 as the second reference image 114 on the display device 302 of the second terminal 300. The user 3 presents the graphic pattern 330 displayed on the display device 302 as a subject corresponding to the second reference image 114.
Further, for example, a graphic pattern physically attached to the second terminal 300 may be presented.

For example, when the second reference image 114 is a face image of the user 3, the subject corresponding to the second reference image 114 is the face of the user 3 itself or oneself displayed on the display device 302 of the second terminal 300. It may be a face image of. The face image to be displayed may be the same image as the second reference image 114, or may be a face image of the user 3 different from the second reference image 114.
The first usage authority information 113 and the second usage authority information 115 are guidance information having text data, image data, and the like that guide the usable range to the owner 2 and the user 3, together with the identification information of the usable range, respectively. May include. The display control unit 223 of the first terminal 200 and the display control unit 323 of the second terminal 300 may display the guidance information on the display devices 202 and 203, respectively.
In the example shown in FIG. 10, the guidance information 331 that guides the usable range by the second usage authority information 115 is displayed on the display device 302 of the second terminal 300.

See FIG. The collation unit 123 acquires a collation image of the subject presented by the owner 2 or the subject presented by the user 3 taken by the camera 102. The collation unit 123 collates the acquired collation image with the first reference image 112 stored in the storage device 103.
The usability determination unit 124 determines whether or not the in-vehicle device can be used, which is specified by the first usage authority information 113 stored in association with the first reference image 112, according to the collation result by the collation unit 123.
That is, when the collated image matches the first reference image 112, the availability determination unit 124 permits the use of the in-vehicle device in the usable range specified by the first usage authority information 113.

When the collation image and the first reference image 112 do not match, the collation unit 123 collates the acquired collation image with the second reference image 114 stored in the storage device 103.
The usability determination unit 124 determines whether or not the in-vehicle device can be used, which is specified by the second usage authority information 115 stored in association with the second reference image 114, according to the collation result by the collation unit 123.
That is, when the collated image matches the second reference image 114, the availability determination unit 124 permits the use of the in-vehicle device in the usable range specified by the second usage authority information 115.
When the collated image does not match the first reference image 112 or the second reference image 114, the availability determination unit 124 also uses the in-vehicle device in the usable range specified by the first usage authority information 113 as the second usage authority. The use of in-vehicle devices within the usable range specified by Information 115 is also not permitted.

The procedure for starting the use of the in-vehicle device operation system according to the second embodiment will be described. See FIG.
In step S20, the registration information setting unit 220 of the first terminal 200 sets the first reference image 112, the first usage authority information 113, the second reference image 114, the second usage authority information 115, and the identification information 111. To do.
The processing of steps S21 to S23 is the same as the processing of steps S2 to S4 of FIG.
In step S24, the registration information transmission unit 221 transmits the second registration information including the second reference image 114 and the second usage authority information 115 to the authentication device 100 together with the identification information 111.

In step S25, the registration possibility determination unit 121 of the authentication device 100 compares the identification information received together with the second registration information with the identification information 111 stored in the storage device 103, so that the second registration information received can be obtained. Determine if it is legitimate. If the received second registration information is valid (step S25: Y), the process proceeds to step S26.
In step 26, the registration unit 122 stores the second reference image 114 included in the second registration information and the second usage authority information 115 in association with each other in the storage device 103. After that, the process proceeds to step S27.

If the received second registration information is not valid (step S25: N), the second reference image 114 and the second usage authority information 115 are not stored in the storage device 103 of the authentication device 100, and the process proceeds to step S27. .. In this case, even if the subject corresponding to the second reference image 114 is presented to the camera 102, the use of the in-vehicle device whose usage authority is indicated by the second usage authority information 115 is not authenticated.
In step S27, the registration information transmission unit 221 of the first terminal 200 transmits the second registration information including the second reference image 114 and the second usage authority information 115 to the second terminal 300. The registration information receiving unit 320 of the second terminal 300 receives the second registration information transmitted from the first terminal 200.
In step S28, the registration unit 321 of the second terminal 300 stores the second reference image 114 and the second usage authority information 115 included in the received second registration information in the storage device 304.
The process of step S29 is the same as the process of step S7 of FIG.

Next, an example of the operation of the authentication device 100 according to the second embodiment will be described. See FIG. The processing of steps S30 and S31 is the same as the processing of steps S10 and S11 of FIG.
In step S32, the collation unit 123 collates the acquired collation image with the first reference image 112 stored in the storage device 103. When the collated image matches the first reference image 112 (step S32: Y), the process proceeds to step S33. When the collated image does not match the first reference image 112 (step S32: N), the process proceeds to step S34.

In step S33, the availability determination unit 124 permits the use of the in-vehicle device within the usable range specified by the first usage authority information 113. After that, the process ends.
In step S34, the collation unit 123 collates the acquired collation image with the second reference image 114 stored in the storage device 103. When the collated image matches the second reference image 114 (step S34: Y), the process proceeds to step S35. If the collated image does not match the second reference image 114 (step S34: N), the process proceeds to step S36.

In step S35, the availability determination unit 124 permits the use of the in-vehicle device within the usable range specified by the second usage authority information 115. After that, the process ends.
In step S36, the availability determination unit 124 does not permit the use of the in-vehicle device in the usable range specified by the first usage authority information 113 or the use of the in-vehicle device in the available range specified by the second usage authority information 115. .. After that, the process ends.

(Effect of the second embodiment)
(1) Each usable range specified by the first usage authority information 113 and the second usage authority information 115 is the first reference image 112 associated with the first usage authority information 113 and the second usage authority information 115, respectively. It depends on the second reference image 114.
As a result, the authentication device 100 can use the in-vehicle device within a different usage permission range depending on whether the subject corresponding to the first reference image 112 is presented or the subject corresponding to the second reference image 114 is presented. Can be authenticated.
Therefore, for example, if only the things left behind in the vehicle are to be removed, the second reference image 114 and the second usage authority information 115 for permitting only the use of the door locking device 10 can be set to cover a range as required. The use of in-vehicle devices can be permitted. In particular, when the use is permitted to the user 3 other than the owner 2, the unintentional use of the user 3 can be prevented.

(2) The first terminal 200 has a process of generating the first usage authority information 113 and a second usage authority information 115 that specifies the usable range of the in-vehicle device different from the usable range specified by the first usage authority information 113. Execute the process to generate. The first terminal 200 executes a process of transmitting the first registration information including the first reference image 112 and the first usage authority information 113 to the authentication device 100 together with the identification information 111. The first terminal 200 performs a process of transmitting the second registration information including the second reference image 114 different from the first reference image 112 and the second usage authority information 115 to the authentication device together with the same identification information as the identification information 111. Do.
As a result, the owner 2 who owns the first terminal 200 sets the first usage authority information 113 for specifying his / her own usable range and the second usage authority information 115 for specifying the usable range of the user 3. , The single identification information 111 used by the owner 2 can be registered in the authentication device 100. As a result, the owner 2 can allow the user 3 to use the in-vehicle device within a range different from the usable range of the owner 2 itself.

(Third Embodiment)
Subsequently, the in-vehicle device operation system according to the third embodiment will be described. In the third embodiment, when the owner 2 permits the user 3 to use the in-vehicle device, the usage history is recorded or the owner 2 is notified. The usage history may be, for example, a log including the opening / closing time of the door of the vehicle 1, the operation time of the in-vehicle device 12, and the position information at these times.
See FIG. The configuration of the first terminal 200 according to the third embodiment has the same configuration as that of the first terminal 200 shown in FIG. 7, and the same reference numerals are given to the same components.
The control device 104 includes a history recording unit 125 and a history notification unit 126. The authentication processing program 110 causes the processor of the control device 104 to realize the functions of the history recording unit 125 and the history notification unit 126.

The collation unit 123 determines which of the first reference image 112 and the second reference image 114 matches the collation image.
Whether or not the history recording unit 125 records the usage history of the in-vehicle device permitted by the availability determination unit 124 according to which of the first reference image 112 and the second reference image 114 matches the collation image. To judge. That is, when the first reference image 112 matches the collated image, in other words, when the use of the vehicle-mounted device by the owner 2 is authenticated, the history recording unit 125 does not record the usage history of the vehicle-mounted device. On the other hand, when the second reference image 114 matches the collation image, in other words, when the use of the vehicle-mounted device by the user 3 is authenticated, the history recording unit 125 records the usage history of the vehicle-mounted device in the storage device 103. ..

The history notification unit 126 notifies the owner 2 of the usage history of the in-vehicle device permitted by the availability determination unit 124, depending on which of the first reference image 112 and the second reference image 114 matches the collation image. Decide whether to do it or not. That is, when the first reference image 112 matches the collated image, the history notification unit 126 does not notify the usage history of the in-vehicle device. On the other hand, when the second reference image 114 matches the collated image, the history notification unit 126 notifies the owner 2 of the usage history of the in-vehicle device.
For example, the history notification unit 126 transmits the usage history to the first terminal 200 of the owner 2. The history notification unit 126 may notify the owner 2 only when a specific log is recorded. For example, the usage history including the location information may be notified only when an urgent situation occurs to the user 3.

(Effect of Third Embodiment)
Whether or not the history recording unit 125 records the usage history of the in-vehicle device permitted by the availability determination unit 124 according to which of the first reference image 112 and the second reference image 114 matches the collation image. To judge. Further, the history notification unit 126 obtains the usage history of the in-vehicle device permitted by the availability determination unit 124 according to which of the first reference image 112 and the second reference image 114 matches the collation image. Decide whether to notify.
Therefore, it is possible to determine whether to record or notify the usage history of the in-vehicle device depending on whether or not the use of the in-vehicle device by the user 3 is authenticated. As a result, the owner 2 can confirm whether or not the user 3 has used the in-vehicle device according to the purpose of use.

(Fourth Embodiment)
Subsequently, the in-vehicle device operation system according to the fourth embodiment will be described. The availability determination unit 124 of the authentication device 100 of the fourth embodiment sets the shooting conditions when the camera 102 shoots the subject, in addition to the matching result of the first reference image 112 or the second reference image 114 and the matching image. The availability of the in-vehicle device is determined accordingly.
The imaging conditions permitting the use of the in-vehicle device may differ depending on which of the first reference image 112 and the second reference image 114 matches the collation image.

The shooting condition of the camera 102 may be, for example, a shooting area of the camera 102 capable of shooting a collation image.
For example, the shooting area of the camera 102 capable of shooting the collated image may be determined by the distance between the vehicle 1 and the subject.
See FIG. 14A. When the distance between the subject corresponding to the first reference image 112, for example, the face of the owner 2 or the first reference image 112 displayed on the first terminal 200 is within the threshold value D1, the availability determination unit 124 owns the subject. Allows person 2 to use the in-vehicle device. When the distance to the subject corresponding to the first reference image 112 is larger than the threshold value D1, the availability determination unit 124 does not allow the owner 2 to use the in-vehicle device.

Further, when the distance between the subject corresponding to the second reference image 114, for example, the face of the user 3 or the second reference image 114 displayed on the second terminal 300 is within the threshold value D2, the availability determination unit 124 Allows user 3 to use the in-vehicle device. When the distance to the subject corresponding to the second reference image 114 is larger than the threshold value D2, the availability determination unit 124 does not allow the user 3 to use the in-vehicle device.
Here, if the threshold value D2 is set shorter than the threshold value D1, the range in which the user 3 can obtain the usage authentication of the in-vehicle device can be limited to be narrower than the range in which the owner 2 can obtain the usage authentication.

Further, for example, the shooting condition of the camera 102 may be, for example, the camera 102 selected for shooting the collation image among the plurality of cameras provided in the vehicle 1.
See FIG. 14B. The vehicle 1 is provided with a plurality of cameras including the first camera 102a and the second camera 102b. Regardless of whether the camera that captures the subject corresponding to the first reference image 112 is either the first camera 102a or the second camera 102b, the availability determination unit 124 permits the owner 2 to use the in-vehicle device.

On the other hand, if the camera that captures the subject corresponding to the second reference image 114 is the first camera 102a, the availability determination unit 124 permits the owner 2 to use the in-vehicle device. However, if the camera that captures the subject corresponding to the second reference image 114 is the second camera 102b, the availability determination unit 124 does not allow the owner 2 to use the in-vehicle device.
As a result, the position range in which the user 3 can obtain the use authentication of the in-vehicle device is limited to be narrower than the position range in which the owner 2 can obtain the use authentication.

(Effect of Fourth Embodiment)
(1) The availability determination unit 124 uses the in-vehicle device according to the shooting conditions when the camera 102 shoots the subject, in addition to the collation result of the first reference image 112 or the second reference image 114 and the collation image. Judge whether or not. The imaging conditions permitting the use of the in-vehicle device may be different depending on which of the first reference image 112 and the second reference image 114 matches the collation image.
Therefore, it is possible to change the shooting conditions that permit the use of the in-vehicle device depending on who receives the in-vehicle device usage authentication.
Therefore, it is possible to limit the shooting conditions that allow the use of the in-vehicle device when the user 3 other than the owner 2 presents the subject, and prevent the user 3 from inadvertently operating the in-vehicle device from a distance. ..

(2) The shooting condition for permitting the use of the in-vehicle device is the distance between the subject presented on the camera 102 and the vehicle 1, or the camera that shot the subject among the plurality of cameras 102a and 102b provided on the vehicle 1. It may be there.
By setting the shooting conditions in this way, the position range of the subject to be presented to the camera 102 for usage authentication can be set. Therefore, the position range in which the usage authentication can be obtained can be set so as to differ depending on who receives the usage authentication of the in-vehicle device.
Therefore, when the user 3 other than the owner 2 uses the in-vehicle device, the user 3 limits the position range in which the in-vehicle device can be used, and the user 3 carelessly operates the in-vehicle device from a distance. Can be prevented.
The fourth embodiment may be combined with the second or third embodiment.

(Fifth Embodiment)
Subsequently, the in-vehicle device operation system according to the fifth embodiment will be described. In the fifth embodiment, the operation screen of the in-vehicle device 12 is displayed on at least one of the first terminal 200 of the owner 2 and the second terminal 300 of the user 3. Hereinafter, the case where the operation screen of the in-vehicle device 12 is displayed on the display device 302 of the second terminal 300 will be described, but the case where the operation screen is displayed on the display device 202 of the first terminal 200 can be similarly realized.

See FIG. The configuration of the second terminal 300 according to the fifth embodiment has the same configuration as that of the second terminal 300 shown in FIG. 4, and the same reference numerals are given to the same components.
The storage device 304 stores an operation program 311 that causes the second terminal 300 to function as a remote controller for the vehicle-mounted device 12 of the vehicle 1. The operation program 311 may be recorded on a machine-readable recording medium, read by a medium reader (not shown), and installed in the storage device 304. Further, the operation program 311 may be downloaded from the first terminal 200 or the communication line via the communication circuit 301 and installed in the storage device 304.

The control device 105 includes a command generation unit 324 and a transmission unit 325. The operation program 311 realizes the functions of the operation detection unit 322, the display control unit 323, the command generation unit 324, and the transmission unit 325 described below in the processor of the control device 105.
The display control unit 323 displays the operation screen of the vehicle-mounted device 12 of the vehicle 1 on the display device 302.
See FIG. For example, on the operation screen 332, operation buttons such as the operation mode change button 333, the temperature setting buttons 334 and 335, and the air volume setting buttons 336 and 337 of the air conditioner which is the in-vehicle device 12 of the vehicle 1 are displayed. Further, on the operation screen 332, operation buttons such as an on / off button 338 of the interior light which is the vehicle-mounted device 12 of the vehicle 1 are displayed.

See FIG. The operation detection unit 322 detects an operation on the operation screen 332.
The command generation unit 324 generates an operation command corresponding to the operation on the operation screen 332, that is, an operation command corresponding to the operated operation buttons 333 to 338.
The transmission unit 325 transmits a request signal including the operation command generated by the command generation unit 324 to the vehicle 1.
See FIG. The configuration of the authentication device 100 according to the fifth embodiment has the same configuration as that of the authentication device 100 shown in FIG. 1, and the same reference numerals are given to the same components.

The control device 104 includes an in-vehicle device operation unit 127. The authentication processing program stored in the storage device 103 causes the control device 104 to realize the function of the in-vehicle device operation unit 127.
The receiving unit 120 receives the request signal transmitted from the second terminal 300 via the communication device 101.
The in-vehicle device operation unit 127 controls the in-vehicle device 12 based on the operation command by distributing the operation command included in the received request signal to the in-vehicle device 12 to be operated or the control ECU 13 of the in-vehicle device 12 to be operated. ..

Next, an example of the operation of the second terminal 300 and the authentication device 100 according to the fifth embodiment will be described. See FIG.
In step S40, the operation detection unit 322 of the second terminal 300 detects the operation on the operation screen 332.
In step S41, the command generation unit 324 generates an operation command corresponding to the operation detected in step S40.

In step S42, the transmission unit 325 transmits a request signal including an operation command to the authentication device 100 of the vehicle 1.
In step S43, the receiving unit 120 receives the request signal transmitted from the second terminal 300.
In step S44, the vehicle-mounted device operation unit 127 distributes the operation command included in the received request signal to the vehicle-mounted device 12 to be operated or the control ECU 13 of the vehicle-mounted device 12 to be operated, and thus the vehicle-mounted device 12 is based on the operation command. To control.

(Effect of the fifth embodiment)
The first terminal 200 or the second terminal 300 performs a process of displaying the operation screen of the in-vehicle device 12 on the respective display devices 202 or 302, a process of detecting the operation of the operation screen, and an operation command corresponding to the detected operation. The process of transmitting to the authentication device 100 of the vehicle 1 provided with the in-vehicle device 12 is executed. The authentication device 100 controls the in-vehicle device 12 based on the transmitted operation command.
Therefore, the owner 2 and the user 3 who own the first terminal 200 and the second terminal 300, respectively, can operate the in-vehicle device 12 of the vehicle 1 by operating their own familiar terminals. Therefore, even if the user interface of the vehicle-mounted device 12 differs depending on the vehicle 1, the operation of the vehicle-mounted device 12 becomes easy by operating the vehicle-mounted device 12 using a familiar terminal.
The fifth embodiment may be combined with the first to fourth embodiments.

1 ... Vehicle, 2 ... Owner, 3 ... User, 10 ... Door locking device, 11 ... Door control ECU, 12 ... In-vehicle device, 13 ... Control ECU, 100 ... Authentication device, 101 ..., 102 ... Camera, 102a ... 1st camera, 102b ... 2nd camera, 103 ... storage device, 104 ... control device, 110 ... authentication processing program, 111 ... identification information, 112 ... first reference image, 113 ... first usage authority information, 114 ... second Reference image, 115 ... Second usage authority information, 120 ... Receiving unit, 121 ... Registration availability determination unit, 122 ... Registration unit, 123 ... Verification unit, 124 ... Availability determination unit, 125 ... History recording unit, 126 ... History notification Unit 127 ... In-vehicle device operation unit, 200 ... First terminal, 201 ... Communication circuit, 202 ... Display device, 203 ... Operation unit, 204 ... Storage device, 205 ... Control device, 206 ... Camera, 210 ... Setting program, 211 ... Instruction program, 220 ... Registration information setting unit, 221 ... Registration information transmission unit, 222 ... Operation detection unit, 223 ... Display control unit, 230 ... Graphic pattern, 300 ... Second terminal, 301 ... Communication circuit, 302 ... Display device , 303 ... operation unit, 304 ... storage device, 305 ... control device, 310 ... instruction program, 311 ... operation program, 320 ... registration information receiving unit, 321 ... registration unit, 322 ... operation detection unit, 323 ... display control unit, 324 ... Command generation unit, 325 ... Transmission unit, 330 ... Graphic pattern, 331 ... Guidance information, 332 ... Operation screen

Claims (14)

It is an authentication method that authenticates the use of the in-vehicle device installed in the vehicle with an authentication device.
The authentication device
Wherein the use authority information indicating a use authority of the in-vehicle apparatus, a reference image including the graphic pattern, the registration information including, received together with identification information,
Based on the received identification information, it is determined whether or not the registration information is valid, and
When it is determined that the registration information is valid, the usage authority information included in the registration information and the reference image are associated and stored in the storage device.
A collation image of the subject taken by the camera provided in the vehicle is acquired, and the collation image is acquired.
It is characterized in that it is determined whether or not the in-vehicle device whose usage authority is indicated by the usage authority information corresponding to the reference image can be used according to the collation result between the collated image and the reference image stored in the storage device. Authentication method. It is an authentication method that authenticates the use of the in-vehicle device installed in the vehicle with an authentication device.
The authentication device
Registration information including the usage authority information indicating the usage authority of the in-vehicle device and the reference image including any of the face image and the graphic pattern of the user having the usage authority of the in-vehicle device is received together with the identification information. And
Based on the received identification information, it is determined whether or not the registration information is valid, and
When it is determined that the registration information is valid, the usage authority information included in the registration information and the reference image are associated and stored in the storage device.
A collation image of the subject taken by the camera provided in the vehicle is acquired, and the collation image is acquired.
According to the collation result between the collated image and the reference image stored in the storage device, it is determined whether or not the in-vehicle device whose usage authority is indicated by the usage authority information corresponding to the reference image can be used.
An authentication method characterized in that the subject is any one of the user's face image and the graphic pattern displayed on the display device of the mobile information terminal device. The authentication method according to claim 2 , wherein the face image and the graphic pattern are the reference images included in the registration information received by the mobile information terminal device. The mobile information terminal includes a process of displaying an operation screen of the in-vehicle device on the display device, a process of detecting an operation of the operation screen, and a process of transmitting an operation command corresponding to the detected operation to the vehicle. The authentication method according to claim 2 or 3 , wherein the in-vehicle device is controlled based on the operation command by causing the device to execute the device. It is an authentication method that authenticates the use of the in-vehicle device installed in the vehicle with an authentication device.
The authentication device
The registration information including the usage authority information indicating the usage authority of the in-vehicle device and the reference image is received together with the identification information.
Based on the received identification information, it is determined whether or not the registration information is valid, and
When it is determined that the registration information is valid, the usage authority information included in the registration information and the reference image are associated and stored in the storage device.
A collation image of the subject taken by the camera provided in the vehicle is acquired, and the collation image is acquired.
According to the collation result between the collated image and the reference image stored in the storage device, it is determined whether or not the in-vehicle device whose usage authority is indicated by the usage authority information corresponding to the reference image can be used.
The usage authority information includes information that specifies the usable range of the in-vehicle device.
An authentication method characterized in that the usable range specified by the usage authority information corresponding to the reference image differs depending on the reference image. The process of generating the usage authority information and
A process of generating a second usage authority information that specifies a usable range of the in-vehicle device that is different from the usable range specified by the usage authority information, and
A process of transmitting the registration information together with the identification information to the authentication device, and
A process of transmitting a second registration information including a second reference image different from the reference image and the second usage authority information to the authentication device together with the same identification information as the identification information.
The authentication method according to claim 5 , wherein the information terminal device is made to execute the above. Whether or not the authentication device performs recording processing or notification processing of the usage history of the in-vehicle device permitted according to the collation result between the reference image and the collation image is determined by the reference image that matches the collation image. The authentication method according to claim 5 , wherein the determination is made accordingly. It is an authentication method that authenticates the use of the in-vehicle device installed in the vehicle with an authentication device.
The authentication device
The registration information including the usage authority information indicating the usage authority of the in-vehicle device and the reference image is received together with the identification information.
Based on the received identification information, it is determined whether or not the registration information is valid, and
When it is determined that the registration information is valid, the usage authority information included in the registration information and the reference image are associated and stored in the storage device.
A collation image of the subject taken by the camera provided in the vehicle is acquired, and the collation image is acquired.
The in- vehicle device whose usage authority is indicated by the usage authority information corresponding to the reference image according to the collation result between the collated image and the reference image stored in the storage device and the shooting conditions of the subject by the camera. Judging the availability of
An authentication method characterized in that the shooting conditions permitting the use of the in-vehicle device differ depending on the reference image. The authentication method according to claim 8 , wherein the shooting condition is a distance between the vehicle and the subject, or a camera that has shot the subject among a plurality of cameras provided in the vehicle. The camera according to claim 1, wherein said vehicle anti-collision cameras, rear view camera, a side view camera, automatic operation camera, and is either a dedicated camera for generating the verification image The authentication method according to any one of 9 to 9 . It is an authentication device that includes a communication device, a storage device, a camera provided in the vehicle, and a control device, and authenticates the use of the in-vehicle device provided in the vehicle.
The control device is
And access authority information indicating authority to use the vehicle unit, a reference image including the graphic pattern, the registration information including, received by the communication device with identification information,
Based on the received identification information, it is determined whether or not the registration information is valid, and
When it is determined that the registration information is valid, the usage authority information included in the registration information is associated with the reference image and stored in the storage device.
A collation image of the subject taken by the camera is acquired, and
It is characterized in that it is determined whether or not the in-vehicle device whose usage authority is indicated by the usage authority information corresponding to the reference image can be used according to the collation result between the collated image and the reference image stored in the storage device. Authentication device. It is an authentication device that includes a communication device, a storage device, a camera provided in the vehicle, and a control device, and authenticates the use of the in-vehicle device provided in the vehicle.
The control device is
The registration information including the usage authority information indicating the usage authority of the vehicle-mounted device and the reference image including any of the face image and the graphic pattern of the user who has the usage authority of the vehicle-mounted device is described together with the identification information. Received by the communication device
Based on the received identification information, it is determined whether or not the registration information is valid, and
When it is determined that the registration information is valid, the usage authority information included in the registration information is associated with the reference image and stored in the storage device.
A collation image of the subject taken by the camera is acquired, and
According to the collation result between the collated image and the reference image stored in the storage device, it is determined whether or not the in-vehicle device whose usage authority is indicated by the usage authority information corresponding to the reference image can be used.
An authentication device characterized in that the subject is any one of the user's face image and the graphic pattern displayed on the display device of the mobile information terminal device. It is an authentication device that includes a communication device, a storage device, a camera provided in the vehicle, and a control device, and authenticates the use of the in-vehicle device provided in the vehicle.
The control device is
The communication device receives the registration information including the usage authority information indicating the usage authority of the in-vehicle device and the reference image together with the identification information.
Based on the received identification information, it is determined whether or not the registration information is valid, and
When it is determined that the registration information is valid, the usage authority information included in the registration information is associated with the reference image and stored in the storage device.
A collation image of the subject taken by the camera is acquired, and
According to the collation result between the collated image and the reference image stored in the storage device, it is determined whether or not the in-vehicle device whose usage authority is indicated by the usage authority information corresponding to the reference image can be used.
The usage authority information includes information that specifies the usable range of the in-vehicle device.
An authentication device characterized in that the usable range specified by the usage authority information corresponding to the reference image differs depending on the reference image. It is an authentication device that includes a communication device, a storage device, a camera provided in the vehicle, and a control device, and authenticates the use of the in-vehicle device provided in the vehicle.
The control device is
The communication device receives the registration information including the usage authority information indicating the usage authority of the in-vehicle device and the reference image together with the identification information.
Based on the received identification information, it is determined whether or not the registration information is valid, and
When it is determined that the registration information is valid, the usage authority information included in the registration information is associated with the reference image and stored in the storage device.
A collation image of the subject taken by the camera is acquired, and
The in-vehicle device whose usage authority is indicated by the usage authority information corresponding to the reference image according to the collation result between the collated image and the reference image stored in the storage device and the shooting conditions of the subject by the camera. Judging the availability of
An authentication device characterized in that the shooting conditions permitting the use of the in-vehicle device differ depending on the reference image.

Images