JP2002142255A - Authentication method and communication terminal device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To certainly make an authentication by authentication system with biometrics. SOLUTION: A storage part 409 has previously stored waveforms indicating a signature of a communication terminal user, waveforms indicating a speech and waveforms indicating movements of lips. A collation part 410 collates sequentially respective waveforms (waveforms indicating the signature, waveforms indicating the speech and waveforms indicating the movements of lips) input from a switch 408 with respective waveforms stored in the storage part 409, thereby making an authentication of a principal. Namely, the one collation part 410 carries out all the three collations of a collation of the signature, a collation of the speech and a collation of the movements of lips by utilizing a displacement of the three waveforms as similar.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a personal authentication method and a communication terminal device, and more particularly to a personal authentication method and a communication terminal device for performing personal authentication using biometrics utilizing information on human biological characteristics.

[0002]

2. Description of the Related Art Conventionally, when accessing highly confidential data or performing electronic payment, it is common practice to use a password or a magnetic card to authenticate whether or not the user is the principal. there were. However, in the case of personal authentication performed using a password or a magnetic card, there is a possibility that a person other than the person is impersonated due to leakage of the password, theft of the magnetic card, or the like, and it cannot be said that security is high.

[0003] Therefore, recently, authentication using biometrics has attracted attention. In the personal authentication method using biometrics, authentication is performed using human biological characteristics such as fingerprints, faces, voices, and handwriting, so there is no risk of leakage or theft, unlike passwords and magnetic cards, and security is reduced. It can be said that this is a high authentication method.

[0004]

However, in the conventional authentication method using biometrics, there is a problem that if there is a person having similar biological characteristics, the authentication of the person cannot be performed reliably. .

[0005] The present invention has been made in view of the above, and an object of the present invention is to provide a personal authentication method and a communication terminal device that can securely perform personal authentication.

[0006]

According to a personal authentication method of the present invention, a personal authentication method for performing personal authentication using a biological characteristic of a human is a method for identifying handwriting information, voice information and lip movement among biological characteristics. Is used to authenticate the user, and when the handwriting, voice, and movement of the lips are all authenticated, the communication terminal user is authenticated as the identity.

In the personal identification method of the present invention, the collation of handwriting, the collation of voice, and the collation of lip movement are performed using the displacement amount represented on the time axis.

According to these methods, personal authentication is performed using handwriting, voice, and lip movement, so that the accuracy of personal authentication can be improved. In addition, since a signature, a voice, and a movement of a lip having similar displacements (waveforms) with respect to time are used as biometric features, it is possible to perform the matching with a single matching circuit. The configuration is simplified. This makes it possible to provide an apparatus for performing personal authentication at a low price. That is, according to these methods, highly accurate personal authentication can be performed easily at low cost.

A communication terminal device according to the present invention is a communication terminal device for performing personal authentication using the biological characteristics of a human being. A signature input means for inputting a signature of the communication terminal user, and a voice of the communication terminal user. Voice acquisition means for acquiring, imaging means for photographing lip movement of the communication terminal user, signature, voice and lip movement of the communication terminal user stored in advance in storage means, and signature input means When the signature, the voice obtained by the voice obtaining unit, and the movement of the lips captured by the imaging unit are compared with each other, and the signature, the voice, and the movement of the lip are all the person's own, Verification means for authenticating the user of the communication terminal as the user.

[0010] In the communication terminal device of the present invention, one collating means verifies the signature by using the displacement amount represented on the time axis.
A configuration in which voice collation and lip movement collation are sequentially performed is adopted.

According to these configurations, since the personal authentication is performed using the handwriting, the voice, and the movement of the lips, the accuracy of the personal authentication can be improved. In addition, since the signature, voice, and movement of the lips, which have similar displacements (waveforms) with respect to time, are used as biometric features, the matching can be performed by a single matching unit, thereby simplifying the circuit configuration. The device scale of the communication terminal can be reduced. This makes it possible to provide a communication terminal for performing personal authentication at a low price. That is, according to these configurations, highly accurate personal authentication can be performed easily at low cost.

A communication terminal device according to the present invention includes first collating means for collating a signature and a voice, and second collating means for collating a lip movement, wherein the voice acquiring means acquires the voice and the image capturing means. Of the lip movement of the communication terminal user at the same time, and the collation of the voice by the first collation means and the collation of the lip movement by the second collation means are performed in parallel.

According to this configuration, the collation of the voice and the collation of the movement of the lips can be performed in parallel, so that the time required for personal authentication can be reduced.

[0014]

Embodiments of the present invention will be described below with reference to the drawings. (Embodiment 1) FIG. 1 is a block diagram showing a configuration of a personal authentication system according to Embodiment 1 of the present invention. The personal authentication system according to the present embodiment includes a communication terminal 100 that requests personal authentication, and an authentication server 200 that performs personal authentication in response to the request.

First, the configuration of the communication terminal 100 will be described. In the communication terminal 100, the operation unit 101 is used to input a user ID number and the like. The voice obtaining unit 102 obtains voice of the communication terminal user. Imaging unit 1
03 photographs a communication terminal user. The transmission data processing unit 104 converts the ID number and the image signal into transmission data. The transmission / reception unit 105 transmits the transmission data to the antenna 106
To the authentication server 200.

The transmitting / receiving section 105 includes an antenna 106
Is input to the received data processing unit 107. The received data processing unit 107 determines the type of the received data and distributes the received data to the image output unit 109 and the audio output unit 108. The image output unit 109 displays an image. The audio output unit 108 outputs audio.

The communication terminal 100 shown in FIG. 1 is, for example, a cellular phone 300 shown in FIG. in this case,
The small camera 301 is attached to the imaging unit 103 and the display 30
2 is the image output unit 109, and the operation button 303 is the operation unit 1
01, the microphone 304 corresponds to the sound acquisition unit 102, and the speaker 305 corresponds to the sound output unit 108.

Next, the configuration of the authentication server 200 will be described. In the authentication server 200, the transmitting / receiving unit 202
Inputs data received by the antenna 201 to the data control unit 203. Also, the transmitting / receiving unit 202 includes the authentication unit 2
A signal indicating the success or failure of authentication input from
01 to the communication terminal 100. Data control unit 20
No. 3 inputs the received data to the authentication information database 204 when registering the authentication information, and inputs the received data to the authentication unit 205 during the personal authentication. Authentication information database 204
Registers data on biological characteristics for each communication terminal user. The authentication unit 205 stores the authentication information database 20
4 is compared with the data sent from the communication terminal 100 to perform personal authentication.

Next, the operation of the personal authentication system having the above configuration will be described. First, an operation at the time of authentication data registration will be described.

First, as shown in FIG. 3, the communication terminal user uses the imaging unit 103 (small camera 301) to
Shoot your own lip movements. The captured image of the movement of the lips is input from the imaging unit 103 (small camera 301) to the transmission data processing unit 104.

After the photographing is completed, the communication terminal user
The D number is input using the operation unit 101 (operation button 303). The user ID number is input to the transmission data processing unit 104. At this time, the communication terminal user makes a request for registration of authentication information using the operation unit 101 (operation button 303). The registration request signal is input to transmission data processing section 104.

The transmission data processing unit 104 multiplexes the image signal, the user ID number, and the registration request signal, and converts the multiplexed data into packet data. The transmission / reception unit 1
05 to the authentication server 200 via the antenna 106.

In the authentication server 200, the data control unit 20
3 detects that the received data includes the registration request signal, and inputs the received data to the authentication information database 204. Then, in the authentication information database 204,
Lip movement information is registered in association with the user ID number.

Next, the operation at the time of personal authentication will be described. First, the communication terminal user uses the imaging unit 103 (small camera 3
01). The captured image is input to the transmission data processing unit 104.

Then, after the photographing is completed, the communication terminal user
The user ID number is input using the operation unit 101 (operation button 303). At this time, the communication terminal user
A request for personal authentication is made using the operation unit 101 (operation button 303). The user ID number and the authentication request signal are input to the transmission data processing unit 104.

The transmission data processing unit 104 multiplexes the image signal, the user ID number, and the authentication request signal into packet data. The packet data is transmitted from the transmitting / receiving unit 105 to the authentication server 200 via the antenna 106.
Sent to.

In the authentication server 200, the data control unit 20
3 detects that the received data includes the personal authentication request signal, and inputs the received data to the authentication unit 205.

The authentication unit 205 first refers to the authentication information database 204 based on the user ID number, and reads out information on lip movement registered as a biological feature of the communication terminal user. Then, the lip movement included in the received data is compared with the lip movement registered in the authentication information database 204.

If the movements of the lips match, the person is authenticated. Conversely, if the movements of the lips do not match, the person is not authenticated. The authentication unit 205 creates a signal indicating the success or failure of the personal authentication and inputs the signal to the transmission / reception unit 202. The transmitting / receiving unit 202 transmits a signal indicating the success or failure of the personal authentication to the communication terminal 100 from the antenna 201.

In communication terminal 100, a signal indicating success or failure of personal authentication received by transmitting / receiving section 105 is input to received data processing section 107. When the signal indicating the success or failure of the personal authentication is a voice signal, the reception data processing unit 107 inputs the signal to the voice output unit 108 (speaker 305), and the success or failure of the personal authentication is transmitted to the communication terminal user by voice. Be informed. When the signal indicating the success or failure of the personal authentication is text data, the received data processing unit 107 inputs the signal to the image output unit 109 (display 302), and the success or failure of the personal authentication is represented by characters in the communication terminal. The user is notified.

As described above, according to the present embodiment, since the personal authentication is performed using the movement of the lips, the accuracy of the personal authentication can be improved.

Further, in the present embodiment, since the data required for the personal authentication is packetized and transmitted, the communication line can be used efficiently.

In the present embodiment, the communication terminal may have a function of registering authentication data and a function of authenticating the user. That is, a configuration may be adopted in which each communication terminal independently performs personal authentication without using an authentication server.

Embodiment 2 The personal authentication method according to Embodiment 2 of the present invention performs personal authentication based on handwriting (signature), voice, and lip movement.

FIG. 4 is a block diagram showing a configuration of a communication terminal that performs personal authentication using the personal authentication method according to Embodiment 2 of the present invention. In the communication terminal 400 shown in FIG. 4, a signature input unit 401 is used when a communication terminal user inputs a signature. Coordinate information acquisition unit 402
Represents the signature input to the signature input unit 401 as data on a coordinate axis. For example, the coordinate information acquisition unit 402
By plotting the movement in the Y-axis direction of the signature input on the XY plane of the signature input unit 401 with the passage of time, the displacement of the signature is represented as a waveform on the time axis. The filter 403 smoothes the waveform input from the coordinate information acquisition unit 402.

The voice acquisition unit 404 is used when the communication terminal user inputs his / her own voice. Amplifying unit 40
5 amplifies the audio signal.

The imaging unit 406 is used when the communication terminal user photographs the movement of the lips. Displacement acquisition unit 40
Reference numeral 7 denotes displacement of the movement of the lips captured by the imaging unit 406 as data on a coordinate axis. For example, the imaging unit 406
By plotting the vertical movement of the lips in the Y-axis direction over time, the movement of the lips is represented on the time axis as a waveform.

The switch 408 switches the connection between the filter 403, the amplifying unit 405, the displacement acquiring unit 407 and the collating unit 410 in accordance with an instruction from the collating unit 410. The storage unit 409 stores information related to the signature of the communication terminal user (a waveform indicating the signature) and information related to the voice (a waveform indicating the voice).
And information on the movement of the lips (a waveform indicating the movement of the lips) is stored in advance. The matching unit 410 includes a switch 408
The personal authentication is performed by collating each waveform (a waveform indicating a signature, a waveform indicating a voice, and a waveform indicating a movement of a lip) input from the storage unit 409 with each waveform.
The result display unit 411 displays the success or failure of the personal authentication.

As shown in FIG. 4, in this embodiment, 1
One matching unit 410 performs all three matchings: signature matching, voice matching, and lip movement matching. The waveform indicating the signature, the waveform indicating the voice, and the waveform indicating the movement of the lips are shown in FIG.
(A) to (c), the changes with time are almost the same (however, the waveform indicating the signature is the same as the filter 403).
This is the waveform after smoothing. Therefore, 3
Since the matching can be performed on the two waveforms using the same matching method (same algorithm), the matching unit can be shared for signature matching, voice matching, and lip movement matching. That is, in the communication terminal of the present embodiment,
It is sufficient to provide one collation unit. Therefore, the device size of the communication terminal can be reduced. Each waveform is used for collation after performing a predetermined normalization process.

Here, the communication terminal 400 shown in FIG. 4 is, for example, a cellular phone 500 shown in FIG. In this case, the small camera 501 is used for the imaging unit 406, and the touch panel 502 is used for the signature input unit 401 and the result display unit 411.
In addition, the microphone 503 corresponds to the voice acquisition unit 404. In the mobile phone 500, the communication terminal user inputs a signature using the touch panel 502.

The communication terminal 400 shown in FIG.
The mobile phone 600 shown in FIG. in this case,
The small camera 601 is in the imaging unit 406, the roll storage type tablet 602 is in the signature input unit 401, and the display 60 is
3 corresponds to the result display unit 411, and the microphone 604 corresponds to the voice acquisition unit 404. This mobile phone 600
Then, the communication terminal user inputs the signature using the roll storage type tablet 602. In addition, the roll storage type tablet 602 is rolled up and stored in the mobile phone except at the time of signature input, so that the portability of the mobile phone 600 is not impaired.

Also, the communication terminal 400 shown in FIG.
The mobile phone 700 shown in FIG. However, in this case, the mobile phone 700 does not include the signature input unit 401,
The communication terminal user inputs the signature using the wireless tablet 704 shown in FIG. The waveform indicating the signature input to the wireless tablet 704 is transmitted to the mobile phone 70 by a predetermined transmission method.
0 is transferred. That is, in the mobile phone 700, the small camera 701 corresponds to the imaging unit 406, the display 702 corresponds to the result display unit 411, and the microphone 703 corresponds to the voice acquisition unit 404.

In the portable telephones shown in FIGS. 6 to 8, the small camera is arranged near the microphone.
For the following reasons. That is, since the communication terminal user always moves his lips when emitting a voice, by arranging the small camera near the microphone, it is possible to simultaneously obtain the voice and the movement of the lips. That is, the communication terminal user does not need to separately input voice and lip movement to the communication terminal. Thereby, the convenience of the communication terminal user is improved.

Next, personal authentication performed using the communication terminal having the above configuration will be described. FIG. 9 is a flowchart illustrating a procedure of personal authentication according to Embodiment 2 of the present invention.

First, step (hereinafter referred to as “ST”) 8
In 01, the communication terminal user inputs a signature to the signature input unit 401. The input signature is represented as a waveform indicating the signature by the coordinate information acquisition unit 402, and is smoothed by the filter 403. At this time, the switch 408 sets the filter 403
The signature waveform (ie, the waveform shown in FIG. 5A) is input to the matching unit 410 because the signature and the matching unit 410 are connected.

Next, in ST802, the matching unit 41
With 0, the waveform of the input signature is compared with the waveform of the signature stored in the storage unit 409. Collation unit 410
Has a predetermined threshold for the authentication rate set in advance,
If this threshold is exceeded, the signature is authenticated. That is, when the degree of coincidence of the waveforms exceeds a predetermined threshold value, the signature is authenticated as the signature of the person.

If the signature is authenticated,
In ST 803, matching section 410 sets switch 408
Are switched, and the amplification unit 405 and the matching unit 410 are switched.
And connect. On the other hand, if the signature is not authenticated, the collation unit 410 displays on the result display unit 411 that the identity cannot be authenticated in ST810, and the authentication process ends.

Next, in ST804, the communication terminal user inputs his / her own voice to voice acquisition section 404. The input voice is amplified by the amplifier 405. At this time, since the switch 408 is in a state of connecting the amplifying unit 405 and the matching unit 410, the audio waveform (that is, FIG.
The waveform (b) shown in FIG.

Next, in ST805, the collating unit 41
With 0, the waveform of the input voice is compared with the waveform of the voice stored in the storage unit 409. Then, when the degree of coincidence of the waveforms exceeds a predetermined threshold, the voice is authenticated as the person's voice.

If the voice is authenticated,
In ST 806, matching section 410 sets switch 408
Is switched, and the displacement acquisition unit 407 and the collation unit 4 are switched.
10 is connected. On the other hand, if the voice is not authenticated, the matching unit 410 displays on the result display unit 411 that the user cannot be authenticated in ST810, and ends the authentication process.

Next, in ST807, the communication terminal user takes an image of the movement of the lips with the imaging section 406. At this time, the communication terminal user takes a picture of the movement of the lips while saying, for example, "aiueo". Even if the same words are spoken, the movement of the lips is different for each person, so that the movements of the lips can be used for personal authentication.

The movement of the photographed lips is calculated by the displacement acquisition unit 407.
Is represented as a waveform indicating the movement of the lips. At this time, the switch 408 is in a state of connecting the displacement acquisition unit 407 and the matching unit 410, and thus the lip movement waveform (that is, the waveform shown in FIG. 5C) is input to the matching unit 410. .

Next, in ST808, collating section 41
0 indicates the input lip movement waveform and the storage unit 409
Is compared with the lip movement waveform stored in the. Then, when the degree of matching of the waveforms exceeds a predetermined threshold value, the movement is recognized as the movement of the lips of the subject.

If it is determined that the movement is the movement of the lips of the person, the collation section 410 displays on the result display section 411 that the person has been successfully authenticated in ST809. On the other hand, if the movement is not recognized as the movement of the lip of the person, in step ST810, the result display unit 411 notifies the collation unit 410 that the person cannot be authenticated.
Will be displayed. That is, in the present embodiment, if all of the signature, voice, and movement of the lips belong to the person, the person is authenticated. In other words, if at least one of the signature, the voice, and the movement of the lips does not belong to the person, the person is not authenticated.

As described above, in the present embodiment, since the personal authentication is performed using a plurality of biological features, the accuracy of the personal authentication can be improved. Changes over time (waveform)
Since the signature, voice, and movement of the lips which are similar to each other are used as the biometric feature, the matching can be performed by one matching circuit, so that the circuit configuration is simplified and the device size of the communication terminal is reduced. be able to. This makes it possible to provide a communication terminal for performing personal authentication at a low price. That is, according to the present embodiment, highly accurate personal authentication can be performed easily at low cost.

When it is necessary to reduce the time required for personal authentication, the communication terminal is configured as shown in FIG. May be performed in parallel. FIG.
0 is a block diagram illustrating another configuration of a communication terminal that performs personal authentication using the personal authentication method according to Embodiment 2 of the present invention. In FIG. 10, the same components as those in FIG. 4 are denoted by the same reference numerals, and detailed description will be omitted.

In communication terminal 900 shown in FIG. 10, switch 901 switches the connection between filter 403 and amplifying section 405 and matching section A 903 in accordance with an instruction from matching section A 903. The storage unit A902 stores in advance a waveform indicating a signature of the communication terminal user and a waveform indicating voice. The collation unit A 903 determines whether each waveform input from the switch 901 (a waveform indicating a signature or a waveform indicating a voice).
And each waveform stored in the storage unit A902.

A waveform indicating the movement of the lips of the communication terminal user is stored in the storage unit B904 in advance. Collation unit B90
Reference numeral 5 compares the waveform indicating the movement of the lips input from the displacement acquisition unit 407 with the waveform stored in the storage unit B904. The determination unit 906 performs personal authentication according to the result of the comparison by the comparison unit A903 and the result of the comparison by the comparison unit B905.

Next, a description will be given of personal authentication performed using a communication terminal having the configuration shown in FIG. Here, the communication terminal user always moves his lips when making a sound, so that the communication terminal can simultaneously obtain the sound and the movement of the lips. Therefore, in the communication terminal 900 shown in FIG. 10, after the signature verification, the voice verification and the lip movement verification are performed in parallel.

In other words, if the signature is verified to be the signature of the person himself / herself, the verification unit A 903 switches the switch 90
1 by switching the connection state of the amplifier unit 405 and the collating unit A9.
03 is connected. Then, the communication terminal user photographs the movement of the lips with the imaging unit 406 while inputting sound to the sound acquisition unit 404. Therefore, a voice waveform is input to the matching unit A 903, and at the same time, a lip movement waveform is input to the matching unit B 905. Then, the collation of the audio waveform in the collation unit A903 and the collation of the lip movement waveform in the collation unit B905 are performed in parallel. Each collation result is input to the determination unit 906.

Then, the judgment unit 906 includes a collation unit A 903
, The signature and the voice are authenticated by the user, and the collation unit B905 verifies that the movement of the lips belongs to the user, and the user is authenticated.

As described above, by adopting the configuration shown in FIG. 10, the collation of the voice and the collation of the movement of the lips can be performed in parallel, so that the time required for personal authentication can be reduced.

In the first and second embodiments, a mobile phone has been described as an example of the communication terminal, but the type of the communication terminal is not limited to this. For example, the first and second embodiments can be applied to a communication terminal such as a telephone used in a wired communication system.

[0064]

As described above, according to the present invention,
Authentication of the person can be performed reliably.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration of a personal authentication system according to a first embodiment of the present invention.

FIG. 2 is a diagram showing a mobile phone used in the personal authentication system according to the first embodiment of the present invention.

FIG. 3 is a diagram showing a state of photographing performed by the personal authentication system according to the first embodiment of the present invention;

FIG. 4 is a block diagram showing a configuration of a communication terminal that performs personal authentication using the personal authentication method according to Embodiment 2 of the present invention.

FIG. 5 is a diagram showing respective waveforms of a signature, a voice, and a movement of a lip used in the personal authentication method according to the second embodiment of the present invention;

FIG. 6 is a diagram showing a mobile phone that performs personal authentication using the personal authentication method according to Embodiment 2 of the present invention.

FIG. 7 is a diagram showing another mobile phone that performs personal authentication using the personal authentication method according to Embodiment 2 of the present invention.

FIG. 8 is a diagram showing another mobile phone and a wireless tablet that perform personal authentication using the personal authentication method according to Embodiment 2 of the present invention.

FIG. 9 is a flowchart for explaining a procedure of personal authentication according to the second embodiment of the present invention;

FIG. 10 is a block diagram showing another configuration of a communication terminal that performs personal authentication using the personal authentication method according to Embodiment 2 of the present invention.

[Explanation of symbols]

 REFERENCE SIGNS LIST 100 communication terminal 101 operation unit 102 audio acquisition unit 103 imaging unit 104 transmission data processing unit 107 reception data processing unit 108 audio output unit 109 image output unit 200 authentication server 203 data control unit 204 authentication information database 205 authentication unit 401 signature input unit 404 Voice acquisition unit 406 Imaging unit 409 Storage unit 410 Collation unit 411 Result display unit

 ──────────────────────────────────────────────────続 き Continued on the front page F term (reference) 5B085 AE25 AE27 BE01 5J104 AA07 KA01 KA16 MA01 NA43 PA10 5K027 AA11 BB09 HH26 5K067 AA32 BB04 DD17 DD52 FF23 FF25 HH22

Claims (5)

[Claims] 1. A personal authentication method for performing personal authentication using biological characteristics of a human, wherein the personal authentication is performed by using handwriting information, voice information, and information relating to lip movement among the biological characteristics, and handwriting and voice A personal authentication method comprising: authenticating a communication terminal user as an individual when all movements of the lips are authenticated by the user. 2. The personal authentication method according to claim 1, wherein the collation of the handwriting, the collation of the voice, and the collation of the movement of the lips are performed by using a displacement amount represented on a time axis. 3. A communication terminal device for performing personal authentication using a biological characteristic of a human being, a signature input unit for inputting a signature of a communication terminal user, and a voice obtaining unit for obtaining a voice of the communication terminal user. Imaging means for photographing the movement of the lip of the communication terminal user, signature of the communication terminal user stored in advance in the storage means, voice and lip movement, and the signature input to the signature input means, The voice acquired by the voice acquisition unit and the lip movement photographed by the imaging unit are respectively compared, and if the signature, the voice and the lip movement are all the person's own, the communication terminal user is A communication terminal device, comprising: verification means for authenticating the user. 4. The method according to claim 3, wherein one collating means sequentially performs signature collation, voice collation, and lip movement collation using the displacement amount represented on the time axis. Communication terminal device. 5. A method according to claim 1, further comprising: first collating means for collating signatures and voices; and second collating means for collating lip movements.
Acquisition of the voice by the voice obtaining means and photographing of the lip movement of the communication terminal user by the imaging means are performed simultaneously, and the matching of the voice by the first matching means and the matching of the lip movement by the second matching means are performed in parallel. 4. The method according to claim 3, wherein
The communication terminal device according to claim 1.