WO2021192061A1 - Authentication control device, authentication system, authentication control method, and recording medium - Google Patents

Abstract

An authentication control device (20) according to the present disclosure is provided with: an image capture control means (22b) which causes a camera (31) to capture an image including a user who is performing an input operation on an input means (33) with fingers; an image acquisition means (22c) which acquires the image captured by the camera; a face detection means (22k) which detects, from the image acquired by the image acquisition means, a face region to which the fingers performing the input operation on the input means are connected; and an authentication control means (22d) which causes an authentication device (10) that performs face authentication to perform face authentication of the user included in the face region detected by the face detection means.

Description

Authentication control device, authentication system, authentication control method and recording medium

This disclosure relates to an authentication control device, an authentication system, an authentication control method, and a recording medium.

Face recognition based on face information extracted from the image of the person to be authenticated by the camera and authentication (verification) based on the identification information input by the person to be authenticated are performed in parallel, and when face recognition is successful, it is usually performed. Patent Document 1, for example, describes a system that performs normal payment processing if authentication (verification) using identification information is successful even when face recognition fails.

Japanese Unexamined Patent Publication No. 2019-36888

However, in the system described in Patent Document 1, a third party other than the person to be certified (for example, a third party lined up behind or a third party crossing the shooting range of the camera) appears in the image taken by the camera. If it is included, there is a problem that the recognition target person may not be authenticated correctly.

In view of the above-mentioned problems, the purpose of the present disclosure is to capture an image taken by a third party other than the certified person (for example, a third party lined up behind or a third party crossing the shooting range of the camera). It is an object of the present invention to provide an authentication control device, an authentication system, an authentication control method, and a recording medium capable of correctly authenticating a recognition target person even if the person is crowded.

The authentication control device according to the first aspect of the present disclosure captures a photographing control means for causing a camera to take an image including a user who is performing an input operation with a finger on the input means, and the image taken by the camera. The image acquisition means to be acquired, the face detection means for detecting the face area to which the fingers performing the input operation to the input means are connected from the image acquired by the image acquisition means, and face authentication. The authentication device to be executed includes an authentication control means for executing face recognition of the user included in the face area detected by the face detection means.

The authentication system according to the second aspect of the present disclosure captures an input means, a camera that captures an image including a user who is performing an input operation on the input means by a finger, and the image captured by the camera. The image acquisition means to be acquired, the face detection means for detecting the face area to which the fingers performing the input operation to the input means are connected from the image acquired by the image acquisition means, and face authentication. The authentication device to be executed includes an authentication control means for executing face recognition of the user included in the face area detected by the face detection means.

The authentication control method according to the third aspect of the present disclosure includes a photographing control step in which an image including a user who is performing an input operation with a finger on the input means is photographed by a camera, and the image captured by the camera. From the image acquisition step to be acquired, the face detection step of detecting the face area to which the fingers performing the input operation with respect to the input means are connected from the image acquired by the image acquisition step, and face authentication. The authentication device to be executed includes an authentication control step for executing face authentication of the user included in the face area detected by the face detection step.

The recording medium according to the fourth aspect of the present disclosure is a photographing control process in which an electronic device including at least one processor is made to take an image including a user who is performing an input operation with a finger on an input means by a camera. From the image acquisition process for acquiring the image taken by the camera and the image acquired by the image acquisition process, a face region to which the fingers performing the input operation with respect to the input means are connected. A program for causing the face detection process to be detected and the authentication control process for causing the authentication device that executes face authentication to execute the face authentication of the user included in the face area detected by the face detection process is recorded. It is a computer-readable recording medium.

According to the present invention, even when a third party other than the person to be authenticated (for example, a third party lined up behind or a third party crossing the shooting range of the camera) is reflected in the image taken by the camera. , An authentication control device, an authentication system, an authentication control method and a recording medium capable of correctly authenticating a recognition target person can be provided.

It is a schematic block diagram of the authentication control device 20. It is a flowchart of an example of the operation of the authentication control device 20. It is a block diagram which shows the structure of the authentication system which concerns on Embodiment 2. It is a schematic block diagram of the authentication device 10. It is a flowchart of an example of the operation (face information registration processing) of the authentication device 10. It is a flowchart of an example of the operation (face recognition processing) of the authentication device 10. It is a schematic block diagram of the authentication control device 20. It is an external view of the payment terminal 30. It is a schematic block diagram of the payment terminal 30. It is a sequence diagram of the authentication system 1 (first operation example). This is an example of the payment execution inquiry screen G2. It is a sequence diagram of the authentication system 1 (second operation example). This is an example of a captured image acquired by the image acquisition unit 22c. It is an example of a feature point and a face area detected from the photographed image of FIG. It is a flowchart of an example of the operation of the authentication control device 20 (mainly a face detection process by a face area detection unit 22k).

(Embodiment 1)
First, a configuration example of the authentication control device 20 constituting the authentication system of the first embodiment will be described with reference to FIG.

FIG. 1 is a schematic configuration diagram of the authentication control device 20.

As shown in FIG. 1, the authentication control device 20 includes a shooting control means 22b for causing the camera 31 to capture an image including a user (authentication target person) who is performing an input operation on the input means 33 by hand, and a camera 31. A face that detects a face area to which a finger performing an input operation on the input means 33 is connected from an image acquisition means 22c that acquires the image taken by the camera and an image acquired from the image acquisition means 22c. The detection means 22k and the authentication device 10 that executes face recognition include authentication control means 22d that executes face recognition of the user included in the face area detected by the face detection means 22k.

Next, an example of the operation of the authentication control device 20 having the above configuration will be described.

FIG. 2 is a flowchart of an example of the operation of the authentication control device 20.

First, the photographing control means 22b causes the camera 31 to take an image including a user who is performing an input operation with a finger on the input means 33 (step S10).

Next, the image acquisition means 22c acquires the image captured by the camera 31 (step S11).

Next, the face detection means 22k detects the face area to which the fingers performing the input operation on the input means 33 are connected from the image acquired in step S11 (step S12).

Next, the authentication control means 22d causes the authentication device 10 that executes face authentication to execute the face authentication of the user included in the face area detected in step S12 (step S13).

As described above, according to the first embodiment, a third party other than the person to be authenticated (for example, a third party lined up behind or a third party crossing the shooting range of the camera 31) took a picture with the camera 31. Even if it is reflected in the image, the recognition target person can be correctly authenticated.

(Embodiment 2)
Hereinafter, the authentication system 1 will be described in detail as the second embodiment of the present invention. Hereinafter, the photographing control unit will be used as the photographing control means 22b. Hereinafter, it will be referred to as an imaging control unit 22b. Further, an image acquisition unit is used as the image acquisition means 22c. Hereinafter, it will be referred to as an image acquisition unit 22c. Further, the authentication control unit is used as the authentication control means 22d. Hereinafter, it will be referred to as an authentication control unit 22d. Further, a payment terminal is used as the information processing terminal 30. Hereinafter, it will be referred to as a payment terminal 30. Further, a touch panel is used as the input means 33. Hereinafter, it will be referred to as a touch panel 33.

FIG. 3 is a block diagram showing the configuration of the authentication system 1 according to the second embodiment.

The authentication system 1 includes an authentication device 10, an authentication control device 20, and a payment terminal 30 that can communicate with each other via a network NW (for example, the Internet).

First, a configuration example of the authentication device 10 will be described.

FIG. 4 is a schematic configuration diagram of the authentication device 10.

As shown in FIG. 4, the authentication device 10 includes a storage unit 11, a control unit 12, a memory 13, and a communication unit 14.

The storage unit 11 is, for example, a non-volatile storage unit such as a hard disk device or a ROM. The program 11a and the face information DB 11b are stored in the storage unit 11.

Program 11a is a program executed by the control unit 12 (processor). In the face information DB 11b, the user ID (plurality) and the face feature information of the user are stored (registered) in association with each other. Further, the authentication device 10 collates the face image or face feature information included in the request with the face feature information of each user in response to the face recognition request received from the outside (for example, the authentication control device 20). The verification result is returned to the requester.

Although not shown, the control unit 12 includes a processor. The processor is, for example, a CPU (Central Processing Unit). There may be one processor or multiple processors. By executing the program 11a read from the storage unit 11 into the memory 13 (for example, RAM), the processor serves as an image acquisition unit 12a, a face detection unit 12b, a feature point extraction unit 12c, a registration unit 12d, and an authentication unit 12e. Function. Some or all of these may be implemented in hardware.

The image acquisition unit 12a acquires an image including the user's face. For example, the image acquisition unit 12a acquires an image received by the communication unit 14. The images received by the communication unit 14 include a registration image transmitted from a user terminal (not shown) and an authentication (verification) image transmitted from the authentication control device 20.

The face detection unit 12b detects a face region from the image acquired by the image acquisition unit 12a and outputs it to the feature point extraction unit 12c.

The feature point extraction unit 12c extracts feature points (for example, facial feature points such as eyes, nose, and mouth edge) from the face region detected by the face detection unit 12b.

When the image acquired by the image acquisition unit 12a is an image for registration, the feature point extraction unit 12c outputs the face feature information to the registration unit 12d. Here, the face feature information is a set of extracted feature points. On the other hand, when the image acquired by the image acquisition unit 12a is an image for authentication, the feature point extraction unit 12c outputs the face feature information to the authentication unit 12e.

The registration unit 12d newly issues a user ID when registering facial feature information. The registration unit 12d registers the issued user ID and the face feature information extracted from the image for registration in the face information DB 11b in association with each other.

The authentication unit 12e collates the face feature information extracted from the face area detected from the authentication image with the face feature information in the face information DB 11b. The authentication unit 12e returns to the authentication control device 20 whether or not the facial feature information matches. The presence or absence of matching of facial feature information corresponds to the success or failure of authentication.

The communication unit 14 is a communication device that communicates with the authentication control device 20 via the network NW.

Next, an example of the operation of the authentication device 10 (face information registration process) will be described.

FIG. 5 is a flowchart of an example of the operation of the authentication device 10 (face information registration process).

First, the authentication device 10 (image acquisition unit 12a) acquires an image (image for registration) including the user's face included in the face information registration request (step S10). For example, the authentication device 10 (communication unit 14) receives the face information registration request from the user terminal (not shown) via the network NW.

Next, the authentication device 10 (face detection unit 12b) detects the face area from the registration image acquired in step S10 (step S11). Next, the authentication device 10 (feature point extraction unit 12c) extracts facial feature points from the face region detected in step S11 (step S12), and outputs face feature information to the registration unit 12d. Finally, the authentication device 10 (registration unit 12d) issues a user ID, associates the user ID with the face feature information, and registers the user ID in the face information DB 11b (step S13). The authentication device 10 may receive face feature information from a face authentication terminal or the like and register it in the face information DB 11b in association with the user ID.

Next, an example of the operation (face recognition processing) of the authentication device 10 will be described.

FIG. 6 is a flowchart of an example of the operation (face recognition processing) of the authentication device 10.

First, the authentication device 10 (image acquisition unit 12a) acquires an image (image for authentication) including the user's face included in the face authentication request (step S20). For example, the authentication device 10 (communication unit 14) receives the face recognition request from the authentication control device 20 via the network NW. Next, the authentication device 10 (face detection unit 12b) detects the face region from the authentication image acquired in step S20 (step S21). Next, the feature point extraction unit 12c extracts facial feature points from the face region detected in step S21 (step S22). Alternatively, the authentication device 10 may receive face feature information from the authentication control device 20. Next, the authentication device 10 (authentication unit 12e) collates the acquired face feature information with the face information DB 11b (step S23). When the face feature information matches (step S24: Yes), the authentication unit 12e identifies the user ID of the user whose face feature information matches (step S25), and determines that the face authentication was successful and the specified user ID. Reply to the authentication control device 20 (step S26). When there is no matching face feature information (step S24: No), the authentication unit 12e returns to the authentication control device 20 that the face authentication has failed (step S27).

Next, a configuration example of the authentication control device 20 will be described.

FIG. 7 is a schematic configuration diagram of the authentication control device 20.

The authentication control device 20 is an information processing device that performs authentication control processing, and is, for example, a server device realized by a computer.

As shown in FIG. 7, the authentication control device 20 includes a storage unit 21, a control unit 22, a memory 23, and a communication unit 24.

The storage unit 21 is a non-volatile storage unit such as a hard disk device or a ROM. The program 21a and the personal authentication information 21b are stored in the storage unit 21.

Program 21a is a program executed by the control unit 22 (processor). The personal authentication information 21b is information in which the user ID (plurality) and the authentication information of the user are associated with each other. The authentication information is, for example, a PIN (Personal Identification Number). Hereinafter, the authentication information is referred to as a registered PIN. The PIN can be called, for example, PIN information or a PIN code. A PIN is a simple code having about 10 digits or less, which is composed of a combination of a plurality of elements (for example, numbers, letters, and symbols). One user ID is assigned to one user. On the other hand, one PIN is assigned to a plurality of users. One PIN may be assigned to one user.

Although not shown, the control unit 22 includes a processor. The processor is, for example, a CPU (Central Processing Unit). There may be one processor or multiple processors. The processor executes the program 21a read from the storage unit 21 into the memory 23 (for example, RAM) to acquire the display control unit 22a, the photographing control unit 22b, the image acquisition unit 22c, the authentication control unit 22d, and the face authentication result. It functions as a unit 22e, an authentication information acquisition unit 22f, a collation unit 22g, a processing control unit 22h, a feature point detection unit 22j, and a face area detection unit 22k. Some or all of these may be implemented in hardware.

The display control unit 22a displays, for example, the PIN input reception screen G1 (authentication information input screen, see FIG. 8) on the display surface of the display unit 32 of the payment terminal 30. Specifically, the display control unit 22a transmits a screen display instruction for displaying the PIN input reception screen G1 to the payment terminal 30 via the communication unit 24. When displaying another screen, for example, the payment execution inquiry screen G2 (see FIG. 11), the same screen display instruction is transmitted to the payment terminal 30 via the communication unit 24. The PIN input reception screen G1 and the payment execution inquiry screen G2 will be described later.

The shooting control unit 22b activates the camera 31 of the payment terminal 30 in response to the input operation of the user U1 on the touch panel 33 of the payment terminal 30 to take an image including the face of the user U1. Specifically, the shooting control unit 22b communicates when the communication unit 24 receives an input start detection notification (notification that the user U1 has started inputting a PIN) transmitted from the payment terminal 30. The shooting instruction is transmitted to the payment terminal 30 via the unit 24.

The image acquisition unit 22c acquires an image (hereinafter, also referred to as a photographed image) photographed by the camera 31 activated by the image capture control unit 22b. Specifically, the communication unit 24 receives the captured image transmitted from the payment terminal 30, and the image acquisition unit 22c acquires the captured image received by the communication unit 24.

The authentication control unit 22d causes the authentication device 10 that executes face authentication to execute the face authentication of the user U1 included in the captured image acquired by the image acquisition unit 22c. Specifically, the authentication control unit 22d transmits the captured image acquired by the image acquisition unit 22c to the authentication device 10 via the communication unit 24. Instead of the captured image, the face region (or the feature point extracted from the captured image) detected from the captured image may be transmitted to the authentication device 10.

The face authentication result acquisition unit 22e acquires the result of the face authentication executed by the authentication device 10. Specifically, the communication unit 24 receives the face authentication result transmitted from the authentication device 10, and the face authentication result acquisition unit 22e acquires the face authentication result received by the communication unit 24.

The authentication information acquisition unit 22f acquires a PIN (hereinafter referred to as an input PIN) input via the touch panel 33 of the payment terminal 30. Specifically, the communication unit 24 receives the input PIN transmitted from the payment terminal 30, and the authentication information acquisition unit 22f acquires the input PIN received by the communication unit 24.

The collation unit 22g collates the input PIN acquired by the authentication information acquisition unit 22f with the registered PIN (see FIG. 7) stored in the storage unit 21.

The processing control unit 22h causes the payment terminal 30 that executes the payment processing to execute the payment processing when the face authentication by the authentication device 10 is successful and the matching results by the matching unit 22g match. Specifically, the payment processing control unit 22h transmits a payment processing instruction to the payment terminal 30 via the communication unit 24. The settlement process is an example of the predetermined process of the present invention.

The feature point detection unit 22j detects the physical feature points (for example, the feature points of the skeleton) of the person included in the captured image from the captured image acquired by the image acquisition unit 22c. Skeleton feature points can be detected by existing techniques (eg, OpenPose®). The detected feature points include, for example, fingers, wrists, elbows, shoulders, neck, face (nose, ears, eyes), hips, knees, and ankles.

An example of detected feature points will be described. FIG. 13 is an example of a captured image (hereinafter referred to as a captured image I) acquired by the image acquisition unit 22c. FIG. 14 is an example of a feature point and a face region detected from the captured image I of FIG. In FIG. 14, the feature points where the symbols P1R, P2R, PRL, P3R, P3L, P4, and P5 are detected are represented, and the face regions where the symbols A1 and A2 are detected are represented.

When the photographed image I (see FIG. 13) includes two users, a user U1 who is performing an input operation on the touch panel 33 of the payment terminal 30 by hand and a user U2 who is lined up behind the user U1, the photographed image I (see FIG. 13) is shown in FIG. As described above, the feature points of the user U1 (for example, wrist P1R, elbow P2R, PRL, shoulder P3R, P3L, neck P4, face P5) and the feature points of the user U2 (omitted in FIG. 14) are detected. That is, the feature points are detected for each person included in the captured image. The feature points may or may not be displayed on the captured image.

The face area detection unit 22k detects the face area to which the fingers performing the input operation on the touch panel 33 of the payment terminal 30 are connected from the captured image acquired by the image acquisition unit 22c. For example, from the captured image I shown in FIG. 13, the face area A1 shown in FIG. 14 is detected as the face area to which the fingers performing the input operation are connected to the touch panel 33 of the payment terminal 30. The process of detecting the face region to which the fingers are connected will be described in more detail in the following example of the operation of the authentication control device 20 (mainly, the face detection process by the face region detection unit 22k).

Next, an example of the operation of the authentication control device 20 (mainly the face detection process by the face area detection unit 22k) will be described.

FIG. 15 is a flowchart of an example of the operation of the authentication control device 20 (mainly the face detection process by the face area detection unit 22k). Here, an example of detecting the face area A1 shown in FIG. 14 as the face area to which the fingers performing the input operation on the touch panel 33 of the payment terminal 30 are connected from the captured image I shown in FIG. 13 will be described.

First, the image acquisition unit 22c acquires a captured image captured by the camera 31 activated by the imaging control unit 22b (step S40). Here, it is assumed that the captured image I shown in FIG. 13 has been acquired.

Next, the feature point detection unit 22j detects the feature points of the skeleton of the person included in the captured image from the captured image acquired in step S40 (step S41). Here, from the captured image I shown in FIG. 13, the feature points of the user U1 shown in FIG. 14 (wrist P1R, elbow P2R, PRL, shoulder P3R, P3L, neck P4, face P5) and the feature points of the user U2 (FIG. 14). (Omitted) is detected.

Next, the face area detection unit 22k detects the face area from the captured image acquired in step S40 (step S42). This face region can be detected by existing technology. Here, it is assumed that the face area A1 of the user U1 and the face area A2 of the user U2 shown in FIG. 14 are detected.

Next, the face area detection unit 22k detects the finger closest to the touch panel 33 of the payment terminal 30 (step S43). For example, the wrist feature point (or finger feature point) having the shortest distance L (see FIG. 14) from the lower side of the captured image I is detected. Here, it is assumed that the wrist feature point P1R of the user U1 is detected as the wrist feature point having the shortest distance L from the lower side of the captured image I.

Next, the face area detection unit 22k is closest to the facial feature points of the user having the fingers (finger feature points) closest to the touch panel 33 detected in step S43 among the face regions detected in step S42. The face area is determined (step S44). Here, among the face areas A1 and A2 detected in step S42, the face closest to the facial feature point P5 of the user U1 having the finger (finger feature point P1R) closest to the touch panel 33 detected in step S43. It is assumed that the region A1 has been determined. The determined face area A1 is a face area (that is, an authentication target person who is inputting a PIN for performing payment processing) to which a finger performing an input operation is connected to the touch panel 33 of the payment terminal 30. The face area of a user U1).

As described above, from the captured image acquired by the image acquisition unit 22c, the face area to which the fingers performing the input operation on the touch panel 33 of the payment terminal 30 are connected (here, the face area A1 of the user U1). ) Can be detected (determined).

Note that steps S40 to S44 are not limited to this order. For example, the execution order of step S41 and step S42 may be reversed.

Next, a configuration example of the payment terminal 30 will be described.

FIG. 8 is an external view of the payment terminal 30, and FIG. 9 is a schematic configuration diagram.

As shown in FIGS. 8 and 9, the payment terminal 30 is an information processing device including a camera 31, a display unit 32, a touch panel 33, a storage unit 34, a control unit 35, a memory 36, and a communication unit 37. The payment terminal 30 is installed in a store, for example. The authentication device 10 and the authentication control device 20 may be installed in the same store or in a place remote from the store.

The payment terminal 30 executes face authentication and PIN verification (two-factor authentication) before the payment process. Then, when the face authentication is successful and the PIN verification results match, the payment terminal 30 performs the payment process. Since publicly known technology can be used for the processing before and after the two-factor authentication such as the input (reading) of the purchased product and the payment processing itself, detailed description thereof will be omitted.

The camera 31 captures an image including the face of the user U1. For example, as shown in FIG. 8, the camera 31 is the face of the user U1 who is inputting the PIN via the touch panel 33, that is, the display surface of the display unit 32 on which the PIN input reception screen G1 is displayed (and its display surface). For example, it is attached to the upper part of the frame of the display unit 32 so that the face of the user U1 facing the camera 31) arranged in the vicinity can be photographed from the front or substantially from the front.

The display unit 32 is, for example, a display such as a display with a touch panel. A display with a touch panel is also called a touch screen display. For example, the PIN input reception screen G1 is displayed on the display surface of the display unit 32. As shown in FIG. 8, the PIN input reception screen G1 includes an image g symbolizing each element constituting the PIN, which the finger of the user U1 should follow via the touch panel 33. Each image g is displayed on the display surface of the display unit 32 in a state of being arranged in a predetermined pattern. For example, the image g is displayed in a state of being arranged in a 3 × 3 grid pattern (see FIG. 8).

The touch panel 33 is an input device operated by the user U1. The touch panel 33 is arranged so as to cover the display surface of the display unit 32. The touch panel 33 is used, for example, to input the PIN by the finger of the user U1. The user U1 inputs a PIN by moving a finger in contact with the touch panel 33 on the touch panel 33 and tracing (via) the image g corresponding to the elements constituting the PIN in order from the beginning of the PIN. do. At that time, the PIN is a simple code having a number of digits of about 10 digits or less composed of a combination of a plurality of elements (for example, numbers, letters, symbols), and the number of fingers is counted so as to follow the corresponding image g. Since the PIN can be input only by moving the number of times, the burden of the PIN input of the user U1 is reduced.

The PIN may be input by tapping a software keyboard (not shown) displayed on the display surface of the display unit 32 via the touch panel 33, or a physical keyboard (not shown) arranged in the vicinity of the display unit 32. It may be input via).

The storage unit 34 is a non-volatile storage unit such as a hard disk device or a ROM. The program 34a is stored in the storage unit 34.

Program 34a is a program executed by the control unit 35 (processor).

Although not shown, the control unit 35 includes a processor. The processor is, for example, a CPU (Central Processing Unit). There may be one processor or multiple processors. The processor functions as a display control unit 35a, an input state detection unit 35b, a shooting control unit 35c, and a payment processing unit 35d by executing a program 34a read from the storage unit 34 into the memory 36 (for example, RAM). Some or all of these may be implemented in hardware.

When the communication unit 37 receives a screen display instruction (screen display instruction for displaying the PIN input reception screen G1) transmitted from the authentication control device 20, for example, the display control unit 35a is displayed on the display surface of the display unit 32. The PIN input reception screen G1 (see FIG. 8) is displayed. The PIN input reception screen G1 may be displayed based on the information stored in the storage unit 34 of the payment terminal 30 in advance, or may be displayed based on the information received from the authentication control device 20 together with the screen display instruction. May be good.

The input state detection unit 35b detects the input state of the PIN. The PIN input state detected by the input state detection unit 35b is, for example, a PIN input start and a PIN input end.

For example, when the communication unit 37 receives a shooting instruction transmitted from the authentication control device 20, the shooting control unit 35c activates the camera 31 to shoot an image including the face of the user U1. For example, the camera 31 is activated by supplying power to the camera 31 or shifting the camera 31 from the sleep state to the normal state. On the other hand, the shooting control unit 35c stops the activation of the camera 31 when the shooting is completed. For example, the activation of the camera 31 is stopped by stopping the power supply to the camera 31 or putting the camera 31 into the sleep state.

The payment processing unit 35d executes the payment processing when, for example, the communication unit 37 receives the payment processing instruction transmitted from the authentication control device 20. That is, the payment process is completed based on the payment information associated with the face-authenticated user U1.

The communication unit 37 is a communication device that communicates with the authentication control device 20 via the network NW.

Next, an example of the operation of the authentication system 1 having the above configuration (first operation example) will be described.

FIG. 10 is a sequence diagram of the authentication system 1 (first operation example).

As shown in FIG. 10, first, the authentication control device 20 (display control unit 22a) transmits a screen display instruction for displaying the PIN input reception screen G1 to the payment terminal 30 via the communication unit 24 (step). S10).

Next, when the communication unit 37 receives the screen display instruction transmitted in step S10, the payment terminal 30 (display control unit 35a) displays the PIN input reception screen G1 (see FIG. 8) on the display surface of the display unit 32. Display (step S11).

Next, the payment terminal 30 activates the camera 31 in response to the input operation of the user U1 on the touch panel 33, and captures an image including the face of the user U1 (steps S12 to S16).

Specifically, first, the user U1 starts inputting the PIN assigned to himself / herself via the touch panel 33 (step S12). For example, the user U1 moves a finger in contact with the touch panel 33 on the touch panel 33, and traces (vias) the image g corresponding to the elements constituting the PIN in order from the beginning of the PIN. Enter. The payment terminal 30 (input state detection unit 35b) detects the start of PIN input.

Next, when the input state detection unit 35b detects the start of PIN input, the payment terminal 30 (communication unit 37) transmits an input start detection notification to the authentication control device 20 (step S13).

Next, when the communication unit 24 receives the input start detection notification transmitted in step S13, the authentication control device 20 (shooting control unit 22b) transmits a shooting instruction to the payment terminal 30 via the communication unit 24 ( Step S14).

Next, when the communication unit 37 receives the shooting instruction transmitted in step S14, the payment terminal 30 (shooting control unit 35c) activates the camera 31 (step S15) and inputs the PIN via the touch panel 33. An image including the face of the user U1 is taken (step S16). Here, it is assumed that the captured image I shown in FIG. 13 has been captured. The number of shots may be one or a plurality. The shooting control unit 35c stops the activation of the camera 31 when the shooting is completed.

As described above, the payment terminal 30 activates the camera 31 in response to the input operation of the user U1 on the touch panel 33 to take an image including the face of the user U1.

Next, the payment terminal 30 (communication unit 37) transmits the captured image I captured in step S16 to the authentication control device 20 (step S17). At that time, the shooting control unit 35c may end the shooting of the camera 31 at the timing when the shot image is transmitted (or may stop the activation of the camera 31).

Next, the authentication control device 20 (communication unit 24) receives the captured image I transmitted in step S17, and the image acquisition unit 22c acquires the captured image I received by the communication unit 24.

Next, the authentication control device 20 (face area detection unit 22k) detects the face area of the user U1 to which the finger performing the input operation is connected to the touch panel 33 of the payment terminal 30, so that the face detection process (face detection process) (See FIG. 15) is executed (step S1700). Here, as a result of this face detection process, the face area A1 (see FIG. 14) of the user U1 is detected as the face area to which the fingers performing the input operation are connected to the touch panel 33 of the payment terminal 30. do.

Next, the authentication control device 20 (authentication control unit 22d) makes a face authentication request for the face authentication of the user U1 included in the face area A1 (face image) detected in step S1700 via the communication unit 24. It is transmitted to the authentication device 10 (step S18). This face recognition request includes the detected face area A1.

Next, when the communication unit 14 receives the face authentication request transmitted in step S18, the authentication device 10 executes the face authentication process (see FIG. 6) (step S19).

Next, the authentication device 10 (authentication unit 12e) transmits the authentication result to the authentication control device 20 of the face authentication request transmission source via the communication unit 14 (step S20). Here, as an authentication result, it is assumed that the authentication is successful and the user ID of the authenticated user U1 is transmitted to the authentication control device 20.

Next, the authentication control device 20 (communication unit 24) receives the face authentication result and the user ID transmitted in step S20, and the face authentication result acquisition unit 22e receives the face authentication result received by the communication unit 24. get.

When the input state detection unit 35b detects the end of the PIN input, the payment terminal 30 (communication unit 37) transmits the input PIN to the authentication control device 20 (step S22). The authentication control device 20 (communication unit 24) receives the input PIN transmitted in step S22, and the authentication information acquisition unit 22f acquires the input PIN received by the communication unit 24.

Next, the authentication control device 20 (verification unit 22g) executes PIN verification (step S23). This PIN verification is a process of collating the input PIN acquired by the authentication information acquisition unit 22f with the registered PIN stored in the storage unit 21 (the registered PIN associated with the acquired user ID). Is.

Next, the authentication control device 20 (communication unit 24) succeeds in face recognition (assuming that the result of face recognition acquired by the face recognition result acquisition unit 22e is successful in authentication) and PIN verification in step S23. When the results of the above are the same, the payment processing instruction is transmitted to the payment terminal 30 via the communication unit 24 (step S24).

Next, when the communication unit 37 receives the payment processing instruction transmitted in step S24, the payment terminal 30 (display control unit 35a) displays a payment execution inquiry screen (see FIG. 11) as to whether or not to execute payment. It is displayed on the display surface of the display unit 32 (step S25). FIG. 11 is an example of the settlement execution inquiry screen G2.

Next, when the user U1 inputs the payment execution, for example, when the user U1 taps the payment button B on the payment execution inquiry screen via the touch panel 33, the payment terminal 30 (payment processing unit 35d) performs the payment processing. Is executed (step S27). At that time, the shooting control unit 35c may end the shooting of the camera 31 (or may stop the activation of the camera 31) at the timing when the user U taps the payment button B via the touch panel 33.

If the face authentication fails (the face authentication result acquired by the face authentication result acquisition unit 22e indicates that the authentication has failed), or if the PIN verification results in step S23 do not match, step S24 The processing of ~ S27 is not executed. In this case, the display unit 32 displays, for example, that the authentication has failed.

In the process of executing the processes of steps S19 to S24, the feature points of the skeleton detected in the face authentication process (step S19) (for example, wrist P1R, elbow P2R, PRL, shoulder P3R, P3L, neck in FIG. 14). P4, face P5) is superimposed on the authentication target person (user who is performing an input operation on the touch panel 33 of the payment terminal 30 with a finger) in the image taken in step S16, and is covered by the touch panel screen (touch panel 33). It may be displayed on the display surface of the displayed display unit 32 (see FIG. 14). At that time, if a third party other than the authentication target person lined up behind the authentication target person is reflected in the image taken in step S16 (not shown), the body part of the third party. The feature points may not be displayed. Alternatively, if a third party other than the authentication target person lined up behind the authentication target person is reflected in the image taken in step S16 (not shown), it is detected in the authentication process (step S19). The feature points of the body part may be superimposed on the authentication target person and the third party in the image taken in step S16 and displayed on the touch panel screen. At that time, the feature points of the body part superimposed on the recognition target person may be highlighted (the feature points of the body part superimposed on the third party may not be highlighted). Further, when the authentication of the authentication process (step S19) is successful, the color of the feature points of the body part superimposed on the authentication target person in the image taken in step S16 may be changed and displayed on the touch panel screen. good. Alternatively, in the process of executing the processes of steps S19 to S24, the touch panel screen (display covered by the touch panel 33) indicates that the face of the frontmost user (operating the touch panel 33) is detected by the skeleton information. It may be displayed on the display surface of the unit 32).

As described above, according to an example of the operation of the authentication system 1 (first operation example), the face authentication (step S19) is performed before the PIN verification (step S23), so that the face authentication can be performed quickly. Can be done. (We can respond quickly.)
Next, an example of the operation of the authentication system 1 having the above configuration (second operation example) will be described.

FIG. 12 is a sequence diagram of the authentication system 1 (second operation example).

In the first operation example, the face authentication process is executed using the face feature information of all the user IDs registered in the face information DB 11b, whereas in the second operation example, it is registered in the face information DB 11b. The face authentication process is executed using the face feature information of the user ID associated with the input PIN among the user IDs. Since the processing of steps S10 to S22 is the same as that of the first operation example, the same reference numerals are given and the description thereof will be omitted. Hereinafter, steps S30 to S37 after step S22 will be mainly described.

First, as a premise, the authentication control device 20 (communication unit 24) receives the captured image transmitted in step S17, the image acquisition unit 22c acquires the captured image received by the communication unit 24, and the face area detection unit 22k. Executes the face detection process (see FIG. 15) (step S1700). Further, the authentication control device 20 (communication unit 24) receives the input PIN transmitted in step S22, and the authentication information acquisition unit 22f acquires the input PIN received by the communication unit 24.

Next, the authentication control device 20 (verification unit 22g) executes PIN verification (step S30). In this PIN verification, the input PIN acquired by the authentication information acquisition unit 22f is collated with the registered PIN (all PINs) stored in the storage unit 21, and is acquired from the storage unit 21 by the authentication information acquisition unit 22f. This is a process of extracting the user ID associated with the input PIN.

Next, the authentication control device 20 (authentication control unit 22d) detects the face area A1 (face) as a result of the face detection process by the face area detection unit 22k when the user ID is extracted as a result of the PIN verification in step S30. The face authentication request for the face authentication of the user U1 included in the image) is transmitted to the authentication device 10 via the communication unit 24 (step S31). This face authentication request includes the detected face area A1 and the user ID extracted in step S30.

Next, when the communication unit 14 receives the face authentication request transmitted in step S31, the authentication device 10 executes the face authentication process (see FIG. 6) (step S32). At that time, the authentication device 10 uses the face feature information of the user IDs (for example, 100 people) extracted in step S30 instead of the face feature information of all user IDs (for example, 1000 people) for face recognition processing. To execute.

Next, the authentication device 10 (authentication unit 12e) transmits the authentication result to the authentication control device 20 of the face recognition request sender (step S33). Here, it is assumed that as the authentication result, the fact that the authentication is successful is transmitted to the authentication control device 20.

Next, the authentication control device 20 (communication unit 24) receives the face authentication result transmitted in step S33, and the face authentication result acquisition unit 22e acquires the face authentication result received by the communication unit 24. ..

Next, the authentication control device 20 (communication unit 24) transmits a payment processing instruction to the payment terminal 30 when the result of the acquired face recognition is that the authentication is successful (step S34).

Next, when the payment terminal 30 (display control unit 35a) receives the payment processing instruction transmitted in step S34, the payment terminal 30 (see FIG. 11) displays a payment execution inquiry screen (see FIG. 11) on the display unit 32 as to whether or not to execute payment. Display (step S35).

Next, when the user U1 inputs the payment execution, for example, when the user U1 taps the payment button B in the payment execution inquiry screen (see FIG. 11) via the touch panel 33, the payment terminal 30 performs the payment process. Execute (step S37).

When the user ID is not extracted as a result of the PIN verification in step S30, or when the face authentication fails (when the result of the face authentication acquired by the face authentication result acquisition unit 22e indicates that the authentication has failed). The processes of steps S34 to S37 are not executed. In this case, the display unit 32 displays, for example, that the authentication has failed.

In the process of executing the processes of steps S32 to S34, the feature points of the skeleton detected in the face authentication process (step S32) (for example, wrist P1R, elbow P2R, PRL, shoulder P3R, P3L, neck in FIG. 14). P4, face P5) is superimposed on the authentication target person (user who is performing an input operation on the touch panel 33 of the payment terminal 30 with a finger) in the image taken in step S16, and is covered by the touch panel screen (touch panel 33). It may be displayed on the display surface of the displayed display unit 32 (see FIG. 14). At that time, if a third party other than the authentication target person lined up behind the authentication target person is reflected in the image taken in step S16 (not shown), the body part of the third party. The feature points may not be displayed. Alternatively, if a third party other than the authentication target person lined up behind the authentication target person is reflected in the image taken in step S16 (not shown), it is detected in the authentication process (step S32). The feature points of the body part may be superimposed on the authentication target person and the third party in the image taken in step S16 and displayed on the touch panel screen. At that time, the feature points of the body part superimposed on the recognition target person may be highlighted (the feature points of the body part superimposed on the third party may not be highlighted). Further, when the authentication of the authentication process (step S32) is successful, the color of the feature points of the body part superimposed on the authentication target person in the image taken in step S16 may be changed and displayed on the touch panel screen. good. Alternatively, in the process of executing the processes of steps S19 to S24, the touch panel screen (display covered by the touch panel 33) indicates that the face of the frontmost user (operating the touch panel 33) is detected by the skeleton information. It may be displayed on the display surface of the unit 32).

As described above, according to an example of the operation of the authentication system 1 (second operation example), after narrowing down by PIN verification (step S30) (for example, in the above example, after narrowing down from 1000 to 100 people). ), Face authentication (step S32) can be performed, so that the authentication accuracy can be improved.

As described above, according to the second embodiment, a third party other than the user U1 (authentication target person) (for example, the user U2 lined up behind or a third party crossing the shooting range of the camera) is the camera 31. The user U1 can be correctly authenticated even when it is reflected in the captured image (see FIG. 13).

That is, in order to detect the face area to which the fingers performing the input operation (input operation for payment) are connected to the touch panel 33 of the payment terminal 30 by the face area detection unit 22k, the touch panel 33 of the payment terminal 30 is used. On the other hand, it is suppressed to mistakenly detect the face area of a third party who is not connected to the finger performing the input operation (input operation for payment), and the PIN is input to perform the payment processing. The face area of the target user U1 can be correctly detected. As a result, the face authentication by the authentication device 10 can be correctly executed.

Further, according to the second embodiment, the camera 31 is activated at an appropriate timing according to the user's input operation to the touch panel 33 (for example, the timing when the user U1 starts the PIN input via the touch panel 33), and the user U1 You can take a picture of your face. As a result, the power consumption can be reduced as compared with the case where the camera 31 is always activated. Further, when the camera 31 is always activated, a third party other than the authentication target person (for example, a third party other than the authentication target person lined up behind the authentication target person or a third party crossing the shooting range of the camera 31). It is not preferable from the viewpoint of privacy protection because the chances of the person being reflected are increased, but the camera 31 is at an appropriate timing (that is, at the timing when authentication is required) according to the user's input operation to the touch panel 33 as in the second embodiment. By activating, it is possible to suppress the reflection of a third party other than the person to be authenticated.

Further, according to the second embodiment, since the face of the user U1 is photographed at the timing corresponding to the user's input operation to the touch panel 33 (for example, the timing when the user U1 starts the PIN input via the touch panel 33), the touch panel is used. It faces the face of the user U1 who is inputting the PIN via 33, that is, the display surface of the display unit 32 (and the camera 31 arranged in the vicinity thereof) on which the PIN input reception screen G1 is displayed (gaze). The face of the user U1 can be photographed from the front or almost from the front. That is, the face of the user U1 can be photographed at an angle suitable for face recognition. This can be expected to improve the authentication accuracy of face recognition.

Next, a modified example will be described.

In the second embodiment, the wrist feature point (or finger feature point) having the shortest distance L (see FIG. 14) from the lower side of the captured image I is detected as the finger closest to the touch panel 33 of the payment terminal 30. An example (when the camera 31 is attached to the upper part of the frame of the display unit 32 (see FIG. 8)) has been described, but the present invention is not limited to this.

For example, when the camera 31 is attached to the lower part of the frame of the display unit 32 (not shown), the wrist having the shortest distance from the upper side of the captured image I as the finger closest to the touch panel 33 of the payment terminal 30. (Or the feature point of the finger) may be detected. When the camera 31 is attached to the right side of the frame of the display unit 32 (not shown), the distance between the photographed image I and the left side of the photographed image I is the shortest as the finger closest to the touch panel 33 of the payment terminal 30. Wrist feature points (or finger feature points) may be detected. When the camera 31 is attached to the left side of the frame of the display unit 32 (not shown), the distance between the camera 31 and the right side of the captured image I is the shortest as the finger closest to the touch panel 33 of the payment terminal 30. Wrist feature points (or finger feature points) may be detected. Further, when the camera 31 is attached to the touch panel screen (the display surface of the display unit 31 covered by the touch panel 33) (not shown), the touch panel 33 is touched as the finger closest to the touch panel 33 of the payment terminal 30. Wrist feature points (or finger feature points) may be detected.

Further, in the second embodiment, the user U1 starts the PIN input via the touch panel 33 at the timing corresponding to the user's input operation to the touch panel 33 (the timing at which the camera 31 is activated to take a picture of the user U1's face). The example of the timing is described, but the present invention is not limited to this. For example, the timing corresponding to the user's input operation on the touch panel 33 (the timing at which the camera 31 is activated to take a picture of the user U1's face) is any timing after the start of the PIN input and before the end of the PIN input. May be good.

In this way, the face of the user U1 who is inputting the PIN via the touch panel 33, that is, the display surface of the display unit 32 on which the PIN input reception screen G1 is displayed (and the camera 31 arranged in the vicinity thereof). The face of the user U1 facing (looking at) can be photographed from the front or substantially from the front. That is, the face of the user U1 can be photographed at an angle suitable for face recognition. This can be expected to improve the authentication accuracy of face recognition.

Further, the timing according to the user's input operation to the touch panel 33 (the timing at which the camera 31 is activated to take a picture of the user U1's face) may be the timing at which the user U1 finishes the PIN input or a timing after that. good.

Further, in the second embodiment, an example in which the camera 31 is attached to the upper part of the frame of the display unit 32 (see FIG. 8) has been described, but the present invention is not limited to this. That is, the camera 31 may be attached anywhere as long as it can shoot at an angle suitable for face recognition. For example, it may be attached to the left portion or the right portion of the frame of the display unit 32. Alternatively, it may be attached to a structure (for example, a wall or a pillar) installed in the vicinity of the payment terminal 30 or other places.

Further, in the second embodiment, an example in which the predetermined process executed when the face authentication by the authentication device 10 is successful and the collation results by the collation unit 22g match is the settlement process has been described, but the present invention is limited to this. No. For example, this predetermined process may be a process of opening a gate or a door through which the user U1 passes, or another process.

Further, in the second embodiment, an example in which the authentication system 1 is composed of an authentication device 10, an authentication control device 20, and a payment terminal 30 capable of communicating with each other via a network NW (for example, the Internet) has been described. Not exclusively.

For example, the configuration or function of all or part of the authentication device 10 and the authentication control device 20 may be added to the payment terminal 30. Further, the configuration or function of all or a part of the payment terminal 30 and the authentication device 10 may be added to the authentication control device 20.

In the above-described first and second embodiments, the program is stored using various types of non-transitory computer readable medium and can be supplied to the computer. Non-temporary computer-readable media include various types of tangible storage mediums. Examples of non-temporary computer-readable media include magnetic recording media (eg, flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (eg, magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, It includes a CD-R / W and a semiconductor memory (for example, a mask ROM, a PROM (Programmable ROM), an EPROM (Erasable PROM), a flash ROM, and a RAM (Random Access Memory)). The program may also be supplied to the computer by various types of temporary computer readable medium. Examples of temporary computer-readable media include electrical, optical, and electromagnetic waves. The temporary computer-readable medium can supply the program to the computer via a wired communication path such as an electric wire and an optical fiber, or a wireless communication path.

The numerical values shown in the above embodiments are all examples, and it goes without saying that an appropriate numerical value different from this can be used.

The above embodiment is merely an example in every respect. The present invention is not limitedly construed by the description of the above embodiment. The present invention can be practiced in various other forms without departing from its spirit or key features.

Part or all of the above embodiments may be described as in the following appendix, but are not limited to the following.

(Appendix 1)
An imaging control means that allows the camera to capture an image including a user who is performing an input operation with a finger on the input means.
An image acquisition means for acquiring the image taken by the camera, and
A face area detecting means for detecting a face area to which the fingers performing the input operation on the input means are connected from an image acquired by the image acquiring means, and a face area detecting means.
An authentication control device including an authentication control means for causing an authentication device that executes face authentication to execute face authentication of the user included in the face area detected by the face area detection means.

(Appendix 2)
The input means is an input means for causing the user to input the authentication information assigned to the user.
Moreover,
An authentication information acquisition means for acquiring the authentication information input via the input means, and an authentication information acquisition means.
A collation means for collating the authentication information acquired by the authentication information acquisition means with the registered authentication information,
The authentication according to Appendix 1, further comprising a processing control means for causing a processing means for executing a predetermined process to execute the predetermined process when the face authentication by the authentication device is successful and the collation results by the collation means match. Control device.

(Appendix 3)
The authentication control device according to Appendix 2, wherein the predetermined process is a settlement process and a process of opening a gate or door through which the user passes.

(Appendix 4)
The authentication control device according to any one of Supplementary note 1 to 3, wherein the input means is an input means for inputting authentication information by the user's finger.

(Appendix 5)
The authentication control device according to Appendix 4, wherein the input means is a touch panel arranged so as to cover the display surface of the display unit.

(Appendix 6)
Additional note that the display surface of the display unit further includes a display control unit that displays an authentication information input screen including an image symbolizing each element constituting the authentication information that the user's finger should follow via the touch panel. The authentication control device according to 5.

(Appendix 7)
A feature point detecting means for detecting at least one feature point of the user's skeleton from the image acquired by the image acquiring means is further provided.
The face area detecting means connects the image acquired by the image acquiring means via a feature point at which the finger performing the input operation to the input means is detected by the feature point detecting means. The authentication control device according to any one of Supplementary note 1 to 6, which detects a face area.

(Appendix 8)
Input means and
A camera that captures an image including a user who is performing an input operation with a finger on the input means, and a camera.
An image acquisition means for acquiring the image taken by the camera, and
A face area detecting means for detecting a face area to which the fingers performing the input operation on the input means are connected from an image acquired by the image acquiring means, and a face area detecting means.
An authentication system including an authentication device for executing face authentication, and an authentication control means for executing face authentication of the user included in the face area detected by the face area detecting means.

(Appendix 9)
It is equipped with an information processing device, an authentication control device, and the authentication device capable of communicating with each other via a network.
The input means and the camera are provided in the information processing device.
The authentication system according to Appendix 8, wherein the image acquisition means, the face detection means, and the authentication control means are provided in the authentication control device.

(Appendix 10)
A shooting control step in which the camera captures an image including a user who is performing an input operation with a finger on the input means.
An image acquisition step of acquiring the image taken by the camera, and
From the image acquired in the image acquisition step, a face area detection step for detecting a face area to which the fingers performing the input operation for the input means are connected, and a face area detection step.
An authentication control method comprising an authentication control step for causing an authentication device that executes face authentication to execute face authentication of the user included in the face area detected by the face detection step.

(Appendix 11)
For electronic devices with at least one processor
Shooting control processing that causes the camera to capture an image that includes a user who is performing an input operation with a finger on the input means.
An image acquisition process for acquiring the image taken by the camera, and
From the image acquired by the image acquisition process, a face area detection process for detecting a face area to which the fingers performing the input operation on the input means are connected, and a face area detection process.
A computer-readable recording medium recording a program for executing an authentication control process for causing an authentication device that executes face authentication to execute face authentication of the user included in the face area detected by the face detection process. ..

1 Authentication system 10 Authentication device 11 Storage unit 11a Program 11b Face information DB
12 Control unit 12a Image acquisition unit 12b Face detection unit 12c Feature point extraction unit 12d Registration unit 12e Authentication unit 13 Memory 14 Communication unit 20 Authentication control device 21 Storage unit 21a Program 21b Personal authentication information 21b2 Authentication information 22 Control unit 22a Display control unit 22b Imaging control unit (imaging control means)
22c Image acquisition unit (image acquisition means)
22d Authentication control unit (authentication control means)
22e Authentication information acquisition department (face authentication result acquisition department)
22g Collation unit 22h Completion processing unit 22j Feature point detection unit 22k Face area detection unit 23 Memory 24 Communication unit 30 Payment terminal (information processing terminal)
31 Camera 32 Display 33 Touch panel (input means)
34 Storage unit 34a Program 35 Control unit 35a Display control unit 35b Input status detection unit 35c Shooting control unit 35d Payment processing unit 36 Memory 37 Communication unit B Payment button G1 PIN input reception screen G2 Inquiry screen NW network g Image

Claims (11)

1. An imaging control means that allows the camera to capture an image including a user who is performing an input operation with a finger on the input means.
   An image acquisition means for acquiring the image taken by the camera, and
   A face area detecting means for detecting a face area to which the fingers performing the input operation on the input means are connected from an image acquired by the image acquiring means, and a face area detecting means.
   An authentication control device including an authentication control means for causing an authentication device that executes face authentication to execute face authentication of the user included in the face area detected by the face area detection means.
2. The input means is an input means for causing the user to input the authentication information assigned to the user.
   Moreover,
   An authentication information acquisition means for acquiring the authentication information input via the input means, and an authentication information acquisition means.
   A collation means for collating the authentication information acquired by the authentication information acquisition means with the registered authentication information,
   The first aspect of claim 1, wherein when the face authentication by the authentication device is successful and the collation results by the collation means match, the processing means for executing the predetermined process is provided with the process control means for executing the predetermined process. Authentication control device.
3. The authentication control device according to claim 2, wherein the predetermined process is a settlement process and a process of opening a gate or a door through which the user passes.
4. The authentication control device according to any one of claims 1 to 3, wherein the input means is an input means for inputting authentication information by the user's finger.
5. The authentication control device according to claim 4, wherein the input means is a touch panel arranged so as to cover the display surface of the display unit.
6. A claim further comprising a display control unit on the display surface of the display unit for displaying an authentication information input screen including an image symbolizing each element constituting the authentication information, which the user's finger should follow via the touch panel. Item 5. The authentication control device according to Item 5.
7. A feature point detecting means for detecting at least one feature point of the user's skeleton from the image acquired by the image acquiring means is further provided.
   The face area detecting means connects the image acquired by the image acquiring means via a feature point at which the finger performing the input operation to the input means is detected by the feature point detecting means. The authentication control device according to any one of claims 1 to 6, which detects a face area.
8. Input means and
   A camera that captures an image including a user who is performing an input operation with a finger on the input means, and a camera.
   An image acquisition means for acquiring the image taken by the camera, and
   A face area detecting means for detecting a face area to which the fingers performing the input operation on the input means are connected from an image acquired by the image acquiring means, and a face area detecting means.
   An authentication system including an authentication device for executing face authentication, and an authentication control means for executing face authentication of the user included in the face area detected by the face area detecting means.
9. It is equipped with an information processing device, an authentication control device, and the authentication device capable of communicating with each other via a network.
   The input means and the camera are provided in the information processing device.
   The authentication system according to claim 8, wherein the image acquisition means, the face detection means, and the authentication control means are provided in the authentication control device.
10. A shooting control step in which the camera captures an image including a user who is performing an input operation with a finger on the input means.
    An image acquisition step of acquiring the image taken by the camera, and
    From the image acquired in the image acquisition step, a face area detection step for detecting a face area to which the fingers performing the input operation for the input means are connected, and a face area detection step.
    An authentication control method comprising an authentication control step for causing an authentication device that executes face authentication to execute face authentication of the user included in the face area detected by the face detection step.
11. For electronic devices with at least one processor
    Shooting control processing that causes the camera to capture an image that includes a user who is performing an input operation with a finger on the input means.
    An image acquisition process for acquiring the image taken by the camera, and
    From the image acquired by the image acquisition process, a face area detection process for detecting a face area to which the fingers performing the input operation on the input means are connected, and a face area detection process.
    A computer-readable recording medium recording a program for executing an authentication control process for causing an authentication device that executes face authentication to execute face authentication of the user included in the face area detected by the face detection process. ..

Images