JP6578326B2 - User authentication system, computing device, terminal device, method thereof, and computer-executable program - Google Patents

Description

  The present invention relates to a user authentication system, a computing device, a terminal device, a method thereof, and a computer-executable program.

  Recently, in information processing apparatuses such as notebook PCs and desktop PCs, an authentication method that replaces a password is required in order to perform user authentication easily. Examples of authentication methods that can replace passwords include face authentication, fingerprint authentication, smart card authentication, and device authentication.

  Face authentication, fingerprint authentication, and smart card authentication require expensive sensors and devices for authentication, such as IR cameras, fingerprint sensors, and smart card readers.

  Device authentication using a smart device such as a smart phone or a smart watch performs user authentication when the information processing apparatus detects a smart device using, for example, Bluetooth (registered trademark). Such device authentication requires that Bluetooth (registered trademark) is always turned on, which increases power consumption.

  In the device authentication, since the device is detected by the information processing apparatus in a certain wide range, there is a possibility that an unauthorized user may illegally use the information processing apparatus from a position slightly away. For example, in a situation where a legitimate user is nearby but does not look at the information processing apparatus, an unauthorized user may authenticate the user of the information processing apparatus using the legitimate user's smartphone in a short time. Conceivable.

JP2013-190900A

  The present invention has been made in view of the above, and uses a configuration installed in an existing information processing apparatus to enable accurate user authentication in a short time without requiring user operation. It is an object to provide a system, a computing device, a terminal device, a method thereof, and a computer-executable program.

  In order to solve the above-described problems and achieve the object, according to the first aspect of the present invention, a user authentication system for performing user authentication of a computing device using a terminal device, wherein the terminal device has a predetermined event The first sound is input to a microphone module mounted on the computing device, and the input first sound is authenticated. An authentication step for authenticating the user if possible.

  In the authentication step, if the direction of the sound source of the first sound is not within a predetermined angle range with respect to the computing device, the user may not be authenticated.

  In the authentication step, the user may not be authenticated when the sound source of the first sound is separated from the computing device by a predetermined distance or more.

  The predetermined event may be a case where a second sound output from a speaker of the computing device is input to a microphone of the terminal device.

  The computing device may output the second sound when the computing device is powered on, returned from the suspended state, or when the lock screen is released.

  The predetermined event may be a case where the terminal device is close to the computing device and further detects a predetermined motion.

  Further, at least the first sound may be a non-audible sound.

  The first sound may be a one-time password modulated into a sound.

  The computing device may be a notebook PC, a desktop PC, or a tablet, and the terminal device may be a smartphone, a mobile phone terminal, or a smart watch.

  In order to solve the above-described problems and achieve the object, a computing device that performs user authentication using a terminal device according to a second aspect of the present invention includes a microphone module, and a first sound from the microphone module. Is input, the signal processing means for determining the direction of the sound source of the first sound, the first sound can be authenticated, and the direction of the sound source of the first sound is the computing User authentication means for authenticating a user when within a predetermined angle range with respect to the apparatus.

  Furthermore, it further comprises signal processing means for determining the direction of the sound source of the sound input from the microphone module, and the user authentication means is configured such that the direction of the sound source of the first sound is a predetermined angle with respect to the computing device. If it is not within the range, the user need not be authenticated.

  In addition, a speaker may be further provided, and the signal processing means may output a second sound from the speaker when the computing device is powered on, returned from a suspended state, or unlocked.

  In addition, in order to solve the above-described problems and achieve the object, the terminal device used when performing user authentication on the computing device according to the third aspect of the present invention generates a speaker and a predetermined event. And a signal processing means for outputting a first sound from the speaker.

  Furthermore, a microphone may be further provided, and the predetermined event may be a case where the terminal device receives a second sound output from a speaker of the computing device.

  In addition, a detection unit for detecting proximity to the computing device and a predetermined motion is provided, and for the predetermined event, the detection unit detects proximity to the computing device and a predetermined motion. It may be the case.

  In order to solve the above-described problems and achieve the object, a method of a computing device for performing user authentication using a terminal device according to a fourth aspect of the present invention includes: a microphone module; Authenticating the user when the first sound to be output is input.

  Further, in order to solve the above-described problems and achieve the object, according to the fifth aspect of the present invention, there is provided a terminal device method used when user authentication is performed on a computing device, wherein a predetermined event is A step of outputting the first sound from the speaker when it occurs.

  In addition, a program installed in a computing device that performs user authentication using a terminal device has a computer authenticating a user when a first sound output from the terminal device is input from a microphone module. Let it run.

  In order to solve the above-described problems and achieve the object, according to a seventh aspect of the present invention, there is provided a program installed in a terminal device used when user authentication is performed on a computing device, and a predetermined event When this occurs, the computer is caused to execute a step of outputting the first sound from the speaker.

  According to the above aspect of the present invention, there is an effect that it is possible to perform accurate user authentication in a short time without requiring a user operation by using a configuration installed in an existing information processing apparatus.

FIG. 1 is a conceptual diagram showing an example of a user authentication system according to the present embodiment. FIG. 2 is a flowchart for explaining an example of user authentication processing executed by the user authentication system according to the present embodiment. FIG. 3 is a schematic external configuration diagram of the user authentication system according to the first embodiment. FIG. 4 is a diagram illustrating a schematic hardware configuration example of the notebook PC of FIG. 3. FIG. 5 is a diagram illustrating a schematic hardware configuration example of the smartphone of FIG. 3. FIG. 6 is a schematic functional configuration diagram of a portion related to user authentication of the notebook PC of FIG. 4 and the smartphone of FIG. FIG. 7 is a flowchart for explaining an example of user authentication processing executed by the user authentication system according to the first embodiment. FIG. 8 is a schematic external configuration diagram of the user authentication system according to the second embodiment. FIG. 9 is a flowchart for explaining an example of user authentication processing executed by the user authentication system according to the second embodiment.

  Hereinafter, a user authentication system, a computing device, a terminal device, a method, and a computer-executable program according to the present invention will be described in detail with reference to the drawings. Although the components of the present invention are generally illustrated in the drawings herein, it can be readily understood that they may be arranged and designed in a wide variety of configurations with various configurations. Accordingly, the following more detailed description of the apparatus, system, method, and program embodiments of the present invention is not intended to limit the scope of the invention as set forth in the claims, but is merely selected implementations of the invention. It is merely an example of the form, and is merely illustrative of selected embodiments of the apparatus, system, method, and program consistent with the present invention as set forth in the claims herein. Those skilled in the art will appreciate that the present invention may be implemented without one or more of the specific details or with other methods, components, and materials. Note that the present invention is not limited to the embodiments. In addition, constituent elements in the following embodiments include those that can be easily assumed by those skilled in the art or that are substantially the same.

(Embodiment)
With reference to FIG.1 and FIG.2, the user authentication system which concerns on this Embodiment is demonstrated. FIG. 1 is a conceptual diagram showing an example of a user authentication system according to the present embodiment. As shown in FIG. 1, a user authentication system 1 according to the present embodiment includes a terminal device 20 of a user who is authorized to use a computing device 10 and a computing device that performs user authentication using the terminal device 20. 10.

  The computing device 10 is, for example, a notebook PC 10A, a tablet 10B, a desktop PC 10C, or the like. The terminal device 20 is, for example, a wearable terminal such as a smartphone 20A, a mobile phone terminal 20B, and a smart watch 20C, and a PDA.

  In the present embodiment, the terminal device 20 outputs a first sound (authentication sound) from the speaker when a predetermined event occurs. The computing device 10 authenticates the user when the first sound is input from the microphone module. In other words, the user is authenticated when the input sound can be authenticated (when it matches the sound for authentication). In the present embodiment, if the direction of the input sound source is not within the predetermined angle range θ (for example, the front direction) with respect to the computing device 10, the user is not authenticated. In this way, in the present embodiment, when the terminal device 20 is not within the predetermined angle range with respect to the computing device 10, there is a situation in which the computing device 10 is not seen even if a legitimate user is nearby. It is considered that users are not authenticated to prevent unauthorized use.

  That is, in the present embodiment, when the terminal device 20 is within a predetermined angle range with respect to the computing device 10, the user is authenticated assuming that a legitimate user is using the computing device 10. . On the other hand, when the terminal device 20 is not within the predetermined angle range with respect to the computing device 10, it is considered that the authorized user is nearby but the authorized user is not using the computing device 10. In order to prevent unauthorized use, the user is not authenticated.

  The terminal device 20 includes a speaker 21, a microphone 22, a detection unit 23, and a signal processing unit 24.

  The signal processing unit 24 causes the speaker 21 to output an authentication sound (first sound) when a predetermined event occurs. The sound for authentication may be a non-audible sound. Accordingly, it is possible to reduce misrecognition without making the user and surrounding people feel bothersome and easily mixing with other sounds (such as environmental sounds) with a microphone. The non-audible sound is a sound that cannot be heard by the human ear, and is, for example, an ultrasonic wave (a sound wave of about 16 kHz to 20 kHz or more). Further, the non-audible sound for authentication may be obtained by modulating a one-time password into a non-audible sound by a predetermined modulation method in order to further improve security. The one-time password may be generated using, for example, a known time synchronization method, challenge-response method, or the like.

  The predetermined event described above may be a case where a second sound (for example, a specific non-audible sound) output from the speaker 12 of the computing device 10 is input to the microphone 22 of the terminal device 20. .

  Further, the predetermined event may be a case where the terminal device 20 approaches the computing device 10 and further detects a predetermined motion of the terminal device 20. For example, the predetermined motion is an operation of stopping, an operation of placing, a motion of sitting, and the like. For example, the terminal device 20 may output a non-audible sound for authentication from the speaker 21 when the user who has the terminal device 20 enters the room where the computing device 10 is located and stops or sits down. Good.

  The detection unit 23 constantly monitors the position information, movement, and usage status of the terminal device 20, and detects the proximity of the terminal device 20 to the computing device 10 and the predetermined motion described above. The detection unit 23 includes, for example, an acceleration sensor, an angular velocity sensor (gyro sensor), a motion sensor having a magnetic sensor, a GPS sensor that acquires position information from a GPS (Global Positioning System) satellite, and Bluetooth (registered trademark) communication distance detection. You may decide to detect the proximity | contact to the computing apparatus 10 and the predetermined motion of the terminal device 20 using 1 or several, such as a function and a ranging sensor.

  In the above configuration, the signal processing unit 24 and the detection unit 23 can be configured by hardware or software modules, or a combination thereof. Further, the functions of the signal processing unit 24 and the detection unit 23 may be realized by a computer executing a program.

  The computing device 10 includes a microphone module 11, a speaker 12, a signal processing unit 13, and a user authentication unit 14.

  The microphone module 11 is composed of, for example, an array microphone or a plurality of microphones so that the signal processing unit 13 calculates position information (including direction and position) of the sound source, and collects and inputs sound. Is.

  The signal processing unit 13 performs various signal processing (A / D conversion, noise reduction, etc.) on the sound input from the microphone module 11. Further, the signal processing unit 13 may calculate position information (direction and position) of the sound source of the input sound. For example, the signal processing unit 13 can calculate the position information of the sound source based on the difference in arrival time of sounds input from the microphones of the microphone module 11.

  The user authentication unit 14 authenticates the user when the sound input from the microphone module 11 matches the authentication sound. If the direction of the sound source calculated by the signal processing unit 13 is not within the predetermined angle range θ with respect to the computing device 10, the user may not be authenticated. For example, the user authentication unit 14 may register in advance a non-audible sound for authentication of one or more users who are permitted to use the computing device 10 in a memory, and determine whether the sound matches the input sound. Good.

  When using a one-time password, the signal processing unit 13 demodulates the inaudible sound input from the microphone module 11 into a one-time password, and the user authentication unit 14 determines whether the demodulated one-time password is correct. It may be determined.

  In addition, the signal processing unit 13 outputs a unique inaudible sound stored in advance in the memory to start user authentication when the computing device 10 is powered on and returns from the suspended state or the screen lock. 12 may be output. For example, in the case of a notebook PC, when there is no input for a predetermined time, or when a transition is made to a sleep state by closing an LID and a return from the sleep state by an input operation or LID opening, the second sound (for example, a specific inaudible sound ) May be output from the speaker 12. Further, for example, in the case of a tablet, when there is no input for a predetermined time, the screen may be locked, and the second sound may be output from the speaker 12 when swiping to release the screen lock.

  In the above configuration, the signal processing unit 13 and the user authentication unit 14 can be configured by hardware or software modules, or a combination thereof. Moreover, you may decide to implement | achieve the function of the signal processing part 13 and the user authentication part 14 by a computer running a program.

  FIG. 2 is a flowchart for explaining an example of user authentication processing executed by the user authentication system 1 according to the present embodiment. User authentication processing executed by the user authentication system 1 according to the present embodiment will be described with reference to the flowchart of FIG. In the flowchart of FIG. 2, the case where a non-audible sound is output from a speaker will be described as an example.

  In FIG. 2, first, in the terminal device 20, when a predetermined event occurs (“Yes” in step S <b> 1), the signal processing unit 24 outputs an inaudible sound for authentication from the speaker 21 (step S <b> 2). .

  For example, when the power is ON, the computing device 10 outputs a unique non-audible sound from the speaker 12 when returning from a suspended state or a screen lock. In response to this, the terminal device 20 may output a non-audible sound for authentication from the speaker 21 when this unique non-audible sound is input from the microphone 22.

  In addition, the terminal device 20 outputs a non-audible sound for authentication from the speaker 21 when it is close to the computing device 10 or close to the computing device 10 and further detects a predetermined motion. Also good. Further, the non-audible sound for authentication may be a one-time password modulated to a non-audible sound.

  In the computing device 10, when a non-audible sound is input from the microphone module 11 (“Yes” in step T1), the signal processing unit 13 determines the direction of the sound source of the non-audible sound input from the microphone module 11 ( Step T2).

  The user authentication unit 14 determines that the input non-audible sound matches the non-audible sound for user authentication, and the direction of the sound source of the non-audible sound determined by the signal processing unit 13 is within a predetermined angle range with respect to the computing device 10. It is determined whether it is within (for example, the front direction) (step T3).

  If the input non-audible sound matches the non-audible sound for user authentication and the direction of the non-audible sound determined by the signal processing unit 13 is within a predetermined angle range with respect to the computing device 10 (step The user authentication unit 14 may authenticate the user (step T4) and perform a predetermined process (for example, activation or restoration of the system).

  When the input non-audible sound matches the non-audible sound for user authentication and the direction of the non-audible sound determined by the signal processing unit 13 is not within the predetermined angle range with respect to the computing device 10 (step The user authentication unit 14 may determine that the user authentication has failed (step T5) and notify the user of an authentication failure message.

  As described above, the user authentication unit 14 is input without determining whether or not the direction of the sound source of the inaudible sound is within a predetermined angle range (for example, the front direction) with respect to the computing device 10. The user may be authenticated if the non-audible sound matches the non-audible sound for user authentication.

  As described above, according to the present embodiment, the terminal device 20 outputs the first sound (sound for authentication) from the speaker 21 when a predetermined event occurs, and the computing device 10 Since the user is authenticated when the first sound is input from the microphone module 11, the configuration installed in the existing information processing apparatus is used, and no user operation is required. Accurate user authentication is possible in a short time. In other words, a low-cost configuration that does not use expensive sensors and devices for authentication can be achieved.

  Further, since the computing device 10 does not authenticate a user whose direction of the sound source of the input sound is not within a predetermined angle range with respect to the computing device 10, for example, the terminal device (sound source) 20 When it is outside the predetermined angle range with respect to the computing device 10, it is considered that the user is not looking at the computing device 10 even when a legitimate user is nearby. Can be prevented.

  Since the computing device 10 does not authenticate the user when the sound source of the first sound is separated from the computing device 10 by a predetermined distance or more, the computing device 10 can further prevent unauthorized use.

  In addition, since the predetermined event is the case where the terminal device 20 receives the second sound output from the speaker 12 of the computing device 10 from the microphone 22, the two-step verification is performed. This makes it possible to prevent unauthorized use more.

  In addition, when the computing device 10 is turned on, returns from the suspended state, or releases the lock screen, the computing device 10 outputs a unique non-audible sound from the speaker 12 so that the computing device 10 can be turned on from the suspended state. User authentication can be performed when returning or releasing the lock screen.

  In addition, since the predetermined event is a case where the proximity of the terminal device 20 to the computing device 10 and a predetermined motion is detected, the terminal device 20 is brought closer to the computing device 10 and a predetermined motion is further transmitted. If so, user authentication can be performed.

  In addition, since the predetermined password is a one-time password, security can be improved.

  In the present embodiment, when the user is authenticated, the direction of the sound source is within a predetermined angle range with respect to the computing device 10, but the signal processing unit 13 is a computing device. Only the sound within a predetermined angle range with respect to 10 is extracted (beam forming process), and the user authentication unit 14 may authenticate the user when the extracted sound matches the authentication sound.

Example 1
A user authentication system 1 according to the first embodiment will be described with reference to FIGS. In the first embodiment, it is assumed that the computing device 10 is moved and used (for example, the notebook PC 10A and the tablet 10B), and the user authentication process is started from the computing device 10 side. In the first embodiment, an example in which the computing device 10 and the terminal device 20 are applied to a notebook PC 10A and a smartphone 20A will be described.

  FIG. 3 is a schematic external configuration diagram of the user authentication system 1 according to the first embodiment. As shown in FIG. 3, the user authentication system 1 includes a notebook PC 10A that performs user authentication and a smartphone 20A that is used for user authentication of the notebook PC 10A.

  As shown in FIG. 3, the notebook PC 10 </ b> A includes a main body side housing 102 and a display side housing (also referred to as “LID”) 103, which are both substantially rectangular parallelepipeds. The main body side housing 102 includes an input unit 104 having a keyboard and a touchpad, and left and right speakers 106a and 106b. The display-side housing 103 is disposed on the LCD (Liquid Crystal Display) 107, on the display surface side of the LCD 107 at a substantially upper center, and on both sides of the camera 108 with the camera 108 in between. Left and right microphones 105a and 105b. Although the number of microphones is two, it may be three or more.

  The main body side case 102 and the display side case 103 are connected to each other by a pair of left and right connecting portions (hinge portions) 109a and 109b at the respective end portions, and the connecting portions 109a and 109b open and close these cases. Supports freely.

  The smartphone 20A includes a substantially hexahedral-shaped housing 202. One surface of the surface of the housing 202 is a front surface 202A, the other surface facing the front surface 202A is a back surface, and a surface between the front surface 202A and the back surface of the surface of the housing 202 is a side surface 202B. In the smartphone 20A, a touch display unit 203 including a touch panel 203A and a display unit 203B on which various icons and images are displayed and a receiver 207 are arranged on the front surface 202A of the housing 202. A microphone 205 and a speaker 206 are disposed on the side surface 202B on the front side of the housing 202. In addition, operation units such as a power button and a volume adjustment button (not shown) are arranged on the right side surface 202B.

  The touch display unit 203 displays information such as icons, characters, graphics, and images, and performs various operations performed on the touch panel 203A using a finger, stylus, pen, or the like (hereinafter referred to as “indicator”). To detect. As a method for detecting various operations by the touch panel 203A, a capacitance type, a pressure sensitive type, or the like can be adopted.

  FIG. 4 is a diagram illustrating a schematic hardware configuration example of the notebook PC 10A of FIG. As shown in the figure, the notebook PC 10A includes a CPU 111, a ROM 112, a memory 113, a storage 114, an LCD 107, an input unit 104, a camera device 115, an audio device 117, a timing circuit 120, a wireless communication unit 119, a battery 121, and a DC-DC. A converter 122 and an AC adapter 123 are provided, and each part is connected directly or indirectly via a bus.

  The CPU 111 controls the notebook PC 10A as a whole by the OS 130 stored in the storage 114 connected via the bus, and controls functions based on various programs stored in the storage 114. The ROM 112 stores a BIOS (Basic Input / Output System: basic input / output system) 112a, data, and the like.

  The memory 113 includes a cache memory and a RAM, and is a writable memory used as a work area for writing processing data of the execution program as a read area for the execution program of the CPU 111.

  The storage 114 is configured by a non-volatile storage device such as an SSD or an HDD, for example. For example, the OS 30 for controlling the entire notebook PC 10A such as Windows (registered trademark) and peripheral devices are operated by hardware. And a function for storing various drivers 131 and browsers, mail applications, voice assistants, and applications 132 such as VOIP.

  The LCD 107 converts display information into a video signal under the control of the CPU 111, and displays various types of information according to the converted video signal on the display screen.

  In this embodiment, an LCD is used as a display. However, the present invention is not limited to this, and another display such as an organic EL display or a CRT may be used.

  The input unit 104 is a user interface for a user to perform an input operation. The input unit 104 is a keyboard composed of various keys for inputting characters, commands, etc., a touch pad for moving a cursor on the screen, and selecting various menus Etc.

  The camera device 115 includes a camera 108 and a camera processing circuit 116. The camera 108 includes a lens and an imaging unit (CCD or CMOS). The lens forms subject light, and the imaging unit outputs the formed subject light as R, G, and B image signals. The camera processing circuit 116 includes an A / D converter, an image processing LSI, a memory, and the like, performs drive timing and exposure control of the imaging unit, and performs data processing (A / D conversion, etc.) and output to the CPU 111.

  The audio device 117 includes microphones 105a and 105b, a speaker 106, and a DSP 118 for audio processing. The microphones 105a and 105b input sound and output to the DSP 118. The speaker 106 outputs a sound corresponding to the sound data output from the DSP 118.

  Further, the audio device 117 is capable of ultrasonic input / output processing, and is configured to collect ultrasonic waves with the microphones 105 a and 105 b and to output ultrasonic waves from the speaker 106.

  The DSP 118 has a wake on voice function, is supplied with power from the DC / DC converter 122 even in the sleep state, and is configured to collect sound from the microphones 105a and 105b even in the sleep state.

  The DSP 118 includes an A / D converter, a D / A converter, an amplifier, an audio processing LSI including various filters, a memory, and the like, and inputs audio input from the microphones 105a and 105b to the A / D. The voice processing after the conversion is performed, the voice data (digital data) after the voice processing is output to the CPU 111, the voice data (digital data) input from the CPU 111 is voice processed, and the voice data after the voice processing is converted to D / A. The data is converted and output from the speaker 106.

  The DSP 118 can calculate the position information (the position and direction of the sound source) of the sound (including ultrasonic waves and sound) input from the microphones 105a and 105b from the difference in the arrival time of the sound of each microphone. ing. Further, the DSP 118 can perform beam forming processing for extracting only sound within a predetermined angle range with respect to the notebook PC 10A.

  The timer circuit 120 generates a time signal from a signal generated by a system clock or an oscillator, and outputs the current time.

  The wireless communication unit 119 performs communication based on a Bluetooth (registered trademark) communication standard or communication based on a Wi-Fi (Wireless Fidelity) communication standard. The wireless communication unit 119 can perform Bluetooth (registered trademark) communication with another Bluetooth (registered trademark) device (for example, the smartphone 20A).

  The AC adapter 123 is connected to a commercial power supply, converts an AC voltage into a DC voltage, and outputs the DC voltage to the DC-DC converter 122. The DC-DC converter 122 converts the DC voltage supplied from the AC adapter 123 into a predetermined voltage, supplies power to each unit, and charges the battery 121. The battery 121 is charged by the DC-DC converter 122 and supplies the charged voltage to each unit. The battery 121 is used when the AC adapter 123 is not connected to a commercial power source.

  FIG. 5 is a block diagram showing a schematic hardware configuration of the smartphone 20A of FIG. As illustrated in FIG. 5, the smartphone 20A includes a control unit 210, a memory 211, a storage 212, a wireless communication unit 215, a communication unit 216, an audio device 217, a power supply unit 224, a touch display unit 203 ( A touch panel 203A, a display unit 203B), an operation unit 223, a receiver 207, a timing circuit 219, a motion sensor unit 225, a GPS positioning unit 226, and the like.

  The touch display unit 203 includes a display unit 203B and a touch panel 203A superimposed on the display unit 203B. Touch panel 203 </ b> A detects various operations performed on touch panel 203 </ b> A using an indicator such as a finger or a pen together with the position on touch panel 203 </ b> A where the operation is performed, and notifies control unit 210. The operations detected by the touch panel 203A include a touch operation, a slide operation, and a pitch operation. The display unit 203B includes, for example, a liquid crystal display (LCD), an organic EL (Organic Electro-Luminescence) panel, and the like, and displays characters, graphics, and the like.

  The operation unit 223 receives a user operation through a power button, a volume adjustment button, and the like, and transmits an instruction signal corresponding to the received operation to the control unit 210.

  The power supply unit 224 supplies power obtained from the storage battery or the AC adapter to each unit of the smartphone 20 </ b> A including the control unit 210 according to the control of the control unit 210.

  The communication unit 216 establishes a radio signal line with the base station via a channel assigned by the base station, for example, in 3G / 4GLTE, and performs telephone communication and information communication with the base station.

  The wireless communication unit 215 performs communication based on a Bluetooth (registered trademark) communication standard or communication based on a Wi-Fi (Wireless Fidelity) communication standard. In addition, the wireless communication unit 215 can perform Bluetooth (registered trademark) communication with other Bluetooth (registered trademark) devices (for example, the notebook PC 10A).

  The timer circuit 219 generates a time signal from a signal generated by a system clock or an oscillator and outputs the current time.

  The motion sensor unit 225 includes an acceleration sensor, an angular velocity sensor (gyro sensor), and a magnetic sensor. A force in a specific direction applied to the smartphone 100 held by the user according to the user's operation state (movement, etc.) A magnetic field (magnetic field) is detected.

  In addition, the GPS positioning unit 226 receives radio waves from a plurality of GPS (Global Positioning System) satellites and acquires geographical position data based on latitude and longitude information.

  The sensor data (acceleration data, angular velocity data, magnetic data) detected by the motion sensor unit 225 and the position data acquired by the GPS positioning unit 226 are output to the control unit 210.

  The audio device 217 includes a microphone 205, a speaker 206, and a DSP 218 for audio processing. The microphone 205 inputs voice and outputs it to the DSP 218. The speaker 206 outputs sound corresponding to the sound data output from the DSP 218.

  Further, the audio device 217 can perform ultrasonic input / output processing, and is configured to collect ultrasonic waves with the microphone 205 and to output ultrasonic waves from the speaker 206.

  The DSP 218 has a wake on voice function, and is supplied with power from the power supply unit 224 even when it is in a screen lock state (sleep state). Therefore, the audio device 217 can collect sound from the microphone 205 even when the screen is locked.

  The DSP 218 includes an A / D converter, a D / A converter, an amplifier, an audio processing LSI including various filters, a memory, and the like, and A / D-converts audio input from the microphone 205. Audio processing is performed later, audio data (digital data) after audio processing is output to the control unit 210, audio data (digital data) input from the control unit 210 is audio processed, and the audio data after audio processing is D / A conversion and output from the speaker 206.

  The memory 211 is composed of, for example, a RAM, a DRAM, or the like, and serves as a work area for temporarily storing a program executed by the control unit 110, data referred to by the control unit 110, a calculation result of the control unit 110, and the like. used.

  The storage 212 is, for example, a nonvolatile memory (for example, EEPROM, SSD), and stores programs and data used for processing in the control unit 210. The programs stored in the storage 212 include an OS 212a for realizing each function of the smartphone, a driver 212b for hardware control of the device, and a remote authentication application 212c for remotely performing user authentication on the notebook PC 10A. A voice reproduction application for reproducing an audio file, a telephone application for realizing a telephone function, a mail application for realizing an e-mail function, a browser application for realizing a WEB browsing function, a file browsing application, and Another application 212d such as a word processor application and various data are included. An OS 212a is interposed in communication between various applications and devices.

  The control unit 210 is, for example, a CPU (Central Processing Unit), a microprocessor, a DSP, and the like, and implements various functions (modes) by comprehensively controlling the operation of the smartphone 20A. Specifically, the control unit 200 executes instructions included in the program stored in the storage 212 while referring to the data stored in the storage 212 and the data expanded in the memory 211 as necessary. Various functions (modes) are realized by controlling the touch display unit 203, the wireless communication unit 215, the communication unit 216, the audio device 217, and the like. Note that the program executed by the control unit 210 and the data to be referenced may be downloaded from the server device or updated by communication using the communication unit 216 or the wireless communication unit 215.

  6 is a schematic functional configuration diagram of a portion related to user authentication of the notebook PC 10A of FIG. 4 and the smartphone 20A of FIG.

  In FIG. 6, in the notebook PC 10 </ b> A, programs such as the BIOS 112 a stored in the ROM 112 and the OS 130 installed in the storage 114 are read into the memory 113 and executed by the CPU 111. The OS 130 intervenes in transmission / reception of data or commands between each application and driver. Hereinafter, the operations and functions of the program executed by the CPU 111 will be described with the program as the main component.

  The OS 130 performs power saving control of the notebook PC 10A and controls transition between the normal state and the sleep state. When the input operation is not performed in the normal state, the OS 130 shifts to the sleep state. Further, for example, when an input operation (including LID open) is performed in the sleep state, the OS 130 notifies the BIOS 112a of a user authentication execution request, and when the BIOS 112a notifies the user 112 that the user authentication has been successful, Return to.

  The BIOS 112a performs user authentication when the power is turned on, and activates the OS 130 when the user authentication is successful. When the BIOS 112a returns from the sleep state to the normal state, the BIOS 112a performs user authentication according to the user authentication execution request from the OS 130. If the user authentication is successful, the OS 112 notifies the OS 130 of the success of the user authentication. Return to normal state.

  The DSP 118 of the audio device 117 stores, in the memory 118a, unique ultrasonic data that triggers user authentication and an arithmetic expression for calculating a one-time password. This arithmetic expression is common to the smartphone 20A. As a pre-stage of user authentication, the DSP 118 causes the speaker 106 to output unique ultrasonic waves corresponding to the unique ultrasonic data stored in the memory 118a in accordance with the instruction of the BIOS 112a.

  Further, when an ultrasonic wave is input from the microphones 105a and 105b, the DSP 118 demodulates the password from the ultrasonic wave, uses the current time output from the time measuring circuit 120, and based on the time when the ultrasonic wave is input. Then, the one-time password is calculated using the calculation formula for calculating the one-time password. Further, the DSP 118 calculates the direction of the ultrasonic sound source relative to the notebook PC 10A.

  The BIOS 112a determines whether or not the password demodulated by the DSP 118 matches the time password generated by the DSP 118. If the two match, the BIOS 112a further determines whether or not the direction of the ultrasonic sound source determined by the DSP 118 is within a predetermined angle range of the notebook PC, and the direction of the ultrasonic sound source is within the predetermined angle range. If so, the user is authenticated.

  In the smartphone 20A, the OS 212a performs power saving control of the smartphone 20A and controls transition between the normal state and the sleep state.

  The remote authentication application 212c is an application executed on the OS 30, and is an application for outputting authentication ultrasonic waves from the speaker 206 and performing user authentication of the notebook PC 10A using the authentication ultrasonic waves. is there.

  The remote authentication application 212c stores an arithmetic expression for calculating a one-time password based on the current time output from the timer circuit 219. This arithmetic expression is common to the notebook PC 10A.

  When the remote authentication application 212c receives a notification from the DSP 218 that the ultrasonic wave input from the microphone 205 matches the registered unique ultrasonic wave, the output is output from the time measuring circuit 219 using the above arithmetic expression. Generate a one-time password based on the current time. The remote authentication application 212c instructs the DSP 218 to output the generated one-time password.

  The DSP 218 of the audio device 217 stores unique ultrasonic data serving as a trigger for user authentication in the memory 218a. When an ultrasonic wave is input from the microphone 205, the DSP 218 determines whether or not the ultrasonic wave input from the microphone 205 matches the registered unique ultrasonic wave. If they match, the remote authentication application This is notified to 212c. Further, the DSP 218 modulates the one-time password into ultrasonic waves by a predetermined modulation method and outputs it from the speaker 206 in accordance with an instruction from the remote authentication application 212c.

  FIG. 7 is a flowchart for explaining an example of the user authentication process executed by the user authentication system 1 according to the first embodiment. User authentication processing executed by the user authentication system 1 according to the first embodiment will be described with reference to the flowchart of FIG.

  In FIG. 7, first, in the notebook PC 10A, the BIOS 112a stores the memory in the DSP 118 of the audio device 117 in the memory 118a when the notebook PC 10A is powered on or returns from the suspended state (“Yes” in step T11). The specific ultrasonic wave corresponding to the specific ultrasonic data is output from the speaker 106 (step T12).

  In the smartphone 20 </ b> A, when the ultrasound is input from the microphone 205 (“Yes” in step S <b> 11), the DSP 218 determines whether or not the ultrasound input from the microphone 205 matches the registered unique ultrasound. Judgment is made (step S12), and if they match (“Yes” in step S12), the fact is notified to the remote authentication application 212c. Upon receiving the notification to that effect, the remote authentication application 212c generates a one-time password based on the current time output from the timer circuit 219 using the common arithmetic expression described above (step S13). In accordance with an instruction from the remote authentication application 212c, the DSP 218 modulates the generated one-time password into ultrasonic waves by a predetermined modulation method (step S14), and outputs it from the speaker 206 (step S15).

  In the notebook PC 10A, the DSP 118 demodulates the password from the ultrasonic wave when the ultrasonic wave is input from the microphones 105a and 105b (“Yes” in step T13) (step T14). Further, the DSP 118 generates a one-time password using the above-described common arithmetic expression based on the current time when the ultrasonic waves are input to the microphones 105a and 105b (step T15), and the direction of the ultrasonic sound source. Is calculated (step T16). Note that the DSP 118 has a delay time from when the one-time password is generated by the remote authentication application 212c until the ultrasonic waves for authentication are input to the microphones 105 and 105b with respect to the current time when the one-time password is generated. May be corrected.

  The BIOS 112a determines whether or not the password demodulated by the DSP 118 matches the time password generated by the DSP 118 (step T17). If the password demodulated by the DSP 118 and the time password generated by the DSP 118 do not match (“No” in step T17), the BIOS 112a determines that user authentication has failed (step T20).

  When the password demodulated by the DSP 118 matches the time password generated by the DSP 118 (“Yes” in step T17), the BIOS 112a determines that the direction of the ultrasonic sound source calculated by the DSP 118 is within a predetermined angle range with respect to the notebook PC 10A. It is determined whether it is within (step T18). If the direction of the ultrasonic sound source is not within the predetermined angle range with respect to the notebook PC 10A (“No” in step T18), the BIOS 112a determines that the user authentication has failed (step T20). On the other hand, when the direction of the ultrasonic sound source is within a predetermined angle range with respect to the notebook PC 10A (“Yes” in step T18), the BIOS 112a authenticates the user (step T19).

  The DSP 118 calculates the position of the ultrasonic sound source, and the BIOS 112a matches the password demodulated by the DSP 118 and the time password generated by the DSP 118, and the direction of the ultrasonic sound source is within a predetermined angle range. The user may be authenticated when the ultrasonic sound source is within a predetermined distance from the notebook PC 10A.

  As described above, according to the first embodiment, the user authentication process is started from the computing device 10 side in the case of the computing device 10 that is moved and used (for example, the notebook PC 10A and the tablet 10B). Is possible.

  Further, according to the first embodiment, since user authentication is performed using the DSP 218 having the wake on voice function, the wake on voice function is a function that is normally provided in the smartphone 20A. For example, the power consumption can be reduced as compared with the case where user authentication is performed using Bluetooth (registered trademark).

(Example 2)
With reference to FIG.8 and FIG.9, the user authentication system 1 which concerns on Example 2 is demonstrated. In the second embodiment, it is assumed that the computing device 10 is used at a fixed position (for example, the desktop PC 10C), and user authentication processing is started from the terminal device 20 side. In the second embodiment, an example in which the computing device 10 and the terminal device 20 are applied to a desktop PC 10C and a smartphone 20A will be described.

  FIG. 8 is a schematic external configuration diagram of the user authentication system 1 according to the second embodiment. As shown in FIG. 8, the user authentication system 1 includes a desktop PC 10C that performs user authentication and a smartphone 20A that is used for user authentication of the desktop PC 10C.

  As shown in FIG. 8, the desktop PC includes a main body 301, an LCD 302 connected to the main body 301, and an input unit 303 such as a keyboard device connected to the main body 301. The hardware configuration of the desktop PC 10C is the same as that of the notebook PC 10A shown in FIG. 4 except that the LCD 302 and the input unit 303 are externally connected, and thus the description thereof is omitted. Further, the external appearance configuration and hardware configuration of the smartphone 20A are the same as those shown in FIGS.

  FIG. 9 is a flowchart for explaining an example of user authentication processing executed by the user authentication system 1 according to the second embodiment. User authentication processing executed by the user authentication system 1 according to the second embodiment will be described with reference to the flowchart of FIG. In FIG. 9, steps that perform the same processing as in FIG. 7 are given the same step numbers.

  In FIG. 9, in the smartphone 20A, when the remote authentication application 212cc detects proximity to the desktop PC 10C and a predetermined action (“Yes” in step S20), an output from the timing circuit 219 is performed using the above-described arithmetic expression. A one-time password based on the current time is generated (step S13).

  The remote authentication application 212c monitors the sensor data (acceleration data, angular velocity data, magnetic data) detected by the motion sensor unit 225, the position information acquired by the GPS positioning unit 226, and the like, and the terminal device 20 It is possible to detect the proximity to the desktop PC 10C and a predetermined motion. For example, the remote authentication application 212c detects the proximity of the user carrying the smartphone 20A (smartphone 20A) to the desktop PC 10C (for example, entering the room where the desktop PC 10C is placed), and as a predetermined action, for example, When an operation of stopping (in front of the desktop PC 10C), an operation of sitting on a chair, an operation of placing the smartphone 20A on a desk, or the like is detected, an ultrasonic wave for authentication may be transmitted.

  In accordance with an instruction from the remote authentication application 212c, the DSP 218 modulates the generated one-time password into ultrasonic waves by a predetermined modulation method (step S14), and outputs it from the speaker 206 (step S15).

  In the notebook PC 10A, the DSP 118 demodulates the password from the ultrasonic wave when the ultrasonic wave is input from the microphones 105a and 105b (“Yes” in step T13) (step T14). Further, the DSP 118 generates a one-time password based on the time when the ultrasonic waves are input from the microphones 105a and 105b using the above-described common arithmetic expression (step T15), and sets the direction of the ultrasonic sound source Calculate (step T16).

  The BIOS 112a determines whether or not the password demodulated by the DSP 118 matches the time password generated by the DSP 118 (step T17). If the password demodulated by the DSP 118 and the time password generated by the DSP 118 do not match (“No” in step T17), the BIOS 112a determines that user authentication has failed (step T20).

  When the password demodulated by the DSP 118 matches the time password generated by the DSP 118 (“Yes” in step T17), the BIOS 112a determines that the direction of the ultrasonic sound source calculated by the DSP 118 is within a predetermined angle range with respect to the desktop PC 10C. Is determined (step T18). When the direction of the ultrasonic sound source is not within the predetermined angle range with respect to the desktop PC 10C (“No” in step T18), the BIOS 112a determines that user authentication has failed (step T20). On the other hand, when the direction of the ultrasonic sound source is within a predetermined angle range with respect to the desktop PC 10C (“Yes” in step T18), the BIOS 112a authenticates the user (step T19).

  As described above, according to the second embodiment, the user authentication process can be started from the terminal device 20 side in the case of the computing device 10 of a type used at a fixed position (for example, the desktop PC 10C). Become.

1 User Authentication System 10 Computing Device 10A Notebook PC
10B Tablet 10C Desktop PC
DESCRIPTION OF SYMBOLS 11 Microphone module 12 Speaker 13 Signal processing part 14 User authentication part 20 Terminal device
20A Smartphone 20B Mobile phone terminal 20C Smart watch 21 Speaker 22 Microphone 23 Detection unit 24 Signal processing unit 105a, 105b Microphone 106 Speaker 111 CPU
112 ROM
112a BIOS
113 Memory 114 Storage 117 Audio Device 118 DSP
120 clock circuit 130 OS
205 Microphone 206 Speaker 210 Control unit 211 Memory 212 Storage 212a OS
212c Remote authentication application 217 Audio device 219 Timing circuit 225 Motion sensor unit 226 GPS positioning unit

Claims (14)

A user authentication system for performing user authentication of a computing device using a terminal device,
An output step in which the terminal device outputs a first sound for authentication from a speaker when a predetermined event occurs;
An authentication step of authenticating a user when the first sound is input to a microphone module mounted on the computing device;
Only including,
The predetermined event is a case where a second sound output from a speaker of the computing device is input to a microphone of the terminal device,
The user authentication system , wherein the computing device outputs the second sound when the computing device is powered on, resumes from a suspended state, or releases a lock screen .   2. The user authentication system according to claim 1, wherein in the authentication step, the user is not authenticated when the direction of the sound source of the first sound is not within a predetermined angle range with respect to the computing device.   3. The user authentication system according to claim 1, wherein, in the authentication step, the user is not authenticated when the sound source of the first sound is a predetermined distance or more away from the computing device.   The user authentication system according to any one of claims 1 to 3, wherein the predetermined event is a case where the terminal device approaches the computing device and further detects a predetermined motion. At least the first sound, the user authentication system according to any one of claims 1-4, characterized in that the non-audible sound. The computing device, laptop PC, a desktop PC, or a tablet, the terminal device, a smart phone, according to any one of claims 1-5, characterized in that the mobile telephone terminal, or a smart watch User authentication system. A computing device that performs user authentication using a terminal device,
A microphone module;
Speakers,
User authentication means for authenticating a user when a first sound for authentication output when a predetermined event occurs in the terminal device from the microphone module ;
Bei to give a,
The predetermined event is a case where a second sound output from a speaker of the computing device is input to a microphone of the terminal device,
The computing device outputs the second sound when the power is turned on, the computer returns from the suspended state, or the lock screen is released . Furthermore, the signal processing means for determining the direction of the sound source of the first sound input from the microphone module,
The computing device according to claim 7 , wherein the user authentication unit does not authenticate the user when the direction of the sound source of the first sound is not within a predetermined angle range with respect to the computing device. A terminal device used when user authentication is performed on a computing device,
With a microphone,
Speakers,
A signal processing means for outputting a first sound for authentication from the speaker when a predetermined event occurs;
Bei to give a,
The predetermined event is a case where a second sound output from a speaker of the computing device is input to a microphone of the terminal device,
The computing device outputs the second sound when the power is turned on, the computer returns from the suspended state, or the lock screen is released . And a detection unit for detecting proximity to the computing device and a predetermined motion,
The terminal device according to claim 9 , wherein the predetermined event is a case where the detection unit detects proximity to the computing device and a predetermined motion. A computing device method for performing user authentication using a terminal device, comprising:
A step of authenticating a user when a first sound for authentication output when a predetermined event occurs from the microphone module is input from the microphone module;
Only including,
The predetermined event is a case where a second sound output from a speaker of the computing device is input to a microphone of the terminal device, and the computing device returns from the power ON and suspend state. Or outputting the second sound when releasing the lock screen . A terminal device method used when user authentication is performed on a computing device,
When a predetermined event occurs, it looks including the step of outputting a first sound for authentication from the speaker,
The predetermined event is a case where a second sound output from a speaker of the computing device is input to a microphone of the terminal device, and the computing device is turned on, resumed from a suspended state, or The method of outputting the second sound when releasing the lock screen . A program installed in a computing device that performs user authentication using a terminal device,
When a first sound for authentication output when a predetermined event occurs from the microphone module is input from the microphone module, the computer is caused to execute a step of authenticating the user ,
The predetermined event is a case where a second sound output from a speaker of the computing device is input to a microphone of the terminal device, and the computing device returns from the power ON and suspend state. Or a computer-executable program for outputting the second sound when releasing the lock screen . A program installed in a terminal device used when user authentication is performed on a computing device,
Causing a computer to execute a step of outputting a first sound for authentication from a speaker when a predetermined event occurs ;
The predetermined event is a case where a second sound output from a speaker of the computing device is input to a microphone of the terminal device, and the computing device is turned on, resumed from a suspended state, or A computer-executable program for outputting the second sound when releasing the lock screen .

Images