JP2015170277A - Server device, information processing system and information processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reduce the labor of a user in authentication of the user using sound.SOLUTION: Sound emission instruction means 301 transmits authentication sound data indicating authentication sound used in authentication to a first device 10 and instructs it to emit the authentication sound. Sound emission means 103 emits authentication sound indicated by authentication sound data transmitted from a server device 30. Sound collection means 201 collects sound in the periphery. Transmission means 203 transmits collection sound data indicating collection sound and user identification data identifying a user to the server device 30. Sound authentication means 302 authenticates the user identified by the user identification data transmitted together with the collection sound data if the authentication sound is included in the collection sound indicated by the transmitted collection sound data. Processing instruction means 303 instructs the first device 10 to perform processing in accordance with the user in a case in which the user is authenticated by the sound authentication means 302.

Description

  The present invention relates to a technique for authenticating a user.

  There are techniques for authenticating users. In Patent Document 1, an electronic settlement terminal collects a melody sound on which a card number emitted from a mobile phone is superimposed, and sends an audio signal representing the melody sound to an authentication device together with a password input by a user. A technique is described in which authentication is performed using a card number extracted from an audio signal and a transferred password by an authentication apparatus.

JP 2010-21777 A

The invention of Patent Document 1 authenticates a user using the collected melody sound, but the user not only collects the melody sound on the electronic payment terminal but also needs to input a password, which is troublesome. It depends.
Therefore, an object of the present invention is to reduce the effort of the user in authenticating the user using sound.

  In order to achieve the above object, according to the present invention, a sound emission instructing means for instructing to transmit authentication sound data indicating an authentication sound used for authentication to the first device and to emit the authentication sound, and a second device When the collected sound data indicating the collected sound and the user identification data for identifying the user are transmitted from the second device, if the authentication sound is included in the sound indicated by the collected sound data, the user identification is performed. Provided is a server device including sound authentication means for authenticating a user identified by data.

Further, the sound emission instructing means may instruct to emit different authentication sounds at the first time and the second time.
Furthermore, when the first device and the second device perform predetermined wireless communication, a communication authentication means for authenticating the user, a case where the user is authenticated by the sound authentication means, and a case where the user is authenticated by the communication authentication means You may provide the process instruction | indication means which instruct | indicates to the said 1st apparatus to perform the process from which a content differs mutually when it authenticates.

  In addition, the present invention provides the server device, sound emitting means for emitting the authentication sound indicated by the authentication sound data transmitted from the server device, and processing according to the user when the user is authenticated. A first device comprising processing means for performing, sound collecting means for collecting ambient sounds, acquisition means for obtaining the user identification data, collected sound data indicating the sound collected by the sound collecting means, There is provided an information processing system including a second device including a transmission unit that transmits user identification data acquired by an acquisition unit to the server device.

In addition, the first device notifies the server device that proximity has been detected when proximity is detected by the proximity detector and the proximity detector that detects that the user has approached the device. Notification means, and the sound emission instruction means of the server device may instruct the release of the authentication sound when notified from the notification means.
The first device further includes a departure detection unit that detects that the user has left the area close to the device, and the processing unit uses the resource of the device as a process instructed by the server device. A process for creating a possible state may be performed, and when a separation is detected by the separation detection unit, a process for terminating the state may be performed.

In the first apparatus, the sound emitting means repeatedly emits the authentication sound at a predetermined time interval, and the processing means can use the resource of the own apparatus as processing instructed by the server apparatus. Processing for creating a state may be performed, and the state may be terminated when the instruction is not repeated at the interval.
Further, the second device includes a communication unit that performs predetermined wireless communication with the first device, and a measurement unit that measures reception intensity in wireless communication by the communication unit, and the sound collection unit includes the measurement unit. The sound collection may be started or ended depending on the reception intensity measured by.

  The present invention also includes a sound emission instruction step in which the server device transmits authentication sound data indicating an authentication sound used for authentication to the first device and instructs to emit the authentication sound, and the second device collects the sound emission instruction step. When the collected sound data indicating the sound and the user identification data for identifying the user are transmitted from the second device, if the authentication sound is included in the sound indicated by the collected sound data, the user identification data There is provided an information processing method including a sound authentication step for authenticating a user to be identified.

  ADVANTAGE OF THE INVENTION According to this invention, the user's effort in the authentication of the user using a sound can be reduced.

The figure which shows the whole structure of the information processing system which concerns on embodiment The figure which shows the hardware constitutions of a 1st apparatus. The figure which shows the hardware constitutions of a 2nd apparatus. The figure which shows the hardware constitutions of the server device The figure which shows an example of the function structure which each apparatus implement | achieves Sequence diagram showing an example of operation of each device in authentication processing The figure which shows an example of the function structure which each apparatus of a modification implement | achieves The figure which shows an example of the function structure which the 1st apparatus of a modification implement | achieves. The figure which shows an example of the function structure which the 2nd apparatus of a modification implement | achieves.

[1] Embodiment [1-1] Overall Configuration FIG. 1 is a diagram illustrating an overall configuration of an information processing system 1 according to an embodiment. The information processing system 1 includes a first device 10, a second device 20, a server device 30, and a network 2. The network 2 includes a mobile communication network and the Internet, and is a system that mediates data exchange between devices. The first device 10, the second device 20, and the server device 30 are connected to the network 2, and data is exchanged between the devices.

  The first device 10 is a device such as a desktop or notebook personal computer or a tablet terminal, and is used by a user. The first device 10 is, for example, a device owned by the user, but may be a device used as a digital signage or a KIOSK terminal. In the present embodiment, the first device 10 performs wireless communication (hereinafter referred to as “BT communication”) using Bluetooth (registered trademark) in addition to performing wired communication with the network 2. The first device 10 includes a speaker and emits sound from the speaker. Further, the first device 10 authenticates the user by inputting a user ID (Identification) and a password from a state in which the user cannot use the device immediately after turning on the power (for example, “password authentication”). In other words, a so-called login process is performed to make the device usable by the user.

  The second device 20 is a device used by the user in the same manner as the first device 10, and is, for example, a mobile phone or a smartphone. In the present embodiment, the second device 20 performs the above-described BT communication in addition to performing wireless communication with the network 2 by mobile communication. The second device 20 is a device having a size and weight that can be carried by the user, and moves with the user. The second device 20 includes a microphone and collects ambient sounds input to the microphone.

  The server device 30 is a device that performs user authentication in cooperation with the first device 10 and the second device 20. Specifically, the server device 30 causes the first device 10 to emit a sound used for authentication (hereinafter referred to as “authentication sound”), and authenticates the user when the second device 20 collects the authentication sound. Hereinafter, the user authentication using the authentication sound performed by the server device 30 is referred to as “sound authentication”. When the sound authentication is performed, the server device 30 instructs the first device 10 to perform a login process even if password authentication is not performed, for example.

[1-2] Hardware Configuration FIG. 2 is a diagram illustrating a hardware configuration of the first device 10. The first device 10 is a computer that includes a control unit 11, a storage unit 12, a first communication unit 13, a second communication unit 14, a sound input / output unit 15, a display unit 16, and an operation unit 17. is there. The control unit 11 includes a central processing unit (CPU), a read only memory (ROM), a random access memory (RAM), and a real time clock. The CPU controls the operation of each device by executing a program stored in the ROM or the storage unit 12 using the RAM as a work area. The real time clock has a function of calculating the current date and time. The storage unit 12 includes a hard disk or the like, and stores data, programs, and the like used by the control unit 11 for control.

  The first communication unit 13 includes a communication circuit for performing wired communication, for example, and performs communication via the network 2. The 2nd communication part 14 has a communication circuit for performing BT communication mentioned above, for example, performs BT communication with the 2nd apparatus 20. FIG. In addition, the second communication unit 14 generates data representing the reception intensity of radio waves in BT communication (hereinafter referred to as “reception intensity data”) and supplies the data to the control unit 11. The sound input / output unit 15 includes a speaker, a microphone, a sound processing circuit, and the like, emits sound from the speaker under the control of the control unit 11, and supplies sound data indicating sound input to the microphone to the control unit 11. The display unit 16 includes, for example, a liquid crystal display, and displays an image under the control of the control unit 11. The operation unit 17 includes a touch sensor, a button, and the like, accepts a user operation, and supplies operation data indicating the content of the operation to the control unit 11. The control unit 11 performs processing according to the supplied operation data.

  FIG. 3 is a diagram illustrating a hardware configuration of the second device 20. The second device 20 is a computer that includes a control unit 21, a storage unit 22, a first communication unit 23, a second communication unit 24, a sound input / output unit 25, a display unit 26, and an operation unit 27. is there. The storage unit 22 includes a flash memory or the like, and is a storage unit that stores data, programs, and the like used by the control unit 21 for control. The first communication unit 23 includes a communication circuit for performing mobile communication, for example, and performs wireless communication with the network 2. Each other part has the same configuration as each part having the same name shown in FIG.

FIG. 4 is a diagram illustrating a hardware configuration of the server device 30. The server device 30 includes a control unit 31, a storage unit 32, and a communication unit 33. Each of these parts has the same configuration as each part of the same name shown in FIG.
The information processing system 1 performs an authentication process for authenticating a user based on the above hardware configuration.

[1-3] Functional Configuration Programs for performing authentication processing are stored in the storage units of the first device 10, the second device 20, and the server device 30, respectively. The control unit of each device executes these programs to control the hardware of each device, thereby realizing the functions described below.
FIG. 5 is a diagram illustrating an example of a functional configuration realized by the first device 10, the second device 20, and the server device 30. The first device 10 includes proximity detection means 101, notification means 102, sound emission means 103, and processing means 104. The second device 20 includes a sound collection unit 201, an acquisition unit 202, and a transmission unit 203. The server device 30 includes a sound emission instruction unit 301, a sound authentication unit 302, and a processing instruction unit 303.

[1-3-1] Proximity Detection Unit The proximity detection unit 101 is a unit that detects that a user has approached the device. In the present embodiment, the proximity detection unit 101 detects the proximity of the user when the radio wave reception intensity in the BT communication indicated by the above-described reception intensity data is changed from being less than the threshold value to being greater than or equal to the threshold value. In this detection method, the proximity of the user can be detected when the user is carrying the second device 20. The threshold value used in this detection method is determined according to the degree of proximity of the user. For example, when it is desired to detect that the user has approached 1 m (meters), the average of a plurality of measured values of the reception intensity of the second communication unit 14 when the distance between the first device 10 and the second device 20 is 1 m. Is defined as a threshold value.

  Note that the proximity detection unit 101 may detect the proximity of the user by other methods. For example, if the device includes a human sensor that detects a person using infrared rays, ultrasonic waves, visible light, or the like, the proximity detection unit 101 outputs a result representing the proximity of the user. The proximity of the user is detected. In addition, if the apparatus includes an imaging unit that captures an image, the proximity detection unit 101 recognizes, for example, the contour of a human face from the image captured by the imaging unit, and the size of the recognized contour (number of pixels). The proximity of the user is detected when becomes equal to or greater than the threshold. The proximity detection unit 101 has a function of performing so-called face authentication and voice authentication, and may detect the proximity of the user when each authentication is performed. When the proximity detection unit 101 detects the proximity of the user, the proximity detection unit 101 supplies detection data indicating that the proximity has been detected to the notification unit 102.

[1-3-2] Notification Unit When the proximity detection unit 101 detects proximity, the notification unit 102 is a unit that notifies the server device 30 that the proximity has been detected. The notification unit 102 stores a destination (IP (Internet Protocol) address, etc.) of the server device 30 in advance, and when detection data is supplied from the proximity detection unit 101, the detection data is directed to the destination of the server device 30. To send. When the server device 30 receives the detection data, the server device 30 is notified that proximity of the user has been detected.

[1-3-3] Sound Release Instruction Unit The sound emission instruction unit 301 is a unit that sends authentication sound data indicating an authentication sound to the first device 10 and instructs to emit the authentication sound. When the notification from the notification unit 102 is received, the sound emission instruction unit 301 instructs the release of the authentication sound. In the present embodiment, the sound emission instructing unit 301 stores reference sound data indicating a sound composed of a non-audible frequency component (that is, a sound having no audible frequency component) as a reference sound serving as a reference sound for the authentication sound. ing.

  When receiving the detection data transmitted from the notification unit 102, the sound emission instructing unit 301 includes a component of a predetermined frequency band of the sound indicated by the reference sound data (which is a frequency band of a non-audible range in this embodiment). For example, time information indicating the time when the detection data is received is superimposed using a known algorithm. Hereinafter, this algorithm is referred to as a “superimposition algorithm”, and a frequency band in which time information is superimposed by the superposition algorithm is referred to as a “superimposition band”. The sound emission instructing means 301 generates authentication sound data indicating the sound on which the time information is superimposed in this way as the authentication sound. In this embodiment, the authentication sound is also a sound that does not have an audible frequency component.

  The sound emission instructing unit 301 transmits the generated authentication sound data and the sound emission instruction data instructing the emission of the authentication sound indicated by the authentication sound data to the first device 10 in association with each other. Thereby, an instruction to release the authentication sound from the sound emission instructing unit 301 to the first device 10 is issued. The sound emission instructing unit 301 supplies time information superimposed on the authentication sound instructing sound emission to the sound authentication unit 302.

  Thus, time information that differs depending on the time when the detection data is received is superimposed on the authentication sound instructed to be released. For example, the authentication sound instructed to be released at 12:00:01 becomes an authentication sound different from the authentication sound instructed to be released at 12:00:00. In this way, the sound emission instructing unit 301 authenticates differently at the first time (in this example, 12:00:00) and at a second time different from the first time (in this example, 12:00:01). Instruct to emit sound. In the present embodiment, the sound emission instructing unit 301 instructs to emit a different authentication sound every time unless two or more instructions are given at the same time.

[1-3-4] Sound emitting means The sound emitting means 103 is a means for emitting the authentication sound indicated by the authentication sound data transmitted from the server device 30. When the sound emission means 103 receives the sound emission instruction data transmitted in association with the authentication sound data from the server device 30, the sound emission means 103 emits the authentication sound indicated by the received authentication sound data as indicated by the sound emission instruction data. To do.

[1-3-5] Sound Collection Unit The sound collection unit 201 is a unit that collects ambient sounds. Hereinafter, the sound collected by the sound collection means 201 is referred to as “collected sound”. The sound collection unit 201 collects, for example, sounds input to the microphone during a predetermined time (such as 0.5 seconds) at predetermined time intervals (such as every 1 second) as ambient sounds, and collects the collected sound. Is sent to the transmission means 203. If the second device 20 is located close to the first device 10 to the extent that the authentication sound emitted from the first device 10 can be collected, the collected sound indicated by the collected sound data includes the authentication sound. become. On the other hand, if the second device 20 is located farther than that, the collected sound indicated by the collected sound data does not include the authentication sound.

[1-3-6] Acquisition Unit The acquisition unit 202 is a unit that acquires user identification data for identifying a user. In the present embodiment, user identification data (for example, a user ID) is stored in the storage unit 22 of the second device 20. In this case, the acquisition unit 202 acquires user identification data by reading from the storage unit 22, and supplies the acquired user identification data to the transmission unit 203.

[1-3-7] Transmission Unit The transmission unit 203 is a unit that transmits the collected sound data and the user identification data described above to the server device 30. For example, the transmission unit 203 stores the destination of the server device such as an IP address in advance, and when the collected sound data is supplied from the sound collection unit 201, the transmission unit 203 stores the destination together with the user identification data supplied from the acquisition unit 202. The data is transmitted to the destination, that is, the server device 30. Note that the transmission means 203 adds the same identification information (several digits, symbols, etc.) to the collected sound data and the user identification data so that it can be understood that both data correspond to each other. May be sent separately.

[1-3-8] Sound Authentication Unit When the collected sound data and the corresponding user identification data are transmitted from the second device 20, the sound authentication unit 302 adds the authentication sound to the collected sound indicated by the collected sound data. Is included, it is means for authenticating the user identified by the user identification data. The sound authentication unit 302 stores, for example, superimposition band data indicating the above-described superimposition band (frequency band on which time information is superimposed), and the component of the superimposition band indicated by the superimposition band data from the collected sound indicated by the collection sound data. Cut out.

  The sound authentication unit 302 extracts information from the extracted component of the superimposed band using an algorithm for extracting information superimposed on the sound from the sound (hereinafter referred to as “extraction algorithm”, which corresponds to the above-described superposition algorithm). If the extracted information represents the time indicated by the time information supplied from the sound emitting instruction unit 301, the sound authenticating unit 302 determines that the collected sound indicated by the collected sound data includes the authentication sound, The user identified by the transmitted user identification data is authenticated. In this way, the above-described sound authentication (user authentication using authentication sound) is performed. If the extracted information does not represent the time, the sound authenticating unit 302 determines that the authentication sound is not included in the collected sound indicated by the collected sound data, and does not authenticate the user. The sound authentication unit 302 supplies authentication result data indicating the authentication result to the processing instruction unit 303.

[1-3-9] Processing Instruction Unit When the user is authenticated by the sound authentication unit 302, the processing instruction unit 303 responds to the user indicated by the user identification data corresponding to the collected sound data used for the authentication. It is means for instructing the first apparatus 10 to perform processing (hereinafter referred to as “user response processing”). In the present embodiment, the processing instruction unit 303 instructs the above-described login processing (processing for making the own device usable by the user) as user-corresponding processing. Specifically, when the authentication result data indicating the result of authenticating the user is supplied, the processing instruction unit 303 transmits processing instruction data instructing execution of the login process to the first device 10. The process instruction unit 303 instructs the first apparatus 10 to execute the login process in this way.

[1-3-10] Processing Unit The processing unit 104 is a unit that performs a user response process corresponding to a user when the user is authenticated. In this embodiment, when the processing instruction data transmitted from the server device 30 is received, the processing means 104 performs a login process as indicated by the processing instruction data even if the user ID and password are not input. As a result, the first device 10 can be used by the user.

[1-4] Operation The information processing system 1 performs the above-described authentication process based on the above configuration. Below, operation | movement which each apparatus with which the information processing system 1 is provided in an authentication process is demonstrated.
FIG. 6 is a sequence diagram illustrating an example of the operation of each device in the authentication process. In the example of FIG. 6, the authentication process is started when a user who owns the second device 20 approaches the first device 10.

  First, the first device 10 detects the proximity of the user (step S11), and notifies the server device 30 that the proximity of the user has been detected (step S12). Step S11 is an operation performed by the proximity detection unit 101, and step S12 is an operation performed by the notification unit 102. Upon receiving the notification in step S12, the server device 30 generates authentication sound data indicating the authentication sound and transmits it to the first device 10, thereby instructing the release of the authentication sound (step S13). The first device 10 emits the authentication sound indicated by the authentication sound data received in step S13 (step S14). Step S13 is an operation performed by the sound emission instructing unit 301, and step S14 is an operation performed by the sound emission unit 103.

  When the program for performing the authentication process is activated, the second device 20 repeatedly collects surrounding sounds at predetermined time intervals (step S21). The second device 20 acquires user identification data (step S22). Step S21 is an operation performed by the sound collection unit 201, and step S22 is an operation performed by the acquisition unit 202. The second device 20 may perform the operation of step S22 each time the operation of step S21 is performed, or performs the operation of step S22 only once after the program is started and continues to use the user identification data acquired there. Also good. The second device 20 transmits collected sound data and user identification data to the server device 30 every time collected sound is collected in step S21 (step S23). Step S23 is an operation performed by the transmission unit 203.

  If the authentication sound is included in the collected sound indicated by the collected sound data transmitted in step S23, the server device 30 authenticates the user identified by the transmitted user identification data (step S24). Step S24 is an operation performed by the sound authentication unit 302. When the server device 30 authenticates the user in step S24, the server device 30 transmits instruction data for instructing execution of the user correspondence processing (login processing in the present embodiment) to the first device 10 (step S25). Step S25 is an operation performed by the processing instruction unit 303. When the first device 10 receives the instruction data in step S25, the first apparatus 10 executes a user handling process as indicated by the instruction data (step S26). In the information processing system 1, the authentication process and the user handling process are performed as described above.

[1-5] Effects According to Embodiment In this embodiment, the user is authenticated when the authentication sound emitted by the first device 10 is included in the collected sound collected by the second device 20. In order to perform sound authentication using the authentication sound in this way, the user only has to carry the second device 20 to a place where the authentication sound can be collected, and separately, for example, a password associated with the user identification data is used. There is no need to perform input operations. According to the present embodiment, compared to a case where such an operation is required, it is possible to reduce the user's trouble in user authentication using sound.

  In the present embodiment, the server device 30 instructs the first device 10 to emit the authentication sound, and the user is authenticated when the emitted authentication sound is included in the collected sound collected by the second device 20. The For this reason, it is not necessary for the first device 10 to store authentication sound data indicating the authentication sound in advance, and it is not necessary to store information superimposed on the authentication sound in advance. As described above, according to the present embodiment, it is possible to perform user authentication using sound even if information common between the server device 30 and the first device 10 is not stored in advance.

  In the present embodiment, the sound emission instruction unit 301 instructs to emit different authentication sounds at the first time and the second time as described above. When sound is used for user authentication, there is a risk that unauthorized authentication may be performed by the third party who recorded the sound. In this embodiment, for example, there is a third party who recorded the authentication sound at the first time. However, unauthorized authentication using the recorded authentication sound cannot be performed at the second time. Thus, according to the present embodiment, it is possible to prevent fraud from being performed more easily in the authentication of a user using sound than when the same authentication sound is always used.

  In the present embodiment, the authentication sound is emitted when the first device 10 detects the proximity of the user. Thereby, it is possible to prevent a third party from recording the authentication sound and using it for unauthorized authentication when there is no user near the first device 10. In this embodiment, a sound having no audible frequency component is used as the authentication sound. Thereby, even if the authentication sound is emitted, it is possible to prevent the user and those around the first device 10 from being concerned.

[2] Modification The above-described embodiment is merely an example of the present invention, and may be modified as follows. Moreover, you may implement combining embodiment mentioned above and each modification shown below as needed.

[2-1] Authentication Sound The sound emission instructing unit 301 generates authentication sound data indicating an authentication sound that does not have an audible frequency component in the embodiment. However, an audible frequency component (for example, a beep sound or a music piece) Authentication sound data indicating an authentication sound including a sound of a person, a human voice, and the like may be generated. Thereby, the user can hear the authentication sound emitted from the first device 10 and can recognize whether or not the authentication sound is emitted.

Moreover, although the sound emission instruction | indication means 301 produced | generated the authentication sound data which shows the authentication sound which superimposed the time information on the reference | standard sound, it is not restricted to this. For example, the sound emission instructing unit 301 generates authentication sound data indicating an authentication sound in which, instead of time information, random number information representing a random number or numerical information representing a numerical value that increases every time an authentication sound is generated is superimposed. May be. In addition, the sound emission instructing unit 301 does not superimpose different information every time, but, for example, an authentication sound indicating an authentication sound with different information superimposed at a predetermined time interval (for example, every minute or every hour). Data may be generated. In short, the sound emission instructing unit 301 only needs to instruct to emit different authentication sounds at least at the first time and the second time. Thereby, even if the authentication sound emitted at the first time is used, the user is not authenticated at the second time, and it is possible to prevent fraud from being performed in the user authentication using the sound.
Note that information may not be superimposed on the authentication sound. A sound authentication method in that case will be described later.

[2-2] Device Identification Data In the embodiment, user identification data for identifying a user is used. However, device identification data for identifying the first device 10 may be used. For example, the sound emission instructing unit 301 may instruct the release of the authentication sound on which the device identification data is superimposed. In this case, when the notification unit 102 of the first device 10 stores the device identification data of the device itself and transmits detection data indicating that proximity has been detected, the device identification data is also transmitted to the server device. . The sound emission instructing unit 301 generates authentication sound data indicating an authentication sound in which the transmitted device identification data is superimposed on the reference data in the same manner as time information and the like.

  The sound authentication unit 302 stores, for example, an identification table indicating a combination of user identification data and device identification data. When the device identification data is included in the information extracted from the component of the superimposed band of the collected sound indicated by the collected sound data (in this case, the collected sound includes the authentication sound), the sound authenticating unit 302 If the user identification data transmitted together with the collected sound data is associated with the device identification data in the identification table, the user identified by the user identification data is authenticated.

  In this modification, for example, even if another person tries to use the first device 10 of the user using his / her second device 20, the device identification data of the first device 10 is associated with the user identification data of the other person. Otherwise, the user is not authenticated. Thus, according to the present modification, it is possible to reduce the possibility that the user's first device 10 is illegally used by another person, as compared with the case where the device identification data is not used.

[2-3] Authentication sound data The sound emission instructing unit 301 uses authentication sound data generated by itself in the embodiment, but is not limited thereto. For example, the sound emission instructing unit 301 may store a plurality of pieces of authentication sound data in advance, and read and use the authentication sound data in order or according to the time of instructing the release. The sound emission instructing unit 301 may acquire the authentication data when instructing the release from the external device that generates or stores the authentication sound data.

[2-4] Sound Authentication Unit The sound authentication unit 302 may perform sound authentication by a method different from the embodiment. For example, the sound emission instructing unit 301 instructs the sound authentication unit 302 to instruct the release of the authentication sound on which no information is superimposed and indicates the authentication sound instructed to release the authentication sound. The sound authenticating means 302 performs pattern matching between the authentication sound indicated by the supplied authentication sound data and the collected sound indicated by the collected sound data transmitted from the second device 20, and the degree of similarity between both sounds is a threshold value. If it is above, it will judge that an authentication sound is contained in a collection sound, and will authenticate a user.

  The sound authentication unit 302 authenticates the user with the authentication sound only after a predetermined time (for example, 1 minute or 5 minutes) elapses after the sound emission instruction unit 301 instructs the emission of the authentication sound. You may make it perform. Hereinafter, the time that limits the time when authentication can be performed is referred to as “time limit”. Thereby, it is possible to further prevent unauthorized authentication by the recorded authentication sound.

  Moreover, the sound authentication means 302 may change the time limit described above. For example, the sound authentication unit 302 sets a short time limit (for example, about 1 minute) when the first device is a portable device (such as a notebook computer or a tablet terminal), and does not carry the device (a desktop personal computer). Etc.), set a long time limit (for example, about 5 minutes). The notification unit 102 may notify the server device which device the first device is. A portable device is easy to use in an environment where another person is nearby, such as in a store, and a non-portable device is easy to use in an environment where there is no other person nearby, such as at home. By changing the time limit as described above, in the former case, the time limit should be shortened to prevent unauthorized authentication, and in the latter case, the time limit should be increased to improve convenience. Can do.

  Furthermore, when the first device or the second device includes positioning means for measuring the position of the own device, the sound authentication unit 302 may change the time limit according to the position of the device. In this case, the first device or the second device transmits positioning data indicating the measurement result of the position of the own device to the server device 30. The sound authentication means 302 stores a range of places where there are many people, such as stores and stations, and authenticates using a long time limit if the position indicated by the transmitted positioning data is not included in the range. If it is included in the range, authentication is performed using a short time limit. Also in this case, it is possible to prevent unauthorized authentication from being performed more easily in the former case, and to improve convenience in the latter case.

[2-5] Two Authentications In the information processing system, in addition to the sound authentication described above, the user may be authenticated by another method.
FIG. 7 is a diagram illustrating an example of a functional configuration realized by each device according to the present modification. In the example of FIG. 7, a server device 30 a including a communication authentication unit 304 in addition to the units illustrated in FIG. 5 is illustrated. The communication authentication unit 304 is a unit that authenticates a user when predetermined wireless communication is performed by the first device 10 and the second device 20. Here, the wireless communication includes the above-described BT communication, wireless LAN (Local Area Network) communication, NFC (Near Field Communication) communication, and the like. Such user authentication using wireless communication is hereinafter referred to as “communication authentication”.

  In the present modification, for example, when the second device 20 performs BT communication with the first device 10, the transmission means 203 transmits the contact data informing that the own device has performed BT communication together with the user identification data to the server. Transmit to device 30a. Upon receiving the contact data transmitted from the second device 20, the communication authentication unit 304 determines that the above-described predetermined wireless communication has been performed, and authenticates the user identified by the transmitted user identification data. The communication authentication unit 304 supplies authentication result data indicating the authentication result to the processing instruction unit 303. The contact data may be transmitted from the first device 10 to the server device 30 instead of from the second device 20. Also in this case, the second device 20 does not transmit contact data, but transmits user identification data.

  The processing instruction unit 303 has different contents depending on whether the user is authenticated by the sound authentication unit 302 (sound authentication is performed) or when the user is authenticated by the communication authentication unit 304 (communication authentication is performed). The first apparatus 10 is instructed to perform user handling processing. Hereinafter, the user response process performed at the time of sound authentication is referred to as “first process”, and the user response process performed at the time of communication authentication is referred to as “second process”. The first process is, for example, the login process described in the embodiment. The second process is, for example, the same login process as the first process, but is a login process that uses fewer resources than the first process. Specifically, in the first process, all functions are used, but in the second process, functions excluding some functions (for example, a function for saving data and a function for rewriting a system file) are used. And so on.

  In sound authentication and communication authentication, when the degree of risk that unauthorized authentication by a user is performed (hereinafter referred to as “danger level”) is different, in other words, the degree of safety that unauthorized authentication is not performed ( (Hereinafter referred to as “safety”) may be different. For example, in communication authentication, communication conforming to a wireless communication standard (such as Bluetooth (registered trademark)) is performed, so when a communication radio wave is received by a third party, the information indicated by the radio wave is decoded. It is easy to be used for unauthorized authentication. On the other hand, in sound authentication, there is no such standard, and if there is no information on the above-described superimposition band and extraction algorithm, even if the authentication sound is recorded, the information superimposed on the authentication sound can be extracted. difficult. That is, sound authentication is less dangerous (higher safety) than communication authentication. According to this modification, it is possible to perform different user handling processes depending on the risk level or safety level of each method (sound authentication and communication authentication) for authenticating a user.

[2-6] First and second processes The first and second processes are not limited to the login process described above. For example, a process that executes a program that requires user authentication (SNS (Social Networking Service) or a program used for e-mail, etc.) while already logged in, or a file that requires user authentication (encrypted file) Etc.) may be performed as the first and second processes. Note that these processes including the login process are processes for creating a state in which resources (programs, files, etc.) of the first device can be used (hereinafter referred to as “resource processes”). In addition to the resource process, the process may be a process of transmitting some data to an external device, a process of notifying the user, or the like. In short, the first and second processes may be any processes as long as they are performed by authenticating the user.

[2-7] Detection of separation When the processing unit 104 of the first device 10 performs the above-described resource processing as the user-corresponding processing, the state created by the resource processing when the user leaves the own device is displayed. It may be terminated.
FIG. 8 is a diagram illustrating an example of a functional configuration realized by the first device of the present modification. In the example of FIG. 8, the first device 10 b including the separation detection unit 105 in addition to the units illustrated in FIG. 5 is illustrated. The leaving detection means 105 is means for detecting that the user has left the area close to the device (hereinafter referred to as “proximity area”). For example, when the reception strength in the BT communication of the second communication unit 14 is less than the threshold value, the leaving detection unit 105 detects that the user has left the proximity area and sends detection data indicating that to the processing unit 104. Supply. The method for detecting separation is not limited to this, and a method using a human sensor described in the description of the proximity detection unit, a method for recognizing a captured image, or the like may be used.

  The processing unit 104 performs processing (hereinafter referred to as “end processing”) for ending the state created by the resource processing (first or second processing) described above when the disconnection detection unit 105 detects the disconnection. Specifically, for example, when the log-in process is performed as a user-corresponding process, the processing unit 104 performs a log-off process or a shutdown process as an end process when separation is detected. In addition, when the processing unit 104 performs processing for executing a program for SNS or e-mail as user-corresponding processing, the processing unit 104 performs processing for ending those programs as end processing, and processing for opening an encrypted file Is performed as a user-corresponding process, the process of closing the file is performed as an end process. According to this modification, it is possible to prevent an unauthorized use of a resource that can be used by the first device while the user is away from the first device.

[2-8] Repeated authentication In the information processing system, the above-described sound authentication may be repeated. In the present modification, the sound emitting means 103 repeatedly emits the authentication sound at a predetermined time interval (for example, every 10 seconds, hereinafter referred to as “authentication interval”). Further, the processing unit 104 performs the above-described resource processing as the processing instructed from the server device 30, and the resource by the resource processing can be used when the processing instruction from the server device 30 is not repeatedly performed at the authorized interval. End the state. In other words, the processing unit 104 maintains a state where resources can be used while a processing instruction is given at an authentication interval.

  In this modification, the user can use the above resources while sound authentication is repeatedly performed, but cannot use the resources when sound authentication is not repeatedly performed. That is, the user must maintain a state in which the second device 20 can collect the authentication sound in order to continue using the resource. Therefore, even when a third party temporarily borrows the second device while the user is away from the user and performs user authentication, the user cannot continue using the second device unless he / she continues to hold the second device. Can prevent unauthorized use.

[2-9] Sound Collection Period The sound collection means 201 of the second device collects surrounding sounds at predetermined time intervals in the embodiment, but is not limited thereto.
FIG. 9 is a diagram illustrating an example of a functional configuration realized by the second device of the present modification. In the example of FIG. 9, a second device 20 c including a measuring unit 204 in addition to the units illustrated in FIG. 5 is illustrated. The measuring unit 204 is a unit that measures the reception intensity in the wireless communication by the communication unit that performs predetermined wireless communication with the first device. The communication means here is an example of the second communication unit 24 shown in FIG. 3, and performs BT communication with the first device 10 as predetermined wireless communication. The measuring unit 204 measures the reception intensity indicated by the reception intensity data generated by the second communication unit 14 as the reception intensity in BT communication. The measuring unit 204 measures the reception intensity at a predetermined time interval (for example, every 0.5 seconds), and supplies measurement data indicating the measured reception intensity to the sound collecting unit 201 each time it is measured.

  The sound collection unit 201 starts and ends sound collection according to the reception intensity measured by the measurement unit 204. For example, the sound collection unit 201 stores a first threshold value and a second threshold value (the second threshold value is a value equal to or lower than the first threshold value) as a threshold value of the reception intensity. The sound collection unit 201 starts collecting sound when the reception intensity indicated by the measurement data supplied from the measurement unit 204 is equal to or higher than the first threshold value. As the first threshold value, the value of the reception intensity when the first device 10 and the second device 20 are separated from each other by a predetermined distance (for example, 2 m or 5 m) may be used. As a result, compared to the case where an operation for starting sound collection (hereinafter referred to as “start operation”) is required, the user's trouble is reduced, and the user who has forgotten the start operation performs the user handling process. You can avoid wasting time until you realize that you don't.

  In addition, the sound collection unit 201 ends the sound collection when the reception intensity indicated by the measurement data becomes less than the second threshold after starting the sound collection. As a result, compared with the case where an operation for ending sound collection (hereinafter referred to as “end operation”) is required, the user's trouble is reduced, and the user forgets the end operation and is away from the first device. However, it is possible to prevent the waste of power of the second device by continuing to collect sound. In the above example, the sound collection unit 201 performs both the start and the end of the sound collection according to the reception intensity. However, only one of these may be performed.

[2-10] Processing According to Distance In the information processing system, processing according to the distance between the first device and the second device (hereinafter referred to as “inter-device distance”) may be performed. In this modification, for example, the measurement unit 204 shown in FIG. 9 supplies measurement data to the transmission unit 203, and the transmission unit 203 transmits the measurement data to the server device. When the sound authentication unit 302 authenticates the user, the processing instruction unit 303 of the server apparatus instructs the first apparatus to perform a user handling process corresponding to the received intensity indicated by the transmitted measurement data. Specifically, the processing instruction unit 303 instructs, for example, to perform the above-described first processing when the reception intensity is less than the threshold value, and instructs to perform the second processing when the reception strength is equal to or greater than the threshold value. . As a result, the first process is performed if the inter-device distance is less than the distance at which the reception intensity is a threshold, and the second process is performed if the inter-device distance is equal to or greater than the distance.

  Note that the inter-device distance may be expressed not only from the received intensity but also from the volume of the sound emitted by the first device and the volume of the sound collected by the second device. Further, when the first device includes an imaging unit, the inter-device distance may be expressed from the result of image processing of the captured image. In either case, the processing instruction unit 303 of the server device 30 instructs to perform user processing according to the inter-device distance, and the processing unit 104 of the first device performs user processing according to the inter-device distance. . According to this modification, for example, a login process is performed when the user approaches the first device, and a program that requires user authentication (such as SNS or e-mail) when the user operates the first device 10. As the user approaches the first apparatus, a plurality of user-corresponding processes can be performed, thereby further reducing the labor of the user. It should be noted that depending on where the user places the second device (for example, immediately in front of the first device and in the user's pocket, the edge of the desk, etc.), the distance between the devices changes, and the user response processing to be performed changes. May be.

[2-11] Acquisition Unit The acquisition unit 202 of the second device acquires the user identification data stored in the storage unit 22 of the own device in the embodiment, but is not limited thereto. For example, the acquiring unit 202 may acquire user identification data from the first device. In this case, the first device stores user identification data, transmits the user identification data to the second device by BT communication, and the acquisition unit 202 acquires the user identification data transmitted by BT communication. Alternatively, the first device superimposes and releases the user identification data on the authentication sound, and the acquisition unit 202 extracts and acquires the user identification data from the collected authentication sound.

[2-12] Processing Unit In the embodiment, the processing unit 104 of the first device performs the user handling process based on the instruction from the processing instruction unit 303. A user handling process corresponding to the user may be performed by being notified of the authentication. Further, when the processing unit 104 inquires the server device about the authentication result at a certain timing, the sound authentication unit 302 may transmit authentication result data indicating the authentication result to the first device. As the timing here, a time when a predetermined time (for example, 5 seconds or 10 seconds) elapses after the authentication sound is emitted may be used. As described above, the processing unit 104 may determine what kind of user handling process is performed and when the user handling process is performed.

[2-13] Category of Invention The present invention can be understood as the information processing system, server device, first device, and second device described above. In addition, it can also be regarded as an information processing method for realizing processing performed by these systems and apparatuses. The process here is, for example, the authentication process shown in FIG. The present invention can also be understood as a program for causing a computer such as a server device, a first device, and a second device to function as each unit shown in FIG. These programs are provided in the form of a recording medium such as an optical disk storing the programs, or downloaded in a computer via a network such as the Internet, installed and made available for use. It may be a thing to do.

DESCRIPTION OF SYMBOLS 1 ... Information processing system, 10 ... 1st apparatus, 20 ... 2nd apparatus, 30 ... Server apparatus, 11, 21, 31 ... Control part, 12, 22, 32 ... Memory | storage part, 13, 23 ... 1st communication part, 33: Communication unit, 14, 24 ... Second communication unit, 15, 25 ... Sound input / output unit, 16, 26 ... Display unit, 17, 27 ... Operation unit, 101 ... Proximity detection means, 102 ... Notification means, 103 ... Sound emitting means 104 ... Processing means 105 ... Separation detecting means 201 ... Sound collecting means 202 ... Acquisition means 203 ... Transmission means 204 ... Measurement means 301 ... Sound emitting instruction means 302 ... Sound authentication means 303 ... Processing instruction means 304 ... Communication authentication means

Claims (9)

A sound emission instructing means for transmitting authentication sound data indicating an authentication sound used for authentication to the first device and instructing to emit the authentication sound;
If the collected sound data indicating the sound collected by the second device and the user identification data for identifying the user are transmitted from the second device, the sound indicated by the collected sound data includes the authentication sound. And a sound authentication means for authenticating a user identified by the user identification data. The server device according to claim 1, wherein the sound emission instructing unit instructs to emit the different authentication sounds at a first time and a second time. Communication authentication means for authenticating the user when the first device and the second device perform predetermined wireless communication;
A process instructing unit that instructs the first apparatus to perform different processing depending on whether the user is authenticated by the sound authenticating unit or when the user is authenticated by the communication authenticating unit. The server apparatus according to 1 or 2. The server device according to any one of claims 1 to 3,
A first device comprising: a sound emitting unit that emits an authentication sound indicated by the authentication sound data transmitted from the server device; and a processing unit that performs processing according to the user when the user is authenticated;
Sound collection means for collecting ambient sounds, acquisition means for acquiring the user identification data, collected sound data indicating the sound collected by the sound collection means, and user identification data acquired by the acquisition means An information processing system comprising: a second device including a transmission unit that transmits to the server device. The first device includes:
Proximity detection means for detecting that the user has approached the device,
A notification means for notifying the server device that the detection has been made when proximity is detected by the proximity detection means;
The sound emitting instruction means of the server device is
The information processing system according to claim 4, wherein when there is a notification from the notification unit, an instruction to release the authentication sound is given. The first device includes:
With a leaving detection means for detecting that the user has left the area close to the device,
A process in which the processing unit performs a process for creating a state in which the resource of the own apparatus can be used as a process instructed by the server apparatus, and terminates the state when the disconnection detection unit detects the disconnection. The information processing system according to claim 4 or 5. The first device includes:
The sound emitting means repeatedly emits the authentication sound at a predetermined time interval,
The processing means performs a process for creating a state in which the resource of the own apparatus can be used as a process instructed by the server apparatus, and terminates the state when the instruction is not repeatedly performed at the interval. Item 7. The information processing system according to any one of Items 4 to 6. The second device includes:
Communication means for performing predetermined wireless communication with the first device;
Measuring means for measuring the reception strength in wireless communication by the communication means,
The information processing system according to any one of claims 4 to 7, wherein the sound collection unit starts or ends sound collection according to the reception intensity measured by the measurement unit. A sound emission instructing step in which the server device transmits authentication sound data indicating an authentication sound used for authentication to the first device to instruct to emit the authentication sound; and
If the collected sound data indicating the sound collected by the second device and the user identification data for identifying the user are transmitted from the second device, the sound indicated by the collected sound data includes the authentication sound. And a sound authentication step for authenticating a user identified by the user identification data.

Images