JP7045633B2 - Head-mounted display device, authentication method, and authentication program - Google Patents

Description

The present invention relates to a head-mounted display device, an authentication method, and an authentication program.

User authentication may be performed when starting an information processing device or accessing a computer network or the like. Only when this user authentication is successful, the information processing device can be used and the computer network can be accessed.

For user authentication, for example, input of a password via a keyboard is required. However, in order to prevent password leakage due to the use of a keyboard, user authentication with higher security has also been developed.

As highly secure user authentication, Patent Document 1 detects the line of sight of the user who gazes at the image displayed on the screen, detects the image gazes by the user based on the line of sight, and authenticates the detected image. A display system that authenticates a user is disclosed as information.

Japanese Unexamined Patent Publication No. 2005-149326

In recent years, a head-mounted display device (HMD) that mounts a display on a user's head has begun to spread. In the head-mounted display device, it is assumed that user authentication that detects the user's line of sight as described in Patent Document 1 is used, but authentication with higher security is required.

The present invention has been made in view of such circumstances, and an object of the present invention is to provide a head-mounted display device, an authentication method, and an authentication program capable of performing authentication with higher security.

In order to solve the above problems, the head-mounted display device, the authentication method, and the authentication program of the present invention employ the following means.

In order to solve the above problems, the "head-mounted display device" according to one aspect of the present invention is a head-mounted display device in which a display is mounted on the user's head so that the user can visually recognize the "head-mounted display device". , An object to be displayed in the image display area of the display according to the face orientation detecting means for detecting the face orientation of the user, the line-of-sight detecting means for detecting the line of sight of the user, and the detection result by the face orientation detecting means. The image display control means for changing the above and the authentication object used for authentication are displayed in the image display area according to the operation of the user, and the line-of-sight detecting means indicates that the user has aligned the line of sight with the authentication object. It is provided with an authentication means for performing authentication when it is detected.

In order to solve the above problem, in the "authentication method" which is one aspect of the present invention, a display is attached to the head of the user so that the user can see it, and the orientation of the user's face is detected. An authentication method for a head-mounted display device including a detection means and a line-of-sight detecting means for detecting the line of sight of the user, and an object to be displayed in an image display area of the display according to a detection result by the face-facing detection means. The first step of changing the above and the authentication object used for authentication are displayed in the image display area according to the operation of the user, and the line-of-sight detection means detects that the user has aligned the line of sight with the authentication object. It has a second step of performing certification in the case of such a case.

In order to solve the above problems, the "authentication program", which is one aspect of the present invention, has a face orientation in which a display is attached to the user's head so that the user can see it, and the orientation of the user's face is detected. The object to be displayed in the image display area of the display is changed according to the detection result by the face orientation detecting means of the computer having the detecting means and the head-mounted display device provided with the line-of-sight detecting means for detecting the line of sight of the user. The image display control means to be used and the authentication object used for authentication are displayed in the image display area according to the operation of the user, and the line-of-sight detection means detects that the user has aligned the line of sight with the authentication object. It functions as an authentication means that authenticates in some cases.

Various technical limitations may be added to the above-mentioned "head-mounted display device" as illustrated below. Further, technical limitation to the same effect may be added to the processing step executed by the "authentication method" or the function of the "authentication program".

The authentication object is not displayed in the image display area at the start of authentication, but is displayed in the image display area by the action of the user.

An authentication display area is set in the image display area, and in the authentication means, the authentication object is displayed in the authentication display area according to the operation of the user, and the user looks at the authentication object. Authentication is performed when the line-of-sight detection means detects that the condition is adjusted to.

The user's action is for the user to turn his / her face or for the user to move the authentication object.

The authentication means authenticates based on the detection result by the line-of-sight detecting means and the detection result by the face facing detecting means.

When an existing pre-registered discriminator is displayed on the display, the authentication object is displayed on the display.

The authentication object is an existing discriminator displayed on the display.

When it is detected that the user has turned his / her line of sight to the authentication object for a predetermined time or more, the authentication means starts an authentication operation, and it is detected that the line of sight is deviated from the authentication object for a predetermined time or more. If the user finishes the authentication operation.

The authentication means starts or ends the authentication operation when the user blinks more than a predetermined number of times within a predetermined time.

The authentication means starts or ends the authentication operation when it is detected that the user has moved the head in a predetermined manner.

According to the present invention, there is an effect that more secure authentication can be performed using a head-mounted display.

It is a block diagram of the display system which concerns on 1st Embodiment of this invention. It is a schematic diagram which shows the image display area by HMD which concerns on 1st Embodiment of this invention. It is a functional block diagram which shows the electric structure of the HMD which concerns on 1st Embodiment of this invention. It is a schematic diagram which shows the user authentication using the HMD which concerns on 1st Embodiment of this invention. It is a schematic diagram which shows the display area for authentication which concerns on 1st Embodiment of this invention. It is a flowchart which shows the flow of the user authentication processing which concerns on 1st Embodiment of this invention. It is a schematic diagram which shows the user authentication using the HMD which concerns on 2nd Embodiment of this invention. It is a schematic diagram which shows the user authentication using the HMD which concerns on 3rd Embodiment of this invention. It is a functional block diagram which shows the electric structure of the HMD which concerns on 3rd Embodiment of this invention. It is a flowchart which shows the flow of the user authentication processing which concerns on 3rd Embodiment of this invention.

Hereinafter, an embodiment of a head-mounted display device, an authentication method, and an authentication program according to the present invention will be described with reference to the drawings.

[1. First Embodiment]
Hereinafter, the first embodiment of the present invention will be described.

[1-1. Display system configuration]
FIG. 1 is a configuration diagram of a display system 10 according to the present embodiment.

The display system 10 includes a head-mounted display device (Head Mount Display, hereinafter referred to as “HMD”) 12 and a server 14.

The HMD 12 is provided with a display 16 such as an LCD (Liquid Crystal Display) on the user's head so that the user can see it. As an example, the display 16 is fixed to the user's head by an elastic band 18.

The outer shape of the HMD 12 shown in FIG. 1 is an example, and the display 16 is located in front of both eyes, but the present invention is not limited to this, and an image may be projected onto a lens of glasses such as a glasses type. Further, the image may be visually recognized by one eye instead of being visually recognized by both eyes. Further, the HMD 12 may be either a transmissive type in which the outside world can be visually recognized even when worn by the user, or a non-transmissive type in which the outside world cannot be visually recognized. Further, the image displayed on the display 16 by the HMD 12 may be either virtual reality (VR) or augmented reality (AR). In the HMD 12 according to the present embodiment, VR is displayed on the display 16.

The HMD 12 and the server 14 are capable of transmitting and receiving information via the communication line 20. The HMD 12 may have a communication function for directly accessing the communication line 20, or may access the communication line 20 via another information processing device such as a mobile phone terminal, for example.

The server 14 stores various information such as a program executed by the HMD 12, and sends and receives information to and from the HMD 12 as needed.

As shown in FIG. 2, the HMD 12 is provided with an image display area 22 on the display 16 so as to cover the user's field of view. Various images (also referred to as objects) are displayed in the image display area 22. The image display area 22 according to the present embodiment substantially matches the visual field range of the user wearing the HMD 12.

The HMD 12 according to the present embodiment performs user authentication when the user activates the HMD 12, and enables the user to operate when the user authentication is successful. In the image display area 22, an authentication object 24, which is an object used for user authentication, is displayed. Then, when the line-of-sight detection unit 32 (see FIG. 3) provided in the HMD 12 detects that the user has aligned the line of sight with the authentication object 24, user authentication is performed.

As an example, the authentication object 24 according to the present embodiment is formed of a plurality of elements (hereinafter referred to as “authentication elements”) 26 that are visually recognized at least one or more and are considered to be successful in authentication. Further, the user authentication according to the present embodiment is considered to be successful when the plurality of authentication elements 26 are visually recognized in a predetermined order, but the authentication is not limited to this, and the order in which the plurality of authentication elements 26 are visually recognized is determined. It may not be necessary, or the time for continuing to visually recognize the authentication element 26 may be a condition for successful authentication. The authentication object 24 may be a single image without being formed by a plurality of authentication elements 26.

[1-2. HMD functional block diagram]
FIG. 3 is a functional block diagram showing an electrical configuration of the HMD 12 according to the present embodiment.

In addition to the display 16, the HMD 12 includes a face orientation detection unit 30, a line-of-sight detection unit 32, a main control unit 34, a storage unit 36, and a communication unit 38.

The face orientation detection unit 30 includes, for example, an acceleration sensor, a gyro sensor, or the like, and detects the orientation of the face of the user wearing the HMD 12.

The line-of-sight detection unit 32 includes, for example, a camera that captures the user's eyes, and detects the user's line of sight based on the result of capturing the user's eyes.

The main control unit 34 is, for example, a CPU (Central Processing Unit), a microprocessor, a DSP (Digital Signal Processor), or the like, and controls the operation of the entire HMD 12.

The storage unit 36 is composed of, for example, a RAM (Random Access Memory), a DRAM (Dynamic Random Access Memory), a flash memory, or the like, and has a work area at the time of execution of processing based on various programs by the main control unit 34. Various data such as images and programs used for processing of the main control unit 34 are stored.

The communication unit 38 has a function of connecting to the communication line 20, and is, for example, a NIC (Network Interface Controller), and connects to a communication network such as a mobile phone network. The communication unit 38 has a function of connecting to a wireless LAN (Local Area Network) instead of or together with the NIC, a function of connecting to a wireless WAN (Wide Area Network), for example, a short-range Bluetooth (registered trademark) or the like. It may have a function that enables wireless communication, infrared communication, and the like.

The display 16, the face orientation detection unit 30, the line-of-sight detection unit 32, the main control unit 34, the storage unit 36, and the communication unit 38 are electrically connected to each other via a system bus. Therefore, the main control unit 34 displays an image on the display 16, various processes using the detection results of the face orientation detection unit 30 and the line-of-sight detection unit 32, access to the storage unit 36, and various communications via the communication unit 38. You can access the network and other terminals. In addition to the above configuration, the HMD 12 is provided with a speaker for outputting sound, an earphone jack, a USB (Universal Serial Bus) connector for transmitting / receiving data to / from another information processing device, and the like.

Further, the HMD 12 can be connected to the controller by wire or wirelessly, and user operation using the controller is possible.

The main control unit 34 includes an image display control unit 40 and an authentication processing unit 42. Each unit included in the main control unit 34 is realized by a program stored in the storage unit 36.

The image display control unit 40 outputs data indicating an image (object) to be displayed in the image display area 22 to the display 16. Further, the image display control unit 40 changes the object to be displayed in the image display area 22 according to the detection result by the face orientation detection unit 30.

The authentication processing unit 42 executes a process related to user authentication.

[1-3. User authentication according to the first embodiment]
User authentication according to this embodiment will be described.

In the user authentication according to the present embodiment, when the authentication object 24 is displayed in the image display area 22 according to the user's operation and the line-of-sight detection unit 32 detects that the user has aligned the line of sight with the authentication object 24. Authenticate.

FIG. 4 is a schematic diagram showing user authentication according to the present embodiment, and schematically shows the image space 44 displayed by the HMD 12. Since the HMD 12 according to the present embodiment displays virtual reality (VR), the image space 44 shown in FIG. 4 is a VR space. The area surrounded by the alternate long and short dash line in FIG. 4 is the entire image space 44 that can be visually recognized by the user wearing the HMD 12 by moving his / her head. On the other hand, the area surrounded by the solid line is the image space 44 displayed in the image display area 22, which is the range actually viewed by the user wearing the HMD 12.

As shown in FIG. 4A, the authentication object 24 exists in the image space 44, but is not displayed in the image display area 22 at the start of user authentication. Therefore, the user performs an operation of changing the direction of the face to display the authentication object 24 existing in the image space 44 in the image display area 22 as shown in FIG. 4 (B).

Further, in the user authentication according to the present embodiment, the authentication display area 22A is set in the image display area 22. As shown in FIG. 5, the image display area 22 is quasily divided into an authentication display area 22A and a non-authentication display area 22B. Then, when the authentication object 24 is displayed in the authentication display area 22A, user authentication is performed.

When the authentication object 24 is displayed in the image display area 22, a display prompting the user to display the authentication object 24 in the authentication display area 22A may be performed. For example, the HMD 12 blinks the authentication display area 22A, displays characters and arrows, or makes an announcement by voice so as to prompt the user to put the authentication object 24 into the authentication display area 22A.

Further, the division of the authentication display area 22A shown in FIG. 5 is an example, and may be another division. Further, the image display area 22 is not provided with the non-authentication display area 22B, and the authentication display area 22A may be the entire image display area 22.

Then, the HMD 12 determines the success or failure of the authentication depending on whether or not the result of the line-of-sight detection by the line-of-sight detection unit 32 matches the registered line-of-sight information for authentication. The line-of-sight information for authentication is generated when the user visually recognizes the object 24 for authentication in order to register it, and is stored in advance in the storage unit 36.

[1-4. Judgment of start or end of authentication operation]
Next, the start or end of the authentication operation by the user will be described.

For example, the authentication processing unit 42 sets the start of the authentication operation when the user performs a predetermined operation on the controller connected to the HMD 12, and ends the authentication operation when the user performs the predetermined operation on the controller again. do. The predetermined operation for the controller is, for example, clicking a predetermined button.

Then, the line-of-sight detection unit 32 starts the user's line-of-sight detection after the authentication processing unit 42 accepts the start of the authentication operation by the user. Further, the line-of-sight detection unit 32 ends the user's line-of-sight detection after the authentication processing unit 42 accepts the end of the authentication operation by the user. After that, the authentication processing unit 42 determines the success or failure of the user authentication based on the line-of-sight detection result by the line-of-sight detection unit 32.

The start or end of the authentication operation by the user is not limited to the predetermined operation for the controller, and may be determined based on the detection result by the line-of-sight detection unit 32 or the face orientation detection unit 30.

For example, the authentication processing unit 42 starts the authentication operation by the user when the line-of-sight detection unit 32 detects that the user has turned his / her line of sight to the authentication object 24 for a predetermined time or longer. Then, the authentication processing unit 42 terminates the authentication operation by the user when the line-of-sight detection unit 32 detects that the line-of-sight has been deviated from the authentication object 24 for a predetermined time or longer. It should be noted that the predetermined time is not a time during which the user unconsciously turns or diverts his / her gaze, but is a time during which it can be determined that the user has intentionally performed the gaze, for example, several seconds.

Further, the authentication processing unit 42 starts or ends the authentication operation when the line-of-sight detection unit 32 detects a user's blink more than a predetermined number of times within a predetermined time. The number of blinks or more within a predetermined time is the number of times that it can be determined that the blink is not the blink that the user unconsciously makes, but the blink that the user intended, for example, three or more blinks within one second. be.

Further, the authentication processing unit 42 starts or ends the authentication operation when the face-facing detection unit 30 detects that the user has moved the head in a predetermined manner. The predetermined motion is a number of times that it can be determined that the motion is not an motion unconsciously performed by the user, such as a predetermined number of times in a predetermined direction within a predetermined time, but an operation intended by the user. For example, the head is set to 1. Tilt to the right twice per second, etc.

Further, when the line-of-sight detection unit 32 detects that the user has turned his / her line of sight to the predetermined object displayed on the display 16 for a predetermined time or longer, the authentication processing unit 42 starts the authentication operation by the user and determines again. When the line-of-sight detection unit 32 detects that the user has turned his / her line of sight to the object for a predetermined time or longer, the authentication operation by the user may be terminated.

The start or end of any authentication operation is determined when the authentication object 24 is displayed in the authentication display area 22A. Further, when the HMD 12 receives an operation indicating the start or end of the authentication operation by the user, the HMD 12 performs a notification indicating that fact (hereinafter referred to as "authentication start notification" or "authentication end notification"). The authentication start notification or the authentication end notification is a display of a predetermined image on the display 16, an output of a predetermined voice, or the like.

By performing the authentication start notification, the user recognizes that the authentication operation can be performed. Further, by performing the authentication end notification, the user can recognize that the HMD 12 has accepted the authentication operation performed by the user.

As described above, the HMD 12 according to the present embodiment accepts the start or end of the authentication operation when the user performs a predetermined operation. As a result, the user can authenticate the user at his / her own timing, and the false detection of the line of sight performed by the user authentication can be prevented.

[1-5. User authentication process according to this embodiment]
FIG. 6 is a flowchart showing the flow of the user authentication process executed by the main control unit 34, and the program for executing the user authentication process is stored in advance in a predetermined area of the storage unit 36. The user authentication process according to the present embodiment is executed, for example, when the user activates the HMD 12.

First, in step 100, it is determined whether or not the authentication object 24 is displayed in the authentication display area 22A, and in the case of an affirmative determination, the process proceeds to step 102. When the HMD 12 is started, the authentication object 24 is not displayed in the authentication display area 22A. Therefore, the user causes the authentication object 24 to be displayed in the authentication display area 22A by moving the head or the like.

In step 102, the authentication processing unit 42 determines whether or not the user has performed a predetermined operation indicating that the authentication operation is started, and in the case of an affirmative determination, the process proceeds to step 104. In the case of an affirmative determination, the authentication processing unit 42 notifies the start of authentication.

In step 104, the line-of-sight detection unit 32 performs line-of-sight detection for user authentication.

In the next step 106, the authentication processing unit 42 determines whether or not the user has performed a predetermined operation indicating that the authentication operation is terminated. In the case of an affirmative determination, the process proceeds to step 108, and in the case of a negative determination, step 104. Return to. In the case of an affirmative determination, the authentication processing unit 42 notifies the end of authentication.

In step 108, the authentication processing unit 42 executes authentication based on the result of line-of-sight detection, and then ends the user authentication process. Specifically, the success or failure of the authentication is determined depending on whether or not the result of the line-of-sight detection for the authentication object 24 matches the registered authentication line-of-sight information. If the authentication is successful, the user can operate the HMD 12. On the other hand, if the user authentication fails, the process returns to step 100 and the user authentication process is performed again.

As described above, the HMD 12 according to the present embodiment includes a face orientation detection unit 30 for detecting the orientation of the user's face and a line-of-sight detection unit 32 for detecting the user's line of sight, and the detection result by the face orientation detection unit 30. The object to be displayed in the image display area 22 of the display 16 is changed accordingly. Then, the HMD 12 displays the authentication object 24 in the image display area according to the user's operation, and performs user authentication when the line-of-sight detection unit 32 detects that the user has aligned the line of sight with the authentication object 24.

As described above, the HMD 12 according to the present embodiment searches for the authentication object 24 by the user moving his / her head, and displays the authentication object 24 on the display 16. Then, the HMD 12 performs user authentication by detecting the line of sight of the user according to the displayed authentication object 24, so that authentication with higher security can be performed.

Further, the authentication object 24 may be made movable by the user in a pseudo manner. In the case of this embodiment, for example, when the authentication object 24 is displayed in the non-authentication display area 22B, the user pseudo-grasps the authentication object 24 by hand and uses the authentication object 24 as the authentication display area 22A. Move to. The operation of grasping the authentication object 24 may be performed via the controller connected to the HMD 12.

Further, a plurality of authentication objects 24 may exist in the image space 44. In the case of this form, only one of the plurality of authentication objects 24 is registered in advance as being used for user authentication. By moving the head, the user finds one registered authentication object 24 and displays it on the display 16 to perform user authentication.

Further, the authentication object 24 may be moved. In this form, for example, a plurality of authentication objects 24 are displayed on the display 16 while moving. By moving the head, the user finds one registered authentication object 24 and displays it on the display 16 to perform user authentication.

[2. Second Embodiment]
Hereinafter, a second embodiment of the present invention will be described.

[2-1. Configuration of HMD according to the second embodiment]

Since the configurations of the display system 10 and the HMD 12 according to the second embodiment are the same as the configurations of the display system 10 and the HMD 12 according to the first embodiment shown in FIGS. 1 to 3, the description thereof will be omitted.

[2-2. User authentication according to the second embodiment]
The authentication processing unit 42 according to the present embodiment performs user authentication based on the result of the line-of-sight detection by the line-of-sight detection unit 32 and the result of the face orientation detection by the face orientation detection unit 30. That is, the condition for successful user authentication is that the user visually recognizes the authentication object 24 and the orientation of the face is set to the pre-registered orientation.

The pre-registered orientations are, for example, up, down, right, and left. In the example of FIG. 7, authentication is successful when the direction of the face detected by the face orientation detection unit 30 and the direction of the line of sight detected by the line-of-sight detection unit 32 are opposite to each other.

As a result, the HMD 12 according to the present embodiment enables highly secure user authentication.

[3. Third Embodiment]
Hereinafter, a third embodiment of the present invention will be described.

[3-1. Configuration of HMD according to the third embodiment]

Since the configurations of the display system 10 and the HMD 12 according to the present embodiment are the same as the configurations of the display system 10 and the HMD 12 according to the first embodiment shown in FIGS. 1 and 2, the description thereof will be omitted.

The image displayed on the display 16 by the HMD 12 according to the present embodiment is AR. Therefore, a camera 56, which will be described in detail later, is provided on the front surface of the HMD 12 to acquire an image (hereinafter referred to as a “real space image”) of the surroundings of the user wearing the HMD 12 (hereinafter referred to as “real space”). AR is realized by displaying an object together with a real space image on the display 16.

[3-2. User authentication according to the third embodiment]
As shown in FIG. 8, the HMD 12 according to the present embodiment displays the authentication object 24 when the pre-registered identification body (hereinafter referred to as “registered identification body”) 50 is displayed on the display 16. Displayed at 16. The registered identification body 50 is, for example, an existing object or the like, and characteristic portions such as a shape and a color for specifying the registered identification body 50 are stored in the storage unit 36. The characteristic portion of the registered identification body 50 is extracted by performing image analysis on the real space image acquired when the registration identification body 50 is registered.

In the example of FIG. 8, the registration identification body 50 is a monitor 54 mounted on the desk 52, and when the monitor 54 is displayed on the display 16, the authentication object 24 is displayed on the display 16. In other words, the initial position of the authentication object 24 is predetermined in the real space. That is, the authentication object 24 does not exist in the image space until the registration identification body 50 is displayed in the authentication display area 22A. Therefore, when the registered identification body 50 is not displayed on the display 16, the user moves the head to display the registered identification body 50 on the display 16.

The registered identification body 50 shown in FIG. 8 is an example, and may be another object such as a clock or a window, but an object whose position does not change in the real space is preferable. Further, in the example of FIG. 8, the authentication object 24 is displayed superimposed on the registered identification body 50, but it does not necessarily have to be superimposed.

When the authentication object 24 is displayed on the display 16, the user moves his / her head so that the authentication object 24 is displayed in the authentication display area 22A. After displaying the authentication object 24 in the authentication display area 22A, the user authenticates the user by aligning the line of sight with the authentication object 24.

When the registered identification body 50 disappears from the display 16 due to the user moving the head after the authentication object 24 is displayed on the display 16, the HMD 12 displays the displayed authentication object 24. It may be hidden, or the authentication object 24 may be continuously displayed as it is to enable user authentication.

FIG. 9 is a functional block diagram showing an electrical configuration of the HMD 12 according to the present embodiment. The same components as those in FIG. 9 in FIG. 9 are designated by the same reference numerals as those in FIG. 3, and the description thereof will be omitted.

The camera 56 is provided on the front surface of the HMD 12 and acquires a real space image of the surroundings of the user.

The image display control unit 40 displays the real space image acquired by the camera 56 on the display 16 in real time, and superimposes a non-existent image (object) on the real space image to display it on the display 16.

The camera image analysis unit 58 identifies an object captured by the camera 56 by performing image analysis or the like on a real space image. That is, the real space image is image-analyzed while being displayed on the display 16.

The authentication processing unit 42 determines whether or not the object specified by the camera image analysis unit 58 and the registered discriminator 50 match or not by image matching or the like. That is, when the real space image contains an object that matches the registered identification body 50, the authentication processing unit 42 determines that the registered identification body 50 is displayed on the display 16, and displays the authentication object 24. Display on 16.

FIG. 10 is a flowchart showing the flow of the user authentication process according to the present embodiment. The same steps as those in FIG. 6 in FIG. 10 are designated by the same reference numerals as those in FIG. 6, and the description thereof will be partially or completely omitted.

First, in step 200, the authentication processing unit 42 determines whether or not the registered identification body 50 is displayed on the display 16, in other words, whether or not the registered identification body is imaged by the camera 56, and in the case of an affirmative determination, step 2. Move to 202. If the HMD 12 is a transmissive type and a positive determination is made in this step 200, the existing registration discriminator 50 is imaged in a predetermined area (for example, the central area) of the image pickup range of the camera 56, and the registration is transmitted through the display 16. The user is directly viewing the discriminator 50. That is, when the HMD 12 is a transmissive type, the image captured by the camera 56 does not have to be displayed on the display 16.

In step 202, the authentication processing unit 42 displays the authentication object 24 on the display 16 and proceeds to step 100.

In steps 100 to 108, the same processing as the user authentication processing according to the first embodiment is performed. If the user authentication fails, the process returns to step 200 and the user authentication process is performed again.

As described above, the HMD 12 according to the present embodiment realizes AR by displaying an object together with a real space image on the display 16, and when the registered identification body 50 is displayed on the display 16. The authentication object 24 is displayed on the display 16.

As a result, the HMD 12 according to the present embodiment enables highly secure user authentication.

A plurality of registered identification bodies 50 are registered in advance, and the registration identification body 50 used for user authentication may be changed for each user authentication, every predetermined number of days, or the like. When the registered identification body 50 used for user authentication changes, the information about the changed registration identification body 50 is notified to the e-mail address or the like of the user registered in advance.

Further, the registered identification body 50 is not limited to an object such as a monitor 54, and may be, for example, an identification code such as a barcode or a QR code (registered trademark), a predetermined image, or the like. These identification codes and images may be printed on paper or the like, or may be displayed on a personal computer monitor, a mobile information terminal, or the like.

Further, the registered identification body 50 may be a virtual object displayed on the display 16 instead of an actual object. In the case of this embodiment, the user moves to the registered identification body 50 in the VR space and displays it on the display 16, or grasps the registered identification body 50 in the VR space and displays it on the display 16.

Further, the real or virtual registration identifier 50 itself may be the authentication object 24. In this case, when the registered identification body 50 is displayed in the authentication display area 22A, user authentication is performed. Further, when the HMD 12 is a transmissive type, user authentication may be performed when the existing registered identification body 50 is imaged in a predetermined area (for example, a central area) of the image pickup range of the camera 56.

[4. Other embodiments]
Although the present invention has been described above using each of the above embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. Various changes or improvements can be made to each of the above embodiments without departing from the gist of the invention, and the modified or improved embodiments are also included in the technical scope of the present invention. In addition, each of the above embodiments may be combined as appropriate.

For example, in each of the above embodiments, the embodiment in which the HMD 12 includes the authentication processing unit 42 has been described, but the present invention is not limited to this, and the server 14 may include the authentication processing unit 42. In this embodiment, the detection result detected by the HMD 12 for user authentication is transmitted to the server 14, the server 14 performs user authentication based on the received detection result, and transmits the authentication result to the HMD 12.

Further, in each of the above embodiments, the embodiment in which the authentication according to the present invention is applied to the user authentication performed at the time of starting the HMD 12 has been described, but the present invention is not limited to this, and is executed by, for example, the HMD 12. It may be applied to user authentication performed at the time of starting the software. It may also be applied to in-game authentication performed by HMD 12. In the form applied to the authentication of the game, the HMD 12 authenticates when it detects that the line of sight is aligned with the authentication object 24, and even if a predetermined event occurs when the authentication is successful, etc. good.

Further, in the first embodiment and the second embodiment, the mode in which the HMD 12 displays VR has been described, but the present invention is not limited to this, and the HMD 12 may display AR.

Further, the flow of the user authentication process described in each of the above embodiments is also an example, and unnecessary steps can be deleted, new steps can be added, or the process order can be changed within a range that does not deviate from the gist of the present invention. You may.

12 HMD (Head-mounted display device)
16 Display 22 Image display area 22A Authentication display area 24 Authentication object 30 Face orientation detection unit (face orientation detection means)
32 Line-of-sight detection unit (line-of-sight detection means)
40 Image display control unit (image display control means)
42 Authentication processing unit (authentication means)

Claims (6)

A display device worn by the user on the head.
Before user authentication, an image display control means that arranges an authentication object used for user authentication outside the authentication area of the display, and
When the authentication object is moved to the authentication area by the user's operation, the user authentication operation is enabled.
When the user authentication operation is possible, the authentication means for executing the user authentication and
Display device. The image display control means arranges the authentication object in an area of the virtual space that is not displayed on the display before user authentication.
The display device according to claim 1. The image display control means is
When the authentication object is displayed on the display, the display mode of the authentication area is changed.
The display device according to claim 2. The display includes the authentication area and a non-authentication area that is not the authentication area.
The image display control means is
Before user authentication, the authentication object is placed in the non-authentication area.
When the authentication object is moved to the authentication area by the user's operation, the user authentication operation is possible.
The display device according to claim 1. For display devices worn by users on their heads
Before user authentication, the authentication object used for user authentication is placed outside the authentication area of the display.
When the authentication object is moved to the authentication area by the user's operation, the user authentication operation is enabled.
When the user authentication operation is possible, the user authentication is executed.
A program for executing processing. For display devices worn by users on their heads
Before user authentication, the authentication object used for user authentication is placed outside the authentication area of the display.
When the authentication object is moved to the authentication area by the user's operation, the user authentication operation is enabled.
When the user authentication operation is possible, the user authentication is executed.
Information processing method including processing.

Images