JP2022083918A - Glasses-type device, management server, and program - Google Patents

Abstract

To provide a glasses-type device having a function by which glasses-type devices are connected by image recognition, or glasses-type devices are connected by a particular operation.SOLUTION: A glasses-type device includes a display control unit 216 that displays content on a display unit, a connection establishment unit 220 that establishes connection with a separate glasses-type device when a predetermined condition is satisfied, and a sharing control unit 222 that shares content with the separate glasses-type device with which the connection has been established by the connection establishment unit 220.SELECTED DRAWING: Figure 6

Description

The present invention relates to eyeglass-type devices, management servers and programs.

Patent Document 1 includes an AR (Augmented) having a display unit capable of superimposing and displaying an AR virtual object on a landscape in a real space by displaying an image such as a text or a figure in a transparent or semi-transparent state. Reality) Glass is described.
[Prior Art Document]
[Patent Document]
[Patent Document 1] Japanese Unexamined Patent Publication No. 2019-114078

According to one embodiment of the present invention, a spectacle-type device is provided. The spectacle-type device may include a display control unit for displaying the content on the display unit. The spectacle-type device may include a connection establishment unit that establishes a connection with another spectacle-type device depending on the condition that a predetermined condition is satisfied. The spectacle-type device may include a shared control unit that shares content with other spectacle-type devices for which the connection establishment unit has established a connection.

The connection establishment unit may establish a connection with the other spectacle-type device based on the line of sight of the user wearing the spectacle-type device. The connection establishment unit meets the other spectacle-type device according to the fact that the line of sight of the user of the spectacle-type device and the line of sight of the user of the other spectacle-type device continuously match for a predetermined time. Connection establishment process may be executed. The connection establishment unit indicates that the line of sight of the user of the spectacle-type device is continuously directed to the connection establishment content displayed at a position corresponding to the user of the other spectacle-type device for a predetermined time. Depending on the situation, the connection establishment process with the other eyeglass-type device may be executed. The connection establishment unit responds that the line of sight of the user of the spectacle-type device is directed to a predetermined object exchanged between the user of the spectacle-type device and the user of the other spectacle-type device. The connection establishment process with the above other eyeglass-type devices may be executed. The connection establishment unit performs a connection establishment process with the other spectacle-type device according to the fact that the locus of the line of sight of the user of the spectacle-type device matches the locus of the finger of the user of the other spectacle-type device. You may do it.

The spectacle-type device has a receivable mode setting unit that sets the spectacle-type device to a receivable mode in which connection requests from other spectacle-type devices can be received in response to an instruction from the user of the spectacle-type device. The connection establishment unit may be provided with the other spectacle-type device in response to receiving the connection application from the other spectacle-type device when the spectacle-type device is in the receivable mode. Connection establishment processing may be executed. The connection establishment unit is based on a captured image of an object captured by the camera of the spectacle-type device and containing information for establishing a connection with the other spectacle-type device corresponding to the other spectacle-type device. The connection establishment process with the other eyeglass-type device may be executed. The connection establishment unit performs a connection establishment process with the other spectacle-type device based on the images captured by the camera of the spectacle-type device and the user of the other spectacle-type device and the other spectacle-type device. You may do it. The connection establishment unit detects a predetermined operation of the user of the spectacle-type device with respect to the spectacle-type device and a predetermined operation of the user of the other spectacle-type device with respect to the other spectacle-type device. Depending on what has been done, the connection establishment process with the other eyeglass-type device may be executed. The spectacle-type device may be a single connection mode for establishing a connection between the spectacle-type device and one other spectacle-type device, or a plurality of other spectacle-type devices, in response to an instruction from the user of the spectacle-type device. The connection mode setting unit may be provided to set the connection mode to the plurality of connection modes, and the connection establishment unit satisfies the predetermined conditions when the eyeglass-type device is set to the plurality of connection modes. Each time, a connection may be established with the other eyeglass-type device described above. The connection establishment unit may use different conditions depending on whether the spectacle-type device is set to the single connection mode or the spectacle-type device is set to the plurality of connection modes.

According to one embodiment of the present invention, a program for making a spectacle-type device function as the spectacle-type device is provided.

According to one embodiment of the present invention, a management server is provided. The management server may include an information receiving unit that receives information from the first spectacle-type device and the second spectacle-type device having a function of displaying the content on the display unit. The management server may include a connection control unit that controls the first spectacle-type device and the second spectacle-type device to establish a connection based on the information received by the information receiving unit. The management server may include a shared control unit for sharing content between the first spectacle-type device and the second spectacle-type device that have established a connection under the control of the connection control unit.

The information receiving unit includes the position information of the first spectacle-type device and the second spectacle-type device, and the first user of the first spectacle-type device and the second of the second spectacle-type device. The locus information of one finger of the user and the line-of-sight information of the first user and the other of the second user may be received, and the connection control unit may receive the first user and the second user. When the locus of one finger and the locus of the other line of sight of the first user and the second user match, the first spectacle-type device and the second spectacle-type device are connected. May be controlled to establish. The information receiving unit has detected the position information of the first spectacle-type device and the second spectacle-type device and the predetermined operation by the first user with respect to the first spectacle-type device. The first detection information indicating the above and the second detection information indicating that the predetermined operation by the second user with respect to the second eyeglass-type device has been detected may be received, and the connection control unit may be received. Is the case where the predetermined operation is detected within the predetermined time range in the first spectacle-type device and the second spectacle-type device located within the predetermined distance. It may be controlled to establish a connection between the first spectacle-type device and the second spectacle-type device.

According to one embodiment of the present invention, a program for making a computer function as the management server is provided.

The outline of the above invention does not list all the necessary features of the present invention. A subcombination of these feature groups can also be an invention.

An example of the system 10 is shown schematically. An example of the configuration of the spectacle-type device 100 is schematically shown. It is explanatory drawing for demonstrating the example of the trigger of the connection between the 1st spectacle-type device 100 and the 2nd spectacle-type device 100. It is explanatory drawing for demonstrating the example of the trigger of the connection between the 1st spectacle-type device 100 and the 2nd spectacle-type device 100. An example of the flow of the connection establishment process by the spectacle-type device 100 is schematically shown. An example of the functional configuration of the control device 200 is schematically shown. An example of the functional configuration of the management server 300 is shown schematically. An example of the hardware configuration of the computer 1200 that functions as the control device 200 is schematically shown.

It is expected that eyeglass-type devices such as AR (Augmented Reality) glasses will become more widespread in the future, and communication between eyeglass-type devices will be possible. However, a method for connecting the spectacle-type device of the person in front of the person by communication with the spectacle-type device of the person in front of the person has not been established, and the same content cannot be easily shared or browsed. The spectacle-type device 100 according to the present embodiment realizes a function of connecting spectacle-type devices by image recognition and connecting spectacle-type devices by a specific operation.

Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention within the scope of the claims. Also, not all combinations of features described in the embodiments are essential to the means of solving the invention.

FIG. 1 schematically shows an example of the system 10. The system 10 includes a plurality of eyeglass-type devices 100 and a management server 300.

The spectacle-type device 100 may be any spectacle-type device as long as it has a wireless communication function and a display function for displaying contents on the display unit. The spectacle-type device 100 may be, for example, an AR glass.

The spectacle-type device 100 may be a device capable of giving the user 102 the feeling that the content is arranged in the real space by displaying the content on a transparent or translucent glass. That is, the spectacle-type device 100 may be a so-called transmissive type (see-through type) device. The glasses-type device 100 may be a video pass-through type device. In this case, the spectacle-type device 100 may display a captured image capturing a range corresponding to the field of view of the user 102 on a non-transparent display, and superimpose and display the content.

The spectacle-type device 100 according to the present embodiment establishes a connection with another spectacle-type device 100 when a predetermined condition is satisfied. The spectacle-type device 100 may be another, for example, depending on whether the line of sight of the user 102 of the spectacle-type device 100 and the line of sight of another user 102 of the other spectacle-type device 100 are continuously aligned for a predetermined time. Establish a connection with the spectacle-type device 100.

According to the prior art, it is conceivable that, for example, each of the two users 102 establishes a connection by performing an operation such as displaying a menu on the respective eyeglass-type device 100 and making a selection. However, in this case, the operation takes time and effort, and it is not possible to easily share the contents. On the other hand, according to the spectacle-type device 100 according to the present embodiment, it is possible to provide the user 102 with a connection establishment method that is less burdensome for the user 102, and to realize an environment in which content can be easily shared. can.

The spectacle-type device 100 establishes a direct connection with, for example, another spectacle-type device 100. Further, for example, the spectacle-type device 100 establishes a connection with another spectacle-type device 100 via the management server 300.

The spectacle-type device 100 may wirelessly communicate with another spectacle-type device 100 by Bluetooth (registered trademark). Further, the spectacle-type device 100 and the other spectacle-type device 100 may be wirelessly communicated by using other short-range wireless communication methods such as Wi-Fi (registered trademark) and Zigbee (registered trademark).

The spectacle-type device 100 may communicate with the management server 300 via the network 20. The network 20 includes a cloud. The network 20 may include a mobile communication network. The mobile communication network may comply with any of the LTE (Long Term Evolution) communication method, the 3G (3rd Generation) communication method, the 5G (5th Generation) communication method, and the 6G (6th Generation) communication method or later. good. The network 20 may be compatible with the Wi-Fi communication method. The network 20 may be accessible via a Wi-Fi access point. The network 20 may be accessible by using other wireless communication in general. The spectacle-type device 100 may be connected to the network 20 by mobile communication, Wi-Fi communication, and other wireless communication in general. The management server 300 may be connected to the network 20 by wire or wirelessly.

FIG. 2 schematically shows an example of the configuration of the spectacle-type device 100. The spectacle-type device 100 includes a frame 110 having a rim 112 and a temple 118. The spectacle-type device 100 includes a control device 200 that executes various controls in the spectacle-type device 100.

The arrangement of the control device 200 in FIG. 2 is an example, and the control device 200 may be arranged at another position of the frame 110. For example, the control device 200 may be arranged outside the frame 110. Further, for example, the control device 200 may be arranged in the temple 118. As a specific example, the control device 200 may be arranged at the tip of the temple 118, that is, in a modern manner. The control device 200 may include a battery. The control device 200 and the battery may be separately arranged at different positions on the frame 110.

The spectacle-type device 100 may include a camera 120. The imaging range of the camera 120 may be a range corresponding to the field of view of the user 102 wearing the spectacle-type device 100. The imaging ease of the camera 120 may be substantially the same as the field of view of the user 102. The arrangement of the camera 120 in FIG. 2 is an example, and the camera 120 may be arranged at another position.

The spectacle-type device 100 may include a sensor 122. The sensor 122 may be a sensor for identifying the environment around the spectacle-type device 100. Sensor 122 may include LiDAR. The sensor 122 may include a ranging sensor. Although FIG. 2 illustrates the case where the sensor 122 is arranged on the bridge 114, the arrangement of the sensor 122 in FIG. 2 is an example, and the sensor 122 may be arranged at another position.

The spectacle-type device 100 may include a line-of-sight detection unit 124. The line-of-sight detection unit 124 detects the line of sight of the user 102 who is the wearer of the spectacle-type device 100. The line-of-sight detection unit 124 detects the line of sight of the user 102, for example, by capturing and monitoring the eyes of the user 102. The arrangement of the line-of-sight detection unit 124 in FIG. 2 is an example, and the line-of-sight detection unit 124 may be arranged at another position.

The spectacle-type device 100 may include a sensor 126. The sensor 126 may be a sensor that detects contact with the place where the sensor 126 is installed in the spectacle-type device 100. The sensor 126 may be capable of detecting pressure. The sensor 126 may be, for example, an electrostatic sensor. The arrangement of the sensor 126 in FIG. 2 is an example, and the spectacle-type device 100 may include the contact sensor 126 at a position different from the position shown in FIG. Further, the spectacle-type device 100 may have the sensors 126 in more places than the example shown in FIG. For example, the sensor 126 may be provided with the sensor 126 on the side surface, the bottom surface, or the like of the rim 112.

The control device 200 may accept various inputs. The control device 200 may accept various inputs from the user 102 via an operation unit arranged at an arbitrary position of the spectacle-type device 100. The control device 200 receives various inputs from the user 102, for example, via an input unit such as a button arranged at an arbitrary position of the frame 110. The control device 200 may accept various inputs from the user 102 via a mobile terminal such as a smartphone, for example. The spectacle-type device 100 may establish a wireless connection with a mobile terminal by using, for example, a short-range wireless communication method such as Wi-Fi, Bluetooth, and Zigbee. The control device 200 may accept the line-of-sight input by the user 102.

The control device 200 may include a positioning sensor. The control device 200 includes, for example, a GNSS (Global Navigation Satellite System) sensor such as a GPS (Global Positioning System) sensor. The control device 200 may include an acceleration sensor. The control device 200 may include a gyro sensor. The control device 200 may include other sensors.

The control device 200 may generate image pickup range information indicating the image pickup range of the camera 120. The control device 200 may generate image pickup range information based on the position, orientation, and orientation of the spectacle-type device 100. The control device 200 may specify the position, orientation, and posture of the spectacle-type device 100 by the outputs of various sensors.

The control device 200 may acquire various information by analyzing the image captured by the camera 120. The control device 200 detects, for example, the line of sight of a person within the imaging range of the camera 120. Further, the control device 200 recognizes, for example, an object within the imaging range of the camera 120. Further, the control device 200 analyzes a code such as a QR code (registered trademark) within the imaging range of the camera 120, and acquires information encoded by the code.

The control device 200 may have a display function on the lens 116. The lens 116 may be an example of a display unit of the spectacle-type device 100. The lens 116 may be a transparent or translucent display, and the control device 200 may cause the lens 116 to perform various displays. That is, the spectacle-type device 100 may be a transparent or translucent display-type device. Further, the control device 200 may have a function of projecting a display onto the lens 116. That is, the spectacle-type device 100 may be a projection-type device.

The control device 200 may have a function of wirelessly communicating with another spectacle-type device 100. The control device 200 may wirelessly communicate with the control device 200 of another spectacle-type device 100 by means of Bluetooth (registered trademark). The control device 200 may wirelessly communicate with the control device 200 of another eyeglass-type device 100 by using other short-range wireless communication methods such as Wi-Fi (registered trademark) and Zigbee (registered trademark).

The control device 200 may have a function of executing communication via the network 20. The control device 200 may access the network 20 by at least one of mobile communication, Wi-Fi communication, and other wireless communication in general. The control device 200 may communicate with the management server 300 via the network 20. The control device 200 may communicate with another spectacle-type device 100 via the network 20.

FIG. 3 is an explanatory diagram for explaining an example of a trigger for connection between the first spectacle-type device 100 and the second spectacle-type device 100. As shown in FIG. 3, for example, the first eyeglass-type device 100 and the second eyeglass-type device 100 have the line of sight of the first user 102 wearing the first eyeglass-type device 100 and the second eyeglass-type device 100. The connection establishment process may be executed depending on whether the line of sight of the second user 102 wearing the spectacle-type device 100 is continuously aligned for a predetermined time. The details of the connection establishment process will be described later.

The detection of the line-of-sight coincidence may be performed by either the first spectacle-type device 100 or the second spectacle-type device 100. For example, the first eyeglass-type device 100 detects the coincidence of the line of sight by detecting the line of sight of the first user 102 and the line of sight of the second user 102.

Further, the detection of the line-of-sight match may be performed by the management server 300. For example, the management server 300 receives information on the line of sight of the first user 102 from the first eyeglass-type device 100, and receives information on the line of sight of the second user 102 from the second eyeglass-type device 100. , Detects a line-of-sight match. Further, for example, the management server 300 receives information on the line of sight of the second user 102 from the first eyeglass-type device 100, and receives information on the line of sight of the first user 102 from the second eyeglass-type device 100. By doing so, the coincidence of the line of sight is detected. When the line of sight of the first user 102 and the line of sight of the second user 102 continuously match for a predetermined time, the management server 300 sends notification information to notify the first eyeglass-type device. It may be transmitted to 100 and the second eyeglass-type device 100. The management server 300 may be provided with a mechanism such as a so-called AR cloud that manages the position of the eyeglass-type device 100 and the content superimposed on the user 102.

FIG. 4 is an explanatory diagram for explaining an example of a trigger for connection between the first spectacle-type device 100 and the second spectacle-type device 100. As shown in FIG. 4, for example, the first eyeglass-type device 100 displays the connection content 250 in association with the second eyeglass-type device 100 or the second user 102 within the imaging range, and the first eyeglass-type device 100 is displayed. Depending on the designation of the connection content 250 by the user 102, the connection establishment process with the second eyeglass-type device 100 may be executed.

The designation of the connection content 250 may be performed by the line-of-sight input by the first user 102, or may be performed by the input via the operation unit of the eyeglass-type device 100 by the first user 102. For example, in the first eyeglass-type device 100, when the line of sight of the first user 102 is continuously directed to the connection content 250 for a predetermined time, the connection content 250 is directed by the first user 102. Judge as specified.

The display of the connection content 250 may be performed mainly by the first eyeglass-type device 100. For example, the first spectacle-type device 100 displays the connection content 250 at a position corresponding to the spectacle-type device 100 in response to recognizing the second spectacle-type device 100 within the imaging range of the camera 120. Information from the sensor 122 or information from wireless communication may be used for recognizing the second eyeglass-type device 100. The first spectacle-type device 100 may recognize that the second spectacle-type device 100 within the imaging range of the camera 120 is included by using any other technique.

The display of the connection content 250 may be performed mainly by the management server 300. For example, the management server 300 continuously receives position information and imaging range information from each of the first spectacle-type device 100 and the second spectacle-type device 100, and the first spectacle-type device 100 and the second spectacle-type device 100. Monitors the positional relationship with the spectacle-type device 100 and the relationship with the imaging range. The management server 300 may continuously receive position information and imaging range information from the first control device 200 and the second control device 200. Then, in response to the determination that the second user 102 wearing the second spectacle-type device 100 is included in the imaging range of the first spectacle-type device 100, the first spectacle-type device 100 is subjected to the first step. The connection content 250 is displayed at a position corresponding to the glasses-type device 100 of 2. Similarly, the management server 300 may cause the second spectacle-type device 100 to display the connection content 250 at a position corresponding to the first spectacle-type device 100.

The management server 300 may continuously receive the captured image from the first spectacle-type device 100 and detect that the second spectacle-type device 100 is included in the imaging range of the camera 120. The management server 300 may detect that the second spectacle-type device 100 is located within the imaging range of the first spectacle-type device 100 by using any other method.

FIG. 5 schematically shows an example of the flow of the connection establishment process by the spectacle-type device 100. Here, the processing content of the first spectacle-type device 100 when the first spectacle-type device 100 and the second spectacle-type device 100 establish a connection will be described.

In step 102 (the step may be abbreviated as S) 102, it is determined whether or not the first eyeglass-type device 100 satisfies a predetermined condition as a trigger for executing the connection establishment process. .. As an example, in the first spectacle-type device 100, the line of sight of the first user 102 of the first spectacle-type device 100 and the line of sight of the second user 102 of the second spectacle-type device 100 are predetermined. If they match continuously for a long time, it is determined that the condition is satisfied.

In S104, the first eyeglass-type device 100 automatically switches to the pairing mode. At this time, the second eyeglass-type device 100 also automatically switches to the pairing mode.

In S106, the first eyeglass-type device 100 identifies a partner in the direction in which the first user 102 is facing, and displays an object indicating the identified partner as a connection candidate. The spectacle-type device 100 may detect the direction by Bluetooth or the like. The spectacle-type device 100 may detect the direction by the output of various sensors. In this example, the object indicating the second user 102 is displayed as a connection candidate. Similarly, the second eyeglass-type device 100 also displays an object indicating the first user 102 as a connection candidate.

In S108, the first eyeglass-type device 100 determines whether or not the object indicating the second user 102 is selected by the first user 102. The spectacle-type device 100 may accept the selection by the first user 102 by the line-of-sight input or the input to the operation unit.

The spectacle-type device 100 may determine that the object indicating the second user 102 is not selected when the state in which the object indicating the second user 102 is not selected by the first user 102 continues for a predetermined time. Further, the spectacle-type device 100 is, for example, when the second user 102 goes out of the imaging range of the first spectacle-type device 100 without selecting an object indicating the second user 102 by the first user 102. , May be determined not to be selected. If it is determined that it has been selected, the process proceeds to S110, and if it is determined that it has not been selected, the process ends.

In S110, the first spectacle-type device 100 establishes a connection with the second spectacle-type device 100. In this way, the first spectacle-type device 100 and the second spectacle-type device 100 are configured to establish a connection in response to the selection of the object indicating the second user 102 by the first user 102. You can do it. Further, in response to the selection of the object indicating the second user 102 by the first user 102, the second eyeglass-type device 100 outputs an inquiry to the second user 102, and the second user Depending on what is approved by 102, the first spectacle-type device 100 and the second spectacle-type device 100 may be configured to establish a connection. Further, according to the fact that the object indicating the second user 102 is selected by the first user 102 and the object indicating the first user 102 is selected by the second user 102, the first eyeglass type The device 100 and the second eyeglass-type device 100 may be configured to establish a connection.

As described above, the connection establishment process by the spectacle-type device 100 may include manual selection of the other party. Further, the connection establishment process by the spectacle-type device 100 may be automatically performed. For example, the first spectacle-type device 100 may establish a connection with the second spectacle-type device 100, which is the other party, in response to switching to the pairing mode in S104.

FIG. 6 schematically shows an example of the functional configuration of the control device 200. The control device 200 includes a storage unit 202, a captured image acquisition unit 204, a sensor information acquisition unit 206, a line-of-sight information acquisition unit 208, a content acquisition unit 210, an imaging range information generation unit 212, an information transmission unit 214, a display control unit 216, and a mode. It includes a setting unit 218, a connection establishment unit 220, and a shared control unit 222. It is not always essential that the control device 200 includes all of these.

The captured image acquisition unit 204 acquires the captured image captured by the camera 120 from the camera 120. The captured image acquisition unit 204 stores the acquired captured image in the storage unit 202.

The sensor information acquisition unit 206 acquires sensor information. The sensor information acquisition unit 206 may acquire the information output by the sensor 122. The sensor information acquisition unit 206 may acquire the information output by the sensor 126. The sensor information acquisition unit 206 may acquire the position information output by the positioning sensor. The sensor information acquisition unit 206 may acquire the information output by the acceleration sensor. The sensor information acquisition unit 206 may acquire the information output by the gyro sensor. The sensor information acquisition unit 206 may acquire information output by another sensor. The sensor information acquisition unit 206 stores the acquired sensor information in the storage unit 202.

The line-of-sight information acquisition unit 208 acquires line-of-sight information. The line-of-sight information acquisition unit 208 may acquire the line-of-sight information indicating the line-of-sight of the user 102 wearing the spectacle-type device 100, which is detected by the line-of-sight detection unit 124.

Further, the line-of-sight information acquisition unit 208 may acquire line-of-sight information indicating the line of sight of a person within the imaging range of the camera 120. The line-of-sight information acquisition unit 208 acquires line-of-sight information indicating the line of sight of a person within the image pickup range of the camera 120 by using the image captured image acquired by the image capture image acquisition unit 204 and the sensor information acquired by the sensor information acquisition unit 206. You can do it.

The content acquisition unit 210 acquires the content to be displayed on the lens 116. The content acquisition unit 210 receives content from, for example, the management server 300. The content acquisition unit 210 may receive content from any device or server via the network 20. The content acquisition unit 210 may receive the content generated by the user 102 from the mobile terminal of the user 102, the PC (Personal Computer) of the user 102, or the like. The content acquisition unit 210 stores the acquired content in the storage unit 202.

The imaging range information generation unit 212 generates imaging range information. The imaging range information generation unit 212 may generate imaging range information using the sensor information acquired by the sensor information acquisition unit 206. The imaging range information generation unit 212 may further generate imaging range information using the captured image acquired by the captured image acquisition unit 204.

The information transmission unit 214 transmits various information to the management server 300. The information transmission unit 214 transmits, for example, the captured image acquired by the captured image acquisition unit 204 to the management server 300. Further, the information transmission unit 214 transmits, for example, the sensor information acquired by the sensor information acquisition unit 206 to the management server 300. The information transmission unit 214 transmits, for example, the image pickup range information generated by the image pickup range information generation unit 212 to the management server 300.

The display control unit 216 controls the display by the display unit. The display control unit 216 causes the lens 116 to display the content stored in the storage unit 202, for example. The display control unit 216 may display the content stored in the storage unit 202 on the lens 116 according to the instruction from the user 102.

The mode setting unit 218 sets the mode of the eyeglass-type device 100. The mode setting unit 218 sets the eyeglass-type device 100 to the pairing mode, for example, when a predetermined condition is satisfied.

Further, the mode setting unit 218 sets, for example, the connection mode. The connection mode may include a single connection mode for establishing a connection with one other spectacle-type device 100 and a plurality of connection modes for establishing a connection with a plurality of other spectacle-type devices 100.

The connection establishment unit 220 establishes a connection with another eyeglass-type device 100. The connection establishment unit 220 may establish a connection with another spectacle-type device 100 depending on the condition that the predetermined conditions are satisfied.

The connection establishment unit 220 may execute the connection establishment process with another spectacle-type device 100 depending on the condition that the predetermined condition is satisfied. For example, the connection establishment unit 220 causes the mode setting unit 218 to set the spectacle-type device 100 to the pairing mode and automatically determines whether or not to establish the connection when the predetermined conditions are satisfied. Inquires to the user 102 and establishes a connection with another spectacle-type device 100 in response to the response from the user 102. Further, for example, the connection establishment unit 220 causes the mode setting unit 218 to set the spectacle-type device 100 to the pairing mode in response to the condition that the predetermined conditions are satisfied, and automatically sets another spectacle-type device to the pairing mode. Establish a connection with 100.

The connection establishment unit 220 establishes a connection with the spectacle-type device 100, for example, based on the line of sight of the user 102 wearing the spectacle-type device 100. For example, the connection establishment unit 220 responds to the fact that the line of sight of the user 102 of the spectacle-type device 100 and the line of sight of the other user 102 of the other spectacle-type device 100 continuously coincide with each other for a predetermined time. The process of establishing a connection with the eyeglass-type device 100 is executed.

The connection establishment unit 220 may detect that the line of sight of the user 102 and the line of sight of another user 102 continuously match for a predetermined time based on the line-of-sight information acquired by the line-of-sight information acquisition unit 208. .. The connection establishment unit 220 identifies the line-of-sight matching based on, for example, the line-of-sight information of the user 102 and the line-of-sight information of another user 102, and determines whether or not the time during which the lines of sight match exceeds a predetermined time. You can do it.

The connection establishment unit 220 may detect that the lines of sight of the user 102 and the other user 102 continuously match for a predetermined time by the notification from the management server 300. The management server 300 identifies the line-of-sight match based on the line-of-sight information of the user 102 and the other user 102 received from the eyeglass-type device 100 and the other eyeglass-type device 100, and the time during which the line-of-sight matches is determined in advance. It may be determined whether or not the time is exceeded.

Further, for example, the connection establishment unit 220 is predetermined in the connection establishment content 250 in which the line of sight of the user 102 of the spectacle-type device 100 is displayed at a position corresponding to the other user 102 of the other spectacle-type device 100. The connection establishment process with the other spectacle-type device 100 is executed according to the continuous time.

The display of the connection content 250 may be executed mainly by the display control unit 216. The display control unit 216 recognizes, for example, when another spectacle-type device 100 is included in the image pickup range of the camera 120, by analyzing the image captured by the image capture image acquisition unit 204. Then, the display control unit 216 displays the connection content 250 at a position corresponding to the other eyeglass-type device 100. As described above, the display of the connection content 250 may be executed mainly by the management server 300.

Further, for example, the connection establishment unit 220 is a predetermined object in which the line of sight of the user 102 of the spectacle-type device 100 is exchanged between the user 102 of the spectacle-type device 100 and another user 102 of the other spectacle-type device 100. The connection establishment process with another spectacle-type device 100 is executed according to the fact that the object is directed to. The object may be any object that is exchanged when people greet each other, and an example thereof is a business card. When the connection establishment unit 220 determines that the user 102 and the other user 102 are exchanging business cards based on the captured image acquired by the captured image acquisition unit 204, the connection establishment unit 220 establishes a connection with the other eyeglass-type device 100. You may execute the process.

The management server 300 may take the initiative in executing the line of sight of the first user 102 and the recognition that the first user 102 and the second user 102 are directed to a predetermined object to be exchanged. .. The management server 300 may recognize the object exchanged between the first user 102 and the second user 102 by analyzing the captured image received from the first eyeglass-type device 100.

Further, for example, the connection establishment unit 220 has another spectacle type according to the fact that the locus of the line of sight of the user 102 of the spectacle type device 100 matches the locus of the fingers of the other user 102 of the other spectacle type device 100. The connection establishment process with the device 100 is executed. The connection establishment unit 220 specifies, for example, the locus of the line of sight of the user 102 by the line of sight information of the user 102 acquired by the line of sight information acquisition unit 208. Further, the connection establishment unit 220 is a finger of another user 102 within the imaging range of the camera 120 by, for example, at least one of the captured image acquired by the captured image acquisition unit 204 and the sensor information acquired by the sensor information acquisition unit 206. Identify the trajectory of. The connection establishment unit 220 executes a connection establishment process with another spectacle-type device 100 when the locus of the line of sight of the specified user 102 and the locus of the finger of the other user 102 match. Thereby, the user 102 and the other user 102 can establish a connection by the user 102 visually following the trajectory of the finger of the other user 102. The spectacle-type device 100 can recognize with high accuracy the intention that the user 102 and another user 102 want to establish a connection.

The management server 300 may play a central role in determining the match between the locus of the line of sight of the first user 102 and the locus of the finger of the second user 102. The management server 300 receives the line-of-sight information of the first user 102 received from the first eyeglass-type device 100 or the second eyeglass-type device 100 and the line-of-sight information received from the first eyeglass-type device 100 or the second eyeglass-type device 100. By analyzing the information on the locus of the finger of the second user 102, it may be determined that the locus of the line of sight of the first user 102 and the locus of the finger of the second user 102 match.

The establishment of the connection between the spectacle-type device 100 and the other spectacle-type device 100 may be realized by setting one of them to the receivable mode. For example, the connection establishment unit 220 can receive the eyeglass-type device 100 and the connection application from another eyeglass-type device 100 to the mode setting unit 218 in response to an instruction from the user 102 of the eyeglass-type device 100. Set to mode. Then, when the spectacle-type device 100 is in the receivable mode, the connection establishment unit 220 performs a connection establishment process with the other spectacle-type device 100 in response to receiving a connection application from the other spectacle-type device 100. Run. As a result, although it takes time and effort to set the receivable mode, it is possible to indicate to the other spectacle-type device 100 that the connection is accepted, which can contribute to the establishment of a smooth connection.

The connection establishment unit 220 is based on an image of an object captured by the camera 120, which includes information for establishing a connection with the other spectacle-type device 100, which corresponds to the other spectacle-type device 100. The connection process with the device 100 may be executed. The object is, for example, an object on which information for establishing a connection with another spectacle-type device 100 is printed. For example, a code in which information for establishing a connection with another spectacle-type device 100 is encoded is printed on the object. The code may be a QR code, a barcode, or the like, or may be a code of another format. The object may be a paper medium such as a card, or may be a three-dimensional medium. Thereby, for example, when the user 102 carries a card on which the QR code is printed and wants to establish a connection between his / her own eyeglass-type device 100 and another user 102's eyeglass-type device 100, he / she presents the card. It is possible to provide an environment that can be connected by.

The connection establishment unit 220 executes a connection establishment process with the other spectacle-type device 100 based on the images captured by the other spectacle-type device 100 and the other user 102 of the other spectacle-type device 100 captured by the camera 120. You may. For example, the storage unit 202 stores in advance the characteristics of the frame 110 of the other eyeglass-type device 100 for which the user 102 wants to establish a connection, and the physical characteristics of the other user 102. Then, when the other user 102 is included in the imaging range of the camera 120, the connection establishment unit 220 recognizes this by using these features stored in the storage unit 202, and recognizes the other user's eyeglasses. The connection establishment process with the type device 100 is executed. For example, even when the size of the spectacle-type device 100 is relatively large and it is difficult to recognize the face of the user 102, the recognition rate can be obtained by using the characteristics of the frame 110 of the spectacle-type device 100 and the characteristics of the whole body of the user 102. Can be prevented from decreasing.

The management server 300 may play a central role in identifying the connection partner based on the captured image captured by the first spectacle-type device 100. The management server 300 analyzes the captured image received from the first spectacle-type device 100, so that the first user 102 wants to establish a connection within the imaging range of the first spectacle-type device 100. It may be determined that the user 102 of the above is included.

The connection establishment unit 220 has a predetermined operation of the user 102 of the spectacle-type device 100 with respect to the spectacle-type device 100 and a predetermined operation of the user 102 of the other spectacle-type device 100 with respect to the other spectacle-type device 100. Depending on what is detected, connection establishment processing with another spectacle-type device 100 may be executed. The connection establishment unit 220, for example, responds to each of the user 102 and the other user 102 performing the same operation with respect to the spectacle-type device 100 and the other spectacle-type device 100 at substantially the same timing. The connection establishment process with another spectacle-type device 100 is executed. Performing the same operation at substantially the same timing may mean performing the same operation within a predetermined time range. Examples of the operation include tapping the frame 110 and lifting the frame 110. As a specific example, in the connection establishment unit 220, the user 102 taps the frame 110 of the eyeglass-type device 100 twice, and the other user 102 taps the frame 110 of the other user 102 twice within a predetermined time range. In response to the tapping, the connection establishment process with the other eyeglass-type device 100 is executed.

Such detection may be executed mainly by the management server 300. For example, when the spectacle-type device 100 detects a predetermined operation of the user 102 with respect to the spectacle-type device 100, notification information for notifying that fact and the position information of the spectacle-type device 100 is transmitted to the management server 300. .. Similarly, when the other spectacle-type device 100 detects a predetermined operation with respect to the other spectacle-type device 100 by the other user 102, that fact and the position information of the other spectacle-type device 100 are obtained. The notification information to be notified is transmitted to the management server 300.

The management server 300 monitors the notification information transmitted from the plurality of eyeglass-type devices 100, and is predetermined within a predetermined time range in the two eyeglass-type devices 100 located within the predetermined range. When it is detected that the operation has been performed, the two eyeglass-type devices 100 are notified to that effect. The two eyeglass-type devices 100 execute the connection establishment process in response to the notification.

The sharing control unit 222 shares the content with another spectacle-type device 100 to which the connection establishment unit 220 has established a connection. When the display control unit 216 displays the content stored in the storage unit 202 on the display unit, the sharing control unit 222 may transmit the content to another eyeglass-type device 100. Further, when the content is displayed on the other spectacle-type device 100, the shared control unit 222 may receive the content from the other spectacle-type device 100 and display the content on the display control unit 216.

As described above, a plurality of eyeglasses are established by establishing a connection with another eyeglass-type device 100 and sharing the content with the eyeglass-type device 100 having established the connection, depending on the condition that the predetermined conditions are satisfied. The type device 100 can provide an environment in which the same content can be easily shared and browsed.

When the single connection mode is set by the mode setting unit 218, the connection establishment unit 220 may switch the partner for establishing the connection each time a predetermined condition is satisfied.

The connection establishment unit 220 may execute automatic switching. For example, the connection establishment unit 220 of the first spectacle-type device 100 may connect with the first spectacle-type device 100 when the first spectacle-type device 100 and the second spectacle-type device 100 establish a connection. When a predetermined condition is satisfied with the third spectacle-type device 100, the connection with the second spectacle-type device 100 is automatically disconnected, and the third spectacle-type device 100 and the third spectacle-type device 100 are automatically disconnected. Establish a connection.

The connection establishment unit 220 may execute manual switching. For example, the connection establishment unit 220 of the first spectacle-type device 100 may connect with the first spectacle-type device 100 when the first spectacle-type device 100 and the second spectacle-type device 100 establish a connection. Whether to switch the connection to the first user 102 of the first spectacle-type device 100 to the third spectacle-type device 100 when the predetermined condition with the third spectacle-type device 100 is satisfied. Inquire whether or not. Then, in response to the response to the effect of switching, the connection establishment unit 220 disconnects from the second spectacle-type device 100 and establishes a connection with the third spectacle-type device 100.

When a plurality of connection modes are set by the mode setting unit 218, the connection establishment unit 220 may establish a connection with another eyeglass-type device 100 each time a predetermined condition is satisfied.

The connection establishment unit 220 may automatically execute an additional connection. For example, the connection establishment unit 220 of the first spectacle-type device 100 may connect with the first spectacle-type device 100 when the first spectacle-type device 100 and the second spectacle-type device 100 establish a connection. When a predetermined condition is satisfied with the third spectacle-type device 100, the connection with the third spectacle-type device 100 is automatically maintained while maintaining the connection with the third spectacle-type device 100. To establish.

The connection establishment unit 220 may manually execute an additional connection. For example, the connection establishment unit 220 of the first spectacle-type device 100 may connect with the first spectacle-type device 100 when the first spectacle-type device 100 and the second spectacle-type device 100 establish a connection. When a predetermined condition with the third spectacle-type device 100 is satisfied, the first user 102 of the first spectacle-type device 100 is additionally connected to the third spectacle-type device 100. Inquire whether to establish. Then, in response to the response that the connection is additionally established, the connection establishment unit 220 connects to the third spectacle-type device 100 while maintaining the connection with the second spectacle-type device 100. Establish.

The connection establishment unit 220 may use different conditions depending on whether the spectacle-type device 100 is set to the single connection mode or the spectacle-type device 100 is set to the plurality of connection modes. For example, when the spectacle-type device 100 is set to the single connection mode, the connection establishment unit 220 has the line of sight of the user 102 of the spectacle-type device 100 and the line of sight of another user 102 of the other spectacle-type device 100 in advance. The condition for establishing a connection is that they match continuously for a specified period of time. Then, when the spectacle-type device 100 is set to the plurality of connection modes, the connection establishment unit 220 is at a position where the line of sight of the other user 102 of the other spectacle-type device 100 corresponds to the user 102 of the spectacle-type device 100. The condition for establishing a connection is that the content for establishing a connection displayed in is continuously directed to the content for establishing a connection for a predetermined time. As a result, when establishing a connection with a plurality of other eyeglass-type devices 100, it is possible to eliminate the need to make a line of sight with each of the plurality of other users 102, and efficiently connect with the plurality of other users 102. Can provide an environment that can be established.

FIG. 7 schematically shows an example of the functional configuration of the management server 300. The management server 300 includes a storage unit 302, an information receiving unit 304, a content transmitting unit 306, and a connection control unit 308. It is not always essential that the management server 300 includes all of these.

The information receiving unit 304 receives various information from the eyeglass-type device 100. The information receiving unit 304 may receive the information transmitted by the information transmitting unit 214. The information receiving unit 304 stores the received information in the storage unit 302.

The content transmission unit 306 transmits content to the eyeglass-type device 100. The content transmission unit 306 may make the content into the transmission spectacle-type device 100 in response to a request from the spectacle-type device 100.

The connection control unit 308 controls the spectacle-type device 100 and another spectacle-type device 100 to establish a connection based on the information received by the information receiving unit 304. The connection control unit 308 sets the first spectacle-type device 100 and the second spectacle-type device 100 according to the condition that a predetermined condition is satisfied between the first spectacle-type device 100 and the second spectacle-type device 100. It may be controlled to establish a connection with the spectacle-type device 100. The connection control unit 308 may use the first spectacle-type device 100 and the first spectacle-type device 100, for example, depending on whether a predetermined condition is satisfied between the first spectacle-type device 100 and the second spectacle-type device 100. A connection establishment instruction for establishing a connection is transmitted to the spectacle-type device 100 of 2.

The connection control unit 308 establishes a connection between the first spectacle-type device 100 and the second spectacle-type device 100, for example, based on the line of sight of the first user 102 of the first spectacle-type device 100.

For example, the connection control unit 308 connects according to the fact that the line of sight of the first user 102 and the line of sight of the second user 102 of the second eyeglass-type device 100 continuously match for a predetermined time. Send an establishment instruction. The connection control unit 308 identifies the line-of-sight match based on the line-of-sight information of the first user 102 and the second user 102 received from the first spectacle-type device 100 and the second spectacle-type device 100, and the line-of-sight is one. It may be determined whether or not the time spent is exceeding a predetermined time.

Further, for example, the connection control unit 308 may previously display the line of sight of the first user 102 on the connection establishment content 250 displayed at a position corresponding to the second user 102 in the lens 116 of the first eyeglass-type device 100. A connection establishment instruction is sent according to the fact that the user has been directed for a specified period of time.

Further, for example, the connection control unit 308 connects according to the line of sight of the first user 102 directed to a predetermined object exchanged between the first user 102 and the second user 102. Send an establishment instruction. The connection control unit 308 may recognize the object exchanged between the first user 102 and the second user 102 by analyzing the captured image received from the first eyeglass-type device 100.

Further, for example, the connection control unit 308 matches the locus of the line of sight of one of the first user 102 and the second user 102 with the locus of the other finger of the first user 102 and the second user 102. In response, a connection establishment instruction is sent.

The connection control unit 308 may transmit a connection establishment instruction based on the captured images of the second spectacle-type device 100 and the second user 102 captured by the camera 120 of the first spectacle-type device 100. .. The connection control unit 308 analyzes the captured image received from the first spectacle-type device 100, so that the first user 102 wants to establish a connection within the imaging range of the first spectacle-type device 100. It may be determined that the user 102 of 2 is included.

When the connection control unit 308 detects a predetermined operation within a predetermined time range in the first spectacle-type device 100 and the second spectacle-type device 100 located within a predetermined distance. May send a connection establishment instruction to. Examples of the operation include tapping the frame 110 and lifting the frame 110.

The sharing control unit 310 causes the first spectacle-type device 100 and the second spectacle-type device 100, which have established a connection, to share the content under the control of the connection control unit 308. The shared control unit 310 may cause the first spectacle-type device 100 to transmit the content displayed on the lens 116 of the first spectacle-type device 100 from the first spectacle-type device 100 to the second spectacle-type device 100. .. Further, the shared control unit 310 causes the second spectacle-type device 100 to transmit the content displayed on the lens 116 of the second spectacle-type device 100 from the second spectacle-type device 100 to the first spectacle-type device 100. You can do it. The shared control unit 310 may wirelessly transmit the content directly between the first spectacle-type device 100 and the second spectacle-type device 100. The shared control unit 310 may relay the transmission of the content between the first spectacle-type device 100 and the second spectacle-type device 100.

FIG. 8 schematically shows an example of a hardware configuration of a computer 1200 that functions as a control device 200 or a management server 300. A program installed on the computer 1200 causes the computer 1200 to function as one or more "parts" of the apparatus according to the present embodiment, or causes the computer 1200 to perform an operation associated with the apparatus according to the present embodiment or the one or the like. A plurality of "parts" can be executed and / or a computer 1200 can be made to execute a process according to the present embodiment or a stage of the process. Such a program may be run by the CPU 1212 to cause the computer 1200 to perform certain operations associated with some or all of the blocks of the flowcharts and block diagrams described herein.

The computer 1200 according to this embodiment includes a CPU 1212, a RAM 1214, and a graphic controller 1216, which are interconnected by a host controller 1210. The computer 1200 also includes an input / output unit such as a communication interface 1222, a storage device 1224, and an IC card drive, which are connected to the host controller 1210 via the input / output controller 1220. The storage device 1224 may be a hard disk drive, a solid state drive, or the like. The computer 1200 also includes an input / output unit such as a ROM 1230 and a keyboard or touch panel, which are connected to the input / output controller 1220 via an input / output chip 1240.

The CPU 1212 operates according to a program stored in the ROM 1230 and the RAM 1214, thereby controlling each unit. The graphic controller 1216 acquires the image data generated by the CPU 1212 in a frame buffer or the like provided in the RAM 1214 or itself so that the image data is displayed on the display device 1218.

The communication interface 1222 communicates with other electronic devices via the network. The storage device 1224 stores programs and data used by the CPU 1212 in the computer 1200. The IC card drive reads the program and data from the IC card and / or writes the program and data to the IC card.

The ROM 1230 stores in it a boot program or the like executed by the computer 1200 at the time of activation, and / or a program depending on the hardware of the computer 1200. The input / output chip 1240 may also connect various input / output units to the input / output controller 1220 via a USB port, a parallel port, a serial port, a keyboard port, a mouse port, and the like.

The program may be provided by a computer-readable storage medium such as an IC card. The program is read from a computer-readable storage medium, installed in a storage device 1224, RAM 1214, or ROM 1230, which is also an example of a computer-readable storage medium, and executed by the CPU 1212. The information processing described in these programs is read by the computer 1200 and provides a link between the program and the various types of hardware resources described above. The device or method may be configured to implement the operation or processing of information in accordance with the use of the computer 1200.

For example, when communication is executed between the computer 1200 and an external device, the CPU 1212 executes a communication program loaded in the RAM 1214, and performs communication processing with respect to the communication interface 1222 based on the processing described in the communication program. You may order. Under the control of the CPU 1212, the communication interface 1222 reads the transmission data stored in the transmission buffer area provided in the recording medium such as the RAM 1214, the storage device 1224, or the IC card, and transfers the read transmission data to the network. The received data transmitted or received from the network is written in the reception buffer area or the like provided on the recording medium.

Further, the CPU 1212 makes the RAM 1214 read all or necessary parts of the file or the database stored in the external recording medium such as the storage device 1224 and the IC card, and various types of processing for the data on the RAM 1214. May be executed. The CPU 1212 may then write back the processed data to an external recording medium.

Various types of information such as various types of programs, data, tables, and databases may be stored in recording media and processed. The CPU 1212 describes various types of operations, information processing, conditional judgment, conditional branching, unconditional branching, and information retrieval described in various parts of the present disclosure with respect to the data read from the RAM 1214. Various types of processing may be performed, including / replacement, etc., and the results are written back to the RAM 1214. Further, the CPU 1212 may search for information in a file, a database, or the like in the recording medium. For example, when a plurality of entries each having an attribute value of the first attribute associated with the attribute value of the second attribute are stored in the recording medium, the CPU 1212 is the first of the plurality of entries. The attribute value of the attribute of is searched for the entry that matches the specified condition, the attribute value of the second attribute stored in the entry is read, and the attribute value of the second attribute is changed to the first attribute that satisfies the predetermined condition. You may get the attribute value of the associated second attribute.

The program or software module described above may be stored on a computer 1200 or in a computer readable storage medium near the computer 1200. Further, a recording medium such as a hard disk or RAM provided in a dedicated communication network or a server system connected to the Internet can be used as a computer-readable storage medium, whereby the program can be transferred to the computer 1200 via the network. offer.

The blocks in the flowcharts and block diagrams of this embodiment may represent the stage of the process in which the operation is performed or the "part" of the device responsible for performing the operation. Specific steps and "parts" are supplied with a dedicated circuit, a programmable circuit supplied with computer-readable instructions stored on a computer-readable storage medium, and / or with computer-readable instructions stored on a computer-readable storage medium. It may be implemented by the processor. Dedicated circuits may include digital and / or analog hardware circuits, and may include integrated circuits (ICs) and / or discrete circuits. Programmable circuits include logical products, logical sums, exclusive logical sums, negative logical products, negative logical sums, and other logical operations, such as, for example, field programmable gate arrays (FPGAs), programmable logic arrays (PLAs), and the like. , Flip-flops, registers, and reconfigurable hardware circuits, including memory elements.

The computer readable storage medium may include any tangible device capable of storing instructions executed by the appropriate device, so that the computer readable storage medium having the instructions stored therein may be in a flow chart or block diagram. It will be equipped with a product that contains instructions that can be executed to create means for performing the specified operation. Examples of the computer-readable storage medium may include an electronic storage medium, a magnetic storage medium, an optical storage medium, an electromagnetic storage medium, a semiconductor storage medium, and the like. More specific examples of computer-readable storage media include floppy (registered trademark) disks, diskettes, hard disks, random access memory (RAM), read-only memory (ROM), and erasable programmable read-only memory (EPROM or flash memory). , Electrically Erasable Programmable Read Only Memory (EEPROM), Static Random Access Memory (SRAM), Compact Disc Read Only Memory (CD-ROM), Digital Versatile Disc (DVD), Blu-ray® Disc, Memory Stick , Integrated circuit cards and the like may be included.

Computer-readable instructions include assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcodes, firmware instructions, state-setting data, or Smalltalk®, JAVA®, C ++, etc. Object-oriented programming languages, and either source code or object code written in any combination of one or more programming languages, including traditional procedural programming languages such as the "C" programming language or similar programming languages. May include.

Computer-readable instructions are used to generate means for a general purpose computer, a special purpose computer, or the processor of another programmable data processing device, or a programmable circuit, to perform an operation specified in a flowchart or block diagram. General purpose computers, special purpose computers, or other programmable data processing locally or via a local area network (LAN), a wide area network (WAN) such as the Internet, etc. to execute such computer-readable instructions. It may be provided to the processor of the device or a programmable circuit. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, and the like.

Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It will be apparent to those skilled in the art that various changes or improvements can be made to the above embodiments. It is clear from the description of the claims that the form with such changes or improvements may be included in the technical scope of the present invention.

The order of execution of each process such as operation, procedure, step, and step in the apparatus, system, program, and method shown in the claims, specification, and drawings is particularly "before" and "prior to". It should be noted that it can be realized in any order unless the output of the previous process is used in the subsequent process. Even if the scope of claims, the specification, and the operation flow in the drawings are explained using "first", "next", etc. for convenience, it means that it is essential to carry out in this order. It's not a thing.

10 systems, 20 networks, 100 eyeglass devices, 102 users, 110 frames, 112 rims, 114 bridges, 116 lenses, 118 temples, 120 cameras, 122 sensors, 124 line-of-sight detectors, 126 sensors, 200 controllers, 202 enclosures. , 204 Captured image acquisition unit, 206 Sensor information acquisition unit, 208 Line-of-sight information acquisition unit, 210 Content acquisition unit, 212 Imaging range information generation unit, 214 Information transmission unit, 216 Display control unit, 218 mode setting unit, 220 Connection establishment unit 222 Shared control unit, 250 connection content, 300 management server, 302 storage unit, 304 information reception unit, 306 content transmission unit, 308 connection control unit, 310 shared control unit, 1200 computer, 1210 host controller, 1212 CPU, 1214 RAM, 1216 graphic controller, 1218 display device, 1220 input / output controller, 1222 communication interface, 1224 storage device, 1230 ROM, 1240 input / output chip

Claims (17)

It ’s a glasses-type device,
A display control unit that displays content on the display unit,
A connection establishment unit that establishes a connection with other eyeglass-type devices when predetermined conditions are met.
A spectacle-type device including the other spectacle-type device to which the connection establishment unit has established a connection and a sharing control unit that shares the content. The spectacle-type device according to claim 1, wherein the connection establishment unit establishes a connection with the other spectacle-type device based on the line of sight of the user wearing the spectacle-type device. The connection establishment unit with the other spectacle-type device, depending on whether the line of sight of the user of the spectacle-type device and the line of sight of the user of the other spectacle-type device continuously match for a predetermined time. The spectacle-type device according to claim 2, which executes the connection establishment process of the above. The connection establishment unit indicates that the line of sight of the user of the spectacle-type device is continuously directed to the connection-establishment content displayed at a position corresponding to the user of the other spectacle-type device for a predetermined time. The spectacle-type device according to claim 2 or 3, wherein the connection establishment process with the other spectacle-type device is executed accordingly. The connection establishment unit responds that the line of sight of the user of the spectacle-type device is directed to a predetermined object to be exchanged between the user of the spectacle-type device and the user of the other spectacle-type device. The spectacle-type device according to any one of claims 2 to 4, which executes a connection establishment process with the other spectacle-type device. The connection establishment unit performs a connection establishment process with the other spectacle-type device according to the fact that the locus of the line of sight of the user of the spectacle-type device matches the locus of the finger of the user of the other spectacle-type device. The spectacle-type device according to any one of claims 2 to 5, which is executed. It is provided with a receivable mode setting unit that sets the spectacle-type device to a receivable mode in which connection requests from other spectacle-type devices can be received in response to an instruction from the user of the spectacle-type device.
When the spectacle-type device is in the receivable mode, the connection establishment unit performs a connection establishment process with the other spectacle-type device in response to receiving the connection application from the other spectacle-type device. The spectacle-type device according to any one of claims 1 to 6 to be executed. The connection establishment unit is based on a captured image of an object captured by the camera of the spectacle-type device and containing information for establishing a connection with the other spectacle-type device corresponding to the other spectacle-type device. The spectacle-type device according to any one of claims 1 to 7, which executes a connection establishment process with the other spectacle-type device. The connection establishment unit performs a connection establishment process with the other spectacle-type device based on the images captured by the camera of the spectacle-type device and the user of the other spectacle-type device and the other spectacle-type device. The spectacle-type device according to any one of claims 1 to 8, which is executed. The connection establishment unit detects a predetermined action of the user of the spectacle-type device with respect to the spectacle-type device and the predetermined action of the user of the other spectacle-type device with respect to the other spectacle-type device. The spectacle-type device according to any one of claims 1 to 9, which executes a connection establishment process with the other spectacle-type device according to the request. In response to instructions from the user of the spectacle-type device, the spectacle-type device has a single connection mode for establishing a connection with one other spectacle-type device, or a plurality of for establishing a connection with a plurality of other spectacle-type devices. Equipped with a connection mode setting unit to set the connection mode
The connection establishment unit establishes a connection with the other spectacle-type device each time the predetermined condition is satisfied when the spectacle-type device is set to the plurality of connection modes, according to claim 1. 10. The spectacle-type device according to any one of 10. The connection establishment unit uses different conditions depending on whether the spectacle-type device is set to the single connection mode and the spectacle-type device is set to the plurality of connection modes, according to claim 11. The described eyeglass-type device. A program for making a spectacle-type device function as the spectacle-type device according to any one of claims 1 to 12. An information receiving unit that receives information from a first spectacle-type device and a second spectacle-type device having a function of displaying contents on a display unit.
A connection control unit that controls to establish a connection between the first spectacle-type device and the second spectacle-type device based on the information received by the information receiving unit.
A management server including a shared control unit for sharing content between the first spectacle-type device and the second spectacle-type device for which a connection is established by control by the connection control unit. The information receiving unit includes the position information of the first spectacle-type device and the second spectacle-type device, and the first user of the first spectacle-type device and the second of the second spectacle-type device. The locus information of one finger of the user and the line-of-sight information of the first user and the second user are received.
When the locus of one finger of the first user and the second user matches the locus of the other line of sight of the first user and the second user, the connection control unit said. The management server according to claim 14, which controls to establish a connection between the first spectacle-type device and the second spectacle-type device. The information receiving unit detects that the position information of the first spectacle-type device and the second spectacle-type device and the predetermined operation by the first user with respect to the first spectacle-type device are detected. The first detection information shown and the second detection information indicating that the predetermined operation by the second user with respect to the second spectacle-type device has been detected are received.
The connection control unit has detected the predetermined operation within a predetermined time range in the first spectacle-type device and the second spectacle-type device located within a predetermined distance. The management server according to claim 14 or 15, which controls to establish a connection between the first spectacle-type device and the second spectacle-type device in the case of a case. A program for operating a computer as a management server according to any one of claims 14 to 16.

Images