JP2016149067A - Sight line guidance system, and sight line guidance device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To indicate a direction that a user is to watch with a simple configuration.SOLUTION: A sight line guidance system includes a transmitter and a plurality of receivers. The transmitter transmits gazing position information indicating the position of a gazing object. A receiver includes: a reception part for receiving the gazing position information transmitted by the transmitter; a calculation part for calculating a direction to the position of the gazing object from the position of its own device on the basis of the gazing position information received by the reception part; and a tactile sense generation part for generating a tactile sense indicating the direction calculated by the calculation part.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a line-of-sight guidance system and a line-of-sight guidance apparatus.

  2. Description of the Related Art A portable navigation device that supports navigation when a user moves with the user holding a housing is known (for example, see Patent Document 1). In this portable navigation device, at least three active elements that generate vibration are arranged at different positions, and the vibration intensity of the active elements is controlled. This allows the user holding the device in his / her palm to recognize that only a single vibrating element is present (vibration is occurring at a predetermined position), and the direction in which the user should move or view Can be pointed to.

JP 2012-127940 A

  However, in the conventional technology, since it is required to always detect the position of the device according to the movement of the user, the configuration of the device may be complicated. In particular, when the user indicates the direction to be viewed without moving, the configuration of the apparatus cannot be simplified even though the position of the apparatus does not always need to be detected. The present invention has been made in view of the above points, and provides a line-of-sight guidance system and a line-of-sight guidance apparatus that can point a user in a direction to be viewed with a simple configuration.

  One aspect of the present invention is a transmitter that transmits gaze position information indicating a position of a gaze target, a receiver that receives the gaze position information transmitted by the transmitter, and the gaze position information received by the receiver. A plurality of receiving devices including a calculation unit that calculates a direction from the position of the own device to the position of the gaze target, and a haptic generation unit that generates a haptic indicating the direction calculated by the calculation unit; It is a gaze guidance system provided with.

  Further, according to one aspect of the present invention, a receiving unit that receives gaze position information transmitted as information indicating a position of a gaze target, the gaze position information received by the receiving unit, and a predetermined position of the device itself And a gaze guidance device that includes a calculation unit that calculates a direction from the position of the own device to the position of the gaze target, and a tactile generation unit that generates a tactile sensation indicating the direction calculated by the calculation unit. .

  One aspect of the present invention is gaze position information indicating a position of a gaze target, and a reception unit that receives the gaze position information transmitted based on a predetermined order of a plurality of positions of the gaze target; Based on the gaze position information received by the receiving unit, a calculation unit that calculates a direction from the position of the own device to the position of the gaze target, and a haptic that generates the tactile sensation indicating the direction calculated by the calculation unit It is a gaze guidance device provided with a generating part.

  According to the aspect of the present invention, it is possible to indicate the direction to be viewed by the user with a simple configuration.

It is a schematic diagram which shows an example of a structure of the gaze guidance system which concerns on embodiment of this invention. It is a block diagram which shows an example of a function structure of the transmitter of this embodiment. It is a figure which shows an example of the gaze position information memorize | stored in the memory | storage part of this embodiment. It is a figure which shows the modification of the gaze position information memorize | stored in the memory | storage part of this embodiment. It is a schematic diagram which shows an example of the external appearance structure of the receiver of this embodiment. It is a block diagram which shows an example of a function structure of the receiver of this embodiment. It is the partial perspective view which illustrated the arrangement position of the vibrator with which the vibration generating part of this embodiment is provided. It is a schematic diagram which shows an example of the vibration localization which the receiver of this embodiment controls. It is a schematic diagram which shows an example of the combination of the amplitude of each vibrator | oscillator of this embodiment. It is a schematic diagram which shows an example of the locus | trajectory of the movement of the vibration localization which the receiver of this embodiment controls. It is a flowchart which shows an example of the flow of the process which the gaze guidance system of this embodiment performs.

[Embodiment]
Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a schematic diagram illustrating an example of the configuration of the line-of-sight guidance system 1 according to the first embodiment of the present invention. The line-of-sight guidance system 1 guides the audience's line of sight by notifying each of the positions on the stage STG of the positions on the stage STG to a spectator sitting in a spectator seat such as a theater or a hall. System. In this example, the position on the stage STG includes a stage lower position P1, a stage center position P2, and a stage upper position P3. In the following description, the lower stage is also referred to simply as “lower” and the upper stage is simply referred to as “high”. The line-of-sight guidance system 1 sits at each spectator seat as a position to watch the upper position P3 of the performer's destination when the performer moves from the lower to the upper stage on the stage STG as the stage progresses. Notify the audience. Thereby, the line-of-sight guidance system 1 guides the audience's line of sight to the position P3 of the upper stage. In the following description, this audience is also referred to as user U. Moreover, when distinguishing the individual user U, it describes also as the user U1-user U5, for example. The line-of-sight guidance system 1 includes one transmission device 100 and a plurality of reception devices 200. In the following description, the receiving device 200 is also referred to as a line-of-sight guidance device.

  Hereinafter, in the present embodiment, the configuration of the line-of-sight guidance system 1 will be described using a plurality of three-dimensional orthogonal coordinate systems. The first three-dimensional orthogonal coordinate system is an XYZ orthogonal coordinate system. The XYZ orthogonal coordinate system indicates coordinates of a place (for example, a theater) where the line-of-sight guidance system 1 is installed as a reference position. For example, in the present embodiment, the XYZ orthogonal coordinate system indicates coordinates with the theater seat entrance as a reference position. In this case, the X axis indicates the coordinates in the theater front direction, and the Y axis indicates the coordinates in the depth direction of the theater. The Z axis indicates the coordinates in the top (height) direction of the theater. In the present embodiment, the coordinates indicated in the XYZ coordinate system are also referred to as absolute coordinates.

  According to the XYZ orthogonal coordinate system, the position P100 of the transmission device 100 is indicated as a position P100a (10, 20, 0). Further, according to the XYZ orthogonal coordinate system, the position P0 of the lower end of the stage STG is indicated as a position P0a (20, 70, 0). Similarly, the lower position P1, the center position P2, and the upper position P3 of the stage STG are respectively a position P1a (70, 80, 0), a position P2a (90, 80, 0), and a position P3a (110, 80, 0). Further, the positions P201 to P205 of the receiving apparatuses 200-1 to -5 arranged in the seats of the respective users U (users U1 to U5) are shown as follows. That is, position P201a (40, 10, 0), position P202a (50, 10, 0), position P203a (60, 10, 0), position P204a (70, 10, 0), position P205a (80, 10, 0) ). In addition, although the user U demonstrates here as an example that it is five, it is not restricted to this.

  The second three-dimensional orthogonal coordinate system is an xs · ys · zs orthogonal coordinate system. The xs · ys · zs orthogonal coordinate system indicates coordinates on the stage STG with a certain position on the stage STG as a reference position. For example, in the present embodiment, the xs · ys · zs orthogonal coordinate system indicates coordinates with the lower end position P0 as a reference position. The top (height) direction of the stage STG is the zs direction, the plane orthogonal to the zs direction is the xs · ys plane, and among the directions orthogonal to the xs · ys plane, the width direction of the stage STG is the xs direction and the depth direction is The ys direction is assumed. According to the xs · ys · zs orthogonal coordinate system, the position P0 at the lower end of the stage STG is indicated as a position P0s (0, 0, 0). Similarly, the lower position P1, the center position P2, and the upper position P3 of the stage STG are respectively the position P1s (50, 10, 0), the position P2s (70, 10, 0), and the position P3s (90, 10, 0).

  The third three-dimensional orthogonal coordinate system is an xr / yr / zr orthogonal coordinate system. The xr / yr / zr orthogonal coordinate system indicates coordinates on the receiving apparatus 200 with a certain position on the receiving apparatus 200 as a reference position. In the xr / yr / zr orthogonal coordinate system, the stacking direction of the components of the receiving apparatus 200 is defined as the zr direction. A plane orthogonal to the zr direction is defined as an xr / yr plane, and directions orthogonal to the xr / yr plane are defined as an xr direction and an yr direction, respectively. A specific example of the xr / yr / zr orthogonal coordinate system will be described later with reference to FIG.

  As illustrated in FIG. 1, in the line-of-sight guidance system 1, a transmission device 100 and a plurality of reception devices 200 communicate with each other wirelessly or by wire. In the following description, as an example, a case where the transmission apparatus 100 and a plurality of reception apparatuses 200 perform wireless communication will be described. The transmission device 100 transmits gaze position information as information for guiding the audience's line of sight to the plurality of reception devices 200 in the theater all at once. The receiving apparatus 200 receives the gaze position information transmitted from the transmitting apparatus 100 all at once, and notifies the audience of the position to be gaze based on the received gaze position information. Hereinafter, configurations of the transmission device 100 and the reception device 200 will be described.

  FIG. 2 is a block diagram illustrating an example of a functional configuration of the transmission apparatus 100 according to the present embodiment. The transmission device 100 includes a storage unit 110, a trigger reception unit 120, a communication unit 130, and a control unit 140.

  The control unit 140 includes a CPU (Central Processing Unit) and the like, and controls the entire transmission apparatus 100. Details of the control performed by the control unit 140 will be described later.

  The communication unit 130 includes, for example, a wireless transmission / reception circuit and an antenna (both not shown), and performs communication with the reception device 200 based on the control of the control unit 140.

  The storage unit 110 is a storage device such as a flash memory, a hard disk drive (HDD), a random access memory (RAM), a read only memory (ROM), and a register. The storage unit 110 stores a program (firmware) executed by the control unit 140 in advance. In addition, the storage unit 110 stores a calculation result obtained by performing the calculation process by the control unit 140. The storage unit 110 also stores gaze position information in which sequence numbers indicating the order of stage progress and coordinates of the gaze position are associated with each other. An example of the gaze position information will be described with reference to FIG.

  FIG. 3 is a diagram illustrating an example of gaze position information stored in the storage unit 110 of the present embodiment. The storage unit 110 stores the coordinates of the gaze position for each sequence number indicating the order of stage progression. An example of the order of the stage progression is shown in FIG. First, a performer appears on the stage STG from the lower side (sequence number “1”). At this time, the gaze position is the position P1 of the lower stage. Next, the performer moves to the center of the stage STG (sequence number “2”). At this time, the gaze position is the position P2 at the center of the stage. Thereafter, the performer sequentially moves in the upper, middle, upper, middle and lower stages of the stage STG (sequence numbers “3” to “7”). At this time, the gaze position is set in accordance with the movement of the performer. An example of gaze position information set based on the order of the stage progression is shown in FIG. Specifically, in the storage unit 110, the sequence number “1” and the position P1a (70, 80, 0) are associated and stored as gaze position information. Here, the position P1a (70, 80, 0) is the absolute coordinate of the position P1 on the lower stage of the stage as described above. That is, in the storage unit 110 of the present embodiment, the sequence number and the absolute coordinates of the gaze position are associated and stored as gaze position information. The storage unit 110 stores the sequence numbers “2” to “7” in association with the absolute coordinates of the gaze position in each sequence number. Specifically, the storage unit 110 has the sequence number “2” and the position P2a (90, 80, 0), the sequence number “3” and the position P3a (110, 80, 0), the sequence number “ 4 ″ and the position P2a (90, 80, 0) are stored in association with each other. Further, in the storage unit 110, the sequence number “5”, the position P3a (110, 80, 0), the sequence number “6”, and the position P2a (90, 80, 0) are the sequence number “7”. The position P1a (70, 80, 0) is stored in association with each other.

As illustrated in FIG. 4, the storage unit 110 may store the sequence number and the relative coordinates of the gaze position in association with each other as gaze position information.
FIG. 4 is a diagram illustrating a modification of gaze position information stored in the storage unit 110 of the present embodiment. Here, the relative coordinates of the gaze position may be coordinates based on the xs · ys · zs orthogonal coordinate system indicating the coordinates on the stage STG with a certain position on the stage STG as a reference position. Further, the relative coordinates of the gaze position may be, for example, coordinates based on a coordinate system in which the position of the transmission device 100 is a reference position. Here, a case where the relative coordinates of the gaze position are coordinates in the xs · ys · zs orthogonal coordinate system will be described. The storage unit 110 stores relative coordinates of the gaze position for each sequence number indicating the order of stage progress. An example of the order of the stage progression is shown in FIG. Note that the order of the stage progression shown in FIG. 4A is the same as the order of the stage progression shown in FIG. An example of gaze position information set based on the order of the stage progression is shown in FIG. Specifically, in the storage unit 110, the sequence number “1” and the position P1s (50, 10, 0) are associated and stored as gaze position information. Here, the position P1s (50, 10, 0) is the coordinates of the position P1 of the lower stage of the stage, with the position P0 of the lower side of the stage STG as the reference position, as described above. That is, in the storage unit 110 of the present embodiment, the sequence number and the relative coordinates of the gaze position are associated and stored as gaze position information. The storage unit 110 stores the sequence numbers “2” to “7” in association with the absolute coordinates of the gaze position in each sequence number. Specifically, in the storage unit 110, the sequence number “2”, the position P2s (70, 10, 0), the sequence number “3”, and the position P3a (90, 10, 0) are the sequence number “ 4 ″ and the position P2a (70, 10, 0) are stored in association with each other. Further, in the storage unit 110, the sequence number “5” and the position P3a (90, 10, 0), the sequence number “6” and the position P2a (70, 10, 0) are the sequence number “7”. The position P1a (50, 10, 0) is stored in association with each other.

  Returning to FIG. 2, the description of the transmission device 100 will be continued. The trigger reception unit 120 receives trigger information output from an external device or the like of the transmission device 100. The trigger information is information indicating that the next sequence number is transferred as the stage progresses. Specifically, this trigger information is generated when an operator who operates a trigger generator (not shown) having a push button presses the push button in accordance with the stage progress. In this case, the trigger receiving unit 120 is connected to the trigger generator, and receives trigger information generated by an operator's push button operation. When receiving the trigger information, the trigger receiving unit 120 outputs the trigger information to the control unit 140.

  Although an example in which the operator generates trigger information by operating the trigger generator has been described here, the present invention is not limited to this. For example, the trigger generator may be a stage lighting control device or a stage sound control device. Here, in these control devices, an illumination sequence and an acoustic sequence are programmed in advance according to the stage progress. Therefore, information for shifting to the next sequence number is stored in advance in these control devices. The trigger receiving unit 120 may receive trigger information from these control devices as a trigger generator. With this configuration, the trigger receiving unit 120 can receive automatically generated trigger information in synchronization with an illumination sequence, an acoustic sequence, or the like without an operator's operation.

  The control unit 140 performs control to transmit gaze position information stored in the storage unit 110 to the reception device 200 via the communication unit 130 based on the trigger information received by the trigger reception unit 120. Specifically, when the trigger receiving unit 120 receives trigger information, the control unit 140 reads gaze position information stored in the storage unit 110. Here, when the trigger reception unit 120 receives the first trigger information, the control unit 140 reads gaze position information associated with the sequence number “1”. More specifically, when the trigger reception unit 120 receives the first trigger information, the control unit 140 reads the position P1a (70, 80, 0) that is the gaze position associated with the sequence number “1”. . Further, the control unit 140 transmits the read position P1a (70, 80, 0) to the receiving device 200 via the communication unit 130. Here, the control unit 140 transmits the same read gaze position information to the plurality of receiving devices 200 all at once. That is, the transmission apparatus 100 transmits gaze position information at a transmission timing based on input transmission instruction information (trigger information).

  The control unit 140 adds 1 to the sequence number every time the trigger receiving unit 120 receives trigger information. Thereby, the control part 140 reads the gaze position information memorize | stored in the memory | storage part 110 in order of a sequence number. Specifically, when the trigger receiving unit 120 receives the trigger information, the control unit 140 adds 1 to the sequence number and reads gaze position information associated with the sequence number “2” after the addition. In addition, the control unit 140 transmits gaze position information associated with the read sequence number “2” to the receiving device 200. Further, when the trigger receiving unit 120 receives the trigger information, the control unit 140 adds 1 to the sequence number and reads gaze position information associated with the sequence number “3” after the addition. In addition, the control unit 140 transmits gaze position information associated with the read sequence number “3” to the receiving device 200. As described above, the control unit 140 sequentially reads the gaze position information stored in the storage unit 110 in the order of the sequence numbers and transmits the information to the receiving device 200. That is, the transmission device 100 transmits a plurality of gaze position information with different gaze target positions based on a predetermined order of the gaze target positions. Thereby, the transmission device 100 can transmit gaze position information indicating the gaze position in accordance with the stage progress to the reception device 200. Next, an example of the configuration of the reception device 200 will be described with reference to FIGS. 5 and 6.

  FIG. 5 is a schematic diagram illustrating an example of an external configuration of the receiving device 200 according to the present embodiment. FIG. 6 is a configuration diagram illustrating an example of a functional configuration of the receiving device 200 according to the present embodiment.

  As illustrated in FIG. 5, the receiving device 200 has, for example, a substantially rectangular shape when viewed in the Zr direction, and is configured such that the touch panel 260, the main body unit 201, and the back cover 202 are stacked in the Zr direction. FIG. 5A illustrates an external configuration of the receiving device 200 as viewed from the touch panel 260 side. FIG. 5B illustrates an external configuration of the electronic device as viewed from the back cover 202 side.

  The touch panel 260 displays an image input from the control unit 220 accommodated in the main body unit 201, detects a position (coordinates) where the user U touches the surface with a finger or the like, and outputs the detected position (coordinates) to the control unit 220. Here, the user U is a user of the receiving device 200. The touch panel 260 is configured, for example, by combining a liquid crystal display device that displays an image and a contact detection mechanism. Various contact detection mechanisms can be used. For example, a contact detection mechanism using various systems such as a resistive film system, a capacitance system, an infrared system, and a surface acoustic wave system can be employed. The touch panel 260 may be an organic EL (Electroluminescence) display device or the like instead of a liquid crystal display (LCD).

  The main body 201 accommodates a communication unit 210, a control unit 220, a vibration generation unit 230, a position acquisition unit 240, a storage unit 250, and the like shown in FIG. Further, the main body 201 may house a power supply circuit, a battery, a GPS (Global Positioning System) receiver, and the like in a casing. The back cover 202 is attached with a mount 203 on which various operation switches and the like can be mounted.

The main body unit 201 may include an imaging unit (camera), an I / O unit, an acceleration sensor, and a speaker in the housing.
The imaging unit is a digital camera that uses a solid-state imaging device such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS), for example. Note that the imaging unit may be a video camera. When the imaging unit is provided, a hole is formed in the back cover 202 to expose the lens of the imaging unit.
The I / O unit includes, for example, a USB (Universal Serial Bus) terminal, an HDMI (registered trademark) (High Definition Multimedia Interface) terminal, a terminal to which an SD card or the like is mounted.
The acceleration sensor is, for example, a triaxial acceleration sensor, detects acceleration (including gravitational acceleration) acting in the Xr direction, Yr direction, and Zr direction with respect to the receiving apparatus 200, and sends the detection result to the control unit 220. Output.
The speaker outputs sound based on the sound data generated by the control unit 220.

  The communication unit 210 performs wireless communication with the communication unit 130 of the transmission device 100. For example, the communication unit 210 performs wireless communication using a wireless LAN network, infrared communication, a mobile phone network, a PHS network, or the like. In addition, the communication unit 210 may include a network card that functions as a communication interface when connected to the transmission device 100 by wire.

The vibration generation unit 230 generates vibration based on the drive signal generated by the control unit 220. The vibration generating unit 230 includes a plurality of vibrators as shown in FIG.
FIG. 7 is a partial perspective view illustrating the arrangement positions of the vibrators included in the vibration generating unit 230 of this embodiment. Specifically, as illustrated in FIG. 7, for example, the vibration generation unit 230 may include vibrators 230 (1), 230 (2), 230 (3), and 230 ( 4). These vibrators are attached to the housing or support portion of the main body 201 or the back cover 202. For example, a voice coil motor (VCM) or an eccentric motor is used as the vibrator. When the voice coil motor is used, the vibrator generates, for example, vibration in the Z direction with respect to a part or the whole of the receiving device 200.

  The arrangement of the vibrators is not limited to that shown in FIG. 7, and other arrangements may be used. For example, the vibration generating unit 230 may include a vibrator in the vicinity of two corners located on the diagonal of the receiving device 200, or may include a vibrator at other positions. Further, the number of vibrators is not limited to four as shown in FIG. 7, and it is sufficient that two or more vibrators are provided. The mode of vibration generated by the vibration generator 230 can be changed by changing factors such as amplitude, frequency, phase, and duty.

  The control unit 220 controls the entire receiving device 200 including the vibration generating unit 230. The control unit 220 includes a vibration control unit (not shown) as the functional unit. The vibration control unit controls the vibration of the vibration generating unit 230 by outputting a vibration signal to the vibration generating unit 230. The control unit 220 can generate a tactile sensation indicating the direction of the gaze position by controlling the mode of vibration generated by the vibration generating unit 230. That is, the vibration generating unit 230 is an example of a tactile generating unit that generates a tactile sense indicating the direction of the gaze position. The control for generating a sense of touch indicating the direction of the gaze position by the control unit 220 will be described later. In the following description, the control performed by the vibration control unit will be described as the control performed by the control unit 220.

  The storage unit 250 is a storage device such as a flash memory, a hard disk drive (HDD), a random access memory (RAM), a read only memory (ROM), or a register. The storage unit 250 stores in advance a program (firmware) executed by a CPU (Central Processing Unit) of the control unit 220. In addition, the storage unit 250 stores a calculation result obtained by the CPU performing a calculation process. The storage unit 250 also stores content information received from other devices via the communication unit 210. Further, the storage unit 250 stores, for example, position information as information for the control unit 220 to control the vibration generation unit 230 in addition to image information serving as original information of an image to be displayed on the touch panel 260. This position information is information indicating the position where the receiving device 200 is disposed. This position information can be defined by various coordinate systems. In this example, the position information is defined by the absolute coordinates described above. Specifically, as described with reference to FIG. 1, the position P201 of the receiving apparatus 200-1 is the position P201a (40, 10, 0). Therefore, the position P201a (40, 10, 0) is stored as position information in the storage unit 250 of the receiving device 200-1. As for the receiving devices 200-2 to -5, the position information is stored in the storage unit 250 in the same manner as the receiving device 200-1. That is, the position P202a (50, 10, 0) is stored in the storage unit 250 of the receiving device 200-2, and the position P203a (60, 10, 0) is stored in the storage unit 250 of the receiving device 200-3. It is stored as information. The storage unit 250 of the receiving device 200-4 has a position P204a (70, 10, 0), and the storage unit 250 of the receiving device 200-5 has a position P205a (80, 10, 0). It is stored as information.

  The position acquisition unit 240 acquires a position where the receiving device 200 is arranged, and generates position information indicating the acquired position. The position acquisition unit 240 acquires the position of the own apparatus using a known technique. For example, the position of the device itself may be acquired from information such as the strength and delay of a radio signal transmitted from the transmission device 100. The position acquisition unit 240 writes the generated position information in the storage unit 250. By providing the position acquisition unit 240, the receiving apparatus 200 can update the position information even when the position is changed.

  In addition, when the position of the receiving device 200 is not changed with respect to the gaze position on the stage STG, the receiving device 200 may not include the position acquisition unit 240. For example, when the receiving device 200 is fixed to a spectator seat in a theater, the receiving device 200 may not include the position acquisition unit 240.

[Control of vibration localization]
Next, the vibration localization of the vibration generated by the vibration generator 230 will be described. The vibration localization is a position where the user U wants to feel that vibration is generated in a state where the receiving apparatus 200 is held by the palm PM of the user U. In other words, the vibration localization is a position recognized as a position where vibration is generated by the user U holding the receiving device 200. In the following description, this vibration localization is also referred to as vibration localization. The control unit 220 controls the vibration localization based on the gaze position information received from the transmission device 100 and the position information stored in the storage unit 250. In the following description, controlling vibration localization is also referred to as localization of vibration. Here, controlling the vibration localization means that the control unit 220 controls the vibration mode of each vibrator so that the vibration is localized at a certain coordinate in the space where the user U wants to feel that the vibration is generated. Is to control. Next, a mechanism in which the control unit 220 localizes vibration will be described.

  FIG. 8 is a schematic diagram illustrating an example of vibration localization controlled by the receiving device 200 according to the present embodiment. In FIG. 8, the position Pv <b> 0 is a position where the user wants the user to feel that vibration has occurred in a state where the receiving apparatus 200 is held by the user's palm PM with the touch panel 260 facing upward. The control unit 220 can make the user feel that vibration is generated at the position Pv0 by controlling the vibration localization. Thus, the effect that allows the user to feel that the vibration is generated at the position where the vibrator is not arranged is referred to as a sense of localization. A sense of orientation is phantom sensation, that is, a specific position between two or more positions when two or more positions on the user's skin are vibrated (stimulated) at the same time. In addition, the user feels as if the vibration is localized.

  For example, the control unit 220 controls the vibrators 230 (1) to 230 (4) so that the position of the center of gravity obtained by weighting the positions of the vibrators 230 (1) to 230 (4) with the vibration intensity matches the position Pv0. ). The intensity of vibration means amplitude, frequency, etc., or a combination thereof, and hereinafter, it is assumed to be amplitude. Further, since each vibrator is attached to, for example, the back cover 202, the vibration is easily transmitted to the user's palm PM by being held by the user's palm PM in the state shown in FIG.

  FIG. 9 is a schematic diagram illustrating an example of a combination of amplitudes of the vibrators of the present embodiment. FIG. 9 illustrates a combination of amplitudes of the transducers 230 (1) to 230 (4) in which the center of gravity weighted by the amplitude coincides with the position Pv0. In FIG. 9, the intersection of the center lines in the XY direction of the receiving apparatus 200 is defined as the origin of the XY plane. The coordinates of the vibrator 230 (1) are (+0.9, +0.9), the coordinates of the vibrator 230 (2) are (−0.9, +0.9), and the coordinates of the vibrator 230 (3) are The coordinates of (+0.9, -0.9), the vibrator 230 (4) are (-0.9, -0.9), and the coordinates of the position Pv0 are (0, -0.5). Here, the amplitude when the vibrator is not vibrating is 0 (zero) × K, and the amplitude of the maximum vibration that can be generated by the vibrator is 1 × K. This K is a reference amplitude. In this case, for example, the control unit 220 vibrates the vibrator 230 (1) with an amplitude of 0.45 × K, vibrates the vibrator 230 (3) with an amplitude of 0.55 × K, and vibrates the vibrator 230 (4). Is vibrated with an amplitude of 1 × K (hereinafter referred to as control state 1), the user holding the receiving apparatus 200 in the state of FIG. 8 may feel that vibration is occurring in the vicinity of the position Pv0. it can.

  Further, instead of the control state 1, the control unit 220 vibrates the vibrator 230 (2) with an amplitude of 0.45 × K and vibrates the vibrator 230 (3) with an amplitude of 1 × K. (4) may be vibrated with an amplitude of 0.55 × K (control state 2). Further, the control unit 220 vibrates the transducer 230 (1) and the transducer 230 (2) with an amplitude of 0.22 × K, and causes the transducer 230 (3) and the transducer 230 (4) to have an amplitude of 0.78 ×. You may vibrate with K (control state 3). As described above, there are a plurality of combinations of vibration modes in which the position of the center of gravity weighted by the amplitude coincides with the position Pv0, and the control unit 220 causes the user to vibrate at the position Pv0 by selecting an arbitrary control state. You can make them feel. The numerical values such as 0.45, 0.55, 1, 0.22, and 0.78 described above are merely examples, and the control unit 220 sets an arbitrary numerical value as long as the center of gravity can be matched with the position Pv0. can do.

[Control to move the vibration localization]
Next, an example of control in which the control unit 220 moves the vibration localization will be described with reference to FIG.
FIG. 10 is a schematic diagram illustrating an example of a locus of movement of vibration localization controlled by the receiving device 200 of the present embodiment. The control unit 220 performs control to move the vibration localization by changing the amplitude of each vibrator with the passage of time. Here, a case where the vibration localization is moved along the locus LC1 from the position Pv1 to the position Pv2 shown in FIG. 10 and further moved along the locus LC2 from the position Pv2 to the position Pv3 will be described as a specific example.

  In the case of this specific example, the control unit 220 first localizes the vibration at the position Pv1. At this time, the control unit 220 controls the vibration mode of each vibrator to localize the vibration at the position Pv1 as in the case where the vibration is localized at the position Pv0 described above. Specifically, the control unit 220 controls the vibration amplitude of the vibrators 230 (1) to (4) to localize the vibration at the position Pv1.

  In addition, the control unit 220 sets the vibration amplitude of the vibrator 230 (here, the vibrator 230 (1) (3)) closer to the position Pv1 to the vibrator 230 (here, the vibrator 230 (2) closer to the position Pv3. ) Each vibrator is vibrated with an amplitude larger than the vibration amplitude of (4)). At this time, the control unit 220 changes any ratio between the amplitude of the vibration of the vibrator 230 closer to the position Pv1 and the amplitude of the vibration of the vibrator 230 closer to the position Pv3. Vibration can be localized at the coordinates. For example, the control unit 220 controls the vibration at the position Pv2 by controlling the vibration amplitude of the vibrator 230 (1) (3) and the vibration amplitude of the vibrator 230 (2) (4) to the same amplitude. Can be localized.

  Next, the control unit 220 controls the vibration mode of each vibrator so that the vibration localization moves from the position Pv1 to the position Pv2. Specifically, the control unit 220 gradually increases the amplitude of the vibrator 230 (2) (4) while gradually decreasing the amplitude of the vibration of the vibrator 230 (1) (3) with the passage of time. As a result, the ratio between the vibration amplitude of the vibrator 230 closer to the position Pv1 and the vibration amplitude of the vibrator 230 closer to the position Pv3 changes, and the vibration localization moves from the position Pv1 to the position Pv2. Furthermore, the control unit 220 gradually increases the amplitude of the vibrator 230 (2) (4) while gradually decreasing the amplitude of the vibration of the vibrator 230 (1) (3) with the passage of time. As a result, the ratio between the vibration amplitude of the vibrator 230 closer to the position Pv1 and the vibration amplitude of the vibrator 230 closer to the position Pv3 changes, and the vibration localization moves from the position Pv2 to the position Pv3.

  Note that the frequency characteristics when various sensory receptors present on the skin of the user U receive vibration as a whole of these sensory receptors are approximately 0.3 to 1000 [Hz]. Among these sensory receptors, as a sensory receptor that receives a stimulus that causes the above-described phantom sensation, there is a Patini body. The frequency characteristic when the Patinny body receives vibration is about 30 to 1000 [Hz]. Therefore, the vibration frequency of each vibrator for generating phantom sensation is preferably about 40 to 1000 [Hz]. The frequency at which the skin of the user U can perceive the vibration generated by the vibrator as a vibration is about 300 [Hz] or less. Accordingly, it is preferable that the vibration frequency of each vibrator for impressing the movement of the vibration localization is about 30 to 300 [Hz].

[Control indicating gaze position]
Next, returning to FIG. 1, the control indicating the gaze position performed by the control unit 220 of the receiving apparatus 200 will be described. As described above, the transmission device 100 transmits one gaze position information to the plurality of reception devices 200 all at once (simultaneously). For example, the transmitting apparatus 100 transmits the position P1a (70, 80, 0) as the gaze position information of the sequence number “1” to the plurality of receiving apparatuses 200 all at once. Here, as shown in FIG. 1, the plurality of receiving apparatuses 200 are arranged at different positions with respect to the stage STG. For this reason, in the receiving apparatus 200-1, the position P1a (70, 80, 0) as the gaze position is the position on the right front of the user U1. On the other hand, in the receiving device 200-5, the position P1a (70, 80, 0) as the gaze position is a position in front of the user U1. That is, since the positions of the receiving devices 200 are different, the direction in which each user U should gaze is different from a certain gaze position on the stage STG.

  Therefore, the control unit 220 of the reception device 200 calculates the direction from the position of the own device to the gaze position by correcting the gaze position information transmitted from the transmission device 100 based on the position of the own device. An example of calculating the direction to the gaze position performed by the control unit 220 will be described.

  In this specific example, the transmitting apparatus 100 transmits the position P1a (70, 80, 0) to the receiving apparatus 200 as the gaze position information of the sequence number “1”. The position P1a (70, 80, 0) is an absolute coordinate indicating the position P1 of the lower stage. Each receiving device 200 receives a position P1a (70, 80, 0) as gaze position information transmitted by the transmitting device 100. Here, among the receiving apparatuses 200, the control unit 220 of the receiving apparatus 200-1 is based on the received position P1a (70, 80, 0) and the position P201a (40, 10, 0) of the own apparatus. The direction of the gaze position with respect to the own device is calculated. Specifically, the control unit 220 of the receiving device 200-1 determines the difference vector (30, 70, 0) between the received position P1a (70, 80, 0) and the position P201a (40, 10, 0) of the own device. 0) is calculated. The direction of the difference vector (30, 70, 0) is the direction of the gaze position with respect to the own device. Further, the control unit 220 of the receiving device 200-5 determines the difference vector (−10, 70, 0) between the received position P1a (70, 80, 0) and the position P205a (80, 10, 0) of the own device. Is calculated. The direction of the difference vector (−10, 70, 0) is the direction of the gaze position with reference to the own device. The control unit 220 of the reception devices 200-2 to 200-4 calculates the difference vector in the same manner as the control unit 220 of the reception devices 200-1 and -5 described above. That is, the control unit 220 of the reception device 200 functions as a calculation unit that calculates the direction from the position of the own device to the position of the gaze target based on the gaze position information received by the communication unit 210. That is, the control unit 220 calculates the direction from the position of the own device to the position of the gaze target based on the gaze position information received by the communication unit 210 and the predetermined position of the own device.

  Note that when the receiving device 200 is not associated with a seat and the position of the receiving device 200 is not determined in advance, the control unit 220 is based on the position of the own device acquired by the position acquisition unit 240 described above. Thus, the direction from the position of the own device to the position of the gaze target is calculated. That is, the control unit 220 calculates the direction from the position of the own device to the position of the gaze target based on the gaze position information received by the communication unit 210 and the position of the own device acquired by the position acquisition unit 240.

  Next, the control unit 220 of the receiving device 200 controls vibration localization based on the calculated difference vector. For example, the control unit 220 calculates the position of the vibration localization in the Xr direction based on the X component of the difference vector, and localizes the vibration at the calculated position. As an example, when the X component of the difference vector is in the range of −10 to +10, the control unit 220 localizes the vibration at the position Pv2 illustrated in FIG. Thereby, the user U holding the receiving apparatus 200 feels that vibration is generated at the position Pv2. The user U pays attention to the front direction when he / she feels that the vibration is generated at the position Pv <b> 2 at the center of the receiving device 200. Thereby, receiving device 200 can make user U's gaze direction the front of user U. Further, when the X component of the difference vector is less than −10, the control unit 220 localizes the vibration to the position Pv1 shown in FIG. Thereby, the user U holding the receiving apparatus 200 feels that vibration is generated at the position Pv1. When the user U feels that the vibration is generated at the left position Pv <b> 1 of the receiving device 200, the user U pays attention to the left direction. Thereby, the receiving device 200 can make the user U's gaze direction the left side of the user U. Further, when the X component of the difference vector exceeds +10, the control unit 220 localizes the vibration to the position Pv3 shown in FIG. Thereby, the user U holding the receiving apparatus 200 feels that vibration is generated at the position Pv3. When the user U feels that the vibration is generated at the position Pv3 on the right side of the receiving apparatus 200, the user U turns attention to the right direction. Thereby, the receiving device 200 can make the user U's gaze direction the right side of the user U. That is, the vibration generating unit 230 functions as a tactile sensation generating unit that generates a tactile sensation indicating the direction calculated by the control unit 220. Next, an example of the operation of the line-of-sight guidance system 1 of the present embodiment will be described with reference to FIG.

[Operation of eye guidance system]
FIG. 11 is a flowchart illustrating an example of a flow of processing executed by the line-of-sight guidance system 1 of the present embodiment.

  First, the control unit 140 of the transmission device 100 determines whether or not the trigger reception unit 120 has received trigger information (step S100). When it is determined that the trigger reception unit 120 has received the trigger information (step S100; YES), the control unit 140 advances the process to step S110. On the other hand, the control part 140 returns a process to step S100, when it determines with the trigger reception part 120 not receiving trigger information (step S100; NO).

  The control unit 140 reads gaze position information associated with the sequence number “1” from the storage unit 110 (step S110). Next, the control unit 140 transmits the gaze position information read in step S110 to the receiving device 200 via the communication unit 130 (step S120).

  The control unit 140 adds 1 to the sequence number “1” (step S130). Further, the control unit 140 determines whether or not the sequence is finished (step S140). Specifically, the control unit 140 determines whether or not the sequence number after addition exists in the gaze position information. When it is determined that the sequence number after the addition exists in the gaze position information, that is, the sequence has not ended (step S140; NO), the control unit 140 returns the process to step S100. On the other hand, when it is determined that the sequence number after the addition does not exist in the gaze position information, that is, the sequence is completed (step S140; YES), the control unit 140 ends the process.

  In addition, when the gaze position information is transmitted from the transmission apparatus 100 in step S120 described above, the control unit 220 of the reception apparatus 200 receives the transmitted gaze position information via the communication unit 210 (step S200).

  Next, the control part 220 reads the positional information which shows the position of an own apparatus from the memory | storage part 250 (step S210). Next, the control unit 220 calculates a gaze direction based on the gaze position information received in step S200 and the position information read in step S210 (step S220).

  Next, the control unit 220 calculates a vibration localization based on the gaze direction calculated in step S220, causes the vibration generation unit 230 to generate vibration based on the calculated vibration localization, and ends the process (step S230). ).

  According to the line-of-sight guidance system 1 of the present embodiment described above, the transmission device 100 transmits one gaze position information to the plurality of reception devices 200 regardless of the position where the reception device 200 is disposed. Can do. That is, since the transmission device 100 does not need to transmit gaze position information to each reception device 200 individually, the configuration of the device can be simplified.

  In the present embodiment, the vibration generating unit 230 has been described as an example of the tactile sensation generating unit, but the present invention is not limited to this. For example, the receiving device 200 may include, as a tactile sensation generating unit, instead of the vibration generating unit 230, a current generating unit that indicates a gaze direction by stimulating the skin or muscle with a weak current. That is, the tactile sensation generating unit may be configured to generate a tactile sensation that can be sensed by a tissue such as skin or muscle instead of vibration.

  Further, in the present embodiment, the transmission device 100 has been described as transmitting gaze position information indicated by absolute coordinates, but is not limited thereto. The transmission device 100 may transmit gaze position information indicated by relative coordinates with a certain position as a reference position. For example, the transmission apparatus 100 may transmit gaze position information indicating the coordinates of the gaze position with the absolute coordinate of the own apparatus as a reference position. In addition, for example, the transmission apparatus 100 transmits gaze position information indicating coordinates of the gaze position using the coordinates on the stage STG with a certain position on the stage STG as a reference position, that is, the xs · ys · zs orthogonal coordinate system. Also good. When transmitting these relative coordinates to the receiving device 200 as gaze position information, the transmitting device 100 may transmit the reference position coordinates of the relative coordinates to the receiving device 200 together with the gaze position information. Thereby, the receiving apparatus 200 can calculate the gaze direction based on the gaze position information based on the relative coordinates, the coordinates of the reference position of the relative coordinates, and the position information indicating the position of the own apparatus. Even with this configuration, the line-of-sight guidance system 1 allows the transmission apparatus 100 to transmit one gaze position information to the plurality of reception apparatuses 200 regardless of the position where the reception apparatus 200 is disposed. it can. That is, since the transmission device 100 does not need to transmit gaze position information to each reception device 200 individually, the configuration of the device can be simplified.

  In the present embodiment, the example in which the sequence number and the relative coordinates of the gaze position are stored in association with each other in the storage unit 110 of the transmission device 100 has been described. However, the present invention is not limited thereto, and the sequence number and the gaze position Relative coordinates may be stored in the storage unit 250 of the receiving device 200. In this case, the transmission apparatus 100 may transmit only the sequence number to the reception apparatus 200.

  Note that a part of the line-of-sight guidance system 1 in the above-described embodiment may be realized by a computer. In that case, the program for realizing the control function may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read by the computer system and executed. Here, the “computer system” is a computer system built in the line-of-sight guidance system 1 and includes an OS and hardware such as peripheral devices. The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. Furthermore, the “computer-readable recording medium” is a medium that dynamically holds a program for a short time, such as a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line, In this case, a volatile memory inside a computer system that serves as a server or a client may be included that holds a program for a certain period of time. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system. Moreover, you may implement | achieve part or all of each functional block of the visual line guidance system 1 in embodiment mentioned above as integrated circuits, such as LSI (Large Scale Integration). Each functional block of the line-of-sight guidance system 1 may be individually made into a processor, or a part or all of them may be integrated into a processor. Further, the method of circuit integration is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor. In addition, when an integrated circuit technology that replaces LSI appears due to the advancement of semiconductor technology, an integrated circuit based on the technology may be used.

  As described above, the embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to the above, and various design changes and the like can be made without departing from the scope of the present invention. It is possible to

  DESCRIPTION OF SYMBOLS 1 ... Gaze guidance system, 100 ... Transmission apparatus, 200 ... Reception apparatus (gaze guidance apparatus), 210 ... Communication part (reception part), 220 ... Control part (calculation part), 230 ... Vibration generation part (tactile sense generation part), 250 ... storage unit

Claims (8)

A transmission device for transmitting gaze position information indicating the position of the gaze target;
A receiving unit that receives the gaze position information transmitted by the transmission device; and a calculation unit that calculates a direction from the position of the own device to the position of the gaze target based on the gaze position information received by the receiving unit; A plurality of receiving devices including a tactile sensation generating unit that generates a tactile sensation indicating the direction calculated by the calculation unit;
A gaze guidance system comprising: The transmitter is
The line-of-sight guidance system according to claim 1, wherein the gaze position information of the gaze target position is transmitted based on a predetermined order of the gaze target position. The transmitter is
The line-of-sight guidance system according to claim 1, wherein the gaze position information is transmitted at a transmission timing based on input transmission instruction information. The receiving device has a predetermined position,
The calculation unit includes:
The direction from the position of the own apparatus to the position of the gaze target is calculated based on the gaze position information received by the receiving unit and a predetermined position of the own apparatus. The line-of-sight guidance system according to claim 1. The receiving device is:
It further includes a position acquisition unit that acquires the position of its own device,
The calculation unit includes:
The direction from the position of the own apparatus to the position of the gaze target is calculated based on the gaze position information received by the receiving unit and the position of the own apparatus acquired by the position acquisition unit. The line-of-sight guidance system according to claim 3. The gaze position information is information indicating the position of the gaze target based on the position of the transmission device,
The transmitter is
The line-of-sight guidance system according to any one of claims 1 to 5, wherein gaze position information indicating a position of a gaze target with respect to the position of the own device is transmitted. A receiving unit that receives gaze position information transmitted as information indicating the position of the gaze target;
A calculation unit that calculates a direction from the position of the own device to the position of the gaze target based on the gaze position information received by the receiving unit and a predetermined position of the own device;
A line-of-sight guidance device comprising: a tactile sensation generating unit that generates a tactile sensation indicating the direction calculated by the calculation unit. Receiving position information indicating the position of the gaze target, and receiving the gaze position information transmitted based on a predetermined order of the plurality of positions of the gaze target; and
Based on the gaze position information received by the receiving unit, a calculation unit that calculates a direction from the position of the own device to the position of the gaze target;
A line-of-sight guidance device comprising: a tactile sensation generating unit that generates a tactile sensation indicating the direction calculated by the calculation unit.

Images