JP6941715B2 - Display device, display program, display method and display system - Google Patents

Description

The present invention relates to a display device, a display program, a display method, and a display system for displaying an image shared by a plurality of users.

In recent years, a technology for a virtual reality (VR) space has been developed that can display an avatar for each user and communicate with each other. In the virtual reality space, a still image or a moving image can be shared and viewed by a plurality of users.

When sharing and viewing a wide range of images such as global images in virtual reality space with multiple users, the user displays a part of the image because the subject becomes small and difficult to see if the entire range of the image is displayed at once. Display as a range. Therefore, since the display range is different for each user, it is convenient to be able to share which part of the image each user is viewing.

Patent Document 1 describes a technique for making the movements of the avatar's face and eyes follow the movements of the actual user's face and eyes when displaying avatar images of a plurality of users in a virtual reality space. According to such a technique, the user can know where the other user is looking by looking at the face of the other user's avatar.

Japanese Unexamined Patent Publication No. 2017-102639

However, in the technique described in Patent Document 1, the user needs to look at the face of the other user's avatar in order to know where the other user is looking. While the user is looking at the face of another user's avatar, he / she cannot see the desired part of the image, which hinders the viewing of the image.

The present invention has been made in view of these points, and provides a display device, a display program, a display method, and a display system capable of appropriately displaying where another user is looking when sharing and viewing an image. The purpose is to provide.

The display device according to the first aspect of the present invention includes a receiving unit that receives a position of a display range for another display device to display a part of an image, and its own display device displays a part of the image. The display control unit for displaying the first symbol indicating the position of the display range of the other display device received by the reception unit is included in the display range for the purpose.

The display control unit may display a second symbol indicating the direction of the other display device to the position of the display range with reference to the position of the display range of the own display device.

The display control unit displays the second symbol having a size set according to the distance between the position of the display range of the own display device and the position of the display range of the other display device. You may.

The display control unit may display the second symbol when the position of the display range of the other display device is outside the display range of the own display device.

The receiving unit receives a predetermined instruction from the other display device, and when the receiving unit receives the predetermined instruction, the display control unit sets the display range of the own display device to the other. You may move to the position of the display range of the display device of.

In the display range of the own display device, the display control unit sets a display mode of a first area including the position of the display range of the other display device, and the position of the display range of the other display device. It may be displayed differently from the display mode of the second region that does not include.

The display control unit may change the size of the first region based on the time during which the position of the display range of the other display device stays.

The receiving unit receives a position designated by the user who uses the other display device, and the display control unit is in addition to the first symbol indicating the position of the display range of the other display device. , The first symbol indicating the designated position received by the receiving unit may be displayed.

The receiving unit may receive the direction of the line of sight of the user who uses the other display device as the position of the display range of the other display device.

In the display program of the second aspect of the present invention, the processor included in the first display device is positioned in a display range for a second display device different from the first display device to display a part of an image. The position of the display range of the second display device received by the receiving unit is indicated within the display range for the receiving unit and the first display device to display a part of the image. It functions as a display control unit that displays the symbol of 1.

In the display method of the third aspect of the present invention, the position of the display range for displaying a part of the image by the second display device different from the first display device is received by the first display device. The display range of the second display device received in the receiving step is within the display range for the first display device to display a part of the image by the step and the first display device. It has a step of displaying a first symbol indicating the position of.

The display system according to the fourth aspect of the present invention includes a first display device and a second display device, and the second display device is for the second display device to display a part of an image. The first display device has a transmitting unit that transmits the position of the display range, the first display device is a receiving unit that receives the position of the display range of the second display device, and the first display device is the image. Within the display range for displaying a part, there is a display control unit that displays a first symbol indicating the position of the display range of the second display device received by the receiving unit.

According to the present invention, there is an effect that when an image is shared and viewed, it is possible to appropriately display where another user is looking.

It is a schematic diagram of the display system which concerns on 1st Embodiment. It is a schematic diagram of the whole image used in 1st Embodiment. It is a block diagram of the display device which concerns on 1st Embodiment. It is a front view of the display part which concerns on 1st Embodiment. It is a front view of the display part which concerns on 1st Embodiment. It is a figure which shows the flowchart of the display method which concerns on 1st Embodiment. It is a figure which shows the flowchart of the display method which concerns on 2nd Embodiment. It is a front view of the display part which concerns on 3rd Embodiment. It is a front view of the display part which concerns on 4th Embodiment.

(First Embodiment)
FIG. 1 is a schematic view of a display system S according to the present embodiment. The display system S includes a plurality of display devices 1, a control server 2 that mediates information exchange between the display devices 1, and an image distribution server 3 that distributes images to each display device 1.

The display device 1, the control server 2, and the image distribution server 3 are connected via an arbitrary network N such as a local area network or the Internet. The display system S may include other devices such as servers and terminals.

The control server 2 receives the position (display position) of the display range in the image being displayed from each display device 1 and transmits the display position to each display device 1. As a result, the display positions are shared between the display devices 1.

The image distribution server 3 transmits an image to be displayed to each display device 1. The image distributed by the image distribution server 3 may be either a still image or a moving image, or may be an image dynamically generated by a program such as a computer game. When using images that are continuously displayed in chronological order, such as moving images or dynamically generated images, the image distribution server 3 may transmit the entire image to the display device 1 at once. A part of the time series of the image may be transmitted to the display device 1 a plurality of times. The image distribution server 3 stores an image or a program for generating an image in advance. An image stored in advance in each display device 1 may be used as the image to be displayed by each display device 1, and in that case, the image distribution server 3 may be omitted.

The control server 2 and the image distribution server 3 are connected to the network N by wired communication or wireless communication, respectively, and are composed of a single computer or a cloud which is a collection of computer resources. The control server 2 and the image distribution server 3 may be configured as one server.

The display device 1 is a terminal that displays an image received from the image distribution server 3 and transmits the display position in the image to the control server 2. The display device 1 is used by the user. The user who uses the display device 1 is determined by the identification information (ID or the like) of the user who is logged in to the display device 1. The display device 1 is configured to be able to communicate with the control server 2 and the image distribution server 3 via the network N by wired communication or wireless communication. As the display device 1, any display device capable of displaying an image to the user, such as a goggle type terminal worn on the user's head or a mobile terminal such as a smartphone, can be used.

[Explanation of whole image W and display image V]
FIG. 2 is a schematic view of the entire image W used in the present embodiment. FIG. 2 shows the relationship between the entire image W and the display image V seen by each user U in a plane. In FIG. 2, a large number of points are represented in the range of the display image V in the entire image W.

The whole image W is a wide range of images such as a global image (also referred to as a 360 ° image) and a panoramic image. The display device 1 displays a predetermined display range that is a part of the entire image W as the display image V. In other words, for each display device 1, there is an area (display image V) that is displayed and an area that is not displayed in the entire image W. The size of the display range of the display image V is determined according to the device configuration (display resolution, etc.) and display settings (scale, viewing angle, etc.) of the display device 1. It is desirable that coordinate information is embedded in the entire image W. The display device 1 can easily determine the display position of the user U based on the coordinate information in the entire image W.

The position of the display range of the display image V is set on the line-of-sight direction E of the user U. As the line-of-sight direction E, the direction set by the user performing an operation on the display device 1 or the direction of the display device 1 itself can be used. Further, the direction of the line of sight of the user U may be used as the line of sight direction E. The direction of the user U's line of sight is detected by a known technique (eg, eye tracking technique).

In the present embodiment, the image distribution server 3 transmits the entire image W to the display device 1, and the display device 1 generates and displays the display image V corresponding to the display range of the display device 1 from the received overall image W. do. Not limited to this, the image distribution server 3 generates a display image V corresponding to the display range of the display device 1 from the entire image W and transmits it to the display device 1, and the display device 1 displays the received display image V. May be good.

[Configuration of display device 1]
FIG. 3 is a block diagram of the display device 1 according to the present embodiment. In FIG. 3, the arrows indicate the main data flows, and there may be data flows other than those shown in FIG. In FIG. 3, each block shows not a hardware (device) unit configuration but a functional unit configuration. Therefore, the block shown in FIG. 3 may be mounted in a single device, or may be mounted separately in a plurality of devices. Data can be exchanged between blocks via any means such as a data bus, a network, or a portable storage medium.

The display device 1 includes a control unit 11, a communication unit 12, a display unit 13, an operation unit 14, a storage unit 15, and an orientation detection unit 16. The control unit 11 includes an image acquisition unit 111, a display position reception unit 112, a display position transmission unit 113, and a display control unit 114. The display system S includes a plurality of display devices 1 having a similar configuration.

The communication unit 12 is a communication interface for communicating with the control server 2 and the image distribution server 3 via the network N. The communication unit 12 performs predetermined processing on the communication signals received from the control server 2 and the image distribution server 3 to acquire data, and inputs the acquired data to the control unit 11. Further, the communication unit 12 performs a predetermined process on the data input from the control unit 11 to generate a communication signal, and transmits the generated communication signal to the control server 2 and the image distribution server 3.

The display unit 13 has an arbitrary display device capable of displaying various information under the control of the control unit 11, such as a liquid crystal display and an organic light emitting diode (OLED) display. The operation unit 14 has an arbitrary operation device that accepts operations from the user, such as a keyboard and a mouse. The operation unit 14 inputs information indicating the user's operation to the control unit 11. Further, by using a touch screen as the display unit 13, the display unit 13 and the operation unit 14 may be integrally configured.

The storage unit 15 is a storage medium including a ROM (Read Only Memory), a RAM (Random Access Memory), a hard disk drive, and the like. The storage unit 15 stores in advance the program executed by the control unit 11.

The orientation detection unit 16 has, for example, a gyro sensor, and generates orientation information indicating the spatial orientation of the display device 1 based on the angular acceleration measured by the gyro sensor. Not limited to this, as the orientation detecting unit 16, any configuration capable of detecting the orientation of the display device 1 can be used. The orientation detection unit 16 inputs the generated orientation information to the control unit 11.

The control unit 11 is, for example, a processor such as a CPU (Central Processing Unit), and by executing a program stored in the storage unit 15, the image acquisition unit 111, the display position reception unit 112, the display position transmission unit 113, and the display It functions as a control unit 114. At least a part of the function of the control unit 11 may be executed by an electric circuit. Further, at least a part of the functions of the control unit 11 may be executed by a program executed via the network.

The display device 1 according to the present embodiment is not limited to the specific configuration shown in FIG. The display device 1 is not limited to one device, and may be configured by connecting two or more physically separated devices by wire or wirelessly.

The image acquisition unit 111 acquires image information indicating the entire image W via the communication unit 12. The image acquisition unit 111 may receive the image information indicating the entire image W from the image distribution server 3, or may read the image information indicating the entire image W stored in the storage unit 15. Further, the image acquisition unit 111 may acquire image information indicating the display image V instead of the entire image W. In this case, the display position transmission unit 113 described later transmits the display position to the image distribution server 3 before acquiring the image information, and the image distribution server 3 generates the display image V from the entire image W according to the display position. And send it to the display device 1.

The display position receiving unit 112 receives the display position information indicating the position (display position) of the display range of the entire image W in the other display device 1 from the control server 2 via the communication unit 12. That is, the display position information indicates the position of the range displayed as the display image V in the entire image W by the other display device 1. The display position is, for example, the coordinates of the center point of the display image V.

The display position transmission unit 113 calculates the display position of its own display device 1 based on at least one of the operation by the user received by the operation unit 14 and the orientation of the display device 1 detected by the orientation detection unit 16. The definition of the display position is the same as that received by the display position receiving unit 112. When the user manually sets the display position using the operation unit 14, the display position transmission unit 113 calculates the display position according to the operation of the operation unit 14 by the user. When the display position is set according to the orientation of the display device 1, the display position transmission unit 113 calculates the display position according to the spatial orientation of the display device 1 detected by the orientation detection unit 16. Then, the display position transmission unit 113 transmits the display position information indicating the calculated display position to the control server 2 via the communication unit 12.

Transmission and reception of the display position by the display position receiving unit 112 and the display position transmitting unit 113 are performed at predetermined time intervals (for example, 1 millisecond to 100 milliseconds). As a result, the latest display position is shared between the display devices 1, and the plurality of display devices 1 can know each other's display positions.

The display control unit 114 generates a display image V from the image information indicating the entire image W acquired by the image acquisition unit 111 according to the display position of its own display device 1 calculated by the display position transmission unit 113, and the generated display image. V is displayed on the display unit 13. When the image acquisition unit 111 acquires the image information indicating the display image V, the display control unit 114 causes the display unit 13 to display the display image V. Further, the display control unit 114 generates various symbols related to the display position of the other display device 1 indicated by the display position information received by the display position reception unit 112, and superimposes and displays the generated symbols on the display image V. Let me.

[Explanation of screen displayed by display device 1]
FIG. 4 is a front view of the display unit 13 displaying the screen including the display image V. The screen of FIG. 4 is displayed when the position of the display range of another display device 1 is within the display range of its own display device 1. First, the display control unit 114 causes the display unit 13 to display the display image V, which is a part of the entire image W corresponding to the display range of its own display device 1.

Further, the display control unit 114 superimposes the position symbol P1 indicating the position of the display range of its own display device 1 and the position symbol P2 indicating the position of the display range of the other display device 1 on the display image V. It is displayed on the display unit 13. In the example of FIG. 4, two position symbols P2 for two other display devices 1 are displayed.

The position symbol P1 is displayed on the position (for example, the center point) of the display range of its own display device 1 calculated by the display position transmission unit 113. The position symbol P2 is displayed on the position (for example, the center point) of the display range of the other display device 1 received by the display position receiving unit 112. Here, when the position of the display range of the other display device 1 is outside the display range of its own display device 1 (that is, outside the display image V), the display control unit 114 does not display the position symbol P2. Instead, the orientation symbol M is displayed as shown in FIG. 5 described later.

As the position symbol P1 and the position symbol P2, symbols having any shape such as a circle or a rectangle can be used. The display control unit 114 may omit the position symbol P1 related to its own display device 1 and display only the position symbol P2 related to another display device 1. The position symbol P1 may be displayed as it is based on the information for displaying the position symbol P1 generated on the display device 1, or may be displayed as it is after the position information is transmitted from the display device 1 to the control server 2. 1 may be displayed based on the information for displaying the position symbol P1 received from the control server 2.

The display control unit 114 displays the position symbol P1 and the position symbol P2 in different modes for each display device 1 (user). The display mode of the position symbol P1 and the position symbol P2 is, for example, a color, a pattern, a shape, or the like. In FIG. 4, different colors are shown depending on the direction of the diagonal lines. As a result, the user can distinguish and recognize the position of the display range (that is, the direction of the line of sight) for each user.

Further, the display control unit 114 superimposes the avatar image A of the user of the other display device 1 on the display image V and displays it on the display unit 13. The avatar image A has a shape imitating a human or an animal, and is arranged so that its face faces the position of the display range of the other display device 1. In the example of FIG. 4, two avatar images A for two other display devices 1 are displayed. The display control unit 114 may receive information for displaying the avatar image A from the control server 2, or may read out the information for displaying the avatar image A stored in the storage unit 15. The display of the avatar image A may be omitted. The display control unit 114 displays the position symbol P2 and the avatar image A related to the same display device 1 (user) in the same color, and displays the position symbol P2 and the avatar image A related to the different display device 1 (user) in different colors. It is desirable to do. As a result, it is possible to clearly display which user the position symbol P2 corresponds to.

FIG. 5 is a front view of the display unit 13 displaying the screen including the display image V. The screen of FIG. 5 is displayed when the position of the display range of another display device 1 is outside the display range of its own display device 1.

Similar to the screen of FIG. 4, the display control unit 114 indicates the position of the display range of its own display device 1 together with the display image V which is a part of the entire image W corresponding to the display range of its own display device 1. The position symbol P1 is superimposed on the display image V and displayed on the display unit 13.

Further, the display control unit 114 superimposes and displays the direction symbol M indicating the direction of the display range of the other display device 1 with respect to the position of the display range of the display device 1 on the display image V. Displayed in unit 13. As the orientation symbol M, a symbol having an arbitrary shape capable of representing a specific orientation, such as an arrow, a bar, or a triangle, can be used. The position where the orientation symbol M is displayed may be near the end of the display image V as shown in FIG. 5, or may be near the position symbol P1. As a result, the user can know which direction the other user's display position is in even if it is outside the display range, so that the user can follow the part of the shared image that the other user is looking at. Is easy.

The orientation symbol M is displayed so as to represent the orientation of the display position of another display device 1 with respect to the display position of the display device 1 itself. Alternatively, the orientation symbol M may be displayed so as to represent one of the up, down, left, and right directions in which the orientation of the display position of the other display device 1 with respect to the display position of the display device 1 is the closest.

The display control unit 114 displays the orientation symbol M in a different manner for each display device 1 (user). The display mode of the orientation symbol M is, for example, a color, a pattern, a shape, or the like. In FIG. 5, different colors are shown depending on the direction of the diagonal lines. As a result, the user can distinguish and recognize the orientation of each user to the display position.

Further, the display control unit 114 sets the length, area, and the like of the orientation symbol M according to the distance between the display position of its own display device 1 and the display position of another display device 1. The display control unit 114 calculates the Euclidean distance between the display positions as the distance, and determines the size of the orientation symbol M according to a predetermined rule according to the calculated distance. More specifically, the display control unit 114 displays the orientation symbol M so that the larger the distance between the display positions, the larger (that is, longer or wider) the orientation symbol M. In FIG. 5, the display position of the other display device 1 related to the right direction symbol M is farther from the own display device 1 than the display position of the other display device 1 related to the left direction symbol M. It is represented. As a result, the user can easily recognize the distance to the display position of another user.

When the display positions of the plurality of other display devices 1 are mixed in the display range and outside the display range, the display control unit 114 uses the position symbol P2 shown in FIG. 4 for the display position within the display range. The orientation symbol M shown in FIG. 5 is displayed for the display position outside the display range.

In the present embodiment, the display control unit 114 displays the orientation symbol M only when the display position of the other user is outside the display range, but displays the orientation symbol M when the display position of the other user is within the display range. You may. In that case, both the position symbol P2 and the orientation symbol M related to one other user are displayed on the display image V.

When the number of the position symbol P2 or the orientation symbol M is large, it becomes difficult to know which user the position symbol P2 or the orientation symbol M relates to. Therefore, when the user performs a predetermined operation, the display control unit 114 may superimpose the user information of the user related to the position symbol P2 or the orientation symbol M on the display image V and display it on the display unit 13. Specifically, the user specifies the position symbol P2 or the orientation symbol M on the display image V by using a device such as a mouse or a pointer connected to the display device 1. The display control unit 114 acquires the user information of another user related to the designated position symbol P2 or the orientation symbol M from the control server 2. The user information is, for example, identification information of another user, a name of another user, or the like, and is stored in advance in the control server 2. Then, the display control unit 114 causes the acquired user information to be displayed in the vicinity of the designated position symbol P2 or the direction symbol M (for example, in the balloon drawn from the position symbol P2 or the direction symbol M). With such a configuration, even when the number of the position symbol P2 or the orientation symbol M is large, it becomes easy to understand which user the position symbol P2 or the orientation symbol M relates to.

[Flowchart of display method]
FIG. 6 is a diagram showing a flowchart of a display method executed by the display device 1 according to the present embodiment. First, when the user performs a predetermined operation on the operation unit 14 of the display device 1, the display device 1 starts sharing the image (S11). At this time, the image sharing may be started by the own user performing an operation of inviting another user and the other user performing an operation of accepting the invitation. Alternatively, the image sharing may be started by another user performing an operation of inviting the own user and the own user performing an operation of accepting the invitation.

Specifically, its own display device 1 first accesses the control server 2 and creates a virtual shared room. Then, the control server 2 invites another user by transmitting the shared room identification information (ID or the like) that identifies the generated shared room to the other display device 1. When an operation of accepting the invitation is performed by another user on the other display device 1, a signal indicating the acceptance is transmitted from the other display device 1 to the own display device 1 via the control server 2. By sharing the image after inviting and consenting between the own user and other users in this way, it is possible to improve the safety in sharing personal information such as the direction of the line of sight.

Next, the own user performs an operation of selecting an image to be shared on his / her own display device 1. Its own display device 1 transmits image identification information (ID or the like) that identifies the selected image to another display device 1 belonging to the shared room via the control server 2.

Next, the own user performs an operation of starting the display of the image to be shared on his / her own display device 1. The display device 1 itself receives an image having image identification information to be shared from the image distribution server 3 and starts displaying the image. At the same time, its own display device 1 transmits a start signal indicating image identification information to be shared to another display device 1 belonging to the shared room via the control server 2. When the other display device 1 receives the start signal, it receives an image having image identification information to be shared from the image distribution server 3 and starts displaying the image. By the above processing, image sharing in step S11 is started. By directly receiving the image from the image distribution server 3 without going through the control server 2 in this way, the load on the control server 2 can be reduced.

The image acquisition unit 111 acquires image information indicating the entire image W from the image distribution server 3 via the communication unit 12 (S12). When the shared image is a moving image or a dynamically generated image, the image acquisition unit 111 repeats step S12 in parallel with the subsequent steps S13 to S20 to obtain the image as one of the time series. It may be acquired for each copy.

The display position receiving unit 112 receives the display position information indicating the position (display position) of the display range of the other display device 1 from the control server 2 via the communication unit 12 (S13). The display position transmission unit 113 calculates the display position of its own display device 1 based on at least one of the operation by the user received by the operation unit 14 and the orientation of the display device 1 detected by the orientation detection unit 16 (S14). .. Then, the display position transmission unit 113 transmits the display position information indicating the display position calculated in step S14 to the control server 2 via the communication unit 12 (S15). Step S13 and steps S14 to S15 may be performed in parallel, or may be performed in the reverse order.

The display control unit 114 generates a display image V from the entire image W indicated by the image information acquired in step S12 according to the display position of its own display device 1 calculated in step S14, and displays the generated display image V on the display unit 13. Display (S16).

When the display position of the other display device 1 indicated by the display position information received in step S13 is within the display range of its own display device 1 (YES in step S17), the display control unit 114 displays the other display. The position symbol P2 indicating the display position of the device 1 is superimposed and displayed on the display image V in step S16 (S18).

When the display position of the other display device 1 indicated by the display position information received in step S13 is outside the display range of its own display device 1 (NO in step S17), the display control unit 114 has its own display device. The orientation symbol M indicating the orientation of the other display device 1 to the display position based on the position of the display range of 1 is superimposed and displayed on the display image V in step S16 (S19).

When a plurality of other display devices 1 share and display an image, the display control unit 114 performs steps S17 to S19 for each of the other display devices 1.

When a predetermined end condition (for example, the user performs a predetermined end operation using the operation unit 14 in the display device 1) is not satisfied (NO in S20), the display device 1 returns to step S13 and repeats the process. When the predetermined end condition is satisfied (YES in S20), the display device 1 ends the process.

[Effect of the first embodiment]
As described above, the display device 1 according to the present embodiment displays the position symbol P2 indicating the display position of the other user when the display position of the other user is within the display range. With such a configuration, the user can easily recognize the part of the shared image that is being viewed by another user.

Since the position symbol P2 cannot be displayed when the display position of another user is outside the display range, the user needs to search various ranges in the shared image to know where the other user is looking. It may be inconvenient. Therefore, when the display position of another user is outside the display range, the display device 1 displays a direction symbol M indicating the direction of the other user to the display position. With such a configuration, the user can know which direction the other user's display position is in even if it is outside the display range, so that the part of the shared image that the other user is looking at Easy to follow.

(Second Embodiment)
In the present embodiment, when a predetermined instruction is given by another display device 1, control is performed so that the display position of the own display device 1 is aligned with the display position of the other display device 1. Other configurations and processes are the same as those in the first embodiment.

In the present embodiment, when the user inputs a predetermined voice (for example, a voice saying "come here") through a microphone (not shown), or when the user performs a predetermined operation using the operation unit 14. The display position transmission unit 113 transmits a movement instruction together with the display position information to the control server 2 via the communication unit 12. Then, the display position receiving unit 112 receives a movement instruction from the control server 2 together with the display position information of the other display device 1 via the communication unit 12. As a result, each display device 1 transmits a movement instruction to the other display device 1 and receives the movement instruction from the other display device 1.

When a move instruction is received from another display device, the display position transmission unit 113 does not calculate the display position of its own display device 1, and instead sets the display position of its own display device 1 to that of the other display device. Set (move) to match the display position. As a result, the user can follow the display position of another user in the display image V.

When following the display position of another user, it is desirable that the display position transmitting unit 113 blinks or slowly moves the position symbol P1 of the display position of its own display device 1 for a predetermined time. During this period, when the orientation detection unit 16 detects a predetermined motion such as the user moving his / her head or shaking his / her head, the display position transmitting unit 113 stops following the display position of another user, and the display position transmitting unit 113 stops following the display position of another user. The display position of the display device 1 of the above is stopped in place or returned to the position before tracking. At this time, the display device 1 of another user may display a character string indicating that the movement instruction is rejected. With such a configuration, the user can refuse to follow the display position of another user.

As a movement instruction, it may be used that a part of the display range of another user overlaps with the display range of the user. That is, when a part of the display range of another user overlaps with the display range of the user, the display position transmitting unit 113 sets (moves) the display position of its own display device 1 to match the display position of the other display device. do. As a result, the display positions can be easily aligned with each other by moving the display positions closer to each other without giving explicit instructions by voice or operation.

[Flowchart of display method]
FIG. 7 is a diagram showing a flowchart of a display method executed by the display device 1 according to the present embodiment. In the flowchart of FIG. 7, steps S21 and S22 are added between steps S13 and S15 in the flowchart of FIG. Since the other steps are the same as the flowchart of FIG. 6, the description thereof will be omitted below.

When the movement instruction is transmitted from the other display device 1, the display position receiving unit 112 receives the movement instruction from the control server 2 via the communication unit 12 together with the display position information in step S13.

When the display position receiving unit 112 receives a movement instruction from another display device 1 (YES in step S21), the display position transmitting unit 113 displays the display position of its own display device 1 received in step S13. It moves so as to match the display position of the other display device 1 indicated by the position information (S22). When the display position receiving unit 112 does not receive the movement instruction from the other display device 1 (NO in step S21), the display position transmitting unit 113 performs step S14.

When a movement instruction is given by its own display device 1, in step S15, the display position transmission unit 113 transmits the movement instruction together with the display position information to the control server 2 via the communication unit 12.

[Effect of the second embodiment]
In addition to achieving the same effect as that of the first embodiment, the present embodiment can easily match the display positions of a plurality of users. Since it is only necessary for one user to give a movement instruction by voice or the like in order to adjust the display position, it is not necessary for each user to perform an operation or change the direction in the display device 1.

(Third Embodiment)
In the present embodiment, in addition to the symbol indicating the display position corresponding to the line-of-sight direction of the user, the symbol indicating the position specified by the user using a device such as a mouse or a pointer is displayed in the display image. Other configurations and processes are the same as those in the first embodiment.

In the present embodiment, a device such as a mouse or a pointer is connected to the display device 1 by wire or wirelessly. The device accepts the user to specify the position on the display image V. When the user specifies the position using the device, the display position transmitting unit 113 transmits the designated position by the user together with the display position information to the control server 2 via the communication unit 12. Then, the display position receiving unit 112 receives the position designated by the user from the control server 2 together with the display position information of the other display device 1 via the communication unit 12. As a result, each display device 1 transmits the designated position to the other display device 1 and receives the designated position from the other display device 1.

[Explanation of screen displayed by display device 1]
FIG. 8 is a front view of the display unit 13 displaying the screen including the display image V. Similar to FIG. 4, the display control unit 114 displays the position symbol P1 indicating the position of the display range of its own display device 1 and the position symbol P2 indicating the position of the display range of the other display device 1 on the display image V. Is superimposed on the display unit 13 and displayed on the display unit 13. Although omitted in FIG. 8, the display control unit 114 may display the avatar image A of the user of the other display device 1 on the display image V as shown in FIG.

Further, the display control unit 114 superimposes the position symbol P3 indicating the designated position of the other display device 1 on the display image V and causes the display unit 13 to display the position symbol P3. The position symbol P3 is displayed on the designated position from the other display device 1 received by the display position receiving unit 112. Although omitted in FIG. 8, the display control unit 114 may display the position symbol P3 indicating the designated position of its own display device 1.

As the position symbol P3, a symbol having an arbitrary shape such as a circle, a rectangle, or a shape imitating a finger can be used. The display control unit 114 displays the shape of the position symbol P2 (circular in FIG. 8) indicating the display position and the shape of the position symbol P3 (rectangular in FIG. 8) indicating the designated position in different shapes. Thereby, the user can easily recognize that the position symbol P3 represents the position specified by the user.

Further, the display control unit 114 displays the position symbol P3 in a different color for each display device 1 (user). At the same time, the display control unit 114 displays the position symbol P2 and the position symbol P3 related to the same display device 1 (user) in the same color. As a result, the user can easily recognize the user with the position symbol P3.

When the designated position of the other display device 1 is outside the display range of its own display device 1, the display control unit 114 uses the position of the display range of its own display device 1 as a reference as in FIG. The symbol M indicating the orientation of the other display device 1 to the designated position is displayed.

[Effect of the third embodiment]
In addition to exerting the same effect as that of the first embodiment, the present embodiment can display not only the display position of the user but also the position designated by the device possessed by the user. Therefore, when the image is shared and viewed by a plurality of users, more information can be shared among the users.

(Fourth Embodiment)
In the first embodiment, a symbol indicating the display position of the other display device 1 is displayed, whereas in the present embodiment, an area including the display position of the other display device 1 is displayed. Other configurations and processes are the same as those in the first embodiment.

[Explanation of screen displayed by display device 1]
FIG. 9 is a front view of the display unit 13 displaying the screen including the display image V. Similar to FIG. 4, the display control unit 114 displays the position symbol P1 indicating the position of the display range of its own display device 1 and the position symbol P2 indicating the position of the display range of the other display device 1 on the display image V. Is superimposed on the display unit 13 and displayed on the display unit 13. At least one of the position symbol P1 and the position symbol P2 may be omitted. Although omitted in FIG. 9, the display control unit 114 may display the avatar image A of the user of the other display device 1 on the display image V as shown in FIG.

The display control unit 114 can distinguish the non-attention area R2 which is the other area from the display range of its own display device 1 by setting the area of interest of the user of the other display device 1 as the area of interest R1. Display on. Specifically, the display control unit 114 displays the attention region R1 including the display position of the other display device 1 in the display image V in a mode different from that of the non-attention region R2 other than the attention region R1. The display control unit 114 displays, for example, the colors, brightness, and the like of the attention region R1 and the non-attention region R2 so as to be different from each other. In FIG. 9, the attention region R1 is displayed in a normal manner, and the non-attention region R2 is darkly displayed. The display control unit 114 may not display the non-attention region R2 (that is, the non-attention region R2 may be filled with a specific color and displayed).

The region of interest R1 is, for example, a circle having a predetermined radius centered on the display position of another display device 1. The shape of the region of interest R1 is not limited to this, and any shape such as a circle or a rectangle can be used. Further, the region of interest R1 may be set to the same position and size as the display range in the other display device 1.

The display control unit 114 may change the size of the region of interest R1 according to the residence time of the display position of the other display device 1. The residence time is the time during which the display position of the other display device 1 does not move from the same position or stays within a predetermined range in the vicinity of the same position. For example, the display control unit 114 displays so that the region of interest R1 is larger (or smaller) as the residence time is longer. This allows the user to know how long other users have been looking at the same location in the image.

[Effect of Fourth Embodiment]
In addition to exerting the same effect as that of the first embodiment, the present embodiment can display a predetermined range including the position displayed by the user as the region of interest R1. Therefore, the user can recognize the range displayed by another user in the shared image.

Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes can be made within the scope of the gist thereof. be. For example, the specific embodiment of the distribution / integration of the device is not limited to the above embodiment, and all or a part thereof may be functionally or physically distributed / integrated in any unit. Can be done. Also included in the embodiments of the present invention are new embodiments resulting from any combination of the plurality of embodiments. The effect of the new embodiment produced by the combination has the effect of the original embodiment together.

The processing of generating the symbols and regions and superimposing them on the shared image in each of the above-described embodiments may be performed entirely by the display device 1, or may be partially or entirely performed by the control server 2.

The control unit 11 (processor) of the display device 1 is the main body of each step (process) included in the display methods shown in FIGS. 6 and 7. That is, the control unit 11 reads a display program for executing the display method shown in FIGS. 6 and 7 from the storage unit 15, executes the display program, and controls each unit of the display device 1, thereby performing FIG. The display method shown in 7 is executed. Some of the steps included in the display methods shown in FIGS. 6 and 7 may be omitted, the order between the steps may be changed, and a plurality of steps may be performed in parallel. The display program according to each embodiment of the present invention is implemented as an application executed by a mobile terminal such as a smartphone or a goggle type terminal worn on the user's head.

S Display system 1 Display device 11 Control unit 112 Display position reception unit 113 Display position transmission unit 114 Display control unit

Claims (14)

A receiver that receives the position of the display range for another display device to display a part of the image,
A display that displays a part of the image and a first symbol indicating the position of the display range of the other display device within a display range for displaying a part of the image by its own display device. Control unit and
Have,
The receiving unit receives a predetermined instruction for moving the display range of the own display device, and receives the predetermined instruction.
The display control unit is a display device that moves the display range of its own display device to a position of the display range of the other display device based on the predetermined instruction received by the receiving unit. The display control unit moves the display range of its own display device to the position of the display range of the other display device based on the predetermined instruction received by the receiving unit from the other display device. ,
The display device according to claim 1. Further having an orientation detection unit for detecting the orientation of its own display device,
When the orientation detected by the orientation detection unit indicates a predetermined operation, the display control unit moves the display range of its own display device to the position of the display range of the other display device. Abort,
The display device according to claim 1 or 2. Further having an orientation detection unit for detecting the orientation of its own display device,
When the orientation detected by the orientation detection unit indicates a predetermined operation, the display control unit before moving the display range of its own display device to the position of the display range of the other display device. Return to position,
The display device according to any one of claims 1 to 3. The display control unit displays the first symbol in a different manner for each of the other display devices.
The display device according to any one of claims 1 to 4. The display control unit displays a second symbol indicating the direction of the other display device toward the position of the display range with reference to the position of the display range of the own display device.
The display device according to any one of claims 1 to 5. The display control unit displays the second symbol having a size set according to the distance between the position of the display range of the own display device and the position of the display range of the other display device. ,
The display device according to claim 6. The display control unit displays the second symbol when the position of the display range of the other display device is outside the display range of the own display device.
The display device according to claim 6 or 7. The receiving unit receives the position specified by the user who uses the other display device, and receives the position.
The display control unit displays the first symbol indicating the designated position received by the receiving unit in addition to the first symbol indicating the position of the display range of the other display device.
The display device according to any one of claims 1 to 8. The display control unit displays an avatar image corresponding to a user who uses the other display device so as to face a position in the display range of the other display device.
The display device according to any one of claims 1 to 9. The processor of the first display device,
A second display device different from the first display device receives a position of a display range for displaying a part of an image, and the first display device displays a part of the image. A display control unit that displays a part of the image and a symbol indicating the position of the display range of the second display device within the display range for the second display device.
To function as
The receiving unit receives a predetermined instruction for moving the display range of the first display device, and receives the predetermined instruction.
The display control unit is a display program that moves the display range of the first display device to a position of the display range of the second display device based on the predetermined instruction received by the receiving unit. A step of receiving a position of a display range for displaying a part of an image by a second display device different from the first display device by the first display device.
The position of a part of the image and the display range of the second display device within the display range for the first display device to display a part of the image by the first display device. The symbols to indicate, the steps to display, and
Have,
In the receiving step, the first display device receives a predetermined instruction for moving the display range of the first display device.
In the display step, the display range of the first display device is moved to the position of the display range of the second display device based on the predetermined instruction received by the first display device. Display method. Equipped with a first display device and a second display device,
The second display device has a transmission unit that transmits a position of a display range for the second display device to display a part of an image.
The first display device is
A receiving unit that receives the position of the display range of the second display device, and
A display for displaying a part of the image and a symbol indicating the position of the display range of the second display device within a display range for the first display device to display a part of the image. Control unit and
Have,
The receiving unit receives a predetermined instruction for moving the display range of the first display device, and receives the predetermined instruction.
The display control unit is a display system that moves the display range of the first display device to a position of the display range of the second display device based on the predetermined instruction received by the receiving unit. A receiver that receives the position of the display range for another display device to display a part of the image,
A display control unit that displays a part of the image and a symbol indicating the position of the display range of the other display device within a display range for displaying a part of the image by its own display device. ,
Have,
The display control unit sets the display range of the own display device based on the overlap of a part of the display range of the own display device and a part of the display range of the other display device. A display device that moves to a position in the display range of the other display device.

Images