WO2018073969A1 - Image display device and image display system - Google Patents

Abstract

An image display device for imaging a candidate article with both a right camera and a left camera, and causing a right display image to be displayed on a right display unit on the basis of the right camera image and causing a left display image to be displayed on a left display unit on the basis of the left camera image. A user wearing the image display device can visually recognize a display image with both eyes on the basis of the right display image and the left display image. A control unit adjusts the display position of the right display image on the right display unit and the display position of the left display image on the left display unit in accordance with an indication of the user. When displaying the display image on a display unit 14, it is possible to resolve a position aberration between a display portion by the right display image and a display portion by the left display image.

Description

Image display device and image display system

The technology disclosed in this specification relates to an image display device that is used while being worn on a user's head, and an image display system including the image display device.

For example, Japanese Patent Laying-Open No. 2014-93050 (hereinafter referred to as Patent Document 1) discloses an image display device used by being mounted on a user's head. This type of image display device relates to a camera that captures an image in a range corresponding to a user's field of view (ie, a real image), a display unit that displays the captured real image, and an image displayed on the display unit. And a computer that displays the object image to be combined with the real image displayed on the display unit.

In the image display device of Patent Literature 1, when an object image is combined with a real image and displayed, it is difficult to adjust the display position of the object image, and the user feels uncomfortable, for example, the object image cannot be seen stereoscopically. There is a case.

This specification discloses a technology that can reduce the user's uncomfortable feeling.

A first image display device disclosed in this specification includes a first frame that can be mounted on a head of a first user, a first frame that is provided in the first frame, and that is mounted on the first frame. The first right-eye display unit disposed at a position facing the user's right eye and the first frame, disposed at a position facing the left eye of the first user wearing the first frame A first left-eye display unit, a right camera that captures a range corresponding to the viewing range of the right eye of the first user wearing the first frame, and the first wearing the first frame A left camera that captures a range corresponding to the visual field range of the user's left eye and a first control unit are provided. The first control unit generates the first type of right image data using at least the right camera image of the right camera image captured by the right camera and the left camera image captured by the left camera. The first type of left image data is generated using at least the left camera image of the camera image and the left camera image, and the first type of right display image represented by the first type of right image data is represented by the first type. Displayed on the right eye display unit, the first type left display image represented by the first type left image data is displayed on the first left eye display unit, and the first user selects the first type right image. In a first type display image that can be viewed with both eyes based on the display image and the first type left display image, a display part by the first type right display image and a display part by the first type left display image of The display position of the first type of right display image in the first right-eye display unit and the display position of the first type of left display image in the first left-eye display unit so that the displacement is eliminated. A first adjustment process for changing at least one of them according to the change instruction is executed.

According to the above configuration, the image display device captures the target article with both the right camera and the left camera, displays the first type right display image on the first right-eye display unit, and the first type. Are displayed on the first left-eye display unit. The first user wearing the first frame can visually recognize the first type display image with both eyes based on the first type right display image and the first type left display image. Then, by executing the first adjustment process, when the first user visually recognizes the first type display image, the display portion by the first type right display image and the first type left display image are used. The positional deviation from the display portion can be eliminated. The “position” here includes a horizontal position, a vertical position, and a depth direction position. Thereby, the image display apparatus can display the first type display image in a manner that is less uncomfortable for the user. Therefore, according to said structure, a user's discomfort can be reduced.

Here, “images (that is, first type right display image and first type left display image) are displayed on the display unit (that is, the first right eye display unit and the first left eye display unit). “To do” is sufficient if the user wearing the image display device can see the image when viewing the display unit. That is, the display unit has a configuration that only reflects the projected light, and the user recognizes the image by viewing the reflected light reflected by the display unit (that is, receiving light by the retina). Including the case where it is possible. The same applies hereinafter.

The first adjustment process includes a first right mark image and a second right mark image that is visually recognized so as to be arranged farther from the first user than the first right mark image. The first left mark image displayed on the first right-eye display unit and the second left mark image visually recognized so as to be arranged farther from the first user than the first left mark image Are displayed on the first display unit for the left eye, and when viewed from the first user, the first right mark image and the first left mark image overlap, and the second right mark image The display position of the first right mark image and the second right mark, and the display position of the first left mark image and the second left mark so that the two right mark images appear to overlap. It may include changing at least one of them.

¡The way human objects are viewed differs depending on whether an object at a close position is viewed or an object at a distant position. The human eye has a function of adjusting so as to compensate for a difference in appearance when an object at a close position and an object at a distant position are viewed at different timings. Therefore, in the above image display device, when the adjustment process for viewing an image displayed at a close position and the adjustment process for viewing an image displayed at a distant position are performed at different timings, the close position is obtained. When an image to be displayed and an image to be displayed at a distant position are displayed at the same time, the first user may not easily view them three-dimensionally. In this regard, according to the above configuration, the first user, in the first adjustment process, overlaps the first right mark image and the first left mark image as viewed from the first user, and Display positions of the first right mark image and the second right mark, and the first left mark image and the second left mark so that the second right mark image and the second right mark image appear to overlap each other. At least one of the display position and the display position can be changed. Therefore, according to the above configuration, even if the first type of display image includes an image at a close position and an image at a distant position as viewed from the first user, the first user has a three-dimensional view. The first type display image can be displayed on the display unit in an easily recognizable manner.

The first adjustment processing recognizes the shape of an object included in a right camera image captured by the right camera and a left camera image captured by the left camera, and a right mark image having a shape that matches the shape of the object Is displayed on the first right-eye display unit, a left mark image having a shape suitable for the right mark image is displayed on the first left-eye display unit, and the right mark image and the left mark image are further displayed. At least a part of the first image is displayed in such a manner that the first image can be visually recognized so as to overlap the object when viewed from the first user, and the right mark image and the left mark image are viewed from the first user. It may include changing the display position of the second image so that the second image, which is the other of them, appears to overlap the first image.

According to this configuration, in the first adjustment process, the first user can make the first image displayed so that at least a part overlaps the object and the second image appear to overlap each other. The display position of the second image can be changed. With the object as a reference, the two images can be aligned. Therefore, the two images can be accurately aligned as compared with the case where the object is not used as a reference. Therefore, according to the above configuration, it is possible to display the first type display image on the display unit more appropriately in such a manner that the first user can easily recognize three-dimensionally.

The first image display device may further include a storage device. In the first adjustment process, the first control unit displays the display position of the first type of right display image on the first right eye display unit and the first type of left display on the first left eye display unit. The display position of the first type of right display image on the first right-eye display unit after being changed by the first adjustment processing after at least one of the display position of the image is changed. Identification information indicating the right adjustment position, the left adjustment position that is the display position of the first type of left display image in the first left-eye display unit after being changed by the first adjustment process, and the first user Are stored in the storage device in association with each other, and when the identification information is input after the right adjustment position, the left adjustment position, and the identification information are stored in the storage device, the first right eye The first type is located at a position corresponding to the right adjustment position on the display unit. Together to display the display image may be displayed first kind of left display image at a position corresponding to left adjustment position in the first left-eye display unit.

According to this configuration, the first image display device stores the right adjustment position and the left adjustment position for the first user in the storage device in association with the identification information, and then when the identification information is input, Based on the stored right adjustment position and left adjustment position, a first type of right display image and a first type of left display image are displayed. That is, when the identification information is input, the result of the first adjustment process performed by the first user can be reflected. The image display device can display the first type display image on the display unit in a manner that is easily recognized by the first user.

The first image display device may further include a first communication interface for executing communication with an external device different from the first image display device. The first control unit may generate the second type of right image data based on the first type of right image data. The second type of right image data may be data for displaying the second type of right display image on the target right eye display unit of the external device. The second type of right display image may be an image related to the first type of right display image. The first control unit may generate the second type of left image data based on the first type of left image data. The second type of left image data may be data for displaying the second type of left display image on the target left eye display unit of the external device. The second type of left display image may be an image related to the first type of left display image. The first control unit may transmit the second type of right image data and the second type of left image data to the external device via the first communication interface.

According to this configuration, the first image display device can allow the user of the external device to visually recognize the display image related to the first type of display image visually recognized by the first user. The first user and the user of the external device can visually recognize images related to each other.

The first control unit receives the third type of right image data and the third type of left image data from the external device via the first communication interface, and is represented by the third type of right image data. The third type right display image is displayed on the first right eye display unit, and the third type left display image represented by the third type left image data is displayed on the first left eye display unit. May be. The third type right display image may be an image related to the target right display image displayed on the target right eye display unit of the external device. The third type of left display image may be an image related to the target left display image displayed on the target left eye display unit of the external device.

According to this configuration, the first image device can cause the first user to visually recognize a display image related to the display image visually recognized by the user of the external device. The first user and the user of the external device can visually recognize images related to each other.

The present specification further discloses an image display system including the first image display device and the second image display device. The second image display device includes a second frame that can be attached to the head of a second user different from the first user, and a second frame that is provided in the second frame and that is attached to the second frame. A second right-eye display unit disposed at a position facing the user's right eye, and a second frame provided at the position facing the left eye of the second user wearing the second frame. A second left-eye display unit, a second communication interface for executing communication with the first image display device, and a second control unit. The second control unit receives the second type of right image data and the second type of left image data from the first image display device via the second communication interface, and receives the second type of right image data. Is displayed on the second right-eye display unit, and the second-type left display image represented by the second-type left image data is displayed for the second left-eye. The second type of right display image is displayed in the second type of display image that can be viewed by both eyes based on the second type of right display image and the second type of left display image. The display position of the second type of right display image in the second right eye display unit and the second left eye display so that there is no positional deviation between the display part of FIG. 2 and the display part of the second type of left display image Type 2 left display on the display The display position of the ray image, at least one of, performing a second adjusting process for changing according to the change instruction input by the second user.

According to this configuration, the second image display device can cause the second user to visually recognize the second type of display image related to the first type of display image visually recognized by the first user. Images related to each other can be visually recognized by the first user and the second user. At that time, the first image display device can display the first type of display image on the display unit as a target that is easily recognized by the first user, and the second image display device The second type display image can be displayed on the display unit in a manner that is easy for the user to recognize.

Note that a control method, a computer program, and a computer-readable recording medium storing the computer program for realizing the first and second image display apparatuses are also novel and useful.

An outline of the image display system is shown. 1 shows a block diagram of an image display system. An outline of an image display method by the image display apparatus will be described. The flowchart of the starting process of 1st Example is shown. The example of the up-down adjustment screen of 1st Example is shown. The example of the left-right adjustment screen of 1st Example is shown. The example of the fine adjustment screen of 1st Example is shown. The example of the menu screen of 1st Example is shown. The flowchart of the display process of 1st Example is shown. The example of a display of the image of each image display apparatus by the display process of 1st Example is shown. The example of a display of the image of each image display apparatus by the display process of 1st Example is shown. The flowchart of the display process of 2nd Example is shown. The example of a display of the image of each image display apparatus by the display process of 2nd Example is shown. The example of the adjustment screen of 3rd Example is shown. The example of the adjustment screen of 4th Example is shown. An appearance of an image display apparatus according to a fifth embodiment is shown.

(First embodiment)
(Configuration of image display system 2; FIGS. 1 and 2)
As shown in FIGS. 1 and 2, the image display system 2 includes image display devices 10 and 50 and a server 80. The image display apparatuses 10 and 50 and the server 80 can perform wireless communication (specifically, Wi-Fi communication) with each other via the Internet 4.

(Configuration of Image Display Device 10)
The image display device 10 is an image display device (a so-called head mounted display) used by being mounted on a user's head. As shown in FIG. 1, the image display device 10 includes a frame 12, a right display unit 14R, a left display unit 14L, a right projection unit 15R, a left projection unit 15L, a right camera 16R, and a left camera 16L. A control box 18 and an operation unit 19 are provided.

The frame 12 is a spectacle frame-shaped member. The user can wear the image display device 10 on the head by wearing the frame 12 like wearing glasses.

The right display portion 14R and the left display portion 14L are translucent display members, respectively. When the user wears the image display device 10 on the head, the right display unit 14R is disposed at a position facing the user's right eye, and the left display unit 14L is disposed at a position facing the left eye. Hereinafter, the right display unit 14R and the left display unit 14L may be collectively referred to as “display unit 14”.

The right projection unit 15R and the left projection unit 15L are members that project images onto the right display unit 14R and the left display unit 14L, respectively. The right projection unit 15R and the left projection unit 15L are provided on the sides of the right display unit 14R and the left display unit 14L, respectively. Hereinafter, the right projection unit 15R and the left projection unit 15L may be collectively referred to as “projection unit 15”. In the present embodiment, the projection unit 15 projects a predetermined virtual image (hereinafter referred to as “object image”) on the display unit 14 in accordance with an instruction from the control unit 30. As a result, the user can view the real-world object or / and space as if the object image was synthesized at a predetermined position in the real-world object or / and space that can be visually recognized by the user through the display unit 14. And the object image. An image of a real-world object or a combination of a space and an object image (that is, an image visually recognized by a user) may be referred to as a “display image” below. Hereinafter, in this specification, when it is explained that the control unit 30 displays a desired image on the display unit 14 by instructing the projection unit 15 to project an image, the operation of the projection unit 15 will be described. It may be omitted and simply expressed as “the control unit 30 causes the display unit 14 to display a desired image”.

The right camera 16R is a camera disposed in the frame 12 at a position above the right display unit 14R (that is, a position corresponding to above the user's right eye). On the other hand, the left camera 16L is a camera disposed in the frame 12 at an upper position of the left display unit 14L (that is, a position corresponding to the upper portion of the user's left eye). Each of the right camera 16R and the left camera 16L can capture a range corresponding to the field of view of the user wearing the image display device 10 (hereinafter may be referred to as a “specific range”) from different angles. That is, it can be said that the right camera 16R captures the viewing range of the user's right eye, and the left camera 16L captures the viewing range of the user's left eye. Hereinafter, the right camera 16R and the left camera 16L may be collectively referred to as “camera 16”.

The control box 18 is a box attached to a part of the frame 12. The control box 18 accommodates each element that controls the control system of the image display apparatus 10. Specifically, as shown in FIG. 2, the control box 18 houses a sensor 20, a Wi-Fi interface 22, a control unit 30, and a memory 32. Hereinafter, the interface is described as “I / F”.

The operation unit 19 is provided on the outer surface of the control box 18. The operation unit 19 is a button that can be operated by the user, and the user can input various instructions to the image display device 10 by operating the operation unit 19.

Referring to FIG. 2, each component in the control box 18 will be described. The sensor 20 is a triaxial acceleration sensor. The sensor 20 detects acceleration of three axes of X, Y, and Z. Using the detection value of the sensor 20, the control unit 30 can specify the posture and motion state of the image display device 10.

The Wi-Fi I / F 22 is an I / F for executing Wi-Fi communication with an external device (for example, the server 80) via the Internet 4.

The control unit 30 executes various processes according to the program stored in the memory 32. Details of processing executed by the control unit 30 will be described later in detail (see FIGS. 4 and 9). The control unit 30 is electrically connected to the display unit 14, the projection unit 15, the camera 16, the sensor 20, the Wi-Fi I / F 22, and the memory 32, and controls the operation of each of these elements. Can do.

The memory 32 stores various programs. The memory 32 is provided with a user information storage area 34 for storing user information related to the user of the image display device 10. The user information includes a user ID for identifying the user, a password used for authentication of the user, and adjustment information. The adjustment information is for adjusting the display positions of the left and right display images when the user corresponding to the user ID visually recognizes the image (that is, the display image) using the image display device 10 to an appropriate position for the user. Information. The user information is stored in the memory 32 by executing a recording process (see FIG. 4) described later. Although not shown, the memory 32 also stores a device ID for identifying the image display device 10.

(Configuration of image display device 50)
The image display device 50 has the same configuration as the image display device 10. That is, the image display device 50 also has the frame 52, the right display unit 54R, the left display unit 54L, the right camera 56R, the left camera 56L, the control box 58, and the operation unit 59, as with the image display device 10. And have. In the control box 58, a sensor 60, a Wi-Fi I / F 62, a control unit 70, and a memory 72 are provided. The memory 72 is provided with a user information storage area 74. The memory 72 also stores a device ID for identifying the image display device 50. Hereinafter, in the present embodiment, an example of each process (for example, the startup process in FIG. 4, the display process in FIG. 9, etc.) executed by the control unit 30 of the image display apparatus 10 may be described. The control unit 70 can also execute all the same processes as the processes executed by the control unit 30 of the image display apparatus 10.

(Configuration of server 80)
The server 80 is a server installed by an administrator of the image display devices 10 and 50 (for example, a company that provides the image display devices 10 and 50). The server 80 manages the image display devices 10 and 50 as devices included in a predetermined device group, and relays image data communication between the image display devices 10 and 50. The server 80 includes a display unit 82, an operation unit 84, a Wi-Fi I / F 86, a control unit 88, and a memory 90.

The display unit 82 is a display capable of displaying various information. The operation unit 84 includes a keyboard and a mouse. The user of the server 80 can input various instructions to the server 80 by operating the operation unit 84. The Wi-Fi I / F 86 is an I / F for executing Wi-Fi communication with an external device (for example, the image display devices 10 and 50) via the Internet 4. The control unit 88 executes various processes according to programs stored in the memory 90. The memory 90 stores the device IDs of the image display devices 10 and 50 in association with predetermined group IDs. That is, the memory 90 stores information indicating that the image display device 10 and the image display device 50 are included in the device group represented by the group ID.

(Outline of image display method; Fig. 3)
Here, an outline of a technique (mechanism) for displaying the display image 110 on the display unit 14 in the image display apparatus 10 of the present embodiment will be described. In FIG. 3, an example is assumed in which the user U1 visually recognizes a display image 110 in which an object image 102 that is a virtual image is combined with an image 101 (hereinafter referred to as “real image”) 101 of a mug 100 that is an actual article. ing. The object image 102 includes a virtual image for making the mug 100 appear as if it has a face, and a virtual image for making it appear as if a balloon is coming out of the mug 100.

As shown in FIG. 3, in this example, the user U1 is viewing the mug 100, which is an actual article, via the display unit 14 with the image display device 10 attached to his / her head. At this time, the shooting range of the camera 16 (that is, the user's field of view) includes the mug 100. The right camera 16R and the left camera 16L each photograph the mug 100 from different angles.

The control unit 30 generates right image data for displaying the right display image 110R on the right display unit 14R based on the right camera image photographed by the right camera 16R. Similarly, the control unit 30 generates left image data for displaying the left display image 110L on the left display unit 14L based on the left camera image captured by the left camera 16L.

Based on the generated right image data, the control unit 30 displays the right display image 110R (that is, the right object image 102R) on the right display unit 14R and the left display image 110L (that is, the left object image) on the left display unit 14L. 102L) is displayed. The right display image 110R includes the right real image 101R of the mug 100 that the user U1 is viewing with the right eye, and the right object image 102R synthesized with the right real image 101R. The left display image 110L includes a left reality image 101L of the mug 100 that the user U1 is viewing with the left eye, and a left object image 102L synthesized with the left reality image 101L. The display position of the right object image 102R in the right display image 110R and the display position of the left object image 102L in the left display image 110L are slightly different from each other. This takes into account the parallax between the right eye and the left eye. The right eye of the user U1 visually recognizes the right display image 110R, and the left eye visually recognizes the left display image 110L. As a result, the user U1 can visually recognize the display image 110 with both eyes.

In the following, the control unit 30 displays the right display image 110R on the right display unit 14R and displays the left display image 110L on the left display unit 14L, thereby allowing the user to visually recognize the display image 110 with both eyes. It may be simply described as “the control unit 30 causes the display unit 14 to display the display image 110”.

As described above, the image display apparatus 10 according to the present embodiment generates right image data based on the right camera image captured by the right camera 16R, and generates left image data based on the left camera image captured by the left camera 16L. Is generated. Then, based on each image data, the right display image 110R and the left display image 110L are displayed on the right display unit 14R and the left display unit 14L, respectively. Since the images 110R and 110L are displayed based on the camera images obtained by the two cameras 16R and 16L, the user U1 displays the display image 110 as compared with the case where the images are displayed based on the camera images obtained by the single camera. It is easy to recognize the object image 120 included in the image three-dimensionally.

As described above, in the image display apparatus 10 of the present embodiment, the right display image 110R and the left display image 110L (that is, the right object image 102R and the left object image 102L) are respectively displayed on the right display unit 14R and the left display unit by the above-described method. By being displayed on 14L, the user U1 can visually recognize one display image 110. However, since the distance, height, position, and the like between the right eye and the left eye are different for each user, if the images 110R and 110L are displayed at fixed positions in the right display unit 14R and the left display unit 14L each time, the user U1 The display image 110 may not be properly viewed by the user, for example, when the object image 120 is displayed twice, such as a shift occurs between the image viewed by the right eye and the image viewed by the left eye. Hereinafter, such a situation may be referred to as “image position shift”. In addition to the positional misalignment of the image caused by the positional relationship between the right eye and the left eye of the user, the position of the focus in the user's field of view (that is, the distance from the feature point on which the user is focused) also changes. Can occur. For example, the convergence angle of both eyes differs between when the user focuses on a relatively near position and when the user focuses on a relatively far position. Due to the difference in the convergence angle of both eyes, the above-described image misalignment may occur.

In the image display device 10 of the present embodiment, a startup process (see FIG. 4) described later is executed in order to suppress image positional deviation. By executing the activation process, the display position of the right display image 110R on the right display unit 14R and the display position of the left display image 110L on the left display unit 14L are positions suitable for the user wearing the image display device 10. Adjusted to And the display process (refer FIG. 9) for displaying an image on the display part 14 in the state by which adjustment was performed is performed. Hereinafter, the startup process (see FIG. 4) and the display process (see FIG. 9) will be described in detail.

(Startup process; Fig. 4)
With reference to FIG. 4, the starting process which the control part 30 of the image display apparatus 10 of a present Example performs is demonstrated. When the user wears the image display device 10 on his / her head and turns on the power of the image display device 10, the control unit 30 starts the activation process of FIG. 4.

In S10, the control unit 30 causes the display unit 14 to display a predetermined login screen (not shown). The login screen is a screen for requesting the user to input a registered user ID and password. While the login screen is displayed, the user can input his / her registered user ID and password by performing a predetermined gesture within the shooting range (that is, the specific range) of the camera 16. In addition, when the user ID and password are not registered, the user can perform a predetermined new registration start operation for requesting new registration. Hereinafter, when the user inputs various operations to the image display device 10, the user inputs the operations by performing a gesture within a specific range. In another example, the user may perform various operations including an input operation such as a user ID and a new registration start operation by operating the operation unit 19.

In subsequent S12, the control unit 30 determines whether a user ID and a password have been input. When the control unit 30 detects that an operation for inputting the user ID and password is performed within the specific range while the login screen is displayed on the display unit 14, the control unit 30 determines YES in S12, and then proceeds to S14. move on. On the other hand, when the control unit 30 detects that a new registration start operation is performed within the specific range while the login screen is displayed on the display unit 14, the control unit 30 determines NO in S12 and proceeds to S20.

In S14, the control unit 30 determines whether or not the authentication of the user ID and password input by the user is successful. Specifically, the control unit 30 includes a user information storage area in the memory 32 that includes user information including a combination that matches a combination of input user ID and password (hereinafter referred to as “specific user ID etc.”). It is determined whether or not it is present in 34. When user information including a specific user ID or the like already exists in the user information storage area 34, the control unit 30 determines YES in S14, and proceeds to S16. On the other hand, when there is no user information including a specific user ID or the like in the user information storage area 34, the control unit 30 determines NO in S14 and returns to S10.

In S16, the control unit 30 reads the adjustment information stored in the user information storage area 34 in association with a specific user ID or the like. Thereafter, the control unit 30 displays the right display image 110R on the right display unit 14R and the left display image 110L on the left display unit 14L according to the display position indicated by the read adjustment information. When S18 ends, the process proceeds to S32.

On the other hand, in S20 (that is, when a new registration start operation is performed by the user), the control unit 30 displays a predetermined new information input screen (not shown) on the display unit 14, and the new user ID and new password are displayed. Monitor input. The user can input a new user ID and a new password by performing a predetermined input gesture within a specific range while the new information input screen is displayed on the display unit 14. In this case, the control unit 30 determines YES in S20, and proceeds to S22. When the combination of the new user ID and the new password input by the user is already registered in the user information storage area 34, the control unit 30 displays the new user ID and the new password on the display unit 14. Display a message requesting a change.

In S22, the control unit 30 adjusts the vertical positions of the images 110R and 110L displayed on the right display unit 14R and the left display unit 14L. Specifically, in S22, the control unit 30 causes the display unit 14 to display the up / down adjustment screen 210 of FIG. The vertical adjustment screen 210 includes marks 212 and 214 for adjusting the vertical position, an up button 216 for raising the image display position, a down button 218 for lowering the image display position, and confirmation. The OK button 220 is included. Of the two marks 212 and 214, the mark 212 is displayed on the right display unit 14R, and the mark 214 is displayed on the left display unit 14L. The up movement button 216, the down movement button 218, and the OK button 220 are displayed on one of the right display portion 14R and the left display portion 14L. The user can visually recognize the vertical adjustment screen 210 as shown in FIG. 5 by viewing these elements with both eyes. While viewing the two marks 212 and 214 with both eyes, the user operates the buttons 216 and 218 to adjust the two marks 212 and 214 so that they overlap. By adjusting the two marks 212 and 214 to overlap, the vertical positions of the images 110R and 110L displayed on the right display unit 14R and the left display unit 14L are adjusted. The user operates the OK button 220 when the two marks 212 and 214 are adjusted so as to overlap (that is, when the vertical position is adjusted), and determines the vertical position. In this case, the control unit 30 temporarily stores the determined vertical position in the memory 32, and proceeds to S24.

In S24, the control unit 30 adjusts the left and right positions of the images 110R and 110L. Specifically, in S24, the control unit 30 displays the left / right adjustment screen 230 of FIG. The left and right adjustment screen 230 includes marks 232 and 234 for adjusting the left and right positions, a separation movement button 236 for increasing the display interval between the left and right images, and a proximity movement button 238 for reducing the display interval between the left and right images. And an OK button 240 for confirmation. Of the two marks 232 and 234, the mark 232 is displayed on the right display unit 14R, and the mark 234 is displayed on the left display unit 14L. The separation movement button 236, the proximity movement button 238, and the OK button 240 are displayed on one of the right display portion 14R and the left display portion 14L. The user can visually recognize the left-right adjustment screen 230 as shown in FIG. 6 by viewing these elements with both eyes. While viewing the two marks 232 and 234 with both eyes, the user operates the buttons 236 and 238 to adjust the two marks 232 and 234 so that they overlap. By adjusting so that the two marks 232 and 234 overlap, the left and right positions (in other words, the intervals) of the images 110R and 110L displayed on the right display unit 14R and the left display unit 14L are adjusted. The user operates the OK button 240 when the two marks 232 and 234 are adjusted so as to overlap each other (that is, when the left and right positions are adjusted) to determine the left and right positions. In this case, the control unit 30 temporarily stores the determined left and right positions in the memory 32 and proceeds to S26.

In S26, the control unit 30 finely adjusts the display positions of the images 110R and 110L. Specifically, in S26, the control unit 30 displays the fine adjustment screen 250 of FIG. The control unit 30 displays the fine adjustment screen 250 of FIG. The fine adjustment screen 250 includes marks 252 and 254 for position adjustment, a right adjustment button 256 for finely adjusting the display position of the image displayed on the right display unit 14R vertically and horizontally, and a left display unit 14L. A left adjustment button 258 for finely adjusting the display position of the displayed image vertically and horizontally, and an OK button 260 for confirmation are included. Of the two marks 252, 254, the mark 252 is displayed on the right display unit 14R, and the mark 254 is displayed on the left display unit 14L. The right adjustment button 256, the left adjustment button 258, and the OK button 260 are displayed on one of the right display portion 14R and the left display portion 14L. The user can view a fine adjustment screen 250 as shown in FIG. 7 by viewing these elements with both eyes. While viewing the two marks 252 and 254 with both eyes, the user operates the buttons 256 and 258 to adjust the two marks 252 and 254 so that they overlap. By adjusting so that the two marks 252 and 254 overlap, the display positions of the images 110R and 110L displayed on the right display unit 14R and the left display unit 14L are finely adjusted, respectively. The user operates the OK button 260 when the two marks 252 and 254 are adjusted so as to overlap each other, and determines the position. In this case, the control unit 30 temporarily stores the determined display position in the memory 32, and proceeds to S28.

In S28, the control unit 30 generates adjustment information indicating the display position determined in S22 to S26. Next, in S30, the control unit 30 stores the adjustment information generated in S28 in the user information storage area 34 in association with the new user ID and the new password. Thereafter, the control unit 30 displays the right display image 110R on the right display unit 14R and the left display image 110L on the left display unit 14L according to the display position indicated by the adjustment information generated in S28. When S30 ends, the process proceeds to S32.

In S32, the control unit 30 causes the display unit 14 to display the menu screen 300 (see FIG. 8). As shown in FIG. 8, the menu screen 300 includes a menu object image 320. In the present embodiment, since the display unit 14 is a translucent display, the menu screen has a mode in which the menu object image 320 is combined with an actual article (that is, an indoor scene) that can be viewed through the display unit 14. 300 can be seen.

As shown in FIG. 8, the menu object image 320 represents the main menu. The menu object image 320 includes three selectable icons 322, 324, and 326, and an end button 328 for ending the display of the menu object image 320. Each icon 322 to 326 corresponds to each function of the image display device 10. In this example, the icon 322 indicates a game application, the icon 324 indicates an education application, and the icon 326 indicates a setting function for changing various settings related to the image display device 10. The user can activate a function corresponding to the desired icon by performing a gesture of touching the desired icon (that is, performing an operation of selecting the desired icon). When the menu screen 300 is displayed in S32, the activation process in FIG. 4 ends.

After the menu screen 300 is displayed on the display unit 14 by the activation process of FIG. 4, when the user selects the icon 326 indicating the setting function and further instructs the adjustment of the display position, the control unit 30 displays the right display unit 14R. In addition, the left and right positions of the images 110R and 110L displayed on the left display unit 14L can be readjusted. In this case, the control unit 30 re-executes the processes of S22 to S30 in FIG. 4, and again performs the vertical position adjustment (S22), the horizontal position adjustment (S24), and the fine adjustment (S26) according to the user instruction. In this case, the control unit 30 displays the right display image 110R on the right display unit 14R and displays the left display image 110L on the left display unit 14L in accordance with the display position indicated by the re-executed adjustment information generated in S28. Let As described above, the user can adjust the display position of the image as needed in accordance with his / her state even after the start-up process of FIG. 4 is completed.

(Display processing; FIG. 9)
With reference to FIG. 9, the display process which the control part 30 of the image display apparatus 10 of a present Example performs is demonstrated. After the activation process (see FIG. 4) is finished and the menu screen 300 is displayed on the display unit 14, when the user performs an operation of selecting an icon (for example, the icon 322) corresponding to a desired application, The display process of FIG. 9 is started.

In S50, the control unit 30 acquires the right camera image currently captured by the right camera 16R from the right camera 16R, and acquires the left camera image currently captured by the left camera 16L from the left camera 16L. .

In subsequent S52, the control unit 30 displays data of the display image displayed on the display unit of another image display device (for example, the image display device 50) in the device group including the own device from the server 80 (that is, the right side). Display image data and left display image data).

In subsequent S54, the control unit 30 displays the right display image on the right display unit 14R of its own device based on the right camera image acquired in S50 and the right image data received in S52 (see 110R in FIG. 3). The right image data for displaying is generated. At the same time, the control unit 30 displays a left display image (see 110L in FIG. 3) on the left display unit 14L of the own device based on the left camera image acquired in S50 and the left image data received in S52. Left image data for generating the image is generated. The right image data and the left image data include object image data to be combined with a real image.

In subsequent S56, the control unit 30 causes the display unit 14 to display a display image (see 110 in FIG. 3) based on the right image data and the left image data generated in S54. That is, the control unit 30 displays the right display image on the right display unit 14R based on the right image data, and displays the left display image on the left display unit 14L based on the left image data. The display image displayed in S56 is, for example, an image in a form in which an object image (see 102 in FIG. 3) is combined with a real image (see 101 in FIG. 3).

In subsequent S58, the control unit 30 includes right display image data indicating the right display image (that is, an image including the real image and the object image) displayed in S56, and a left display image (that is, the real image and the object image). Left display image data indicating (image) is generated and transmitted to the server 80. When the server 80 receives the right display image data and the left display image data from the image display device 10, the server 80 transmits the image display device to another image display device (for example, the image display device 50) in the device group including the image display device 10. The right display image data and the left display image data received from 10 are transmitted. Thereby, the display image of the aspect which visually recognized the same target object from the own viewpoint from the display units 14 and 54 of the image display apparatuses 10 and 50, respectively, is displayed.

The control unit 30 repeatedly executes the processes of S50 to S58 until a predetermined end operation is performed. The control unit 30 can change the display content of the display image according to the operation, such as changing the display mode of the object image included in the display image according to the user's operation. Further, the control unit 30 can change the display content of the display image according to the contents of the right image data and the left image data received from the server 80.

(Specific examples: FIGS. 10 and 11)
Subsequently, referring to FIG. 10 and FIG. 11, when display processing (see FIG. 9) is executed by the image display device 10 and the image display device 50 of the present embodiment, the display unit of each device 10, 50. A specific example of the display image displayed on 14 and 54 will be described. In this example, as shown in FIG. 10, a user U1 wearing the image display device 10 and a user U2 wearing the image display device 50 exist in the room R. In this example, in both the image display devices 10 and 50, a game application (that is, an application corresponding to the icon 322 in FIG. 8) is activated, and display processing (see FIG. 9) is executed. Each of the users U1 and U2 sees the apple 400, which is an actual article existing in the room R, from a different position (that is, the apple 400 exists within the shooting range of the cameras 16 and 56).

FIG. 10 shows a state in which an object image 410 imitating an arrow is stabbed into the apple 400 by an operation of the user U1 in the game (specifically, an operation in which the user U1 shoots an arrow using a virtual bow). Yes. When the image display apparatus 10 executes the processes of S50 to S58 in FIG. 9, a display image 450 is displayed on the display unit. Display image 450 includes a real image 401 of apple 400 and an object image 410 of an arrow. In the display image 450, the object image 410 represents a state in which an arrow is stuck toward the back side of the page. Further, the display image 460 is displayed on the display unit 54 by the image display device 50 executing the processing of S50 to S58 of FIG. The display image 460 also includes a real image 401 of the apple 400 and an arrow object image 410. However, in the display image 460, the object image 410 represents a state in which an arrow is stuck toward the left side of the page. In this way, display images 450 and 460 in a form in which the same object is viewed from the viewpoint of the own device are displayed on the display units 14 and 54 of the image display apparatuses 10 and 50, respectively.

FIG. 11 further shows that the object image 420 imitating the flag of the apple 400 is further stabbed by an operation of the user U2 in the game (specifically, an operation in which the user U2 pushes up a virtual flagpole). ing. At this time, a display image 470 is displayed on the display unit 14 of the image display device 10. Display image 470 further includes a flag object image 420. In the display image 470, the object image 420 represents a state where a flag is stuck on the left side of the apple 400. Further, a display image 480 is displayed on the display unit 54 of the image display device 50. Display image 480 also includes a flag object image 420. In the display image 480, the object image 420 represents a state where a flag is stuck in front of the apple 400. As described above, display images 470 and 480 in a form in which the same object is visually recognized from the viewpoint of the own device are displayed on the display units 14 and 54 of the image display devices 10 and 50, respectively.

The configuration and operation of the image display system 2 according to the present embodiment have been described above. In the present embodiment, the image display apparatus 10 captures the target article with both the right camera 16R and the left camera 16L, displays the right display image on the right display unit 14R based on the right camera image, and also displays the left camera image. The left display image is displayed on the left display unit 14L based on (see FIGS. 3 and 9). The user wearing the image display device 10 can visually recognize the display image with both eyes based on the right display image and the left display image. Therefore, according to the configuration of the present embodiment, the image display device 10 recognizes three-dimensionally for the user as compared to the case where a configuration in which a display image is displayed based only on an image obtained by photographing an article with one camera is employed. The display image can be displayed on the display unit 14 in a manner that is easy to do.

Further, in the present embodiment, the control unit 30 executes the processing of S22 to S30 in FIG. 4 to display the display portion by the right display image and the display by the left display image when displaying the display image on the display unit 14. Misalignment with the part can also be eliminated. Therefore, according to the image display apparatus 10 of the present embodiment, it is possible to display a display image in a manner that is less uncomfortable for the user. Therefore, according to the present embodiment, the user's uncomfortable feeling can be reduced.

Further, the control unit 30 stores the generated adjustment information in the user information storage area 34 in association with the new user ID and the new password (S28 and S30 in FIG. 4). Then, when the user ID and password stored in the user information storage area 34 are input in the subsequent startup processing (FIG. 4) (YES in S14), the control unit 30 associates with the user ID and the like. Then, the adjustment information stored in the user information storage area 34 is read (S16). After that, the control unit 30 displays the right display image on the right display unit 14R and displays the left display image on the left display unit 14L according to the display position indicated by the read adjustment information. Therefore, the image display apparatus 10 can store adjustment information indicating the display position for each user, and can reflect the display position indicated by the adjustment information when the user authentication is successful. The image display device 10 can display a display image on the display unit 14 in a manner that is easy for the user to recognize for each user.

The control unit 30 also displays display image data (that is, right display image data and left display image data) displayed on the display unit of another image display device in the device group including the own device from the server 80. (S52 in FIG. 9), based on the display image data, right image data and left image data to be displayed on the display unit of the own device are generated (S54). Then, the control unit 30 causes the display unit 14 to display a display image (see 110 in FIG. 3) based on the right image data and the left image data generated in S54 (S56). Further, the control unit 30 generates right display image data and left display image data representing the display image displayed in S56, and transmits them to the server 80 (S58). When the server 80 receives the right display image data and the left display image data from the image display device 10, the server 80 transmits the image display device to another image display device (for example, the image display device 50) in the device group including the image display device 10. The right display image data and the left display image data received from 10 are transmitted. Therefore, as shown in FIGS. 10 and 11, the image display devices 10 and 50 can display display images related to each other on the display units 14 and 54.

The correspondence between this embodiment and the claims will be described. The image display device 10 is an example of a “first image display device”. The image display device 50 is an example of an “external device” or “second image display device”. The right display unit 14R and the left display unit 14L are examples of a “right eye display unit” and a “left eye display unit”, respectively. The right image data and the left image data generated in S54 of FIG. 9 are examples of “first type right image data” and “first type left image data”, respectively. The right display image and the left display image displayed in S56 of FIG. 9 are examples of the “first type right display image” and the “first type left display image”, respectively. The up / down position adjustment instruction performed in S22 in FIG. 4, the left / right position adjustment instruction performed in S24, and the fine adjustment instruction performed in S26 are examples of the “change instruction”. The vertical position adjustment performed in S22, the horizontal position adjustment performed in S24, and the fine adjustment performed in S26 are examples of the “first adjustment process”. The display position for the right display unit and the display position for the left display unit indicated by the adjustment information generated in S28 are examples of “right adjustment position” and “left adjustment position”, respectively. The user ID is an example of “identification information”. The right display image data and the left display image data transmitted to the server 80 in S58 of FIG. 9 are examples of “second type right image data” and “second type left image data”, respectively. The right display image data and the left display image data received from the server 80 in S52 of FIG. 9 (that is, received from the image display device 50 via the server 80) are “third type right image data”, It is an example of "3rd type left image data."

(Second embodiment)
A description will be given centering on differences from the first embodiment. The basic structure of the image display system 2 of this embodiment is the same as that of the first embodiment, but the contents of display processing executed by the control unit 30 of the image display device 10 are different from those of the first embodiment (FIG. 12). reference).

With reference to FIG. 12, a display process executed by the control unit 30 of the image display apparatus 10 of the present embodiment will be described. After the activation process (see FIG. 4) is finished and the menu screen 300 is displayed on the display unit 14, when the user performs an operation of selecting an icon (for example, the icon 324) corresponding to a desired application, The display process of FIG. 12 is started. In S70, the control unit 30 determines whether or not the setting of the own device is the transmission side. In the present embodiment, the memory 32 of the image display apparatus 10 stores information indicating whether the own device functions as a transmission side terminal or a reception side terminal.

Here, the transmission-side terminal is a device that transmits data representing a display image displayed on its own device to another device via the server 80. The receiving side terminal receives data representing the display image displayed on the transmitting side terminal from the transmitting side terminal via the server 80 and displays the same display image as the display image displayed on the transmitting side terminal. Terminal. The user can set in advance whether the image display device 10 functions as a transmission-side terminal or a reception-side terminal. When the memory 32 stores information indicating the setting that the own device is the transmission side terminal, the control unit 30 determines YES in S70 and proceeds to S72. On the other hand, when the information indicating the setting that the own device is the receiving terminal is stored in the memory 32, the control unit 30 determines NO in S70, and proceeds to S80.

In S72, the control unit 30 acquires the right camera image currently captured by the right camera 16R from the right camera 16R, and acquires the left camera image currently captured by the left camera 16L from the left camera 16L. .

In S74, the control unit 30 generates right image data for displaying a right display image (see 110R in FIG. 3) on the right display unit 14R of the own device based on the right camera image acquired in S70. At the same time, the control unit 30 generates left image data for displaying a left display image (see 110L in FIG. 3) on the left display unit 14L of the own device based on the left camera image acquired in S70. The right image data and the left image data include object image data to be combined with a real image.

In S76, the control unit 30 causes the display unit 14 to display a display image (see 110 in FIG. 3) based on the right image data and the left image data generated in S74. That is, the control unit 30 displays the right display image on the right display unit 14R based on the right image data, and displays the left display image on the left display unit 14L based on the left image data.

In subsequent S78, the control unit 30 generates right display image data indicating the right display image displayed in S76 and left display image data indicating the left display image, and transmits them to the server 80. When the server 80 receives the right display image data and the left display image data from the image display device 10, the server 80 transmits the image display device 10 to another image display device (for example, the image display device 50) that is a receiving side terminal in the device group. The received right display image data and left display image data are transmitted. As a result, in the present embodiment, the same display image is displayed on the display units of the image display devices 10 and 50, respectively.

Thereafter, the control unit 30 repeatedly executes the processes of S72 to S78 until a predetermined end operation is performed. The control unit 30 can change the display content of the display image according to the operation, such as changing the display mode of the object image included in the display image according to the user's operation.

On the other hand, in S80 (that is, in the case where the own device is a receiving terminal), the control unit 30 displays data of the display image displayed on the display unit of the image display device 10 that is the transmitting terminal (that is, the server 80). , Right display image data and left display image data).

In subsequent S82, the control unit 30 causes the display unit 14 to display a display image based on the right display image data and the left display image data received in S80. That is, the control unit 30 displays the right display image on the right display unit 14R based on the right display image data, and displays the left display image on the left display unit 14L based on the left display image data. Thereby, the same image as the display image data displayed on the display part of the other image display apparatus which is a transmission side terminal is displayed on the display part 14. FIG.

(Specific example: FIG. 13)
Subsequently, referring to FIG. 13, when a display process (see FIG. 12) is executed by the image display device 10 and the image display device 50 of the present embodiment, the display units 14 and 54 of the devices 10 and 50. A specific example of the display image displayed on the screen will be described. In this example, as shown in FIG. 13, a user U1 wearing the image display device 10 and a user U2 wearing the image display device 50 exist in the room R. In this example, in both the image display devices 10 and 50, an education application (that is, an application corresponding to the icon 324 in FIG. 8) is activated, and display processing (see FIG. 12) is executed. The image display device 10 is set as a display side terminal, and the image display device 50 is set as a reception side terminal. In this example, it is assumed that the user U1 who is a lecturer teaches how to cook for the user U2 who is a student role using the image display system 2. The user U1 is looking at the pan 500 which is an actual article existing in the room R (that is, the pan 500 exists within the shooting range of the camera 16). A part of the bread 500 is sliced in advance.

In FIG. 13, an object image 510 showing an explanatory message around the pan 500 by the operation of the user U1 who is a lecturer (specifically, an operation in which the user U1 cuts bread using a virtual knife). And an object image 512 simulating a knife is shown. In the image display device 10 (that is, the transmission side terminal), the display image 550 is displayed on the display unit 14 as a result of executing the processing of S72 to S78 of FIG. The display image 550 includes a real image 501 of the pan 500, an object image 510 for an explanatory message, and a knife object image 512. Further, in the image display device 50 (that is, the receiving terminal), the display image 600 is displayed on the display unit 54 as a result of executing the processing of S80 and S82 of FIG. The display image 600 is the same image as the display image 550 displayed on the display unit 14 of the image display device 10. Thus, the display images 550 and 600 having the same contents are displayed on the display units 14 and 54 of the image display devices 10 and 50, respectively.

The image display system 2 of the present embodiment can also exhibit the same operational effects as the image display system 2 of the first embodiment. Further, as described above, in the present embodiment, the display images 550 and 600 having the same contents are displayed on the display units 14 and 54 of the image display devices 10 and 50, respectively. That is, each user can visually recognize the same image. The right image data and the left image data generated in S74 of FIG. 12 are examples of “first type right image data” and “first type left image data”, respectively. The right display image data and the left display image data transmitted to the server 80 in S78 are examples of “second type right image data” and “second type left image data”, respectively. The right display image data and the left display image data received from the server 80 in S80 (that is, received from the transmitting terminal via the server 80) are “third type right image data” and “third type”, respectively. Is an example of “left image data”.

(Third embodiment)
A description will be given centering on differences from the first embodiment. In the present embodiment, the contents of processing for adjusting the positions of the images 110R and 110L displayed on the right display portion 14R and the left display portion 14L are different from those in the first embodiment. As described above, in the first embodiment, in S22 to S26 of FIG. 4, the control unit 30 performs vertical position adjustment, left and right position adjustment, and fine adjustment, respectively (see FIGS. 5 to 7). On the other hand, in this embodiment, instead of the processing of S22 to S26 of FIG. 4, the control unit 30 performs adjustment by displaying the adjustment screen 710 of FIG. The adjustment screen 710 of this embodiment includes marks 712 and 714 for position adjustment at positions close to the user, marks 722 and 724 for position adjustment at positions far from the user, and a right adjustment button 730. And a left adjustment button 732 and an OK button 750 for confirmation.

The marks 712 and 714 are mark images that are visually recognized so as to be displayed at positions close to the user. On the other hand, the marks 722 and 724 are mark images that are visually recognized so as to be displayed at positions far from the user. In the example of FIG. 14, the marks 722 and 724 are displayed separately in four places. Among the marks, the mark 712 and the mark 722 are displayed on the right display unit 14R, and the mark 714 and the mark 724 are displayed on the left display unit 14L.

The right adjustment button 730 is an adjustment button for adjusting the display position of each image (in this case, the mark 712 and the mark 722) displayed on the right display unit 14R, and the left adjustment button 732 is a left display. This is an adjustment button for adjusting the display position of each image (in this case, the mark 714 and the mark 724) displayed on the portion 14L in the vertical and horizontal directions. When the right adjustment button 730 is operated, the display positions of the mark 712 and the mark 722 are changed simultaneously with the operation. Similarly, when the left adjustment button 732 is operated, the display positions of the mark 714 and the mark 724 change simultaneously with the operation. In the present embodiment, the right adjustment button 730, the left adjustment button 732, and the OK button 750 are displayed on one of the right display portion 14R and the left display portion 14L. The user can visually recognize the adjustment screen 710 as shown in FIG. 14 by viewing the above elements with both eyes.

The user operates the buttons 730 and 732 while viewing the marks 712, 714, 722, and 724 with both eyes, and adjusts the mark 712 and the mark 714 so that they overlap, and the mark 722 and the mark 724 overlap. By adjusting the marks 712 and 714 so as to overlap with each other, the display position of the image displayed at a position close to the user when viewed from the user is adjusted among the images 110R and 110L. Then, by adjusting the marks 722 and 724 so as to overlap each other, the display position of an image displayed at a position far from the user among the images 110R and 110L is adjusted. When the user adjusts the marks 712 and 714 and the marks 722 and 724 to overlap each other, the user operates the OK button 750 to determine the position. In this case, the control unit 30 temporarily stores the determined display position in the memory 32, and proceeds to S28 of FIG. The subsequent processing is the same as in the first embodiment.

¡The way human objects are viewed differs depending on whether an object at a close position is viewed or an object at a distant position. The human eye has a function of adjusting so as to compensate for a difference in appearance when an object at a close position and an object at a distant position are viewed at different timings. Therefore, when the image display device 10 performs an adjustment process for viewing an image displayed at a close position and an adjustment process for viewing an image displayed at a distant position at different timings, the display is performed at a close position. When an image to be displayed and an image displayed at a distant position are displayed at the same time, it may be difficult for the user to visually recognize them. In this regard, according to the present embodiment, the user adjusts the marks 712 and 714 so that the marks 722 and 724 appear to overlap while looking at the adjustment screen 710. Therefore, according to the present embodiment, even when the images 110R and 110L include an image at a close position and an image at a distant position when viewed from the user, the image 110R is easily recognized three-dimensionally by the user. 110L can be displayed on the display unit 14.

The marks 712 and 714 of the present embodiment are examples of “first right mark image” and “first left mark image”, respectively. The marks 722 and 724 are examples of a “second right mark image” and a “second left mark image”, respectively.

(Fourth embodiment)
A description will be given centering on differences from the first embodiment. In the present embodiment, the contents of processing for adjusting the positions of the images 110R and 110L displayed on the right display portion 14R and the left display portion 14L are different from those in the first embodiment. In this embodiment, instead of the processing of S22 to S26 in FIG. 4, the control unit 30 performs adjustment by displaying the adjustment screen 810 in FIG. In the adjustment screen 810 of the present embodiment, an actual object (television monitor 850 in the example of FIG. 15) existing in the shooting range of the camera 16 (that is, the view range of the user), and marks 812 and 814 for position adjustment. A right adjustment button 830 for adjusting the display position of the image displayed on the right display unit 14R vertically and horizontally, and a left adjustment for adjusting the display position of the image displayed on the left display unit 14L vertically and horizontally. A button 832 and an OK button 840 for confirmation are included.

Of the two marks 812 and 814, the mark 812 is a mark image displayed on the right display unit 14R, and the mark 814 is a mark image displayed on the left display unit 14L. The mark 812 has a shape that matches the outer shape of the actual monitor portion of the television monitor 850 that exists in the user's field of view, and is displayed at a position that overlaps the outer shape of the monitor portion. That is, in this embodiment, the control unit 30 recognizes the shape of the monitor portion of the television monitor 850 from the right camera image taken by the right camera 16R and the left camera image taken by the left camera 16L, and monitors the monitor. An image of the mark 812 having a shape that matches the portion is generated and displayed on the right display unit 14R. The mark 814 has the same shape as the mark 812 (that is, a shape that matches the external shape of the monitor portion of the television monitor).

Also, the right adjustment button 830, the left adjustment button 832, and the OK button 840 are displayed on one of the right display portion 14R and the left display portion 14L. The user can visually recognize the adjustment screen 810 as shown in FIG. 15 by viewing each of the above elements with both eyes. The user operates the buttons 830 and 832 while adjusting the marks 812 and 814 displayed at close positions with both eyes, and adjusts the marks 812 and 814 to overlap each other. At this time, the user can move the mark 814 and adjust the mark 814 so as to overlap the mark 812 that is already displayed on the television monitor 850. That is, the user can make adjustments based on the TV monitor 850 that is an actual object. By adjusting the marks 812 and 814 to overlap, the positions of the images 110R and 110L displayed on the right display unit 14R and the left display unit 14L are adjusted. When the user adjusts the marks 812 and 814 to overlap, the user operates the OK button 840 to determine the position. In this case, the control unit 30 temporarily stores the determined display position in the memory 32, and proceeds to S28 of FIG. The subsequent processing is the same as in the first embodiment.

According to the present embodiment, the user can change the display position of the mark 814 so that the mark 812 displayed so as to overlap the television monitor 850 and the mark 814 appear to overlap each other. The marks 812 and 814 can be aligned with reference to the television monitor 850 (that is, an actual object). Therefore, the marks 812 and 814 can be accurately aligned as compared with the case where the television monitor 850 is not used as a reference. Therefore, according to the above configuration, it is possible to display the images 110R and 110L on the display unit 14 in a more appropriate manner that allows the user to easily recognize three-dimensionally.

The marks 812 and 814 of the present embodiment are examples of a “right mark image” and a “left mark image”, respectively. In addition, the marks 812 and 814 in the above example are examples of “first image” and “second image”, respectively. The television monitor 850 is an example of “object”.

(5th Example)
A description will be given centering on differences from the first embodiment. In the present embodiment, as shown in FIG. 16, the configuration of the image display apparatus 1000 is different from that of the first embodiment. The image display apparatus 1000 of the present embodiment is different from the first embodiment in that the display unit 1014 is a light-shielding display and blocks the user's field of view when the user wears the image display apparatus 1000. Is different. Other components are almost the same as those in the first embodiment.

As described above, in the present embodiment, since the display unit 1014 is a light-shielding display, the control unit 30 faces the right eye of the user in the display unit 1014 when displaying the display image on the display unit 1014. The right display image is displayed in the area, and the left display image is displayed in the area of the display unit 1014 facing the user's left eye.

As mentioned above, although the Example was described in detail, these are only illustrations and do not limit a claim. The technology described in the claims includes various modifications and changes of the specific examples illustrated above. For example, the following modifications may be adopted.

(Modification 1) In each of the above-described embodiments, the image display device 10 (50, 1000) includes one component in which all the components 14 to 32 (54 to 72, 1014) are mounted on the frame 12 (52). It is configured as a device. However, the present invention is not limited to this, and some of the components of the image display device may be provided outside the frame. For example, the memory 32 may be provided outside the frame 12 so as to be able to communicate with the control unit 30. In this modification, the image display device 10 may be formed by combining the components mounted on the frame 12 and the components provided outside the frame 12.

(Modification 2) In each of the above-described embodiments, the image display device 10 has the operation unit 19 provided outside the control box 18. The image display device 10 is not limited to this, and the physical operation unit 19 may not be provided. The input of various instructions may all be performed by the control unit 30 detecting a user gesture performed within the shooting range of the camera 16 (that is, the specific range). Further, instead of the operation unit 19, a connection unit that can connect an external input device such as a keyboard may be provided. In that case, input of various instructions may be performed by an external input device connected to the connection unit.

(Modification 3) In each of the above-described embodiments, the right camera 16R and the left camera 16L are disposed above the right display unit 14R and the left display unit 14L, respectively. The arrangement positions of the right camera 16R and the left camera 16L are not limited to this, the right camera captures a range corresponding to the user's right eye view range, and the left camera captures a range corresponding to the user's left eye view range. If possible, they may be arranged at arbitrary positions.

(Modification 4) In each of the above embodiments, the right image data for displaying the right display image on the right display unit 14R is generated based on the right camera image, and the left display image is displayed on the left display unit 14L. The left image data for this is generated based on the left camera image. The right image data is generated based on the right image of the combined image of the right camera image and the left camera image, and the left image data is generated based on the left image of the combined image. May be.

(Modification 5) In the second embodiment, the image display devices 10 and 50 may perform wireless communication directly without using the server 80. In this case, for example, the image display device 10 and the image display device 50 may execute wireless communication other than Wi-Fi communication, such as Bluetooth (registered trademark) communication.

(Modification 6) In the second embodiment described above, the image display device set in the receiving terminal may not be provided with a camera. That is, the device that is the receiving terminal may be a reception-only device.

(Modification 7) In each of the above embodiments, each of the image display devices has a substantially glasses-like frame, and can be worn on the user's head like wearing glasses. The image display device is not limited to this, and may have an arbitrary support frame such as a hat shape or a helmet shape as long as the image display device can be mounted on the user's head.

(Modification 8) An image display device is formed by mounting a camera, a control box, etc. on eyewear (glasses, sunglasses, etc.) generally used for purposes such as vision correction and eye protection. May be. In that case, the lens portion of the eyewear may be used as the display unit.

(Modification 9) In the third embodiment, instead of displaying the adjustment screen 710, the control unit 30 performs an up / down adjustment screen for adjusting the vertical position, a left / right adjustment screen for adjusting the left / right position, Adjustments may be made by displaying fine adjustment screens for adjustment in order. Similarly, in the fourth embodiment, instead of displaying the adjustment screen 810, the control unit displays a vertical adjustment screen for adjusting the vertical position, a horizontal adjustment screen for adjusting the horizontal position, and a fine adjustment for fine adjustment. Adjustments may be made by displaying the adjustment screens in order.

(Modification 10) In the fourth embodiment, when the adjustment screen 810 is displayed, the control unit 30 may display the mark 814 on the television monitor 850 in place of the mark 812.

(Modification 11) In the fourth embodiment, an object that exists in the user's field of view and is used as a reference for position adjustment is not limited to the television monitor 850 shown in FIG. 15, and may be any object. Therefore, for example, a dedicated article for position adjustment may be used.

Further, the technical elements described in the present specification or drawings exhibit technical usefulness alone or in various combinations, and are not limited to the combinations described in the claims at the time of filing. In addition, the technology illustrated in the present specification or the drawings achieves a plurality of objects at the same time, and has technical utility by achieving one of the objects.

Claims (7)

1. A first image display device,
   A first frame attachable to the head of the first user;
   A first right-eye display unit provided in the first frame and disposed at a position facing the right eye of the first user wearing the first frame;
   A first left-eye display unit provided in the first frame and disposed at a position facing the left eye of the first user wearing the first frame;
   A right camera that captures a range corresponding to the field of view of the right eye of the first user wearing the first frame;
   A left camera that captures a range corresponding to a visual field range of the left eye of the first user wearing the first frame;
   A first control unit,
   The first controller is
   First type right image data is generated using at least the right camera image of a right camera image photographed by the right camera and a left camera image photographed by the left camera,
   First type left image data is generated using at least the left camera image of the right camera image and the left camera image,
   Displaying a first type of right display image represented by the first type of right image data on the first right-eye display unit;
   Displaying a first type of left display image represented by the first type of left image data on the first left-eye display unit;
   In the first type of display image that the first user can visually recognize with both eyes based on the first type of right display image and the first type of left display image, display by the first type of right display image The display position of the first type of right display image on the first right-eye display unit and the first left eye so that there is no positional deviation between the portion and the display part of the first type of left display image Executing a first adjustment process for changing at least one of the display position of the first type of left display image on the display unit according to a change instruction;
   1st image display apparatus.
2. The first adjustment process includes:
   The first right eye includes a first right mark image and a second right mark image that is visually recognized so as to be arranged farther from the first user than the first right mark image. Display on the display for
   The first left eye includes a first left mark image and a second left mark image that is visually recognized so as to be arranged farther from the first user than the first left mark image. Display on the display for
   As viewed from the first user, the first right mark image and the first left mark image overlap, and the second right mark image and the second right mark image appear to overlap. As described above, at least one of the display position of the first right mark image and the second right mark and the display position of the first left mark image and the second left mark is changed. including,
   The first image display device according to claim 1.
3. The first adjustment process includes:
   Recognizing the shape of an object included in the right camera image captured by the right camera and the left camera image captured by the left camera;
   A right mark image having a shape suitable for the shape of the object is displayed on the first right eye display unit, and a left mark image having a shape suitable for the right mark image is displayed on the first left eye display unit. Display
   Further, at least a part of the first image that is one of the right mark image and the left mark image is displayed in a manner that can be visually recognized so as to overlap the object when viewed from the first user,
   The display position of the second image so that the second image, which is the other of the right mark image and the left mark image, appears to overlap the first image when viewed from the first user. Including changing the
   The first image display device according to claim 1.
4. A storage device,
   The first controller is
   In the first adjustment process, the display position of the first type of right display image in the first right eye display unit and the first type of left display image in the first left eye display unit. The display position of the first type of right display image on the first right-eye display unit after being changed by the first adjustment process after at least one of the display position and the display position is changed. A right adjustment position; a left adjustment position that is a display position of the first type of left display image in the first left-eye display unit after being changed by the first adjustment process; Storing the identification information indicating the user in association with the storage device,
   When the identification information is input after the right adjustment position, the left adjustment position, and the identification information are stored in the storage device, the right eye in the first right-eye display unit The first type right display image is displayed at a position corresponding to the adjustment position, and the first type left display image is displayed at a position corresponding to the left adjustment position in the first left-eye display unit. ,
   The 1st image display apparatus as described in any one of Claim 1 to 3.
5. A first communication interface for executing communication with an external device different from the first image display device;
   The first controller is
   Second type right image data is generated based on the first type right image data, and the second type right image data is displayed on the target right eye display unit of the external device. And the second type right display image is an image related to the first type right display image,
   Second type left image data is generated based on the first type left image data, and the second type left image data is displayed on the target left eye display unit of the external device. And the second type of left display image is an image related to the first type of left display image,
   Transmitting the second type of right image data and the second type of left image data to the external device via the first communication interface;
   The 1st image display apparatus as described in any one of Claim 1 to 4.
6. The first controller is
   Receiving the third type of right image data and the third type of left image data from the external device via the first communication interface;
   Displaying a third type of right display image represented by the third type of right image data on the first right-eye display unit;
   Displaying a third type of left display image represented by the third type of left image data on the first left-eye display unit;
   The third type right display image is an image related to a target right display image displayed on the target right eye display unit of the external device,
   The third type left display image is an image related to a target left display image displayed on the target left eye display unit of the external device.
   The first image display device according to claim 5.
7. An image display system comprising the first image display device according to claim 5 and a second image display device,
   The second image display device
   A second frame attachable to a head of a second user different from the first user;
   A second right-eye display unit provided in the second frame and disposed at a position facing the right eye of the second user wearing the second frame;
   A second left-eye display unit provided in the second frame and disposed at a position facing the left eye of the second user wearing the second frame;
   A second communication interface for executing communication with the first image display device;
   A second control unit,
   The second controller is
   Receiving the second type of right image data and the second type of left image data from the first image display device via the second communication interface;
   Displaying a second type of right display image represented by the second type of right image data on the second right-eye display unit;
   Displaying a second type of left display image represented by the second type of left image data on the second left-eye display unit;
   In the second type display image that the second user can visually recognize with both eyes based on the second type right display image and the second type left display image, the display by the second type right display image The display position of the second type of right display image on the second right-eye display unit and the second left eye so that the positional deviation between the portion and the display part of the second type of left display image is eliminated. Executing a second adjustment process for changing at least one of the display position of the second type of left display image on the display unit according to a change instruction input by the second user;
   Image display system.

Images