JP5375481B2 - Head mounted display - Google Patents

Description

  The present invention relates to a see-through type head mounted display that presents a content image indicated by content data to a user's eye so as to be visible.

  2. Description of the Related Art Conventionally, a technique related to a see-through type head mounted display that presents a content image indicated by content data to a user's eye so as to be visible is proposed. For example, a head-mounted AV device having a translucent liquid crystal display panel for displaying an image and having a spectacle portion mounted on the head so that the panel comes in front of the eyes, and a work object in each work process A storage unit for storing various animation images created in advance in the form of an image, and a storage unit for a work object itself visually recognized through a liquid crystal display panel by a wearer wearing the AV device according to the order of each work process And an animation display processing function for displaying the animation image on the liquid crystal display panel so that the corresponding animation images stored in the screen overlap, and by displaying the animation image on the liquid crystal display panel according to the order of each work process, Techniques have been proposed in which the work content to be performed on the work object is shown to the wearer (for example, patent documents) Reference 1).

JP 2004-21931 A

  By the way, in a see-through type head-mounted display, a content image is presented on an external image so that it is difficult for a user to visually recognize and recognize the content image separately from the external image. For example, when a head-mounted display is used for work support such as displaying work contents as in Patent Document 1, the user's (worker) 's attention is not always directed to the content image. The user needs to pay sufficient attention to the work object and / or its surroundings from the content image. For this reason, it may be difficult for the user to distinguish and visually recognize the content image and the external image. In such a state, an image of a part, which is a content image, may be mistaken for an actual product and may not be touched even if the hand is stretched out, which may reduce work efficiency or confuse the user. Especially when the background is dark, the parts appear to be in the outside world.

  It is an object of the present invention to provide a see-through type head mounted display that allows a user to easily distinguish a content image from an external image.

  The present invention made in view of the above conventional problems presents a content image indicated by content data so as to be visible to the user's eyes, and allows a user viewing the content image to visually recognize the external image superimposed on the content image. In a see-through type head mounted display, when the content image and the external image are similar, a display effect is added to the content image, and the content image with the display effect added is presented to the user's eyes It is what.

  A first problem-solving means reflecting the present invention presents a content image indicated by content data so as to be visible to a user's eyes, and a user viewing the content image superimposes an external image on the content image. A see-through type head-mounted display that can be visually recognized; when the determination unit determines that the content image and the external image are similar, and the determination unit determines that the content image and the external image are similar, Image processing is performed on the content data, and a display effect adding means for adding a display effect to the content image, and the content image to which the display effect is added by the display effect adding means are presented to the eyes of the user And a content image presenting means for performing the operation. It is an example. According to this, when the content image and the external image are similar, the content image to which the display effect is added can be presented to the user's eyes.

  The second problem solving means is a head-mounted display of the first problem solving means, and includes an imaging means for capturing the external image, and the determination means is captured by the content image and the imaging means. The similarity with the external image is judged. According to this, the similarity between the content image and the external image can be determined for the external image captured by the imaging unit.

  The third problem solving means is the head-mounted display of the first or second problem solving means, and the display effect adding means includes a frame surrounding a range in which the content image presenting means presents the content image, It is added as the display effect. According to this, it is possible for the user to appropriately view (recognize) the range in which the content image is presented.

  The fourth problem solving means is the head-mounted display of the first or second problem solving means, wherein the display effect adding means includes a frame surrounding the first object included in the content image as the first object. The display effect is added to the above. According to this, it is possible for the user to appropriately view (recognize) the first object included in the content image.

  A fifth problem solving means is the head mounted display of the fourth problem solving means, wherein the determination means compares the first object with a second object included in the external image, and the content image The display effect adding means adds the frame as the display effect only to the first object determined to be similar to the second object by the determining means. Features. According to this, it is possible to add a frame as a display effect to the first object included in the content image that is similar to the second object included in the external image. In other words, a frame as a display effect can be added only to the part of the content image (first object) that is difficult to distinguish from the external image.

  The sixth problem solving means is the head-mounted display of the first or second problem solving means, and the display effect adding means changes the color of the content image to give the display effect to the content image. It is characterized by adding. According to this, the range of the content image can be recognized by the user.

  The seventh problem solving means is a head-mounted display according to any one of the first to sixth problem solving means, and the display effect adding means makes the content image and the external image similar to each other by the judging means. If it is determined that the content processing has not been performed, the image processing is not executed on the content data, and the display effect is not added to the content image. The content image with no effect added is presented to the eyes of the user. According to this, when the content image and the external image are not similar, the image processing for adding the display effect can be prevented from being performed. In other words, the image processing for adding the display effect can be executed only when the content image and the external image are similar and can be difficult to distinguish.

  According to the present invention, it is possible to obtain a see-through type head mounted display in which a user can easily distinguish a content image from an external image.

It is a figure which shows a head mounted display. (A) is a top view of a head mounted display main body, (b) is a front view, (c) is a left side view. It is a figure which shows the functional block of a control box. It is a figure which shows the functional block of an image presentation part. It is a figure which shows the flowchart of a main process. (A) shows the content image with the effect to which the display effect by the frame surrounding the 1st object contained in a content image was added, (b) is a figure which shows an external field image. It is a figure which shows the flowchart of a display effect addition process. (A) shows the content image with the effect to which the display effect by the frame surrounding the 1st object contained in a content image was added, (b) is a figure which shows an external field image.

  Embodiments for implementing the above problem solving means reflecting the present invention will be described below in detail with reference to the drawings. The above-mentioned problem solving means is not limited to the configuration described below, and various configurations can be adopted in the same technical idea. For example, in each configuration described below, a predetermined configuration can be omitted. In each process described below, a predetermined step can be omitted.

(Overview of head mounted display)
A head mounted display (Head Mounted Display / hereinafter also referred to as “HMD”) 10 will be described with reference to FIGS. 1 and 2. The HMD 10 includes an HMD main body 100 and a control box 200. The HMD main body 100 is worn on the user's face and used. The control box 200 is attached to the user's waist or the like.

  The HMD main body 100 includes temples 104A and 104B each having a modern 102A and 102B that hits the user's ears attached to one end, armor 106A and 106B coupled to the other end of the temples 104A and 104B via hinges 112A and 112B, 106A and 106B, a front frame 108, and a nose pad 110 attached to the center of the front frame 108 and in contact with the user's nose. Each of these parts forms a skeleton part of the HMD main body 100. Temples 104A and 104B can be folded with hinges 112A and 112B formed on armor 106A and 106B. The structure of the skeleton part of the HMD main body 100 is the same as, for example, normal glasses, and the HMD main body 100 is supported on the user's face by the modern 102A and 102B and the nose pad 110 when the user wears it. . In FIG. 2B, illustration of the moderns 102A and 102B and the temples 104A and 104B is omitted.

  An image presentation unit 114 is attached to the skeleton part of the HMD main body 100 via an attachment part 122 provided near the armor 106A. The image presentation unit 114 is disposed at a position that is substantially the same height as the left eye 118 of the user wearing the HMD main body 100 in a state where the image presentation unit 114 is attached to the vicinity of the armor 106 </ b> A via the attachment unit 122. A CCD sensor 260 is attached to the upper surface of the image presentation unit 114 (not shown in FIG. 2, see FIG. 1). The image presentation unit 114 and the CCD sensor 260 are connected to the control box 200 via the signal cable 250. Although details will be described later, the control box 200 performs a reproduction process (rendering process) on the content data stored in a predetermined area, and transmits an image signal including the content image formed thereby through the signal cable 250. To the image presentation unit 114. The image presentation unit 114 acquires an image signal output from the control box 200 and optically emits a content image based on the image signal toward the half mirror 116.

  The image light 120a representing the content image emitted from the image presentation unit 114 is reflected by the half mirror 116, and the reflected image light 120b is incident on the left eye 118 of the user, in other words, presented (projected) so as to be visible. The Thereby, the user visually recognizes the content image. The half mirror 116 transmits external light representing an external image. The user can visually recognize the external image superimposed on the content image with the left eye 118 through the half mirror 116 with the HMD main body 100 mounted.

  The image presentation unit 114 scans the image light 120a and 120b in accordance with the acquired image signal in a two-dimensional direction, guides the scanned image light 120a and 120b to the user's left eye 118, and displays the content image on the retina. In addition to a retinal scanning type display that forms a liquid crystal display, a liquid crystal display, an organic EL (Organic Electroluminescence) display, and other devices may be used.

(Control box)
The control box 200 will be described with reference to FIG. The control box 200 includes a CPU 202 that controls the device itself, a program ROM 204 that stores programs for various processes including a main process and a display effect adding process described below, and a nonvolatile memory that stores content data and other various data. Flash ROM 206 and RAM 208 as a work area. For example, the CPU 202 executes a program for main processing (see FIG. 5) stored in the program ROM 204 on the RAM 208. Further, the CPU 202 executes a program for reproduction processing in the main processing, and executes a program for display effect addition processing (see FIG. 7) in a predetermined case. Various functional units are configured by the CPU 202 executing various programs stored in the program ROM 204 on the RAM 208.

  The control box 200 includes a video RAM 210, an HMD connection I / F controller 220, an external device connection I / F controller 230, and a peripheral I / F 240. The video RAM 210 stores content images formed by reproduction processing, content images input from an external device 400 described later, and the like. The HMD connection I / F controller 220 is connected to the HMD main body 100 via the signal cable 250 and controls input / output of various signals performed with the image presentation unit 114 of the HMD main body 100 based on a command from the CPU 202. To do. Specifically, the HMD connection I / F controller 220 outputs an image signal including a content image, a control signal for the image presentation unit 114, and the like to the image presentation unit 114.

  The external device connection I / F controller 230 is connected to the external device 400 such as a personal computer via a predetermined cable, and controls communication with the external device 400 based on a command from the CPU 202. For example, the external device connection I / F controller 230 receives an image signal input from the external device 400. The external device connection I / F controller 230 stores the content image based on the received image signal in the video RAM 210.

  The peripheral I / F 240 is a connection I / F to which the CCD sensor 260, the power switch 270, the power lamp 280, and the like are connected. The CPU 202 acquires an external image captured by the CCD sensor 260 via the peripheral I / F 240. The user operates on / off of the image presentation unit 114 and the control box 200 via the power switch 270. The power lamp 280 is turned on when the power switch 270 is turned on and turned off when the power switch 270 is turned off.

(Image presentation part)
The image presentation unit 114 will be described with reference to FIG. The image presentation unit 114 includes a scanned image light generation unit 3121, a collimating optical system 3122, a horizontal scanning unit 3123, a vertical scanning unit 3124, a relay optical system 3125, and a relay optical system 3126.

  The scanned image light generation unit 3121 is a device that reads the image signal output from the HMD connection I / F controller 220 for each dot clock and modulates the intensity according to the read image signal to generate scanned image light. The scanned image light generation unit 3121 includes a signal processing circuit 3211, a light source unit 3212, and a light combining unit 3213.

  The signal processing circuit 3211 is connected to the HMD connection I / F controller 220. The signal processing circuit 3211 is configured to generate B (blue), G (green), and R (red), which are elements for generating scanned image light, based on the image signal input from the HMD connection I / F controller 220. Image signals 3214 a to 3214 c are generated and output to the light source unit 3212. The signal processing circuit 3211 is connected to a horizontal scanning control circuit 3123b of the horizontal scanning unit 3123 described later. The signal processing circuit 3211 generates a horizontal drive signal 3215 based on the image signal input from the HMD connection I / F controller 220, and outputs the horizontal drive signal 3215 to the horizontal scanning control circuit 3123b. Further, the signal processing circuit 3211 is connected to a vertical scanning control circuit 3124b described later. The signal processing circuit 3211 generates a vertical drive signal 3216 based on the image signal input from the HMD connection I / F controller 220 and outputs the vertical drive signal 3216 to the vertical scanning control circuit 3124b.

  The light source unit 3212 includes a B laser driver 3212a, a G laser driver 3212b, an R laser driver 3212c, a B laser 3212d, a G laser 3212e, and an R laser 3212f. The B laser driver 3212a drives the B laser 3212d based on the B (blue) image signal 3214a output from the signal processing circuit 3211 for each dot clock. The B laser 3212d emits intensity-modulated blue laser light based on the B (blue) image signal 3214a. Similarly, the G laser 3212e and the R laser 3212f emit green laser light and red laser light, which are respectively intensity-modulated.

  Each of the lasers 3212d to 3212f includes a semiconductor laser and a solid-state laser with a harmonic generation function. When a semiconductor laser is used, the drive current is directly modulated to modulate the intensity of the laser beam. When using a solid state laser with a harmonic generation function, each of the lasers 3212d to 3212f is provided with an external modulator to modulate the intensity of the laser light. Note that the efficiency of harmonic generation is not high, and the loss of the external modulator is also added, so that the power consumption of the solid-state laser with the harmonic generation function is increased. Therefore, it is preferable to use a semiconductor laser for each of the lasers 3212d to 3212f. .

  The light combining unit 3213 includes collimating optical systems 3213a to 3213c, dichroic mirrors 3213d to 3213f, and a coupling optical system 3213g. The collimating optical systems 3213a to 3213c are arranged in front of the lasers 3212d to 3212f, respectively, and collimate the laser beams emitted from the lasers 3212d to 3212f. The dichroic mirrors 3213d to 3213f are disposed in front of the collimating optical systems 3213a to 3213c, respectively, and convert the laser beams collimated by the collimating optical systems 3213a to 3213c into only laser beams having a predetermined range of wavelengths. Selectively reflects or transmits.

  The coupling optical system 3213g is disposed in front of the dichroic mirror 3213d. Blue laser light transmitted through the dichroic mirror 3213d and green laser light and red laser light reflected by the dichroic mirrors 3213e and 3213f are incident on the coupling optical system 3213g. The coupling optical system 3213 g condenses (mixes) the laser beams of the three primary colors and enters the optical fiber 3127. Note that white can be expressed by equalizing the intensity of each of the blue laser light, the green laser light, and the red laser light.

  In order to irradiate the laser beam incident on the optical fiber 3127 as an image, the horizontal scanning unit 3123 and the vertical scanning unit 3124 scan the laser beam in the horizontal direction and the vertical direction to generate scanning image light.

  The horizontal scanning unit 3123 includes a resonant deflection element 3123a, a horizontal scanning control circuit 3123b, and a horizontal scanning angle detection circuit 3123c. The laser light incident on the optical fiber 3127 is collimated by the collimating optical system 3122 and is incident on the resonant deflection element 3123a. The resonant deflection element 3123a has a reflection surface 3123d that is swung by the horizontal scanning control circuit 3123b, and scans the incident laser light in the horizontal direction by being reflected by the swinging reflection surface 3123d. The horizontal scanning control circuit 3123b generates a driving signal for swinging the reflecting surface 3123d of the resonant deflection element 3123a based on the horizontal driving signal 3215 output from the signal processing circuit 3211. The horizontal scanning angle detection circuit 3123c detects a swing state such as a swing range and a swing frequency of the reflection surface 3123d of the resonant deflection element 3123a based on the displacement signal output from the resonant deflection element 3123a. A signal indicating the swing state is output to the HMD connection I / F controller 220.

  The vertical scanning unit 3124 includes a deflection element 3124a, a vertical scanning control circuit 3124b, and a vertical scanning angle detection circuit 3124c. The deflection element 3124a has a reflection surface 3124d that is oscillated by the vertical scanning control circuit 3124b. The incident laser beam is reflected by the oscillating reflection surface 3124d and scanned in the vertical direction to scan two-dimensionally. The emitted image light is emitted to the relay optical system 3126. Based on the vertical drive signal 3216 output from the signal processing circuit 3211, the vertical scanning control circuit 3124b generates a drive signal for swinging the reflection surface 3124d of the deflection element 3124a. Based on the displacement signal output from the deflection element 3124a, the vertical scanning angle detection circuit 3124c detects the oscillation state such as the oscillation range and oscillation frequency of the reflecting surface 3124d of the deflection element 3124a, and detects the oscillation state. The signal shown is output to the HMD connection I / F controller 220.

  The relay optical system 3125 is disposed between the resonant deflection element 3123a and the deflection element 3124a. The relay optical system 3125 causes the laser beam scanned in the horizontal direction by the reflection surface 3123d of the resonance type deflection element 3123a to enter the reflection surface 3124d of the deflection element 3124a.

  Based on the image signal input from the HMD connection I / F controller 220, the signal processing circuit 3211 outputs a horizontal drive signal 3215 and a vertical drive signal 3216 to the horizontal scan control circuit 3123b and the vertical scan control circuit 3124b, respectively. Image light is generated by changing the scanning angle of the reflecting surfaces 3123d and 3124d.

  The scanning angles of the reflecting surfaces 3123d and 3124d thus changed are detected as detection signals by the horizontal scanning angle detection circuit 3123c and the vertical scanning angle detection circuit 3124c, and the detection signals are input to the HMD connection I / F controller 220, Feedback is provided to the drive signal 3215 and the vertical drive signal 3216.

  The relay optical system 3126 includes lens systems 3126a and 3126b having a positive refractive power. The image light emitted from the deflecting element 3124a is converted into convergent image light by the lens system 3126a, with the respective image lights having their scanning image light center lines substantially parallel to each other. The converged image light is converted into substantially parallel scanned image light by the lens system 3126b, and the center line of these scanned image light is condensed so as to converge on the pupil Ea of the user.

  In the present embodiment, laser light incident from the optical fiber 3127 is scanned in the horizontal direction by the horizontal scanning unit 3123 and then scanned in the vertical direction by the vertical scanning unit 3124. The arrangement of the vertical scanning unit 3124 may be changed, and after the vertical scanning unit 3124 is scanned in the vertical direction, the horizontal scanning unit 3123 may scan in the horizontal direction.

(Main process)
The main process will be described with reference to FIG. The main process is performed by the CPU 202 of the control box 200 executing a program for this process stored in the program ROM 204 on the RAM 208. When executing this processing, the CPU 202 uses data such as content data stored in the flash ROM 206, an external image captured by the CCD sensor 260, and a content image received by the external device connection I / F controller 230.

  First, the user operates an operation unit (not shown) of the control box 200 to select content to be visually recognized by the HMD 10. When this user selection is made, the CPU 202 starts this process for content data corresponding to the selected content. The CPU 202 which has started this process controls the CCD sensor 260 and starts capturing an external image (S100). Here, in accordance with S100, the CPU 202 reads the selected content data from the flash ROM 206, stores it in the RAM 208, and executes a reproduction process on this content data. Then, the content image formed thereby is stored in the video RAM 210. When an image signal is input from the external device 400, the external device connection I / F controller 230 stores a content image based on the received image signal in the video RAM 210.

  In S102, the CPU 202 analyzes the content image stored in the video RAM 210 and the external image captured by the CCD sensor 260, and determines the similarity between the content image and the external image. When there are a plurality of content images, the CPU 202 executes the determination in S102 for each content image. For example, when the content data indicates a work instruction consisting of a plurality of pages, the similarity to the external image is determined for each content image corresponding to each page. Note that various known image processing methods can be used as similar determination methods. For example, a contour is extracted from a content image and an external image by edge detection. Then, the similarity between the content image and the external image is determined by comparing the extracted images inside the contours of the two by pattern matching. Further, similarity may be determined by comparing hue and saturation histograms, comparing spatial frequencies, and the like between the content image and the external image.

  As a result of the determination in S102, when a content image similar to the external image is not included (S102: dissimilar), the CPU 202 shifts the process to S104. On the other hand, when a content image similar to the external image is included (S102: similar), the CPU 202 shifts the processing to S106. In S <b> 104, the CPU 202 outputs an image signal including the content image stored in the video RAM 210 and a control signal for presenting the content image to the image presentation unit 114 via the HMD connection I / F controller 220. The presentation of the content image from the presentation unit 114 is executed. Thereby, the user visually recognizes the content image to which the display effect is not added.

  In S <b> 106, the CPU 202 adds a display effect to the content image stored in the video RAM 210. Here, when there are a plurality of content images, the process of S106 is executed for all of the plurality of content images. A configuration in which the process of S106 is executed for all the content images determined to be similar in S102 can also be adopted. The display effect addition process executed in S106 will be described later.

  In S108, the CPU 202 executes the same process as S104, outputs an image signal including the content image with effect 504A to which the display effect is added in S106 (see FIG. 6A), and the effect from the image presentation unit 114. Presentation of the attached content image 504A is executed. Thus, for example, the user visually recognizes the content image with effect 504A to which the frame 502 surrounding the first object 500 included in the content image is added. Specifically, when the HMD 10 is used as a tool for providing a work instruction for this work in an assembly work in which a predetermined cable is connected to a connector provided on the back of the server computer, As shown in FIG. 6A, a content image 504A with an effect to which a frame 502 surrounding the connector image as the first object 500 is added is visually recognized.

  In addition, the user visually recognizes the content image with effect 504A including the connector image as the first object 500 shown in FIG. 6A, while viewing the own field of view through the half mirror 116 with the left eye 118 (FIG. 6B). The connector image as the second object 510 included in the external image (the back of the server computer) is also visually recognized (see FIG. 6B). However, since the frame 502 is added to the connector image as the first object 500, the user can obtain the connector image as the first object 500 and the connector image as the second object 510 by the image presentation unit 114. Even if they are similar, they can be distinguished. In other words, the user can distinguish between the content image presented from the image presentation unit 114 (content image with effect 504A) and the external image.

  After executing S104 or S108, the CPU 202 determines whether the user operates the operation unit (not shown) of the control box 200 or the power switch 270 is turned off and an instruction to end this process is input ( S110). As a result of the determination, if an end command is not input (S110: No), the CPU 202 returns the process to S100 and repeats the above steps. On the other hand, when an end command is input (S110: Yes), the CPU 202 ends this process.

(Display effect addition processing)
The display effect addition process executed in S106 of the main process shown in FIG. 5 will be described with reference to FIG. The CPU 202 that has started this process extracts the second object 510 included in the external image captured by the CCD sensor 260 (S200). Further, the CPU 202 extracts the first object 500 included in the content image (S202). Note that the CPU 202 performs predetermined image analysis when extracting the second object 510 from the external image and extracting the first object 500 from the content image.

  After executing S200 and S202, the CPU 202 selects one of the first object 500 and the second object 510 extracted in both steps. Then, the CPU 202 compares the selected first object 500 and second object 510 (S204), and determines the similarity between them (S206). For example, the CPU 202 identifies the contour of the first object 500, identifies the contour of the second object 510, compares the identified contours, and determines similarity.

  As a result of the determination in S206, if the first object 500 and the second object 510 are similar (S206: Yes), the CPU 202 proceeds to S208, but if they are not similar (S206: No), S208 The process proceeds to S210 without executing. That is, the CPU 202 executes S208 only when the first object 500 and the second object 510 are similar.

  In step S <b> 208, the CPU 202 executes processing for adding a frame 502 surrounding the first object 500 similar to the second object 510 on the content image. Thereby, an effect-added content image 504A is formed. In S210, the CPU 202 determines whether all of the second object 510 extracted in S200 and the first object 500 extracted in S202 have been compared. For example, the CPU 202 sequentially selects the first objects 500 extracted in S202, and determines whether all of them are compared with the second objects 510 extracted in S200.

  If there is a first object 500 and a second object 510 that are not compared as a result of the determination in S210 (S210: No), the CPU 202 returns the process to S204, and the first object 500 and the second object that are not compared. 510 is selected, and the above steps S200 to S208 are repeated. On the other hand, when the uncompared first object 500 and second object 510 do not exist (S210: Yes), the CPU 202 ends this process and shifts the process to S108 of the main process shown in FIG.

(Modification)
The configuration of the present embodiment described above can also be as follows.

  (1) In the above description, the HMD body 100 and the control box 200 are separated from each other as an example. However, the HMD body 100 and the control box 200 may be integrated into an HMD. In this case, each component (see FIG. 3) of the control box 200 is accommodated in, for example, a housing (cover) that forms the image presentation unit 114.

  (2) In the above, when it is determined as “similar” in S <b> 102 of the main process shown in FIG. 5, the display effect addition process shown in FIG. 7 is executed in S <b> 106 and includes the first object 500 surrounded by the frame 502. The configuration for forming the content image with effect 504A (see FIG. 6A) has been described as an example. In addition to such a configuration, for example, when “similar” is determined in S102 of the main process illustrated in FIG. 5, the CPU 202 presents the content image as illustrated in FIG. A frame 520 that surrounds the range (maximum presentation range) (a frame 520 that matches the outer edge of the maximum presentation range) may be added to the content image, and then the process may proceed to S108 in FIG.

  In this case, in S108, the CPU 202 outputs an image signal including the content image with effect 504B, and executes the presentation of the content image with effect 504B from the image presentation unit 114. In order for the user to visually recognize the content image 504B with the effect shown in FIG. 8A, the content image presented from the image presentation unit 114 (the content image with effect 504B) and the server computer shown in FIG. It is possible to distinguish the external object image including the connector image as the second object 510 representing the connector provided on the back surface (distinguish the first object 500 from the second object 510). In addition, when the image size of the content image is smaller than the maximum presentation range, the outer edge of the content image may be surrounded by a frame.

  (3) In the above description, the configuration in which S102 is executed in the main processing shown in FIG. However, in addition to such a configuration, S102 may be omitted (also omitted for S104), and the process may directly shift to S106 to execute the display effect addition processing shown in FIG. In this case, the CPU 202 executes the display effect addition process shown in FIG. 7 regardless of whether or not the content image and the external image are similar. Then, the CPU 202 compares the first object 500 included in the content image with the second object 510 included in the external image, and determines that they are similar (S206: Yes), the second object 510 A process of adding a frame 502 surrounding the first object 500 determined to be similar is executed on the content image (S208), and the resulting content image 504B is presented (S108). Therefore, also by the configuration of the modification (3), the user can distinguish between the content image (content image with effect 504B) and the external image as described above. If there is no first object 500 that is determined to be similar (S206: No), the CPU 202 does not execute S208. Therefore, in S108, the content image is presented in the same manner as in S104 of FIG.

  (4) In the above, in the display effect addition process shown in FIG. 7, the second object 510 included in the external image is extracted (S200), and a frame 502 is added to the first object 510 similar to this (S206: Yes, S208) The configuration has been described as an example. However, in addition to such a configuration, for example, steps S200, S204, and S206 may be omitted, and a frame 502 may be added to all the first objects 500 extracted from the content image (S208). In this case, S210 is determined based on whether or not a frame 502 has been added to all the first objects 500.

  (5) In the above, the configuration in which the frame 502 is added to the first object 500 (see this embodiment, for example, FIG. 6A) and the range in which the image presentation unit 114 presents the content image (maximum presentation range) are enclosed. The configuration in which the frame 520 is added (see the modified example (2), FIG. 8A) has been described. However, in addition to such a configuration, it is also possible to change the color of the content image and add a display effect to the content image. Specifically, the first object 500 or the entire content image is set to a color different from the color of the external image visually recognized through the half mirror 116, for example, a reddish color (color). Also with the configuration of the modification (5), the user can distinguish between the content image and the external image.

  (6) In the above, the similarity between the content image and the external image is determined in the main processing shown in FIG. 5 (S102), and if it is determined as “similar” in the determination in S102, the display effect addition in FIG. In the process, the similarity between the first object 500 and the second object 510 is determined (S206). If the determination in S206 is affirmative (S206: Yes), a frame 502 surrounding the first object 500 is added as a display effect. (S208) The configuration has been described as an example. However, a configuration different from such a configuration may be used.

  Specifically, according to the type of content image visually recognized by the user on the HMD 10, a configuration in which the similarity between the content image and the external image can be determined can be adopted. For example, when the HMD 10 is used as a tool for providing a work instruction for a predetermined product in an assembly operation of a predetermined product, for example, the user can use a part (FIG. 6, “connector” corresponds to FIG. 8) and the like is visually recognized through the half mirror 116. In such a state, when a content image including a component used for assembly is presented to the user's left eye 118 without adding a display effect, the component included in the content image is mistaken for an actual component. The occurrence of a situation such as recognition is assumed. That is, when the type of the content image to be presented is determined and the type of such a situation is assumed, the content image and the external image are determined without performing the specific determination of the present embodiment. You may make it consider that it is similar.

  Further, when receiving an image signal including a content image from the external device 400 via the external device connection I / F controller 230, the external device 400 performs the specific determination itself of the present embodiment. A signal indicating the determination result may be received together with the image signal, and the similarity between the content image and the external image may be determined according to the signal indicating the determination result. For example, when the HMD 10 is used as a tool for providing work instructions as described above, the external device 400 is assumed to be a computer installed in a center that monitors assembly work. In the case of the configuration of the modification (6), the HMD 10 (the CPU 202 of the control box 200) does not make the specific determination of the present embodiment, so the CCD sensor 260 and S100 of the main process in FIG. Can be omitted.

(Advantageous effects of the configuration of the present embodiment)
According to the configuration of the present embodiment, in order to add a display effect to the content image, the content image and the external image can be distinguished (the first object 500 and the second object 510 are distinguished).

10 Head mounted display (HMD)
100 Head-mounted display body (HMD body)
114 Image presentation unit 116 Half mirror 200 Control box 202 CPU
204 Program ROM
206 Flash ROM
208 RAM
260 CCD sensor 502,520 frame

Claims (7)

A see-through head-mounted display that presents a content image indicated by content data so as to be visible to the user's eyes, and allows a user viewing the content image to visually recognize an external image superimposed on the content image,
Determining means for determining similarity between the content image and the external image;
Display effect adding means for executing image processing on the content data and adding a display effect to the content image when the determination means determines that the content image and the external image are similar;
A head-mounted display comprising: a content image presentation unit that presents the content image to which the display effect is added by the display effect addition unit to the eyes of the user. Comprising imaging means for imaging the external image,
The head mounted display according to claim 1, wherein the determination unit determines a similarity between the content image and the external image captured by the imaging unit.   3. The head mounted display according to claim 1, wherein the display effect adding unit adds, as the display effect, a frame surrounding a range in which the content image presenting unit presents the content image.   3. The head mounted display according to claim 1, wherein the display effect adding unit adds a frame surrounding the first object included in the content image to the first object as the display effect. 4. . The determining means compares the first object with a second object included in the external image, determines the similarity between the content image and the external image,
5. The head mount according to claim 4, wherein the display effect adding unit adds the frame as the display effect only to the first object determined to be similar to the second object by the determining unit. display.   The head mounted display according to claim 1, wherein the display effect adding unit adds the display effect to the content image by changing a color of the content image. The display effect adding unit, when the determining unit determines that the content image and the external image are not similar, does not execute the image processing on the content data, and displays the display on the content image. Without adding effects,
The content image presenting means presents the content image, to which the display effect is not added by the display effect adding means, to the eyes of the user. The head mounted display as described in.