JP2011209805A - Video display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To perform appropriate processing by detecting an object desired by an observer even when the images of a plurality of objects are imaged by an imaging part.SOLUTION: An image display device includes: a video display part 11 for displaying a video by overlapping it with an external image; an imaging part 17 having an angle of view including the video display area of the video display part and imaging the external image of the video display area; a detection part 34 for detecting an object Q from an imaged image imaged by the imaging part; an analysis part 35 for analyzing the content of the object detected by the detection part; a processing part 36 for performing processing in accordance with the content of the object analyzed by the analysis part; a distance calculation part 37 for calculating a distance from the center of the video display area to each object when a plurality of objects are detected in one imaged image by the detection part; and a control part 43 for determining the object whose distance calculated by the distance calculation part is the minimum as a target object, and for making the analysis part analyze the content of the object, and for performing processing corresponding to the analysis result.

Description

  The present invention relates to an image display apparatus that enables an outside world to be observed and causes an observer to visually recognize a displayed image by superimposing it on an image of the outside world.

  An image display device in which a display unit for displaying an image is fixed to an observer's head so that an external image can be observed together with the image is becoming widespread. For example, there is a goggle in which a lens and a camera are provided in a housing that can be mounted on the observer's head, and a transmissive film-like LCD is attached to the lens. In this goggles, the image displayed on the transmissive film-like LCD can be superimposed on the external image that can be observed through the lens. Therefore, when the observer sends an external image captured by the camera to the management room or the like, instructions and work contents suitable for the external image can be transmitted from the management room to goggles and displayed on the transmissive film-like LCD. An observer can be notified (for example, refer to Patent Document 1).

  In addition, information browsing is performed by capturing a two-dimensional code printed on a document with a camera, decoding the captured two-dimensional code, obtaining a URL, inputting information corresponding to the URL from the WWW, and displaying the information on the CRT. A system is known (for example, refer to Patent Document 2).

  By combining these techniques, when an observer images a two-dimensional code with a camera in the workplace and transmits the two-dimensional code data to the management room, the management room decodes the received two-dimensional code, and the two-dimensional code is received. Send information corresponding to. The transmitted information is displayed on the transmissive film-like LCD, and the observer can know instructions, work contents, etc. from the display.

Japanese Patent Laid-Open No. 2005-217921 Japanese Patent Laid-Open No. 11-203381

  However, when a plurality of two-dimensional codes (subjects) are close together, an unintended two-dimensional code in the surrounding area is captured when an image of the outside world is captured by a camera (imaging unit). In some cases, a plurality of two-dimensional codes exist in the captured image. In such a case, the video display device cannot determine which two-dimensional code is necessary, and there is a problem that information suitable for the observer cannot be provided.

  Therefore, the present invention has been made to solve the above problems, and even when a plurality of subjects are imaged by the imaging unit, the subject desired by the observer can be detected and appropriate processing can be performed. An object is to provide a video display device.

In order to solve the above problems, the present invention provides:
(1) an image display unit that displays an image superimposed on an external image,
An imaging unit having an angle of view including a video display area of the video display unit, and imaging an external image of the video display area;
A detection unit for detecting a subject from a captured image captured by the imaging unit;
An analysis unit for analyzing the content of the subject detected by the detection unit;
A processing unit that performs processing according to the content of the subject analyzed by the analysis unit;
A distance calculation unit that calculates a distance from the center of the video display area to each subject when the detection unit detects a plurality of subjects in one captured image;
A control unit that determines a subject having a minimum distance calculated by the distance calculation unit as a target subject, causes the analysis unit to analyze the content of the subject, and performs processing according to the analysis result;
It is characterized by providing.

The present invention also provides:
(2) In the video display device of (1) above,
A distance difference calculating unit that calculates a distance difference between a subject having the smallest distance calculated by the distance calculating unit and a subject having the second smallest distance;
A storage unit for storing a threshold value of the distance difference calculated by the distance difference calculation unit;
A determination unit that determines whether the distance difference calculated by the distance difference calculation unit exceeds a threshold stored in the storage unit;
A movement detection unit that detects that the imaging unit has moved;
When the determination unit determines that the distance difference does not exceed the threshold, an indicator indicating the subject with the smallest distance is displayed on the video display unit, and then the movement of the imaging unit is detected by the movement detection unit. And an indicator display control unit that moves the indicator to a subject existing in the moving direction ahead,
The controller is
When the determination unit determines that the distance difference exceeds the threshold, the subject with the smallest distance is determined as the target subject,
If the determination unit determines that the distance difference does not exceed the threshold value, the indicator indicating the subject is displayed by the indicator display control unit, and then the subject indicated by the indicator is not moved for a predetermined time. Is determined as a target subject.

The present invention also provides:
(3) In the video display device of (2) above,
The movement detecting unit detects a moving direction and a moving amount of the imaging unit from a change amount of the position of the same subject in two captured images having different imaging times.

The present invention also provides:
(4) In the video display device of (2) or (3) above,
The index display control unit moves the index in a direction in which the moving direction component of the imaging unit detected by the movement detection unit is maximized.

The present invention also provides:
(5) In the video display device according to any one of (2) to (4),
The index display control unit moves the index to a subject having a minimum linear distance from the current subject on which the index is displayed among subjects existing in the direction in which the index is moved.

The present invention also provides:
(6) In the video display device according to any one of (1) to (5) above,
The subject is a two-dimensional code.

According to the present invention, when the subject is imaged by the imaging unit, the detection unit detects the subject from the captured image captured by the imaging unit. The analysis unit analyzes the content of the subject detected by the detection unit, and the processing unit performs processing according to the content of the subject analyzed by the analysis unit.
Here, when the detection unit detects a plurality of subjects in one captured image, the distance calculation unit calculates the distance from the center of the video display area to each subject. Then, the control unit determines the subject having the smallest distance calculated by the distance calculation unit as a target subject, causes the analysis unit to analyze the content of the subject, and performs processing according to the analysis result.
In other words, since it is normal for the observer to observe the center of the external image that can be observed in the video display area, it is reasonable to consider that the observer is observing the subject closest to this center. . Therefore, by performing the above processing, the control unit can detect the subject desired by the observer and perform appropriate processing even when a plurality of subjects are imaged by the camera.

The external appearance perspective view which shows the structure of a video display apparatus. The block diagram which shows the structure of a video display apparatus. The block diagram which shows the structure of a control apparatus. 6 is a flowchart showing a flow from detection and analysis of a two-dimensional code to determination of a target two-dimensional code. The figure which shows the example which calculates the distance from the center of a captured image to each two-dimensional code. The figure which shows an example of the image | video of the liquid crystal display element which displayed the cursor. The figure explaining the movement of a cursor.

Hereinafter, embodiments of a video display device according to the present invention will be described with reference to the drawings.
<Configuration of video display device>
As shown in FIGS. 1 to 3, the video display device 100 includes a main body 1 and a back end 2 for a user (observer) to view a video.
The main body 1 is used over the ear like glasses, and when it is put on the ear, the display portion of the image is positioned in front of the user's eyes.
The back end 2 is formed in a box shape and used in a pocket of clothes.
The main body 1 and the back end 2 are connected by a cable 2a for exchanging signals between them.

(Main unit)
The main body 1 includes a frame 10, a liquid crystal display element 11, a light source 12, a condenser lens 13, an eyepiece optical system 14, a half mirror 15, a liquid crystal shutter 16, a camera 17, a microphone 18, and an earphone 19.
The frame 10 is formed in the same shape as the eyeglass frame, and is formed in a U shape in plan view. Both ends of the frame 10 are formed so as to face each other, and one end is locked from the left temple to the ear and the other end is locked from the right temple to the ear.

The liquid crystal display element 11 is provided inside the frame 10. The liquid crystal display element 11 is a modulation type video display element that displays a video based on a video signal transmitted from the back end 2 and modulates the illumination light applied thereto with the displayed video to generate light representing the video. is there. That is, the liquid crystal display element 11 functions as a video display unit. Here, a transmissive type that modulates while transmitting illumination light is adopted as the liquid crystal display element 11.
The light source 12 is provided inside the frame 10. The light source 12 is formed of a light emitting diode and emits illumination light to be given to the liquid crystal display element 11.
The condenser lens 13 is provided inside the frame 10. The condenser lens 13 guides the illumination light from the light source 12 to the liquid crystal display element 11 as a substantially parallel light beam.

The eyepiece optical system 14 is provided inside the frame 10. The eyepiece optical system 14 includes a lens, and guides light (hereinafter referred to as image light) L1 representing an image from the liquid crystal display element 11 to a user's (observer) eye E to display an image displayed by the liquid crystal display element 11. Provides an enlarged virtual image of That is, the eyepiece optical system 14 is positioned on the optical path of the light representing the image from the liquid crystal display element 11 to the half mirror 15, and functions as an enlarging optical system that enlarges the provided image.
The half mirror 15 is provided at a position facing one eye of the user (observer) when the frame 10 is attached. The half mirror 15 reflects and guides the image light L1 from the liquid crystal display element 11 that has passed through the eyepiece optical system 14 to the eye E, and transmits light from the outside (hereinafter referred to as outside light) L2 to the eye E. . The half mirror 15 functions as a combiner that superimposes the image light L1 and the external light L2 and guides it to the observer's eye E. The observer's eye E is provided with an image superimposed on the external image.

The liquid crystal shutter 16 transmits the external light L2 and guides it to the half mirror 15. The transmittance of the liquid crystal shutter 16 depends on the applied voltage and can be adjusted by changing the applied voltage. That is, the liquid crystal shutter 16 can attenuate external light reaching the half mirror 15 and functions as an external light attenuation unit whose degree is variable by the applied voltage. As the liquid crystal shutter 16, a combination of a polarizing plate and a TN liquid crystal or a ferroelectric liquid crystal, a guest host liquid crystal, or the like can be used.
The camera 17 is provided above the half mirror 15 in the frame 10. That is, the camera 17 is disposed so as to have an angle of view in the same direction as the user's field of view when the video display device 100 is mounted. The camera 17 has an angle of view including a video display area of the liquid crystal display element 11 in the half mirror 15, and uses a background portion of the video display area as a photometric area. That is, the camera 17 functions as an imaging unit that captures an external image.
The microphone 18 and the earphone 19 are provided on the surface of the frame 10 and can communicate between the manager of the video transmission source and the wearer of the main body 1. That is, the microphone 18 is provided at a position near the user's mouth when the main body 1 is worn, and the earphone 19 is provided at a position near the user's ear when the main body 1 is worn.

The liquid crystal display element 11 employs a transmission type, but a reflection type that modulates while reflecting illumination light can also be employed.
Further, although a lens is employed as the eyepiece optical system 14, the eyepiece optical system may be configured using an element having optical power other than the lens, such as a concave mirror, a diffraction grating, or the like.
In addition, the provided video can be monochrome or color. When a monochrome image is provided, a light emitting diode that emits monochromatic light may be used as the light source 12. When providing a color image, three types of light emitting diodes emitting red light, green light, and blue light are used as the light source 12, and red light, green light, and blue light are selected for each pixel of the liquid crystal display element 11. A color filter that transmits light may be provided.

(Back end)
The back end 2 includes a control device 3 and an operation unit 4.
The control device 3 includes a video luminance adjustment unit 31, an external image luminance adjustment unit 32, a linkage control unit 33, a detection unit 34, an analysis unit 35, a processing unit 36, a distance calculation unit 37, a distance difference calculation unit 38, a storage unit 39, The determination part 40, the movement detection part 41, the cursor control part 42, and the control part 43 are provided.
The video brightness adjusting unit 31 controls the light emission brightness of the light source 12. The luminance of the image provided to the eye E depends on the amount of the image light L1, and the amount of the image light depends on the amount of illumination light applied to the liquid crystal display element 11. Therefore, the image luminance adjusting unit 31 emits light from the light source 12. By controlling, the brightness of the image can be adjusted.
The external image brightness adjustment unit 32 controls the transmittance of the liquid crystal shutter 16 through the control of the voltage applied to the liquid crystal shutter 16. Since the brightness of the external image depends on the amount of the external light L2 that passes through the liquid crystal shutter 16, the external image brightness adjusting unit 32 can adjust the brightness of the external image by controlling the transmittance of the liquid crystal shutter 16. it can.
The interlock control unit 33 controls the video luminance adjustment unit 31 and the external image luminance adjustment unit 32 in conjunction with each other, thereby adjusting the luminance of the provided video and the external image.

The detection unit 34 detects the subject from the captured image captured by the camera 17. Here, the subject imaged by the camera 17 is, for example, a two-dimensional code. Of course, the subject is not limited to the two-dimensional code as long as it can be detected from the captured image.
The analysis unit 35 analyzes the content of the two-dimensional code detected by the detection unit 34. Specifically, information included in the detected two-dimensional code is analyzed, and what kind of information is included is analyzed.
The processing unit 36 performs processing according to the content of the two-dimensional code analyzed by the analysis unit 35. Here, as processing performed by the processing unit 36, information included in the two-dimensional code is displayed on the liquid crystal display element 11, such information and instructions are transmitted to the main body 1 as audio data, and an earphone 19 notifies the observer Perform the process.

The distance calculation unit 37 calculates the distances from the center of the video display area (the center of the captured image) to each two-dimensional code when the detection unit 34 detects a plurality of two-dimensional codes in one captured image. .
The distance difference calculation unit 38 calculates the distance difference between the two-dimensional code with the smallest distance calculated by the distance calculation unit 37 and the two-dimensional code with the second smallest distance.
The storage unit 39 stores a distance difference threshold calculated by the distance difference calculation unit 38.
The determination unit 40 determines whether the distance difference calculated by the distance difference calculation unit 38 exceeds the threshold stored in the storage unit 39.
The movement detection unit 41 detects that the camera 17 has moved. In other words, it is detected that the observer wearing the main body 1 has moved his head. The movement detection unit 41 detects the movement direction and movement amount of the camera 17 from the amount of change in the position coordinates of the same two-dimensional code in two captured images with different imaging times.

When the determination unit 40 determines that the distance difference does not exceed the threshold, the cursor control unit 42 displays an index indicating the two-dimensional code with the shortest distance (two-dimensional code closest to the center of the captured image) on the liquid crystal display. It is displayed on the element 11. Here, the index is a cursor C (see FIGS. 6 and 7) surrounding the two-dimensional code, and is displayed so as not to overlap the two-dimensional code.
When the movement detection unit 41 detects the movement of the camera 17, the cursor control unit 42 moves the cursor C to the two-dimensional code existing in the movement direction.
The cursor control unit 42 moves the cursor C in the direction in which the movement direction component of the camera 17 detected by the movement detection unit 41 is maximized.
The cursor control unit 42 moves the cursor C to the two-dimensional code that minimizes the linear distance from the current two-dimensional code on which the cursor C is displayed among the two-dimensional codes that exist in the direction in which the cursor C is moved. .
Therefore, the cursor control unit 42 functions as an index display control unit.

The control unit 43 determines the two-dimensional code with the smallest distance calculated by the distance calculation unit 37 as a target two-dimensional code desired by the observer, causes the analysis unit 35 to analyze the contents of the two-dimensional code, and performs analysis. Process according to the result.
When the determination unit 40 determines that the distance difference exceeds the threshold, the control unit 43 determines the two-dimensional code having the minimum distance as the target two-dimensional code desired by the observer, and the determination unit 40 If it is determined that the distance difference does not exceed the threshold value, the cursor C indicating the two-dimensional code is displayed by the cursor control unit 42. If the camera 17 does not move for a predetermined time, the two-dimensional The code is determined as a target two-dimensional code.

The operation unit 4 includes a dial-type or slide-type operation member operated by a user, and transmits an operation amount (rotation amount or movement amount) of the operation member to the interlock control unit 33. The interlock control unit 33 sets the luminance of the video to be provided according to the operation amount of the operation member. Therefore, the user can specify the brightness of the video via the operation unit 4.
The back end 2 is provided with a communication unit (not shown) for receiving a video related to a work instruction or the like from a manager of the video transmission source. The communication unit can receive an image from the administrator under the communication control by the control device 3 and can transmit an external image captured by the camera 17 to the administrator's terminal.
The back end 2 and the administrator's terminal are wirelessly connected by a communication unit. The communication method is free and can be appropriately changed according to the use environment.

<Adjusting image brightness>
In the video display device 100, a process for facilitating observation of the video is performed regardless of the brightness of the outside world.
The control unit 3 acquires luminance information of the external image from the camera 17. The photometric area at this time is the background portion of the video display area that can be viewed from the half mirror 15.
Next, based on the luminance information, the interlock control unit 33 controls the video luminance adjustment unit 31 and the external image luminance adjustment unit 32. The external image luminance adjustment unit 32 adjusts the liquid crystal shutter 16, and the video luminance adjustment unit 31 adjusts the light source 12.

Specifically, when the difference between the luminance of the provided video and the luminance of the external image is large, the user can operate the operation unit 4 to change the luminance of the video to reduce the luminance difference. This makes it easy to observe an image even when the external image is dark or bright, and also makes it difficult to cause eye fatigue.
However, when the external image is extremely bright, if the luminance of the image is increased accordingly, the image is easy to observe but the eyes are easily fatigued. In order to prevent this, the interlock control unit 33 sets an upper limit on the luminance of the video to be provided, and when the luminance exceeding the upper limit is designated by the operation of the operation unit 4, the luminance of the video is set to the upper limit. While maintaining this, the transmittance of the liquid crystal shutter 16 is lowered to lower the brightness of the external image. As a result, the luminance difference between the image and the external image is reduced, the image is easily observed, and eye fatigue is reduced.

<Detection and analysis of two-dimensional code>
When the main body 1 and the back end 2 are powered on, processing is performed according to the flow shown in FIG.
An external image in the video display area is captured by the camera 17, and a captured image is acquired (step S1).
Next, the detection unit 34 detects the two-dimensional code Q from the captured image and determines whether there are a plurality of two-dimensional codes Q1, Q2,..., Qn in the captured image (step S2).

In step S2, when the detection unit 34 determines that there are a plurality of two-dimensional codes Q1, Q2,..., Qn in the captured image (step S2: YES), the distance calculation unit 37 determines the center of the captured image. , Dn from the two-dimensional codes Q1, Q2,..., Qn are calculated (step S3). On the other hand, if the detection unit 34 determines that there is no two-dimensional code Q1, Q2,..., Qn in the captured image (step S2: NO), the detection unit 34 returns to step S1.
For example, as shown in FIG. 5, when there are four two-dimensional codes Q1, Q2, Q3, and Q4 in the captured image, the distance calculation unit 37 starts the respective two-dimensional codes Q1, Q2, and Q2 from the center O of the captured image. The distances d1, d2, d3 and d4 to Q3 and Q4 are calculated.

Next, the distance difference calculation unit 38 calculates a distance difference between the minimum distance dmin1 calculated in step S2 and the second smallest value dmin2 (step S4). In FIG. 5, the distance from the center of the captured image is the shortest to the distance d2 to the two-dimensional code Q2, and the second smallest distance is the distance d3 to the two-dimensional code Q3. Therefore, the distance difference calculation unit 38 calculates d3-d2.
Next, the determination unit 40 determines whether or not the distance difference dmin2−dmin1 calculated in step S4 is larger than the threshold value stored in the storage unit 39 (step S5).

In step S5, when the determination unit 40 determines that the calculated distance difference dmin2−dmin1 is larger than the threshold stored in the storage unit 39 (step S5: YES), in other words, from the center O of the captured image. When only the two-dimensional code Q having the smallest distance exists near the center of the captured image and the other two-dimensional code Q is far away from the center O of the captured image, the control unit 43 is dmin1 2 It is determined that the dimension code Qmin1 is a two-dimensional code targeted by the observer (step S6).
In FIG. 5, when the distance difference between d3 and d2 is larger than the threshold value, the control unit 43 determines that the two-dimensional code Q2 is a two-dimensional code targeted by the observer.

Next, the control unit 43 causes the analysis unit 35 to analyze the content of the determined two-dimensional code Q, and causes the processing unit 36 to perform processing according to the analysis result (step S10).
Here, the processing in step S10 includes, for example, transmission of an e-mail indicating completion of the work of the observer, display of a work manual or an image on the liquid crystal display element 11, and the like.
In step S5, when the determination unit 40 determines that the calculated distance difference dmin2−dmin1 is equal to or less than the threshold stored in the storage unit 39 (step S5: NO), in other words, it is closest to the center of the captured image. When the two-dimensional code and the second closest two-dimensional code are close together, the cursor control unit 42 causes the liquid crystal display element 11 to display the cursor C indicating the two-dimensional code Qmin1 whose distance is the minimum value dmin1 ( Step S7).
In FIG. 5, when the distance difference between d3 and d2 is equal to or smaller than the threshold, the cursor control unit 42 displays a cursor C indicating the two-dimensional code Q2, as shown in FIG.

Next, the control unit 43 determines whether or not the cursor C has moved within a predetermined time (step S8). The movement of the cursor C can be determined by whether or not the position coordinates of the cursor C have changed.
Here, the movement detection unit 41 detects that the cursor C has moved. The movement detection unit 41 detects the movement direction (up / down / left / right) and the movement amount of the camera 17 from the amount of change in the position of the same two-dimensional code Q in two captured images having different imaging times. In other words, by detecting the moving direction and moving amount of the camera 17, the direction in which the observer moves the head and the amount of movement thereof are detected.
In FIG. 6, a change in the position coordinates of the two-dimensional code Q2 is detected from two captured images having different imaging times.

In step S8, when the control unit 43 determines that the cursor C has moved within a predetermined time (step S8: YES), the control unit 43 repeats the determination in step S8 and determines again the detection of cursor movement.
Here, as shown in FIG. 7, when comparing two captured images having different imaging times, if the captured image in the upper diagram of FIG. 7 changes to the captured image in the lower diagram of FIG. Since the position coordinates have changed from (105, 121) to (77, 131), the movement detection unit 41 indicates that the position coordinates of the two-dimensional code Q2 have changed by −28 in the X direction and +10 in the Y direction. To detect. That is, since the two-dimensional code Q2 is moving toward the lower left, the observer has moved his head to the upper right.

In such a case, the cursor control unit 42 pays attention to the direction in which the movement direction component of the two-dimensional code Q2 detected by the movement detection unit 41 is maximum and the direction in which the head is moved, and the right side in FIG. Move the cursor C in the direction.
Here, when the two-dimensional code Q2 is out of frame from the captured image of the subsequent frame, the detection unit 34 detects the two-dimensional code again.

When the cursor C moves, the cursor control unit 42 moves the cursor C from the current two-dimensional code Q2 on which the cursor C is displayed among the two-dimensional codes Q3 and Q4 existing in the right direction in FIG. The cursor C is moved to the two-dimensional code Q3 that minimizes the straight line distance.
When there is no two-dimensional code in the moving direction of the camera 17 detected by the movement detecting unit 41, the cursor C is not moved and the current position is maintained.

In step S8, when the control unit 43 determines that the cursor C has not moved within the predetermined time (step S8: NO), the control unit 43 determines that the two-dimensional code Q currently surrounded by the cursor is the target. It is determined that the code is a two-dimensional code (step S9).
That is, as shown in FIG. 6, after the cursor C is displayed on the two-dimensional code Q2, if the movement detection unit 41 detects that the position of the two-dimensional code Q2 has not changed within a predetermined time, the control unit 43 determines that the two-dimensional code Q2 is the target two-dimensional code. On the other hand, after the movement of the two-dimensional code Q2 is detected by the movement detection unit 41 and the cursor C moves to the two-dimensional code Q3, the movement detection unit 41 does not change the position of the two-dimensional code Q3 within a predetermined time. Is detected, the control unit 43 determines that the two-dimensional code Q3 is the target two-dimensional code.
Next, the control unit 43 causes the analysis unit 35 to analyze the content of the determined two-dimensional code Q, and causes the processing unit 36 to perform processing according to the analysis result (step S10).
Note that the above flowchart is a processing flow when there are a plurality of two-dimensional codes in the captured image. If there is only one two-dimensional code in the captured image, the two-dimensional code is This is a two-dimensional code targeted by the observer, and processing corresponding to the two-dimensional code is executed.

<Action and effect>
As described above, according to the video display device 100, when the two-dimensional code Q is captured by the camera 17, the detection unit 34 detects the two-dimensional code Q from the captured image captured by the camera 17. The analysis unit 35 analyzes the content of the two-dimensional code Q detected by the detection unit 34, and the processing unit 36 performs processing according to the content of the two-dimensional code Q analyzed by the analysis unit 35.
Here, when the detection unit 34 detects a plurality of two-dimensional codes Q in one captured image, the distance calculation unit 37 calculates the distances from the center of the video display area to the respective two-dimensional codes Q, and the distances are calculated. The difference calculation unit 38 calculates a distance difference between the two-dimensional code Q having the smallest distance and the two-dimensional code Q having the second smallest distance.
When the distance difference exceeds the threshold, the two-dimensional code Q having the shortest distance is determined as the target two-dimensional code Q, and the processing unit 36 performs processing under the control of the control unit 43. .
On the other hand, when the calculated distance difference does not exceed the threshold, the cursor C is displayed on the two-dimensional code Q having the smallest distance, and the observer is given an opportunity to reselect the two-dimensional code Q. When the movement of the camera 17 is detected, the cursor C is moved from the current two-dimensional code Q to the nearest two-dimensional code Q in the moving direction of the camera 17.

  As described above, since the observer usually observes the center of the external image that can be observed in the video display area, the observer observes the two-dimensional code Q that is closest to the center of the captured image. It is reasonable to think. Therefore, when the control device 3 performs the above processing, even when a plurality of two-dimensional codes Q are captured by the camera 17, the two-dimensional codes Q desired by the observer are detected and appropriate processing is performed. be able to.

In addition, since the movement of the camera 17 can be detected by calculation from the same two-dimensional code Q in the two captured images captured by the camera 17, it is necessary to provide a separate device for detecting the movement in the main body 1. No, the number of parts can be reduced and the weight can be reduced.
Further, since the cursor control unit 42 moves the cursor C in the direction in which the movement direction component of the camera 17 is maximized, it is possible to easily reflect the intention of the observer.
Further, when the cursor C is moved, the cursor C can be moved from the current two-dimensional code Q to the closest two-dimensional code Q, so that the intention of the observer can be easily reflected.

Note that the present invention is not limited to the above-described embodiment, and design changes can be freely made without changing the essential part of the invention.
Moreover, in the said embodiment, although a liquid crystal display element, a light source, a condensing lens, and an eyepiece optical system are incorporated in the main body, you may provide these in a back end.
In addition, a detection unit, an analysis unit, a processing unit, a distance calculation unit, a distance difference calculation unit, a determination unit, a movement detection unit, a cursor control unit, and a control unit are provided in the back-end control device. Although being performed at the end, some or all of the control may be performed in a management room wirelessly connected to the back end.
In addition, although the movement detection unit detects the moving direction and the moving amount of the camera using two captured images, the two captured images may be adjacent frames or spaced several frames apart. The frames that were present may be used.
In addition, although the detection of the moving direction and the moving amount of the camera by the movement detection unit is performed using two captured images, an acceleration sensor may be provided in the main body, and the detection result by the acceleration sensor may be obtained.
Further, when the movement detection unit 41 detects the movement of the cursor C, the movement of the cursor C itself may be directly detected, or the movement of the cursor C may be indirectly detected by the change in the image data in the cursor C. You may make it detect to.
Further, although the cursor control unit moves the cursor in the direction in which the moving direction component of the camera is maximized, the cursor may be moved in the moving direction of the camera.
Further, when moving the cursor, the cursor is moved to the two-dimensional code having the shortest linear distance from the current two-dimensional code, but the method of determining the destination two-dimensional code can also be changed.

11 Liquid crystal display device (video display unit)
17 Camera (imaging part)
34 detection unit 35 analysis unit 36 processing unit 37 distance calculation unit 38 distance difference calculation unit 39 storage unit 40 determination unit 41 movement detection unit 42 cursor control unit (index display control unit)
43 Control Unit 100 Video Display Device C Cursor (Indicator)
Q 2D code (subject)

Claims (6)

An image display unit that displays an image superimposed on an external image,
An imaging unit having an angle of view including a video display area of the video display unit, and imaging an external image of the video display area;
A detection unit for detecting a subject from a captured image captured by the imaging unit;
An analysis unit for analyzing the content of the subject detected by the detection unit;
A processing unit that performs processing according to the content of the subject analyzed by the analysis unit;
A distance calculation unit that calculates a distance from the center of the video display area to each subject when the detection unit detects a plurality of subjects in one captured image;
A control unit that determines a subject having a minimum distance calculated by the distance calculation unit as a target subject, causes the analysis unit to analyze the content of the subject, and performs processing according to the analysis result;
A video display device comprising: A distance difference calculating unit that calculates a distance difference between a subject having the smallest distance calculated by the distance calculating unit and a subject having the second smallest distance;
A storage unit for storing a threshold value of the distance difference calculated by the distance difference calculation unit;
A determination unit that determines whether the distance difference calculated by the distance difference calculation unit exceeds a threshold stored in the storage unit;
A movement detection unit that detects that the imaging unit has moved;
When the determination unit determines that the distance difference does not exceed the threshold, an indicator indicating the subject with the smallest distance is displayed on the video display unit, and then the movement of the imaging unit is detected by the movement detection unit. And an indicator display control unit that moves the indicator to a subject existing in the moving direction ahead,
The controller is
When the determination unit determines that the distance difference exceeds the threshold, the subject with the smallest distance is determined as the target subject,
If the determination unit determines that the distance difference does not exceed the threshold value, the indicator indicating the subject is displayed by the indicator display control unit, and then the subject indicated by the indicator is not moved for a predetermined time. The video display apparatus according to claim 1, wherein the target subject is determined.   The video display according to claim 2, wherein the movement detection unit detects a movement direction and a movement amount of the imaging unit from a change amount of the position of the same subject in two captured images having different imaging times. apparatus.   4. The video display device according to claim 2, wherein the index display control unit moves the index in a direction in which a movement direction component of the imaging unit detected by the movement detection unit is maximized. 5.   The index display control unit moves the index to a subject having a minimum linear distance from a current subject on which the index is displayed, among subjects existing in a direction in which the index is moved. The video display apparatus as described in any one of -4.   The video display device according to claim 1, wherein the subject is a two-dimensional code.

Images