JPH0916312A - Input device for stereoscopic image display device - Google Patents

Abstract

PURPOSE: To provide an input device for stereoscopic image display device with which an interactive switch operation can be performed while watching a stereoscopic image without touching the display screen of a stereoscopic medium such as a stereoscopic video display device. CONSTITUTION: Plural pieces of photodetection sensors, to which light emitting elements composed of infrared light emitting diodes for irradiating a frame- shaped frame 10 with unvisible beams and light receiving elements composed of infrared phototransistors for receiving those beams are fitted while facing each other, are longitudinally and laterally arranged between a stereoscopic image display device 2 and an operator O and the frame 10 is fitted to confront its opening with a seat 7, where the operator O sits down, so that the range of that detection can be grid-shaped. When the operator 0 extends his hand for operating, it can be detected by a spatial area sensor 2 so that the interactive switch operation can be performed while watching the stereoscopic image without touching the display screen.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION This invention is applicable to exhibitions, advertisements,
The present invention relates to an input device for an interactive stereoscopic image display device that can be used in many fields such as education and entertainment.

[0002]

2. Description of the Related Art With the development of computers, an attempt to use new media that mixes conventional media such as print and voice with computer graphics and video in many fields such as display, advertisement, education, entertainment, and commerce. Has been done.

One attempt to use these new media is an interactive one that processes interactively with the media.

By the way, the interactive means by interacting with each other, for example, a cash dispenser of a bank.

In this cash dispenser, in accordance with the instruction displayed on the television screen of the terminal connected to the host computer, an icon that matches the conditions is selected from among a plurality of icons also displayed on the television screen, It is possible to withdraw a desired amount of money by advancing processing interactively between the two. At that time, by attaching a transparent touch panel to the TV screen and touching the screen directly, anyone can definitely select the icon to improve operability,
It is designed to facilitate interactive activities.

By the way, in recent years, projectors and color televisions capable of displaying stereoscopic images without using special glasses (glasses with colored red and blue or polarized glasses) have been put into practical use. Also, with the spread of computers, 3D images using red and blue colored glasses can be easily produced, and the produced images can be displayed on a TV screen, making stereoscopic images familiar. It is becoming.

[0007] Therefore, paying attention to the various expressiveness of being a stereoscopic image and the magnitude of the effect at the time of display (for example, the image can be reproduced more realistically because of the stereoscopic effect), and the display and advertisement The interactive use of stereoscopic images as described above is considered in the fields of education, entertainment, and commerce.

However, the stereoscopic image display device described above, for example, two liquid crystal projectors P for the right eye and the left eye shown in FIG. 13 and the corrugated double lenticular screen S are used without using special glasses. In a projector or a color television capable of displaying images, a so-called stereoscopic television, two liquid crystal projectors P project images for the right eye and the left eye on the double lenticular screen S, and the projected images are displayed. Separation is performed by a polarizing lens of the lenticular screen S so that the image of the right-eye projector P enters the right eye and the image of the left-eye projector P enters the left eye, and a stereoscopic image is reproduced by causing parallax due to the displacement of the left and right images. for that reason,
As shown in FIG. 13, a stereoscopic image can be viewed only at a position where the right-eye image and the left-eye image separated by the double lenticular screen S just enter the right eye and the left eye of the viewer (40-inch type requires at least about 1 m). There is a problem that you cannot do it.

Therefore, for example, even if a transparent touch panel is provided on the screen S and icons are displayed on the screen, there is a distance between the screen S and the operator O, so that a stereoscopic image of the screen S is displayed. There is a problem that the transparent touch panel on the screen S cannot be operated while looking.

Therefore, an object of the present invention is to enable operation while viewing a stereoscopic image on a stereoscopic medium.

[0011]

In order to solve the above problems, in the first invention, a light emitting element for irradiating an invisible ray between a stereoscopic image display device and an operator and a light emission output of the light emitting element. A plurality of light detection sensors each including a light receiving element for receiving light are provided, and a spatial area sensor is provided in which the detection range is arranged in a grid pattern for the operator, and each light detection sensor of the area sensor is a stereoscopic image display device. That is, the configuration is adopted in which the detection is performed in synchronization with the image display of, and the operation of the operator corresponding to the image display is detected.

Further, at this time, in the second invention, it is possible to adopt a configuration in which a video camera is arranged in place of the light emitting element and the light receiving element of the spatial area sensor.

Further, in the third invention, it is possible to adopt a configuration in which a plurality of the above-mentioned spatial area sensors are provided between the stereoscopic image display device and the operator.

[0014]

According to the first aspect of the invention configured as described above, the operation of the operator is detected by the spatial area sensor arranged between the stereoscopic image display device and the operator, and the operator constantly watches the stereoscopic image. Allow operation.

That is, the spatial area sensor is arranged at a position between the operator and the stereoscopic image display device where the operator can see a stereoscopic image by the stereoscopic image display device, for example.

Further, in the space area sensor thus arranged at the position where the stereoscopic image between the stereoscopic image display device and the operator is displayed, for example, the light emitting element and the light receiving element are opposed to each other, and the light emitting element and the light receiving element are connected to each other. A transmissive type or a light-receiving element and a light-receiving element that detect that the passing detection target blocks the output light of the light-emitting element are provided in parallel, and the light-emitting element and the light-receiving element provided in parallel are opposed to each other and a reflective element such as a mirror Are arranged so that the output light of the light emitting element is reflected by the mirror and the reflected light is received by the light receiving element, and the object to be detected that passes between the mirror and the light emitting element, the light receiving element receives the light by the light receiving element. It can be formed by a light detection sensor of a reflection type or the like that detects passage of an object by blocking light.

That is, by providing a plurality of such transmissive or reflective photodetection sensors and arranging their detection ranges in a grid pattern with respect to the operator, a pair of light emitting elements and The light receiving element divides the display area of the stereoscopic image display device into a grid pattern for detection. Therefore, for example, when a stereoscopic image display device displays an icon by a stereoscopic image and the operator extends his hand to touch the displayed icon, the hand out of a plurality of light detection sensors Since the incident output light that is incident on the light receiving element of the light detection sensor in the inserted area is blocked, which area of the grid-shaped detection area the operator extended his hand from the coordinates covered by the blocked light detection sensor Can be detected.

At this time, each light detection sensor of the spatial area sensor detects in synchronization with the display image of the stereoscopic image display device. That is, for example, only the light detection sensors in the area corresponding to the image displaying the icon of the spatial area sensor are activated, and the rest are inactivated. And
When the activated light detection sensor detects that the operator's hand is extended, the detected sensor is active only when the icon is displayed, so the operator can see the image displayed on the screen. Correspondingly, it is possible to detect that an operation of touching the area where the detection area icon is displayed is performed.

Similarly, when a plurality of icons are displayed on the image, only the optical detection sensors of the spatial area sensors corresponding to the displayed images are activated and the rest are inactive, and the activated optical detection sensors are sequentially detected. By doing so, since the light detection sensor is active only when the icon corresponding to the detection area is displayed, the icon pointed by the operator can be discriminated from the plurality of icons.

At this time, the light emitting element is controlled to invisible light rays, for example,
By using infrared rays, the output light of the light emitting element can be made invisible to the operator, so that the output light can be prevented from affecting the stereoscopic image displayed by the stereoscopic image display device.

In the second invention, as in the first invention, the video camera using the space area sensor photographs the display area of the stereoscopic image display device, and the photographed video is subjected to, for example, feature extraction by image processing. If the movement of the operator's hand is detected, the movement of the operator can be detected. At that time, for example, by dividing the detection area and synchronizing it with the image displayed by the stereoscopic image display device, for example, only the detection area corresponding to the image displaying the icon is activated, and the rest are inactive and only the detection area is activated. By detecting, it is possible to detect whether or not the operator touches the displayed icon.

In the third invention, a plurality of the above-mentioned spatial area sensors are provided between the stereoscopic image display device and the operator, so that the detection areas of the plurality of the preceding area sensors are provided, for example, in an overlapping manner. For example, since the position of the hand protruding by the operator can be detected three-dimensionally by the overlapping sensors, the movement of the operator in response to a stereoscopic image with depth such as when icons with different heights are displayed is detected. be able to.

[0023]

Embodiments of the present invention will be described below with reference to the drawings.

FIG. 1 shows a simulator using the input device for a stereoscopic image display device according to the first and third inventions.

As shown in FIG. 2, this simulator includes a stereoscopic image display device 1 using a double lenticular screen S, a spatial area sensor 2, a stereophonic sound system 3 including a bodysonic and a speaker group, a downlight and a dimming unit. A lighting system 4 consisting of
It is composed of an LD player 5 and a system controller 6 that controls them.

As described in the conventional example, the stereoscopic image display device 1 is composed of a corrugated double lenticular screen S and two liquid crystal projectors P for the right and left eyes as shown in FIG. The liquid crystal projector P is connected to the LD player 5 connected to the system controller 6.

The images projected from the two liquid crystal projectors P on the double lenticular screen S are separated by the polarizing lens of the lenticular screen S, the image of the right eye projector enters the right eye and the image of the left eye projector enters the left eye, A stereoscopic image is reproduced by causing parallax due to the displacement of the left and right images.

At this time, for the projection of this stereoscopic image, dedicated software photographed by a stereo camera consisting of a right-eye camera and a left-eye camera, or right-eye and left-eye images are produced by CG (computer graphics). Software is required. At this time, as shown in the first embodiment, when the image software for the right eye and the image software for the left eye are supplied by different LDs, two LD players 5 are required, but for the right eye, When the image and the image for the left eye are combined in one LD, an LR converter is provided between the stereoscopic image display device 1 and the LD player 5, as shown by a chain line in FIG. A three-dimensional image may be reproduced.

Further, as shown in FIG. 1, the space between the stereoscopic image display device 1 and the seat 7 on which the operator O sits, that is, in the position space where the operator O displays the stereoscopic image by the stereoscopic image display device 1. Is provided with a spatial area sensor 2.

In the case of the embodiment, the spatial area sensor 2 includes, as shown in FIG. 1, a light emitting element 11 composed of an infrared light emitting diode for irradiating an invisible ray and a frame type frame 10 as shown in FIG. A light-receiving element 1 and a light-receiving element 1 that face each other and are attached to a light-receiving element 12 formed of an infrared phototransistor that receives light.
A plurality of detection areas by the light detection sensor 13 for detecting that light is shielded by an object to be detected that passes between the two are arranged in the vertical direction and the horizontal direction, and the detection areas are formed in a grid shape, and thus, in a grid shape. Frame 10 with light detection area
Is installed so as to face the seat 7 on which the operator O sits.

Therefore, when an object to be detected such as the hand of the operator O enters the frame 10 of the area sensor 2, the light detection sensors provided in the vertical and horizontal directions of the frame 10 into which the hand or the like is inserted. 13 is turned off at the same time, and the light detection sensor 13 turned off, for example, the frame 10
An area with a hand can be specified from the coordinates above.

At this time, if a large number of photodetection sensors 13 are arranged so that the photodetection sensors 13 in the predetermined number of photodetection areas in the vertical direction and photodetection areas 13 in the horizontal direction are turned off at the same time, the width of the detection area is increased. Can be set freely.
Further, at this time, if the infrared detection frequency bands of the infrared rays used by the adjacent photodetection sensors 13 are different from each other, it is possible to prevent the mutual interference so that the area can be surely recognized.

In the embodiment, as shown in FIG. 1, a three-layer area sensor 2 is provided to give the detection range a depth, for example, the position of the operator O's protruding hand and the operator's hand. You can detect the timing,
Display of a plurality of stereoscopic images displayed by the stereoscopic image display device 1, for example, when a stereoscopic image with a depth is displayed, such as a case where a plurality of icons are displayed in front and back so that the heights of the stereoscopic images are different, It is possible to detect the motion of the operator O in response to.

Here, a method of setting the detection area of the area sensor 2 in the case of the embodiment will be described by describing a case of setting as shown in FIG. 7, for example.

That is, the setting of the detection area A can be determined by the following procedure.

For example, when the screen size is a 40-inch projector, the effective size of the screen is W: 800 × H: 610 mm as shown in FIG.
If the mm width is cut, W: 600 × H: 410 mm, and the sensor area of the spatial area sensor 2 is set in this area A.

Next, assuming that the distance at which a 3D image can be seen is 1 m from the screen, and the 3D image projection range is about 700 mm, the length of the arm extended by the operator O for operation is determined. Assuming about 600 mm, the effective depth range of the operator O's arm and the protrusion due to the 3D effect is a 3D image up to 300 mm on the operator O side, and the length when the arm is extended is 600 mm. , 600 mm-300 mm = 300 mm.

At this time, the maximum width of the hand is 150 mm, and three detection areas A ₁ , A ₂ , A ₃ are arranged in the lateral direction.
Is set to 150 mm × 3 = 450 mm, and the width of the separation band provided between the areas A is (600 mm-450 mm) /4=37.5 mm as shown in FIG.

Further, the length of one detection area with respect to the upper and lower sides is 170 mm, and the detection areas A ′ ₁ , A ″ ₂ ,
The overlapping range of A ''_'3 as shown in FIG. 6 as 50 mm, in triplicate to the upper and lower, and set the detection area A ₁ · · · A ₃ A total of nine.

Further, as shown in FIG. 7, the space between the three spatial area sensors 2 is equal to the frame 1 of the area sensor 2.
If the thickness of 0 is 50 mm, the length when the hand is extended is 3
Since it is 00 mm, in the case of the embodiment, FIGS.
It was set to 125 mm as shown in.

Incidentally, FIG. 8 shows the dimensions of each positional relationship when the position of the line of sight of the operator O seated on the seat 7 is 1180 mm.

The detection area A by the respective light detection sensors 13 of the respective space area sensors 2 in which the detection area A is set as described above is connected to the system controller 6,
The stereoscopic video display device 1 is adapted to perform video display and synchronous control.

For synchronous control, as shown in FIG. 3, the system controller 6 is provided with a select circuit 8 for selecting the light detection sensor 13 of the spatial area sensor 2 to activate the light detection area. , A frame number of the laser disc reproduced by the LD player 5, that is, the photodetection sensor 13 covering the area A of the space area sensor 2 in which an icon is displayed for each stereoscopic image reproduced by each frame of the laser disc is selected. The circuit 8 is pre-programmed for selection. Then, by loading the synchronization program at the time of reproduction, the light detection area of the space area sensor 2 is activated in synchronization with the reproduced image. Therefore, only when the operator O touches the area where the icon is displayed,
The action can be detected as valid.

At this time, even when a plurality of icons are displayed in the reproduced video, if the light detection areas are sequentially switched in synchronization with the video, only the area where the icons are displayed is displayed. Can be made effective, so that the area A in which a plurality of icons are displayed can be discriminated.

The body sonic is provided in the seat 7 so that the acoustic effect can be experienced. Also,
The output of the audio ROM of the plurality of speakers is mixed. The downlight can be adjusted in illuminance by a dimming unit, and these are all connected to the system controller 6.

As shown in FIG. 3, the system controller 6 is composed of a CPU 14 and a microcomputer having an interface for driving each device, and can individually control each device according to a pre-installed program. It is like this.

This embodiment is constructed as described above. Next, the case where this apparatus is used as an interactive simulator in a fortune-telling simulator will be described.

That is, in this fortune-telling simulator,
The selected element of the stereoscopic image is output to the space, and the detection area A of the spatial area sensor 2 is synchronized with the image output position of the stereoscopic image,
This is a form in which the process of fortune-telling proceeds according to the selection of the operator O.

Now, in this simulator, for example, a sensor is provided outside the entrance, the system controller 6 outputs the synthesizer sound by the voice ROM upon detecting the entrance of the operator O, and at the same time controls the light control unit 4 to illuminate the inside. Fade out to create an atmosphere that makes you feel like outer space, give voice guidance to the operator O, and make him sit on the seat 7 where Body Sonic is set. For example, by providing a pressure switch connected to the system controller 6 on the seat 7, it becomes possible to inform the system controller 6 that the operator O has arrived at the seat 7 by operating the pressure switch. When the system controller 6 detects that the operator O has arrived at the seat 7, the system controller 6 operates the LD player 5 and causes the stereoscopic image display device 1 to reproduce a stereoscopic image.

At this time, for example, a fortune teller appears in the stereoscopic image, presents an icon imitating a tarot card based on the stereoscopic image to the operator O, and gives an instruction to shuffle the tarot card in mind that he wants the fortune telling. At this time, the system controller 6 outputs the frame of this image and at the same time activates the synchronization program to activate the light detection sensor 13 in the detection area A of the space area sensor 2 to which the tarot card is inserted. Therefore, when the operator O reaches for the card while hoping to fortune, the extended hand is detected by the space area sensor 2 as shown in FIG. 9, and the detection signal is input to the system controller 6, In response to the detection signal, the system controller 6 calls the next image from the LD player 5. In this case, the fortune teller requests that the card be shuffled and that the player choose to stop the shuffle by touching the card. Therefore, when the operator O reaches out again, the spatial area sensor 2 detects the operation in the same manner as before, and the system controller 6 sends the shuffled card to the front and back of the operator O as the next image. And output the video piled up in two mountains. Then, instruct them to touch which card they should choose.

According to the instruction, when the operator O reaches for the pile of one of the cards, the three-layer space area in which synchronous control is performed depending on which card is placed on the front, back, left or right The next image, which is detected by the sensor 2 and is on the card with the hand over, is displayed. In this manner, the movement of the hand of the operator O in response to the question of the system controller 6 is detected by the spatial area sensor 2, a stereoscopic image is output corresponding to the movement, and fortune-telling is developed interactively.

At this time, in order to effectively direct the fortune-telling,
Synchronize the audio for the Hodisonic and the stereophonic speakers on the seat 7. Also, if you put a printer on the ceiling and print the result of the fortune telling according to the image thrown from the fortune teller's hand from that printer and drop it,
It is effective.

In the first embodiment, the light detecting sensor 13
As an example, the transmission type light detection sensor 13 in which the light emitting element 11 and the light receiving element 12 are opposed to each other is used. However, as shown in FIG.
A light emitting element 11 that outputs an invisible light beam to a detected body and a light receiving element 12 that receives reflected light of the emitted light that is output to the detected object of the light emitting element 11 are arranged in parallel, and the light emitting element 11 that is arranged in parallel Reflecting element 12 'facing the light receiving element 12
It is also possible to use the light detection sensor 13 in which (for example, a mirror) is arranged.

11 and 12 show a spatial area sensor 2 according to the second and third inventions using a video camera 14 instead of the light emitting element 11 and the light receiving element 12 as a second embodiment.

In this case, the detection area A is divided by the video camera 14 into a matrix as shown in FIG. 11, and each area A divided into the matrix is swept and photographed as in the first embodiment. It is to detect whether or not the operator O has performed an operation by performing image processing, such as feature extraction, on the video.

At this time, as shown in FIG. 12, if two video cameras 15 are provided at intervals and the images are taken by the two cameras 15, the detection range A is obtained from the parallax of the two video cameras 15. Can be three-dimensionally detected.

The other functions and effects are the same as those of the first embodiment, and the description thereof will be omitted.

[0058]

According to the first aspect of the invention, a plurality of light detection sensors each having a light emitting element for irradiating an invisible ray and a light receiving element for receiving the invisible ray are provided between the stereoscopic image display device and the operator. By providing a spatial area sensor arranged so that its detection range is in a grid pattern for the operator, and detecting each light receiving element of the area sensor in synchronization with the video display of the stereoscopic image display device, the stereoscopic media is detected. In, the interactive switch operation can be performed while watching the stereoscopic image without touching the display screen.

Therefore, display, advertisement, education,
In the entertainment and commercial fields, it is possible to interactively use stereoscopic images having various expressions.

In the second invention, a video camera is used instead of the light emitting element and the light receiving element of the spatial area sensor, so that the display screen is not touched on the three-dimensional media, as in the first invention. You can perform interactive switch operations while viewing 3D images.

Therefore, display, advertisement, education,
It is possible to interactively use stereoscopic images having various expressions in entertainment and commercial fields.

Further, according to the present invention, when performing such detection, for example, between the stereoscopic image display device and the operator,
Since it is not necessary to provide a frame-shaped frame and the installation is easy, the installation cost can be low.

According to the third aspect of the invention, since the plurality of spatial area sensors are provided between the stereoscopic image display device and the operator, the position of the hand projected by the operator can be detected three-dimensionally. By providing the detection range with depth, for example, the position of the hand of the operator O protruding and the timing at which the operator releases the hand can be detected. Therefore, it is possible to detect the operation of the operator O in response to a stereoscopic image displayed by the stereoscopic image display device 1, for example, a stereoscopic image with depth such as when icons are displayed with different heights in the front and rear.

[Brief description of the drawings]

FIG. 1 is a perspective view of a first embodiment.

FIG. 2 is a block diagram of a first embodiment.

[Fig. 3] Block diagram of system controller

FIG. 4 is a schematic diagram showing a spatial area sensor.

FIG. 5 is a diagram illustrating a method of setting a detection area of the spatial area sensor according to the first embodiment.

FIG. 6 is a diagram illustrating a method of setting a detection area of the spatial area sensor according to the first embodiment.

FIG. 7 is a diagram illustrating a method of setting a detection area of the spatial area sensor according to the first embodiment.

FIG. 8 is a diagram showing a spatial area sensor of the first embodiment.

FIG. 9 is an operation explanatory view for explaining the first embodiment.

FIG. 10 is a schematic diagram showing another aspect of the first embodiment.

FIG. 11 is a schematic diagram of a second embodiment.

FIG. 12 is a schematic diagram showing another aspect of the second embodiment.

FIG. 13 is an operation explanatory view showing the principle of the stereoscopic image display device.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 3D image display device 2 Spatial area sensor 10 Frame 11 Light emitting element 12 Light receiving element 12 'Reflecting element 13 Photodetection sensor 15 Video camera

Continuation of the front page (51) Int.Cl. ⁶ Identification number Office reference number FI Technical display location G06T 7/00 H04N 13/04 G09F 9/00 361 G06F 15/62 350K H04N 13/04 415

Claims (3)

[Claims] 1. A plurality of light detection sensors, each of which includes a light emitting element that outputs an invisible ray and a light receiving element that receives a light emission output of the light emitting element, between the stereoscopic image display device and an operator.
A spatial area sensor arranged so that the detection range is in a grid pattern for the operator is provided, and each light detection sensor of the area sensor is detected in synchronization with the image display of the stereoscopic image display device, and the image display is supported. Input device for a stereoscopic image display device that detects a motion of an operator who performs the operation. 2. The input device for a stereoscopic image display device according to claim 1, wherein a video camera is used instead of the light emitting element and the light receiving element of the spatial area sensor. 3. The input device for a stereoscopic image display device according to claim 1, wherein a plurality of the spatial area sensors are provided between the stereoscopic image display device and an operator.