JP2001273484A - Instructed position detection system, presentation system and information storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an instructed position detection system, a presentation system and an information storage medium for exactly detecting an instructed position based on an image pickup signal without being affected by the noise of disturbance light or the like. SOLUTION: A noise area information generating part 115 is provided, the luminance value of the image pickup signal from a CCD camera 40 is decided and while using a pointing coordinate detecting part 116, based on the relevant decided result, the position instructed by an infrared pointer is detected while excluding the area of high luminance value from the detection target of the instructed position.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to a pointing position detection system, a presentation system, and an information storage medium.

[0002]

2. Description of the Related Art In a presentation system using a projector or the like, it is necessary to detect a position indicated by a pointing device or the like. In this case, it is important to accurately detect the indicated position and reflect the detected position in various image processing.

For this reason, the present inventors have been studying a system for capturing an image of a screen on which an image is displayed by a projection light from a projector with a camera or the like, and detecting an indicated position based on the image signal.

However, a noise level on the screen causes fluctuations in the luminance level on the screen due to external noise, for example, disturbance light such as sunlight or indoor lighting, or shading or the like due to the disturbance light. However, there is a problem that it is difficult to detect a position with high accuracy by simply performing signal processing on an imaging signal such as the above.

SUMMARY OF THE INVENTION The present invention has been made in consideration of the above problems, and has as its object to provide a pointing position detection system for accurately detecting a pointing position based on an image signal without being affected by noise such as disturbance light. , A presentation system and an information storage medium.

[0006]

According to another aspect of the present invention, there is provided a pointing position detecting system for detecting a pointing position by a spot light projected on a predetermined image display area. An imaging unit that captures an image display area, based on a captured image of the imaging unit, includes a position detection unit that detects a designated position by the spot light in the image display region from a designated image included in the captured image, The position detection means, edge detection means for performing edge detection processing of the pointing image included in the captured image, and detection means for detecting a pointing position by the spot light based on information of the edge detection processing of the pointing image, , Is included.

Further, an information storage medium according to the present invention is a computer-readable information storage medium storing information for detecting a position indicated by a spot light projected on a predetermined image display area, Is information based on an image captured by an image capturing unit that captures the image display area, the information for realizing a position detecting unit that detects an indicated position by the spot light in the image display area from an instruction image included in the captured image. Wherein the position detecting means includes an edge detecting means for performing an edge detecting process of the designated image included in the captured image, and a detecting means for detecting a designated position by the spot light based on information of the designated image subjected to the edge detecting process. Means.

According to the present invention, by performing the edge detection processing, the level fluctuation of disturbance light and the shading due to the disturbance light become strong, and the designated position can be detected with high accuracy.

According to another aspect of the present invention, there is provided a pointing position detecting system for detecting a pointing position by a spot light projected on a predetermined image display area. A position detection unit that detects a position indicated by the spot light in the image display area from an instruction image included in the captured image based on the image captured by the imaging unit. Means for storing a difference image generation image obtained by imaging a region; difference image extraction means for extracting a difference image between the captured image and the difference image generation image; and edge detection processing for the difference image. An edge detection unit for performing the detection, and a detection unit for detecting a position indicated by the spot light based on the information on the detected edge.

[0010] Further, another information storage medium according to the present invention includes:
A computer-readable information storage medium that stores information for detecting a position indicated by a spot light projected on a predetermined image display area, wherein the information is an image captured by an imaging unit that captures the image display area. The information includes information for realizing a position detecting unit that detects a position indicated by the spot light in the image display area from an instruction image included in the captured image, and the position detection unit captures the image display area. Means for storing a difference image generation image obtained by performing the above operation, difference image extraction means for extracting a difference image between the captured image and the difference image generation image, and edge detection for performing edge detection processing of the difference image Means, and detecting means for detecting a position indicated by the spot light based on the information on which the edge is detected.

According to the present invention, by extracting the difference image, the pointing position can be accurately detected without being affected by disturbance light.

Further, the position detecting means includes a binarizing means for binarizing the information of the pointing image which has been subjected to the edge detection processing, and the detecting means comprises an instruction binarized by the binarizing means. It is preferable that the designated position is detected based on image information.

According to this, by performing binarization, subsequent processing becomes easy, and the apparatus can be downsized.

The position detecting means includes a noise area detecting processing means for detecting and storing a noise area by performing an edge detecting process on a picked-up image of an image display area in a non-pointed state. It is preferable that the detection unit detects the designated position of the designated image by excluding the noise region detected by the noise region detection processing unit from the detection target of the designated position.

According to this, the influence of the noise area such as characters and scratches displayed on the screen is detected by detecting the indicated area of the indicated image by detecting the noise area and excluding it from the detection of the indicated position. The pointing position can be accurately detected without receiving it.

It is preferable that the noise area detection processing means performs expansion processing on the area detected by performing the edge detection processing and stores the result as the noise area.

According to this, even when the noise area moves due to a slight movement of the screen position, it is possible to accurately detect the indicated position by grasping the noise area in a wider manner in consideration of the movement. .

Another pointing position detection system according to the present invention is a pointing position detection system for detecting a pointing position by a spotlight projected from a pointing tool on a predetermined image display area, wherein the image display area is imaged. Imaging means;
A position detection unit configured to detect a position indicated by the spotlight in the image display area from an instruction image included in the captured image based on a captured image of the imaging unit; and a timing having a predetermined relationship with an imaging timing of the imaging unit. Means for transmitting information to the pointing device, wherein the pointing device blinks a spot light in synchronization with an imaging timing of the imaging device based on the timing information, and the position detecting device comprises a spot light. Based on the image of the spot light included in the difference image, the difference image generation image captured at the time of non-lighting, and a difference image extracting unit that extracts a difference image between the instruction image captured at the time of lighting of the spot light, Detecting means for detecting the indicated position.

Further, another information storage medium according to the present invention includes:
A computer-readable information storage medium that stores information for detecting a position indicated by a spot light projected on a predetermined image display area, wherein the information is an image captured by an imaging unit that captures the image display area. A position detecting means for detecting a position indicated by the spot light in the image display area from an instruction image included in the captured image, and timing information having a predetermined relationship with an imaging timing of the imaging means to the indicator. Means for transmitting to the transmission means, and information for realizing,
The indicating tool blinks a spotlight in synchronization with an imaging timing of the imaging unit based on the timing information,
The position detection unit includes a difference image extraction unit that extracts a difference image between a difference image generation image captured when the spotlight is not lit and an instruction image captured when the spotlight is lit, and a difference image included in the difference image. Detecting means for detecting the indicated position based on an image of the spot light to be emitted.

According to the present invention, by taking the difference between the image information output by the image pickup means when the spotlight is turned on and the image information output by the image pickup means when the spotlight is turned off, the influence of disturbance light on position coordinate detection is almost eliminated. Can be
By improving the S / N ratio of the detection system, for example, even weak light such as infrared light can be appropriately detected.

The image pickup means is formed so as to be capable of picking up the image display area in an infrared region, and the designated position detection means is configured to determine the designated position based on an infrared image picked up in the infrared region. Is preferably detected.

According to this, the person and the like can be clearly separated from the spot light, and the pointing position can be detected accurately.

Further, the presentation system according to the present invention includes means for displaying an image in the image display area, and detects the designated position using the designated position detection system.

According to this, based on the detection of the pointing position,
Various controls such as cursor display position control can be performed in correspondence with the position of the spot light.

It is preferable that the edge detecting means performs a weighting operation of adjacent pixels on the captured image as a part of the edge detecting process.

According to this, the edge can be further clarified. Note that the adjacent pixels include, for example, pixels on both sides in the horizontal direction of the target pixel, eight pixels around the target pixel, and the like.

As the edge detection processing, for example, a difference processing using a difference between images of a predetermined dot, a differentiation processing using an operator, and the like can be applied.

[0028]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described below with reference to the drawings, taking as an example the case where the present invention is applied to a system for detecting a designated position in a presentation system.

(Explanation of the Entire System) FIG. 1 is a schematic explanatory diagram of a presentation system according to an example of the present embodiment.

FIG. 1 shows an example of a presentation system using a front projection device as an image display device.

An image for a predetermined presentation is projected and displayed on a screen 10 as a projection surface from a projector 20 provided substantially in front of the screen 10. The image display area 12 is defined by the area of the display image obtained by projecting the image. The presenter 30 gives a presentation to a third party while indicating a desired pointing position of the image in the image display area 12 using the infrared pointer 50 or the like.

As shown in FIG. 1, the image display area 12 of the screen 10 is photographed by using a CCD camera 40 which is an image pickup means provided substantially in front of the screen 10.

FIG. 2 is a schematic diagram showing the relationship between the designated position and the cursor display position.

When making a presentation, as shown in FIG. 2, the presenter 30 indicates a desired designated position on the image display area 12 of the projected image by using the infrared pointer 5.
The presentation is performed while instructing using the spotlight 310 projected from 0.

The spot light 310 projected by the presenter 30 from the infrared pointer 50 is detected based on the photographed image, and image processing is performed.
The designated position which is the projection position of 0 is specified.

Then, predetermined data processing is performed based on the detection result. An example of such data processing is cursor control.

For example, as shown in FIG.
When 0 indicates a desired position of the image display area 12 using the infrared pointer 50, the cursor 200 included in the display image of the image display area 12 moves following the position indicated by the infrared pointer 50. Become.

When such cursor control is performed, it is necessary to accurately detect the pointing position so that the cursor 200 does not deviate from the pointing position.

However, depending on the place where the presentation is performed, when infrared light from a remote controller or the like or disturbance light such as sunlight is projected on the image display area 12, these lights are combined with the light from the infrared pointer 50. In some cases, it was recognized incorrectly and the indicated position could not be detected accurately.

In the present embodiment, by detecting the designated position by performing edge detection processing on the designated image included in the photographed image, the influence of disturbance light can be reduced and the designated position can be accurately detected.

When making a presentation,
Before the presentation is performed, there may be a factor that becomes an edge due to scratches on the screen, characters, or the like.
In this state, give a presentation,
Even if an attempt is made to detect the edge of the pointing image, an edge due to a noise component such as a scratch on a screen or a character may be erroneously recognized as an edge of the pointing image.

For this reason, it is conceivable that the noise generation area is grasped before the presentation is executed, and the edge detection processing is performed using a method of excluding the noise generation area from the edge detection target using the difference processing or the like at the time of the presentation. Can be

However, even when such a method is used, since noise components such as scratches and characters are formed by thin lines, if the screen slightly moves due to wind or the like, it is necessary to grasp the screen before executing the presentation. The position of the noise generating area that has been shifted from the position of the noise generating area when the presentation is executed may occur, and the noise may not be accurately excluded from the edge detection target.

In the present embodiment, noise components such as screen scratches and characters are subjected to dilation processing to appropriately remove the noise components.

FIG. 3 is an explanatory diagram of the expansion processing.
FIG. 3A shows a noise image before the expansion processing, and FIG.
FIG. 7 is a diagram showing a noise image after the dilation processing.

The character "ABCD" shown in FIG. 3 (A) is subjected to dilation processing to the noise image before dilation processing displayed on the screen, thereby obtaining "ABCD" as shown in FIG. 3 (B). An image with thicker characters is generated.

By performing a mask process using an image (hereinafter, referred to as a "mask image") subjected to a dilation process for a noise component, the noise component can be removed and the designated position can be accurately detected.

FIG. 4 is an explanatory diagram of the noise removal processing.
FIG. 4A shows an instruction image before noise removal, and FIG.
(B) is a diagram showing an instruction image after edge processing and noise removal.

As shown in FIG. 4A, when the presentation is executed, the noise component (“ABCD”) shown in FIG.
It is assumed that the instruction is performed in a state that includes the characters

By performing the mask processing described above,
The character "ABCD" is removed, and only the edge of the designated image can be extracted.

In this embodiment, in addition to edge detection, a difference image between frames is extracted before edge detection.

By extracting such a difference image, an indicator such as the infrared pointer 50 having a low light intensity can be used without using a pointer having a high light intensity such as a laser beam. Can be enhanced.

Further, in the present embodiment, since the instruction is performed using the infrared pointer 50, disturbance light that is not infrared light is removed, and only infrared light is appropriately extracted. Take into account.

FIG. 5 is an explanatory diagram of the inter-frame difference processing synchronized with the blinking of the infrared pointer 50, and FIG.
5 shows an instruction image when the infrared pointer 50 emits light, and FIG.
5B illustrates an image when the infrared pointer 50 is turned off, and FIG. 5C illustrates an instruction image after the inter-frame difference processing. FIG. 6 is an explanatory diagram showing the relationship between the imaging frame number and the state of the infrared light source.

As shown in FIG. 6, first, an image is taken when the infrared pointer 50 is turned on. This is taken as an imaging frame number 0. In the imaging image at this time, as shown in FIG. 5A, the white clear white circle on the left is the infrared light of the infrared pointer 50, and the large blurred white circle on the right is It is disturbance light.

Next, an image is taken when the infrared pointer 50 is turned off. This is taken as imaging frame number 1, and the captured image at this time is in a state where there is no infrared light but only disturbance light as shown in FIG. 6 (B).

Then, by extracting a difference image between the captured image of the imaging frame number 0 and the imaging image of the imaging frame number 1, an image of only infrared light excluding disturbance light shown in FIG. 6C is obtained. be able to.

According to such a method, since the image light often has a strong correlation between the consecutive frames, the image information output by the imaging means when the infrared pointer 50 is turned on and the image information is output when the infrared pointer 50 is turned off. By taking the difference from the image information output by the means, the influence of disturbance light can be almost eliminated in position coordinate detection, and the S / N of the detection system can be reduced.
By improving the ratio, even weak light such as infrared light can be appropriately detected.

Further, by obtaining a captured image between two consecutive frames, it is possible to realize a higher-speed processing than to obtain a difference between two distant frames, and to reduce the capacity of a frame memory required for the difference processing. It can be suppressed to a minimum of one frame.

(Explanation of Functional Blocks) Next, the infrared pointer 50 for realizing the above-described functions and the functional blocks of the present system will be described.

FIG. 7 is a functional block diagram of the infrared pointer 50 according to an example of the present embodiment.

The infrared pointer 50 includes an operation unit 52, a light emitting unit 54 which is a spot light projection unit for projecting a spot light when the operation unit 52 is operated, a reception unit 56 for receiving an image pickup timing signal from the system, and A light emission control unit 58 that controls light emission of the light emitting unit 54 based on the received imaging timing signal.

As described above, the light emission control unit 58 controls the light emission unit 5 for each imaging frame based on the imaging timing signal.
4 is turned on and off.

More specifically, the operation section 52 is, for example, a switch, the light-emitting section 54 is, for example, an infrared LED, and the reception section 56 can be realized by means for receiving electromagnetic waves. In the present embodiment, receiving section 56 includes a device that receives a generally used weak electromagnetic wave.

As described above, since the imaging timing is synchronized with the turning-on and turning-off timings of the infrared pointer 50, the pointing device can be replaced by an infrared LED or the like which has low light but has high security. The pointing position can be detected.

Next, a description will be given of functional blocks of the present system for performing imaging and detecting a designated position.

FIG. 8 is a functional block diagram of a system according to an example of the present embodiment.

This system includes a CCD camera 40 serving as an imaging unit, a transmission unit 60 for transmitting an imaging timing signal indicating the imaging timing of the CCD camera 40 to the infrared pointer 50, a processing unit 110, and the projector 20. It is comprised including.

The processing section 110 includes a position detecting section 130 for detecting a designated position based on an image pickup signal, and a calculation for performing various controls and calculations in addition to controlling the display position of the cursor 200 based on the result of detecting the designated position. The processing unit 118 is included.

More specifically, the position detecting section 130 includes a differential image extracting section 111 for generating a differential image, an edge detecting section 112 for detecting an edge of the differential image, and a data processing for the edge detection information. Binarization processing unit 114 for performing binarization so as to easily perform noise detection, and noise region information generation unit 1 for excluding a noise region from binarized edge detection information
15 and a pointing coordinate detection unit 116 that detects the designated position from the edge detection information from which the noise region has been excluded.

Such a processing unit 110 is, specifically,
This is realized using a PU, a ROM that is an information storage medium for storing various programs, data, and the like, a RAM that functions as a work area, and the like.

Hereinafter, each unit in the position detection unit 130 will be described in detail in order.

The image pickup signal output from the CCD camera 40 is input to the difference image extraction unit 111. In the present embodiment, it is assumed that the CCD camera 40 outputs a monochrome imaging signal.

As described with reference to FIGS. 5 and 6, the difference image extracting section 111 extracts a difference image between the image one frame before and the image of the current frame.

FIG. 9 is a functional block diagram of the difference image extracting unit 111 according to an example of the present embodiment.

The difference image extracting section 111 is provided for the CCD camera 40.
The imaging information when the infrared pointer 50 is not lit is stored in the storage unit 410 using the control unit 412.

Then, the difference image extracting section 111 obtains the image information when the infrared pointer 50 from the CCD camera 40 is turned on in the next image pickup, and uses the difference image generation section 414 to store the image information and the storage section. A difference image with the imaging information stored in 410 is generated.

The difference image generated by the difference image extraction unit 111 is input to the edge detection unit 112.

FIG. 10 is a functional block diagram of the edge detection unit 112 according to an example of the present embodiment.

The edge detection unit 112 stores the difference image delayed by one dot from the normal difference image in the storage unit 420 using the control unit 422.

Then, the edge detecting section 112 calculates the difference (absolute value difference) between the normal difference image and the difference image delayed by one dot stored in the storage section 420 by using the difference calculation section 424. I do.

The edge detection information output from the edge detection unit 112 described with reference to FIG.
At 14, binarization is performed to generate binary information.

FIG. 11 is a functional block diagram of the noise area information generation unit 115 according to an example of the present embodiment.

The noise area information generating section 115 generates noise area information for excluding a flaw, character, or the like (noise area) in the image display area 12 from the detection of the designated position. The generation of the noise area information is performed at an arbitrary timing when the instruction detection target does not appear in the image display area 12, for example, before the execution of the presentation.

FIG. 3B is a diagram visualizing and showing the noise area information. Such a figure is also called a mask image.
Specifically, the noise area information is generated as follows.

Before the presentation, the CCD camera 40 captures an image of the image display area 12. The edge detection unit 112 generates edge detection information based on the obtained captured image, and the binarization processing unit 114 generates binary information based on the edge detection information. This binary information is input to the noise area information generation unit 115.

Thereafter, the noise area information generating section 11 expands the area for the luminance exceeding the predetermined threshold value.
The expansion processing unit 450 in 5 performs expansion processing on the binary information.
The binary information after the expansion processing is stored in the storage unit 452 by the control unit 454. The storage content of the storage unit 452 corresponds to the noise area information, and during the pointing coordinate detection operation,
Will be retained.

In the above-described method for generating noise area information, the difference image extracting section 111 does not perform the inter-frame difference image generation processing.

Then, the control section 454 outputs noise area information indicating the noise area to the pointing coordinate detection section 116.

FIG. 12 is a functional block diagram of pointing coordinate detecting section 116 according to an example of the present embodiment.

In the pointing coordinate detecting section 116 functioning as detecting means for detecting the designated position, the noise area information from the noise area information generating section 115 is transmitted to the NOT circuit 46.
The information inverted by 0 and the binary information from the binarization processing unit 114 are input to the AND circuit 462.

As a result, when the determination signal is true, the designated position is detected based on the binary information excluding the noise region. Note that if the determination signal is false, the pointing position is not detected.

The detection of the actual designated position is performed by the center-of-gravity coordinate detector 464. Since the light from the infrared pointer 50 has a circular or elliptical shape, the pointing position can be accurately detected by detecting the center of gravity.

The pointing coordinate detecting section 116 detects the coordinates of the center of gravity, and outputs the detection result to the arithmetic processing section 118 as the designated position indicated by the infrared pointer 50.

The arithmetic processing unit 118 performs various data processing and image processing based on the input data of the designated position thus detected.

The details of the above-mentioned binarization processing and the like are described in the patent document (Japanese Patent Application No.
−89025), the detailed description is omitted here.

In the present embodiment, the arithmetic processing section 118 includes the camera control section 122 and the cursor control section 1.
Functions as 20.

The camera control unit 122 includes the CCD camera 40
Various optical controls such as focus control of the CCD camera 40 are performed based on the information output from the.

The cursor control unit 120 controls the position of the arrow-shaped cursor 200 projected and displayed on the image display area 12 so as to indicate the detected pointing position. That is, the cursor control unit 120 controls the cursor 200 included in the image projected from the projector 20.
Controls the projector 20 to move following the position indicated by the infrared pointer 50.

(Description of Flow of Pointed Position Detection Process) Next, the flow of the pointed position detection process using the above-described units will be described with reference to a flowchart.

FIG. 13 is a flowchart showing the flow of the designated position detecting process according to an example of the present embodiment.

First, the noise area information generating section 115 generates and stores noise area information (step S).
1).

Then, the presentation image is displayed (step S2).

An image pickup timing signal is transmitted from the transmitting section 60 to the infrared pointer 50 as the presenter's instruction tool in accordance with the image pickup timing of the CCD camera 40, and is received by the receiving section 56.

In accordance with the image pickup timing signal processing (step S4), the infrared pointer 50
When the instruction is performed by the light emitting unit 54, the light emission control unit 58 repeats the lighting and extinguishing (flashing) of the light emitting unit 54 for each frame to be imaged (step S6).

Then, the CCD camera 40 captures the actual designated image (step S8), and the difference image extracting unit 111
Extracts a difference image based on the captured image (step S10).

Then, the edge of the difference image is detected by the edge detector 112 (step S12).

[0108] Of the binarized information, the noise area information is generated by the noise area information generating section 115 for the information having a high luminance (step S18).

Then, the pointing coordinate detecting section 116
Based on the noise area information from the noise area information generation unit 115 and the binarized information detected by the edge from the binarization processing unit 114, the barycentric coordinate detection unit 464 uses the barycentric coordinates of the spot light from the infrared pointer 50. Is detected (step S20).

The cursor control unit 120 controls the display position of the cursor 200 based on the barycentric coordinates (step S22).

The above processing (steps S2 to S22) is repeated until the presentation ends.

As described above, according to the present embodiment, erroneous recognition is performed by performing position detection by using the noise area information generation unit 115 to remove disturbance light, screen scratches, characters, and the like. Thus, accurate pointing position detection can be performed.

Further, by taking the difference between the image information output by the image pickup means when the infrared pointer 50 is turned on and the image information output by the image pickup means when the infrared pointer 50 is turned off, the influence of disturbance light in position coordinate detection is almost eliminated. Thus, the S / N ratio of the detection system can be improved, and even weak light such as infrared light can be appropriately detected.

Further, by performing the edge detection processing in the edge detection unit 112, the level fluctuation of disturbance light and the shading due to disturbance light become strong, and the designated position can be detected with high accuracy.

Next, the hardware configuration of the processing unit 110 will be described.

FIG. 14 is an explanatory diagram of a hardware configuration of a processing unit according to an example of the present embodiment.

In the apparatus shown in FIG.
OM 1002, RAM 1004, information storage medium 100
6. Image generation IC 1010, I / O (input / output port) 1
020-1 and 020-2 are connected to each other via a system bus 1016 so that data can be transmitted and received therebetween. And, CCD via I / Os 1020-1 and 1020-2
It is connected to devices such as the camera 40, the projector 20, and the transmission unit 60.

The information storage medium 1006 stores programs,
Image data and the like are stored.

The CPU 1000 controls the entire apparatus and performs various data processing in accordance with programs stored in the information storage medium 1006, programs stored in the ROM 1002, and the like. The RAM 1004 is storage means used as a work area or the like of the CPU 1000.
006 or given contents of the ROM 1002 or the CPU 100
The operation result of 0 is stored. The data structure having a logical configuration for realizing the present embodiment is the RAM 1
004 or the information storage medium 1006.

The various processes described with reference to FIGS. 1 to 13 are realized by an information storage medium 1006 storing a program for performing these processes, a CPU 1000 operating according to the program, an image generation IC 1010, and the like. Note that the processing performed by the image generation IC 1010 or the like may be performed by software using the CPU 1000, a general-purpose DSP, or the like.

Although the preferred embodiment to which the present invention is applied has been described, the application of the present invention is not limited to the above-described embodiment.

(Other Embodiments) For example, the above-described edge detection unit 112 has simply performed edge detection by difference processing using a difference image delayed by one dot. Edge detection may be performed by performing a differentiation process on adjacent pixels using the matrix of (1).

FIG. 15 is a schematic view of an operator according to an example of the present embodiment.

As the operator, various operators such as Sobel operator are used. The operator shown in FIG. 15 is an operator that emphasizes a component in the vertical direction. Of course, the numerical values and sizes of the operators are shown in FIG.
The invention is not limited to the one shown in FIG.

In the above-described embodiment, an example has been described in which a difference image is generated using the difference image extraction unit 111 and edge detection processing is performed on the difference image using the edge detection unit 112. Edge detection processing may be performed without extracting an image.

Also, for example, in the present embodiment, a pointer that emits infrared light is used as the pointing device. However, even when a pointer that emits laser light or visible light is used, the pointing position can be accurately detected. Can be.

Further, the CCD camera 40, the transmitting section 60 and the processing section 110 may be integrated with the projector 20.

Further, as data processing after detection of the indicated position, for example, processing for changing the display of the cursor, processing for confirming the indication of the icon, processing for changing the display of the icon, etc. can be performed in addition to the processing for calculating the display position of the cursor. It is.

Further, the CCD camera 40 may be configured to capture an image in a predetermined infrared region through an infrared transmitting portion that transmits only infrared light.

According to this, by performing imaging in the infrared region through the infrared transmitting portion, unnecessary light components are removed and noise is reduced, thereby enabling accurate position detection.

Here, the infrared region is a region in which only infrared light can be recognized.
The region from nm to 1 mm corresponds.

The above-described method of generating a difference image is a method of generating a difference image generation image to be referred to for each frame. It may be stored in an area.

In this case, if necessary, the difference image generation image can be re-fetched and replaced with the difference image generation image stored in the storage area. Thus, for example, even when noise due to disturbance light such as sunlight increases, the noise can be removed by generating a difference image, and the detection of the indicated position can be accurately performed according to a change in the applied environment. It can be carried out.

Further, the present invention can be applied to a case where a presentation or the like is performed by displaying an image using a display means other than the projection means such as the projector described above. Such display means include, for example, a liquid crystal projector, a CRT (Cathode Ray Tube), a PD
P (Plasma Display Panel), F
ED (Field Emission Display)
y), EL (Electro Luminescence)
e), a display device such as a direct-view type liquid crystal display device and the like.

Furthermore, in the above-described embodiment, an example in which a front projection type projector is applied has been described. However, a rear projection type projector can be applied.

[Brief description of the drawings]

FIG. 1 is a schematic explanatory diagram of a presentation system according to an example of an embodiment.

FIG. 2 is a schematic diagram illustrating a relationship between a designated position and a cursor display position.

FIGS. 3A and 3B are explanatory diagrams of the expansion processing. FIG. 3A shows a noise image before the expansion processing, and FIG. 3B shows a noise image after the expansion processing.

FIG. 4 is an explanatory diagram of a noise removal process, and FIG.
Shows an instruction image before noise removal, and FIG. 4B shows an instruction image after edge processing and noise removal.

5A and 5B are explanatory diagrams of an inter-frame difference process synchronized with the blinking of the infrared pointer. FIG. 5A shows an instruction image when the infrared pointer emits light, and FIG. FIG. 5C shows an image when the light is turned off, and FIG.

FIG. 6 is an explanatory diagram showing a relationship between an imaging frame number and an infrared light source state.

FIG. 7 is a functional block diagram of an infrared pointer according to an example of the present embodiment.

FIG. 8 is a functional block diagram of a system according to an example of the present embodiment.

FIG. 9 is a functional block diagram of a difference image extracting unit according to an example of the present embodiment.

FIG. 10 is a functional block diagram of an edge detection unit according to an example of the present embodiment.

FIG. 11 is a functional block diagram of a noise area information generation unit according to an example of the present embodiment.

FIG. 12 is a functional block diagram of a pointing coordinate detection unit according to an example of the present embodiment.

FIG. 13 is a flowchart illustrating a flow of a designated position detection process according to an example of the present embodiment.

FIG. 14 is an explanatory diagram of a hardware configuration of a processing unit according to an example of the present embodiment.

FIG. 15 is a schematic diagram of an operator according to an example of the present embodiment.

[Explanation of symbols]

 Reference Signs List 10 screen 12 image display area 20 projector 30 presenter 40 CCD camera 110 processing unit 111 difference image extraction unit 112 edge detection unit 113 brightness determination unit 114 binarization processing unit 115 noise region information generation unit 116 pointing coordinate detection unit 130 position detection unit 1006 Information storage medium

Continued on front page F-term (reference) 2F065 AA03 AA12 BB02 DD03 DD04 DD11 FF04 GG07 GG12 JJ26 QQ11 QQ13 QQ24 QQ25 QQ31 5B057 CE02 CE12 DA07 DA08 DB06 DB08 DC16 DC32 5B087 AA02 AC12 BC32 CC09 5L096 BA20 CA05 EA05

Claims (15)

[Claims] 1. An indication position detection system for detecting an indication position by a spot light projected on a predetermined image display area, wherein: an imaging means for imaging the image display area; And a position detecting means for detecting a position indicated by the spot light in the image display area from an instruction image included in the image. The position detection means performs edge detection processing of the instruction image included in the captured image. A pointing position detection system, comprising: edge detection means; and detection means for detecting a pointing position by the spot light based on information of the pointing image subjected to the edge detection processing. 2. An indication position detection system for detecting an indication position by a spot light projected on a predetermined image display area, wherein: an image pickup means for picking up the image display area; Position detecting means for detecting a position indicated by the spot light in the image display area from an instruction image included in the image, wherein the position detection means is for generating a differential image obtained by imaging the image display area. Means for storing an image; difference image extracting means for extracting a difference image between the captured image and the image for generating a difference image; edge detection means for performing edge detection processing of the difference image; And a detecting means for detecting a position indicated by the spot light based on the spot light. 3. The apparatus according to claim 1, wherein the position detecting means includes a binarizing means for binarizing information of the designated image subjected to the edge detection processing. A designated position detection system, wherein the designated position is detected based on information of a designated image binarized by a value conversion unit. 4. The apparatus according to claim 1, wherein the position detection unit detects and stores a noise area by performing an edge detection process on a captured image of an image display area in a non-pointed state. A noise region detection processing unit, wherein the detection unit detects a designated position of the designated image by excluding a noise region detected by the noise region detection processing unit from a detection target of the designated position. Pointing position detection system. 5. The pointing position detection system according to claim 4, wherein the noise area detection processing means performs expansion processing on the area detected by performing the edge detection processing and stores the result as the noise area. 6. A pointing position detection system for detecting a pointing position of a spot light projected from a pointing tool on a predetermined image display area, comprising: an imaging unit that captures an image of the image display region; A position detecting unit that detects a position indicated by the spot light in the image display area from an instruction image included in the captured image; and transmitting timing information having a predetermined relationship with an imaging timing of the imaging unit to the indicator The pointing device blinks the spotlight in synchronization with the imaging timing of the imaging unit based on the timing information, and the position detection unit detects the difference captured when the spotlight is not lit. A difference image extracting unit that extracts a difference image between the image generation image and the instruction image captured when the spotlight is turned on, Based on the image of Murrell spot light, it instructs position detection system which comprises a detecting means for detecting the indicated position. 7. The imaging device according to claim 1, wherein the imaging unit is formed so that the image display area can be imaged in an infrared region, and the pointing position detection unit is imaged in the infrared region. A designated position detection system, wherein the designated position is detected based on an infrared captured image. 8. A presentation system, comprising: means for displaying an image in the image display area, wherein the designated position is detected by using the designated position detection system according to any one of claims 1 to 7. 9. A computer-readable information storage medium storing information for detecting a position indicated by a spot light projected on a predetermined image display area, wherein the information captures an image of the image display area. Based on the image captured by the image capturing unit, the information includes information for realizing a position detecting unit that detects a pointed position by the spot light in the image display area from an instruction image included in the captured image. Edge detecting means for performing edge detection processing of the pointing image included in the captured image, and detecting means for detecting a pointing position by the spot light based on information of the pointing image subjected to the edge detection processing, Information storage medium. 10. A computer-readable information storage medium storing information for detecting a position indicated by a spot light projected on a predetermined image display area, wherein the information captures an image of the image display area. Based on the image captured by the image capturing unit, the information includes information for realizing a position detecting unit that detects a pointed position by the spot light in the image display area from an instruction image included in the captured image. Means for storing a difference image generation image obtained by imaging the image display area; difference image extraction means for extracting a difference image between the captured image and the difference image generation image; edge detection of the difference image Edge detecting means for performing processing; and detecting means for detecting a position indicated by the spot light based on information on the detected edge. Information storage medium characterized. 11. The method according to claim 9, wherein the position detecting means includes a binarizing means for binarizing information of the designated image subjected to the edge detection processing. An information storage medium, wherein the designated position is detected based on information of a designated image that has been binarized by a binarizing unit. 12. The image processing apparatus according to claim 9, wherein the position detection unit detects and stores a noise area by performing an edge detection process on a captured image of an image display area in a non-pointed state. A noise region detection processing unit, wherein the detection unit detects a designated position of the designated image by excluding a noise region detected by the noise region detection processing unit from a detection target of the designated position. Information storage medium. 13. The information storage medium according to claim 12, wherein the noise area detection processing means performs expansion processing on the area detected by performing the edge detection processing and stores the expanded area as the noise area. 14. A computer-readable information storage medium storing information for detecting a position indicated by a spot light projected on a predetermined image display area, wherein the information captures an image of the image display area. A position detection unit configured to detect a position indicated by the spot light in the image display area from an instruction image included in the image based on an image captured by the imaging unit; Means for transmitting to the indicator towards the indicator, including information for realizing, the indicator, based on the timing information, flashes the spotlight in synchronization with the imaging timing of the imaging means, The position detection means includes: a difference image generation image captured when the spot light is not lit; and an image captured when the spot light is lit. And a difference image extracting means for extracting a difference image between the instruction image, based on the spot light of an image included in the difference image, the information storage medium characterized by comprising a detecting means for detecting the indicated position. 15. The imaging device according to claim 9, wherein the imaging unit is formed so as to be able to capture the image display area in an infrared region, and the pointing position detection unit is captured in the infrared region. An information storage medium for detecting the indicated position based on an infrared captured image.