JP2003330612A - Information input/output system, program and storage medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information input/output system for improving convenience by easily identifying which application program an overlapped image is plotted for. <P>SOLUTION: An overlapped image plotted for the application image of an application program displayed at a display device (steps S28, S29) is made to correspond to the application program (a step S31). Thus, the overwritten image is managed by an application program unit, so that which application program the overwritten image is plotted for can be easily identified. Thus, it is possible to improve convenience. <P>COPYRIGHT: (C)2004,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information input / output system, a program and a storage medium.

[0002]

2. Description of the Related Art Conventionally, an electronic device capable of reading handwritten information written on a writing surface such as a whiteboard or a writing sheet by using a writing tool with a dedicated scanner and outputting the recording paper with a dedicated printer. Blackboard devices are known. On the other hand, in recent years, an information input device is arranged on the writing surface of the electronic blackboard so that the information handwritten on the writing surface can be input to a computer such as a personal computer in real time. A system is also provided.

For example, a software board manufactured by Microfield Graphics, Inc. is constructed by arranging an information input device on a whiteboard, and characters and pictures written on the whiteboard. It is a device that makes it possible to capture the visual data of a computer in real time. In the information input system configured by using this soft board, the visual data captured by the soft board is input to the computer and the CRT is used.
It can be displayed on a (Cathode Ray Tube), displayed on a large screen using a liquid crystal projector, and output to recording paper with a printer. It is also possible to project the screen of the computer to which the soft board is connected onto the soft board with a liquid crystal projector and operate the computer on the soft board.

In recent years, a display device for displaying characters and images, an information input device in which an information input surface (touch panel surface) is provided on the front surface of the display device, and an input from the information input device are used. An information input / output system is provided that includes a control device that controls the display of a display device, and that uses the display device and the information input device to configure the display surface and the writing surface of the electronic blackboard.

[0005] For example, in the Smart 2000 manufactured by SMART Technologies Inc., a panel is used in a state where a liquid crystal projector connected to a computer is used to project images of characters, pictures, figures and graphics on the panel. Using the information input device (writing surface) arranged on the front surface of the projection surface (display surface), the process of importing handwritten information into the computer is performed. Then, the handwritten information and the image information are combined in the computer so that they can be displayed again in real time via the liquid crystal projector.

In such an information input / output system, an image input using the information input device can be superimposed and displayed as an overwritten image on the image displayed on the screen by the display device. It is already widely used in educational settings, and its use effect is highly evaluated. Further, such an information input / output system is also used as an electronic conference system by incorporating a communication function such as voice / image and connecting remote places with a communication line.

[0007]

However, the information input / output system as described above is positioned as a powerful tool for inputting and displaying information with the spread of personal computers and the like. It cannot be said to be perfect, and there are many problems that must be solved for full-scale commercialization.

In recent years, a computer is often used while switching a plurality of application programs. However, in the conventional information input / output system, when the application program is switched from the word processor software to the presentation software and used, the overwrite image input using the information input device when the word processor software is used does not change the application program. Since it is saved in the same file as the overwrite image that was input using the information input device when it was in use, unnecessary overwrite images must be deleted, or the data size of the overwrite image increases. There is a problem with.

An object of the present invention is to provide an information input / output system, a program and a storage medium which can easily identify to which application program an overwritten image is drawn and improve convenience. Is to provide.

[0010]

An information input / output system according to a first aspect of the present invention is a display device and an information input device for locating an information input area on a display surface of the display device to detect information input by a predetermined object. In an information input / output system including a device and a control device that executes an application program in response to an input from the information input device, in accordance with the information input by a predetermined object in the information input area, the information processing device is based on the application program. The drawing means for drawing an overwrite image for the application image displayed on the display device, and the overwrite image drawn by the drawing means are active when information is input by a predetermined object in the information input area. Overwriting image associating means that is associated with the application program Obtain.

Therefore, the overwrite image drawn on the application image of the application program is associated with the application program. As a result, the overwrite image is managed in units of application programs, and it is possible to easily identify to which application program the overwrite image was drawn, so that convenience can be improved. .

According to a second aspect of the present invention, in the information input / output system according to the first aspect, the overwriting image associating means, when the application image of the application program moves on the display surface of the display device,
The drawn overwriting image is associated with the application image.

Therefore, when the application image of the application program is moved (for example, page turning or scrolling), the application image of the application program and the overwritten image drawn on the application image can be surely associated with each other. Therefore, it becomes possible to further improve convenience.

The invention according to claim 3 is the invention according to claim 1 or 2.
In the information input / output system described above, the overwrite image associated with the application program or the application image of the application program is stored in a storage unit when the application program ends.

Therefore, it becomes possible to prevent forgetting to save the overwrite image associated with the application program or the application image of the application program.

The invention according to claim 4 is the invention according to claims 1 to 3.
In the information input / output system according to any one of items 1 to 3, an overwrite image list display unit that displays a list of the overwrite images associated with the application images of the application program on the display device, and a list by the overwrite image list display unit Overwriting image selecting means for selecting one of the overwriting images from the displayed plurality of overwriting images, and overwriting image re-displaying means for displaying the overwriting image selected by the overwriting image selecting means together with the application image. , Is provided.

Therefore, one overwrite image selected from the plurality of overwrite images displayed in the list is displayed together with the application image. This makes it possible to redisplay the overwritten image for confirmation, for example, after switching pages or application programs.

The invention according to claim 5 is the invention according to claims 1 to 4.
In the information input / output system according to any one of 1 to 3, whether the overwrite image associated with the application image of the application program is saved together with the application image, only the overwrite image is saved, or not saved. A storage method selecting means for selecting either one is provided.

Therefore, it is possible to save the stroke data of only the overwrite image (coordinate data of the drawing locus) in a small size, paste the overwrite image in the application image, and save it. It will be possible.

A program according to a sixth aspect of the present invention controls various kinds of information based on input information input from the information input device according to a position of a predetermined object indicating an information input area provided in the information input device. A program for causing a computer to execute a drawing for drawing an overwrite image for an application image displayed on a display device based on the application program in accordance with information input by a predetermined object in the information input area. A function and an overwrite image associating function for associating the overwrite image drawn by the drawing function with the application program that is active when information is input by a predetermined object in the information input area.

Therefore, the overwrite image drawn on the application image of the application program is associated with the application program. As a result, the overwrite image is managed in units of application programs, and it is possible to easily identify to which application program the overwrite image was drawn, so that convenience can be improved. .

According to a seventh aspect of the invention, in the program according to the sixth aspect, the overwrite image associating function is drawn when the application image of the application program moves on the display surface of the display device. The overwrite image is associated with the application image.

Therefore, when the application image of the application program is moved (for example, page turning or scrolling), the application image of the application program and the overwrite image drawn on the application image can be surely associated with each other. Therefore, it becomes possible to further improve convenience.

The invention according to claim 8 is the invention according to claim 6 or 7.
In the program described, the overwrite image associated with the application program or the application image of the application program, when the application program ends,
It is saved in the memory.

Therefore, it becomes possible to prevent forgetting to save the application program or the overwrite image associated with the application image of the application program.

The invention according to claim 9 is the invention according to claims 6 to 8.
In the program according to any one of 1, the overwrite image list display function of displaying a list of the overwrite images associated with the application images of the application program on the display device, and a list display by the overwrite image list display function. An overwrite image selection function that enables selection of one of the overwrite images from a plurality of overwrite images; and an overwrite image redisplay function that displays the overwrite image selected by the overwrite image selection function together with the application image, Make the computer realize.

Therefore, one overwrite image selected from the plurality of overwrite images displayed in the list is displayed together with the application image. This makes it possible to redisplay the overwritten image for confirmation, for example, after switching pages or application programs.

According to a tenth aspect of the present invention, in the program according to any one of the sixth to ninth aspects, the overwriting image associated with the application image of the application program is stored together with the application image, The computer is made to realize a saving method selection function of selecting whether to save only the overwrite image or not to save it.

Therefore, it is possible to save the stroke data of only the overwrite image (coordinate data of the drawing trajectory) in a small size, paste the overwrite image in the application image, and save it. It will be possible.

A computer-readable storage medium according to an eleventh aspect of the present invention stores the program according to any one of the sixth to tenth aspects.

Therefore, by making a computer read the program stored in this storage medium, it is possible to obtain the same operation as the program according to any one of claims 6 to 10.

[0032]

BEST MODE FOR CARRYING OUT THE INVENTION An embodiment of the present invention will be described with reference to FIGS. The present embodiment is an example in which a so-called electronic blackboard system equipped with a large display device is applied as an information input / output system.

Here, FIG. 1 is an external perspective view schematically showing the information input / output system 1. As shown in FIG. 1, an information input / output system 1 includes a panel unit 4 including a plasma display panel (PDP) 2 which is a display device and an information input device 3, a personal computer which is a control device, and the like. 2, a scanner 7 for reading an image of an original, a printer 7 for outputting image data on recording paper, and a device storage 9 for storing a video player 8 (see FIG. 2). .

The PDP 2 and the information input device 3 are
The information input device 3 is integrated so as to be positioned on the display surface 2a side, and is housed in the panel unit 4 such that the information input area 3a of the information input device 3 is positioned on the display surface 2a of the PDP 2. In this way, the panel unit 4 houses the PDP 2 and the information input device 3, and constitutes the display surface (display surface 2a of the PDP 2) and the writing surface (information input area 3a) of the information input / output system 1. As the PDP 2, a large screen type such as 40 inches or 50 inches that can be used as an electronic blackboard is used. Although not shown, the PDP 2 is provided with a video input terminal and a speaker, and is connected to various information devices and AV devices such as the video player 8 and other laser disc players, DVD players, video cameras, etc. However, the PDP 2 can be used as a large screen monitor.

Next, the electrical connection of each unit built in the information input / output system 1 will be described with reference to FIG. As shown in FIG. 2, in the information input / output system 1, the computer 5 is connected to the PDP 2, the scanner 6, the printer 7, and the video player 8, and the computer 5 controls the entire system. Further, the computer 5 is connected with a controller 10 for the information input device 3 that calculates the position coordinates in the information input area 3a designated by a predetermined object such as a fingertip or a pointing means such as a pen. The information input device 3 is also connected to the computer 5 via the controller 10. Also, the computer 5
The information input / output system 1 can be connected to the network 11 via the, and the data created by another computer connected on the network 11 can be displayed on the PDP 2 or the data created by the information input / output system 1 can be It is also possible to transfer to other computers.

Next, the computer 5 will be described.
Here, FIG. 3 is a block diagram showing the electrical connection of each unit incorporated in the computer 5. As shown in FIG. 3, the computer 5 is a CPU (Cent) that controls the entire system.
Ral Processing Unit) 12, a ROM (Read Only Memory) 13 storing a boot program, and a CPU 12
RAM (Random Acces
s Memory) 14, a keyboard 15 for inputting characters, numerical values, various instructions, etc., a mouse 16 for moving the cursor, selecting a range, etc., a hard disk 17 as a storage unit, and a PDP 2. The graphics board 1 that controls the display of images on the PDP 2
8, a network card (or a modem may be used) 19 for connecting to the network 11, an interface (I / F) 20 for connecting the controller 10, the scanner 6, the printer 7, and the like, and the above-mentioned units are connected. And a bus 21 for working.

The hard disk 17 has an operating system (OS) 22,
A device driver 23 for operating the information input device 3 on the computer 5 via the controller 10, various application programs 24 such as overwriting software which is a kind of so-called drawing software, word processor software, spreadsheet software, presentation software, etc. are stored. Has been done.

In the computer 5, a storage medium 26 storing various program codes (control programs) such as the OS 22, the device driver 23 and various application programs 24, that is, a flexible disk, a hard disk, an optical disk (CD-ROM, CD-ROM, CD
-R, CD-RW, DVD-ROM, DVD-RAM,
DVD-R, DVD + R, DVD + RW, etc.), magneto-optical disk (MO), flexible disk drive device which is a device for reading program codes stored in a memory card, CD-ROM drive device, MO
A program reading device 25 such as a drive device is installed.

The various application programs 24 are
OS2 that starts up when the computer 5 is powered on
It is executed by the CPU 12 under the control of 2. For example, when the overwrite software is activated by a predetermined operation of the keyboard 15 or the mouse 16, a predetermined image based on the overwrite software is displayed on the PDP 2 via the graphics board 18. Further, the device driver 23 is also activated together with the OS 22 and becomes ready for data input from the information input device 3 via the controller 10.
When the user draws a character or a figure in the information input area 3a of the information input device 3 with the pointing means while the overwrite software is activated, the coordinate information is input to the computer 5 as image data based on the description of the pointing means. , For example PDP
The image on the screen displayed in 2 is superimposed and displayed as an overwrite image. More specifically, the computer 5
CPU 12 generates overwriting data (overwriting image) for overwriting lines and characters based on the input image data, and is provided on the graphics board 18 in accordance with the position coordinates based on the input coordinate information. Writing to a video memory (not shown). After that, the graphics board 18 transmits the overwrite information written in the video memory to the PDP 2 as an image signal, so that the same character as the character written by the user is displayed on the PDP 2. That is, since the computer 5 recognizes the information input device 3 as a pointing device such as the mouse 16, the computer 5 performs the same process as when writing characters using the mouse 16 on the overwriting software. become.

Next, the information input device 3 will be described in detail. As the information input device 3 that can be applied to the information input / output system 1 of the present embodiment, various types having different detection methods can be considered. Therefore, in the following, as the information input device 3, several information input devices having different detection methods are given, and the configuration and principle thereof will be described.

A. First Information Input Device First, the first information input device 3A will be described with reference to FIGS.
It will be described based on. The first information input device 3A is
This is a so-called recursive light shielding type information input device.

Here, FIG. 4 is an explanatory view schematically showing the configuration of the first information input device 3A. As shown in FIG.
The information input device 3A includes a horizontally long rectangular information input area 3a having a size corresponding to the size of the display surface 2a of the PDP 2. This information input area 3a is an area that allows input of handwritten characters and figures. Optical units 27 (a left side optical unit 27L and a right side optical unit 27R) for emitting and receiving light are provided near the corners located at both lower ends of the information input area 3a at a predetermined mounting angle. From these optical units 27, a plane or a substantially plane is formed, and for example, L ₁ , L ₂ , L ₃ ,
, L _n (R ₁ , R ₂ , R ₃ , ..., R _n ) is a fan-shaped thin film light flux film composed of a bundle of light (probe light) such as the information input area 3a. The light is projected in parallel along the surface of the display surface 2a of the PDP 2 so as to cover the entire area.

Further, the information input area 3a of the information input device 3
A retroreflective member 28 is provided in the peripheral portion except the lower portion of the. The retroreflective member 28 is formed by arranging a large number of conical corner cubes, for example, and has a characteristic of reflecting incident light toward a predetermined position regardless of the incident angle. For example, the probe light L ₃ projected from the left optical unit 27L is reflected by the retroreflective member 28 and is received by the left optical unit 27L as retroreflected light L ₃ ′ that follows the same optical path again. That is, the information input area 3a is also formed by the retroreflective member 28.

Next, the optical unit 27 will be described. Here, FIG. 5 is a configuration diagram schematically showing the structure of the optical unit 27. Note that although FIG. 5 mainly shows the xz direction, the portions shown by the alternate long and two short dashes line are the same components viewed from different directions (xy direction or yz direction). .

As shown in FIG. 5, the optical unit 27 includes
The light emitting means 29 and the light receiving means 30 are provided. The light projecting means 29 is an LD (La
serDiode: Semiconductor laser), pinpoint LED (Ligh
A light source 31 such as a t Emitting Diode is provided. The light emitted perpendicularly to the display surface 2a of the PDP 2 from the light source 31 is collimated in the x direction by the cylindrical lens 32 that can change the magnification in only one direction. The light collimated in the x direction by the cylindrical lens 32 has two cylindrical lenses 3 whose curvature distribution is orthogonal to that of the cylindrical lens 32.
The light is condensed in the y direction by 3, 34. That is, due to the action of these cylindrical lens groups (cylindrical lenses 32, 33, 34), a region where the light from the light source 31 is linearly condensed is formed behind the cylindrical lens 34. Here, a slit plate 35 having a slit narrow in the y direction and elongated in the x direction is arranged.
Therefore, the light that has passed through the cylindrical lens group (cylindrical lenses 32, 33, 34) forms a linear secondary light source 36 at the slit position of the slit plate 35. The light emitted from the secondary light source 36 is emitted from the half mirror 3
Folded at 7, parallel light along the surface of the display surface 2a without spreading in the vertical direction of the display surface 2a of the PDP 2, and fan-shaped light flux centered on the secondary light source 36 in the direction parallel to the display surface 2a. It becomes a film and advances in the information input area 3a. In other words, the fan-shaped light forms the information input area 3a. These cylindrical lens groups (cylindrical lens 3
2, 33, 34) and the slit plate 35 form a focusing optical system.

As described above, the luminous flux film that has traveled through the information input area 3a in the fan shape is recursively reflected by the retroreflective member 28, and follows the same optical path again, so that the half mirror 3 is formed.
I will return to 7. Therefore, the retroreflective member 28
The luminous flux film that is recursively reflected by (2) also forms the information input area 3a.

The retroreflected light reflected by the retroreflective member 28 and returned to the half mirror 37 passes through the half mirror 37 and enters the light receiving means 30. The retro-reflected light incident on the light receiving means 30 is linearized through the cylindrical lens 38 which is a condenser lens, and then provided at a distance f (f is a focal length of the cylindrical lens 38) from the cylindrical lens 38. CCD (Charge Coupled
Device (light receiving element) 39 receives light at different positions for each probe light. The CCD of this embodiment
The (light receiving element) 39 is a one-dimensional CCD, and the number of pixels thereof is 2,048.

Specifically, the retroreflected light reflected by the retroreflective member 28 is the cylindrical lens 3 in the z-axis direction.
The light reaches the CCD (light receiving element) 39 while being collimated without receiving the action of 8. In addition, the retro-reflected light is PDP2.
In the direction parallel to the display surface 2a of the cylindrical lens 3
The light propagates so as to be focused on the center of the lens 8, and as a result, is imaged on the CCD (light receiving element) 39 provided on the focal plane of the cylindrical lens 38 under the action of the cylindrical lens 38. As a result, a light intensity distribution is formed on the CCD (light receiving element) 39 according to the presence or absence of retroreflected light. That is, when the retroreflected light is blocked by the indicating means P, the CCD
A point having a weak light intensity (a peak point described later) occurs at a position on the (light receiving element) 39 corresponding to the shielded retroreflected light. CCD (light receiving element) 39 that receives the retroreflected light
Generates an electric signal based on the light intensity distribution of the retroreflected light (probe light), and outputs the electric signal to the controller 10 described above. Note that, as shown in FIG. 5, the secondary light source 36 and the cylindrical lens 38 are both disposed at a position of the distance d with respect to the half mirror 37 and have a conjugate positional relationship.

Here, in FIG. 6, an electric signal based on the light intensity distribution of the retro-reflected light is input from the light receiving element 39, and the processing for specifying the coordinates of the position where the light traveling in the information input area 3a is blocked is executed. FIG. 3 is a block configuration diagram of a controller 10 to be operated. The controller 10 controls the light emission of the light source (LD) 31 of the optical unit 27 (left optical unit 27L, right optical unit 27R) and CC of the optical unit 27 (left optical unit 27L, right optical unit 27R).
The output from the D (light receiving element) 39 is calculated. As shown in FIG. 6, the controller 10 is provided with a CPU 40 that centrally controls each unit.
The PU 40 has a ROM for storing programs and data
41, a RAM 42 that rewritably stores various data and functions as a work area, an interface 43 for connecting to the computer 5, an A / D (Analog / Digita)
l) The converter 44 and the LD driver 45 are connected to the bus. Further, the CPU 40 has a hard disk 46 for storing various program codes (control programs).
And non-volatile memory EEPROM (Electrically
An Erasable Programmable Read Only Memory) 47 is connected to the bus. Here, the CPU 40, the ROM 41, and the RAM 42 constitute a microcomputer. In such a microcomputer, a storage medium 49 storing various program codes (control programs), that is, a flexible disk, a hard disk, an optical disk (CD-ROM, CD-R, CD-R).
W, DVD-ROM, DVD-RAM, DVD-R, D
VD + R, DVD + RW, etc., magneto-optical disk (M
O), a program reading device 48 such as a flexible disk drive device, a CD-ROM drive device, or an MO drive device, which is a device for reading the program code stored in a memory card.

As a circuit for calculating the output from the CCD (light receiving element) 39, an analog processing circuit 51 is connected to the output terminal of the CCD (light receiving element) 39 as shown in the figure. C
The reflected light incident on the CD (light receiving element) 39 is converted into analog image data having a voltage value according to the intensity of light in the CCD (light receiving element) 39 and output as an analog signal. This analog signal is processed by the analog processing circuit 51 and then processed by the A / D (Analog / Digital) converter 4.
It is converted into a digital signal by 4 and passed to the CPU 40. After that, the CPU 40 calculates the two-dimensional coordinates of the instructing means P.

Various program codes (control programs) stored in the hard disk 46 or a storage medium 49
Various program codes (control programs) stored in the RA are stored in the RA when the controller 10 is powered on.
It is written in M42 and various program codes (control programs) are executed.

Then, based on the control program, the CPU
The functions performed by 40 will be described. Here, the coordinate detection process, which is a characteristic function of the information input device 3 according to the present embodiment, will be specifically described below.

Here, FIG. 7 is a front view showing an example in which one point in the information input area 3a of the information input device 3 is pointed by the pointing means P. As shown in FIG. 7, for example, L ₁ , L ₂ , L ₃ , ...
-, if n th probe light L _n in the fan-shaped light composed of the probe light such L _n is blocked by the pointing means P, it is the probe light L _n reaching the retroreflection member 28 There is no.

At this time, consider the light intensity distribution on the CCD (light receiving element) 39. Here, FIG. 8 shows a CCD (light receiving element) 3
It is explanatory drawing which shows the detection operation of 9 typically. Pointing means P
Is not inserted in the information input area 3a, the CCD
Although the light intensity distribution on the (light receiving element) 39 is almost constant,
As shown in FIG. 8, when the pointing means P is inserted into the information input area 3 a and the probe light L _n is blocked by the pointing means P, the probe light L _n is the CCD of the optical unit 27.
Since it is not received by the (light receiving element) 39,
CCD of the optical unit 27 corresponding to the probe light L _n
A predetermined position X _n on the (light receiving element) 39 becomes a region (dark spot) where the light intensity is weak. The position X _n, which is the region (dark spot) where the light intensity is weak, appears as a peak point in the waveform of the light intensity output from the CCD (light receiving element) 39. The appearance of the peak point in the waveform is recognized by the change in the voltage, and the position X _n of the dark point which is the peak point of the waveform of the light intensity is detected.

When the dark point position X _{n, which} is the peak point of the light intensity waveform, is detected, the CCD is detected from the dark point position X _n.
The distance to the center pixel of the (light receiving element) 39 is, for example, CC
It is detected based on the pixel number of D (light receiving element) 39 (for example, pixel number m in FIG. 8).

Position X _n which is a region (dark spot) where the light intensity is weak
(X _n L on the CCD (light-receiving element) 39 of the left optical unit 27L, X _n R on the CCD (light-receiving element) 39 of the right optical unit 27R) is the emission / incident angle θ _n of the blocked probe light. Correspondingly, θ _n can be known by detecting X _n . That is, from the dark spot position X _n to C
CD and the distance to the center pixel of the (light receiving element) 39 and a, theta _n as a function of ^{_{a, θ n = tan -1 (}} a / f) .................................... (1 ) It can be expressed as. However, f is the focal length of the cylindrical lens 38. Here, the left optical unit 2
Replace θ _n in 7L with θ _n L and a with X _n L.

Further, in FIG. 7, the pointing means P and the left optical unit 2 are defined by the conversion coefficient g of the geometrical relative positional relationship between the left optical unit 27L and the information input area 3a.
The angle θL formed with 7L is X _n L obtained by the equation (1).
ΘL = g (θ _n L) (2) where θ _n L = tan ⁻¹ (X _n L / f).

Similarly, with respect to the right side optical unit 27R, the symbol L in the above equations (1) and (2) is replaced with the symbol R, and the geometrical relative position between the right side optical unit 27R and the information input area 3a. Depending on the conversion coefficient h of the relationship, θR = h (θ _n R) ………………………… (3) However, it may be expressed as θ _n R = tan ⁻¹ (X _n R / f). it can.

Here, the CCD of the left optical unit 27L
(Light receiving element) 39 center position and right optical unit 27R
If the distance from the center position of the CCD (light receiving element) 39 of No. 2 is w shown in FIG. 7, the two-dimensional coordinates (x, y) of the point designated by the pointing means P in the information input area 3a are the principle of triangulation. Thus, x = w · tan θR / (tan θL + tan θR) (4) y = w · tan θL · tan θR / (tan θL + tan θR) (5)

These (1) (2) (3) (4) (5)
The formula is previously stored in the hard disk 4 as part of the control program
6 and the storage medium 49, (1) (2)
From the equations (3), (4) and (5), the position coordinates (x, y) of the indicating means P are calculated as a function of X _n L, X _n R. That is, by detecting the position of the dark spot on the CCD (light receiving element) 39 of the left optical unit 27L and the position of the dark spot on the CCD (light receiving element) 39 of the right optical unit 27R, the position coordinates of the indicating means P are detected. (X, y) will be calculated. The position coordinates (x, y) of the pointing means P
Is calculated at a constant cycle (time interval accompanying the sampling signal, for example, 20 ms).

The position coordinates (x, y) of the indicating means P calculated in this way are output to the computer 5 via the controller 10 and used for predetermined processing.

According to such an information input device 3A, in the information input area 3a, negligible difference, complete transparency,
It is possible to achieve a high sense of drawing.

B. Second Information Input Device Next, the second information input device 3B will be described with reference to FIGS.
It will be described based on 1. The first information input device 3A
The same reference numerals are used for the same parts as
The description is also omitted.

The second information input device 3B is a so-called retro-reflecting information input device.

Here, FIG. 9 is a perspective view showing the indicating means 61 used in the information input device 3B. FIG. 10 is a front view showing an example in which one point in the information input area 3a of the information input device 3B is pointed by the pointing means 61. As shown in FIG. 9, a retroreflective member 62 is provided in the vicinity of the tip of the pointing means 61 used for pointing a point in the information input area 3a of the information input device 3B. The retroreflective member 62 is formed by arranging a large number of conical corner cubes, for example, and has a characteristic of reflecting incident light toward a predetermined position regardless of the incident angle. For example, as shown in FIG. 10, the probe light L _n projected from the left optical unit 27L is reflected by the retroreflective member 62 and is again reflected by the left optical unit 27L as retroreflected light L _n ′ that follows the same optical path. It will be received. Therefore, as shown in FIG. 10, in the information input device 3B, it is not necessary to provide the retroreflective member 28 in the information input area 3a unlike the information input device 3A described above. The pointing means 61 has a pen-like shape and is preferably made of a material such as rubber or plastic rather than glossy metal.

Therefore, the vicinity of the tip of the pointing means 61 provided with the retroreflective member 62 is located near the information input device 3B.
Insert it at the appropriate position (x, y) in the information input area 3a of
For example, when the probe light L _n in the fan-shaped light beam film projected from the left optical unit 27L is reflected by the retroreflective member 62 of the pointing means 61, the retroreflected light L
_n 'the left optical unit 27L of the CCD (light receiving element) 3
It is received by 9. Thus CCD (light receiving element) 39 is retroreflected light L _{n 'when} receiving the retro-reflected light L _n' strong place Dn on CCD (light receiving element) 39 which corresponds to the light intensity It becomes an area (light spot). That is, as shown in FIG. 11, on the CCD (light receiving element) 39, a region having a high light intensity is generated at the position Dn, and the CCD
A peak appears in the shape of the intensity distribution of the light from the (light receiving element) 39. The position Dn where this peak appears corresponds to the emission / incident angle θn of the reflected probe light, and Dn
Θn can be known by detecting. That is, also in the case of such a retroreflective-type information input device 3B, as in the case of the retroreflective-type information input device 3A described above, an instruction means is provided by a triangulation method based on peaks appearing in the light intensity waveform. The position coordinates (x, y) of 61 are calculated. The calculation of the position coordinates (x, y) of the pointing means 61 is performed at a constant cycle (time interval associated with the sampling signal, for example, 20 ms).

The position coordinates (x, y) of the indicating means 61 calculated in this way are output to the computer 5 via the controller 10 and used for predetermined processing.

According to such an information input device 3B, the information input area 3a has negligible difference, complete transparency,
It is possible to achieve a high sense of drawing.

C. Third Information Input Device Next, the third information input device 3C will be described with reference to FIGS. The same parts as those described in the first information input device 3A are designated by the same reference numerals, and the description thereof will be omitted.

The third information input device 3C is a modification of the optical unit in the first information input device 3A.
In detail, in the optical unit 27 used in the first information input device 3A, the fan-shaped light beam film is projected to form the information input area, but in the information input device 3C, the rotary scanning of the polygon mirror or the like is performed. The optical unit 70 has a system and forms an information input area by radially projecting a light beam emitted from a light source by the rotary scanning system.

Here, FIG. 12 is a plan view schematically showing the optical unit 70. As shown in FIG. 12, the optical unit 70 includes an LD (Laser Diode: semiconductor laser) 71, a half mirror 72, a polygon mirror 73, which is a light source that has a drive circuit (not shown) and emits laser light. A light projecting unit 70a including a light lens 74 and a light receiving element 75 are provided. The light receiving element 75 is composed of a PD (Photo Diode) provided at a distance f (f is a focal length of the condenser lens 74) from the condenser lens 74. In such an optical unit 70, after the laser light emitted from the LD 71 is folded back by the half mirror 72, it is sequentially radially reflected by the polygon mirror 73 which is rotationally driven at a predetermined angular velocity ωt by a pulse motor (not shown). Therefore, the optical unit 70 repeatedly projects the light beam radially. That is, the information input area 3a is formed by the light beams radially projected from the two optical units 70. On the other hand, the beam light reflected and incident on the optical unit 70 is reflected by the polygon mirror 73 and reaches the half mirror 72. The reflected beam light that has reached the half mirror 72 passes through the half mirror 72, reaches the light receiving element 75, and is converted into an electric signal.

Next, such an optical unit 70 is installed in the first
An information input device 3C applied in place of the optical unit 27 used in the information input device 3A will be described. As shown in FIG. 13, when the pointing means P is inserted at a certain position in the information input area 3a and a certain beam light is shielded, the beam light is not reflected by the retroreflective member 28. Therefore, it does not reach the light receiving element 75. In this way, when the light beam with the pointing means P inserted at a certain position in the information input area 3a is blocked, a dip appears in the shape of the intensity distribution of the light from the light receiving element 75.

The electrical connection and the like of each part are known in the art, and therefore a detailed description thereof will be omitted. However, as shown in FIG. 14, when the instruction means P is not inserted in the information input area 3a, the optical connection is performed. The intensity indicates “I = I ₁ ”, but when the indicating means P is inserted in the information input area 3 a and the return light does not return to the light receiving element 75, the light intensity indicates “I = I ₀ ”. . In this way, the portion where the light intensity is “I = I ₀ ” is
It's a dip. In FIG. 14, time t = t ₀ is the reference position for rotation of the polygon mirror 73, and is the time when the beam light that is rotationally scanned reaches a predetermined angle.

Therefore, assuming that the time t when the light intensity is "I = I ₀ " is t ₁ , the emission angle θ of the light beam shielded by the pointing means P inserted in the information input area 3a is , Θ = ω (t ₁ −t ₀ ) = ωΔt. That is, the emission angles θ (θnL, θnR) of the beam light shielded by the indicating means P inserted in the information input area 3a in the optical units 70 (70L, 70R) provided on the left and right sides are calculated, and these are emitted. Position coordinates (x, y) in which the indicating means P is inserted by a triangulation method based on the angle θ (θnL, θnR)
Will be calculated. The calculation of the position coordinates (x, y) of the pointing means P is performed at a constant cycle (a time interval associated with the sampling signal, for example, 20 ms).

The position coordinates (x, y) of the pointing means P calculated in this way are output to the computer 5 via the controller 10 and used for predetermined processing.

According to such an information input device 3C, the information input area 3a has negligible difference, complete transparency,
It is possible to achieve a high sense of drawing.

D. Fourth Information Input Device Next, the fourth information input device 3D will be described with reference to FIGS. 15 to 16. The second information input device 3
The same parts as those described in B and the third information input device 3C are denoted by the same reference numerals, and description thereof will be omitted.

The fourth information input device 3D is a modification of the optical unit in the second information input device 3B.
Specifically, in the optical unit 27 used in the second information input device 3B, the fan-shaped light beam film is projected to form the information input region, but in the fourth information input device 3D,
An optical unit 70 which has a rotary scanning system such as a polygon mirror and which radially projects a light beam emitted from a light source by the rotary scanning system to form an information input area is used. The description of the optical unit 70 has been given with respect to the third information input device 3C, and will not be repeated here.

An information input device 3D in which such an optical unit 70 is applied instead of the optical unit 27 used in the second information input device 3B will be described. As shown in FIG. 15, when the indicating means 61 is inserted at a certain position in the information input area 3a, a predetermined light beam is retroreflected by the retroreflective member 62 of the indicating means 61, and the light beam is received. Reach the element 75. Thus, the information input area 3a
When the beam light in which the indicating means 61 is inserted at a certain position therein is retroreflected, a peak appears in the shape of the intensity distribution of the light from the light receiving element 75.

The electrical connection of each part and the like are known in the art and therefore a detailed description thereof will be omitted. However, as shown in FIG. 16, when the instruction means 61 is not inserted in the information input area 3a, the optical connection is performed. The intensity indicates “I = I ₀ ”, but when the indicating means 61 is inserted in the information input area 3 a and the recursive light reaches the light receiving element 75, the light intensity indicates “I = I ₁ ”. . Thus, the portion where the light intensity is "I = I ₁ " is the peak. In addition, in FIG. 16, at time t = t ₀ ,
It is a reference position for rotation of the polygon mirror 73, and is a time point when the beam light that is rotationally scanned reaches a predetermined angle.

Therefore, assuming that the time t when the light intensity becomes “I = I ₁ ” is t ₁ , the emission angle θ of the beam light retroreflected by the indicating means 61 inserted in the information input area 63. Is calculated as θ = ω (t ₁ −t ₀ ) = ωΔt. That is, the output angles θ (θnL, θnR) of the beam light retroreflected by the pointing means 61 inserted in the information input area 3a in the optical units 70 (70L, 70R) provided on the left and right sides are calculated, respectively. The position coordinates (x, y) in which the indicating means 61 is inserted are calculated by the triangulation method based on the emission angle θ (θnL, θnR). The calculation of the position coordinates (x, y) of the pointing means 61 is performed at a constant cycle (time interval associated with the sampling signal, for example, 20 ms).

The position coordinates (x, y) of the indicating means 61 calculated in this way are output to the computer 5 via the controller 10 and used for predetermined processing.

According to such an information input device 3D, in the information input area 3a, negligible difference, complete transparency,
It is possible to achieve a high sense of drawing.

E. Fifth Information Input Device Next, the fifth information input device 3E will be described with reference to FIGS. 17 to 18. This fifth information input device 3E
Is a so-called camera-imaging-type information input device that captures image information in an information input area by an imaging camera and detects position coordinates based on a part of the captured image information.

Here, FIG. 17 is a front view schematically showing the configuration of the information input device 3E. Imaging cameras 82, which are imaging means, are provided at both ends above the information input area 3a of the information input device 3E at a distance w. The image pickup camera 82 is provided with a light receiving element 83, which is a CCD (Charge Coupled Device), and an imaging optical lens 84 at a distance f. The imaging angle of view of each of these imaging cameras 82 is about 90 degrees, and they are installed so that the information input area 3a is the imaging range. Further, the image pickup camera 82 is installed so as to be a predetermined distance from the display surface 2a of the PDP 2 forming the coordinate input surface, and its optical axis is the optical axis of the PDP 2.
Is parallel to the display surface 2a.

In addition, a background plate 85 is provided at a peripheral edge portion excluding the upper portion of the information input area 3a and at a position which covers the entire photographing visual field without hindering the image capturing angle of view of the image capturing camera 82. The background plate 85 is provided substantially perpendicular to the display surface 2a of the PDP 2 with its surface facing the center of the information input area 3a. The background plate 85 has a uniform black color, for example.

FIG. 18 shows the relationship between the signal from the image pickup camera 82 and the instruction means P. As shown in FIG. 18, when the instructing means P is inserted into the information input area 3 a, the instructing means P is photographed by the imaging camera 82, and the image of the instructing means P is formed on the light receiving element 83 of the imaging camera 82. It Information input device 3
As in E, the background plate 85 is black and the finger is used to indicate the pointing means P.
In this case, the indicating means P is the background plate 85.
Since it has a higher reflectance than that of, the portion corresponding to the indicating means P of the light receiving element 83 is a region (bright point) where the light intensity is strong.

The electrical connection and the like of each part are known in the art, and therefore a detailed description thereof will be omitted. However, as shown in FIG. 18, when the indicating means P is inserted in the information input area 3a, the light receiving is performed. A peak appears in the shape of the intensity distribution of the light from the element 83. The position Dn where this peak appears corresponds to the apparent angle θn of the indicating means P from the principal point of the imaging optical lens 84, and θn is expressed as θn = arctan (Dn / f) as a function of Dn. be able to. That is, also in the case of the information input device 3E of such a camera imaging system, the position coordinate (of the pointing means P by the triangulation method based on the peak appearing in the waveform of the light intensity, as in the above-described information input device 3A and the like. x,
y) will be calculated. The calculation of the position coordinates (x, y) of the pointing means P is performed at a constant cycle (a time interval accompanying the sampling signal, for example, 20 ms).

The position coordinates (x, y) of the indicating means P thus calculated are output to the computer 5 via the controller 10 and used for predetermined processing.

As the instructing means P, a dedicated pen having a light emitting element that emits light by itself can be applied.

According to such an information input device 3E, in the information input area 3a, negligible difference, complete transparency,
It is possible to achieve a high sense of drawing.

F. Sixth Information Input Device Next, a sixth information input device 3F will be described with reference to FIGS. 19 to 20. This sixth information input device 3F
Is an information input device of a so-called LED array type that directly detects coordinates of two axes orthogonal to each other, instead of detecting coordinates by triangulation.

Here, FIG. 19 is a front view schematically showing the configuration of the information input device 3F. As shown in FIG. 19, the information input device 3F includes a light emitting element array 92 in which light emitting diodes (LEDs) 91, which are Xm light emitting means, are horizontally arranged at regular intervals, and one to one.
Corresponding to the light receiving element array 94 in which phototransistors 93, which are Xm light receiving means, are arranged to face each other at regular intervals,
Light emitting element array 95 in which LEDs 91 are arranged at regular intervals in the vertical direction, and light receiving element array 9 in which Yn phototransistors 93 corresponding to this one-to-one are arranged at regular intervals.
6 and. Then, these light emitting element arrays 92
The space portion surrounded by the light receiving element array 94, the light emitting element array 95, and the light receiving element array 96 serves as the information input area 3a. That is, in the information input area 3a, m optical paths formed in the horizontal direction and n optical paths formed in the vertical direction can intersect in a matrix. The information input area 3a has a size corresponding to the size of the display surface 2a of the PDP 2 and is formed in a horizontally long quadrangular shape, and is an area in which handwritten characters and figures can be input.

When the pointing means P such as a finger is inserted at a certain position in the information input area 3a, the pointing means P
As a result, the predetermined optical path is blocked, so that the amount of light received by the phototransistor 93 of the light-receiving element array 94 and the phototransistor 93 of the light-receiving element array 96 on the shielded optical path is reduced.

The electrical connection and the like of each part are known in the art and therefore a detailed description thereof will be omitted. However, as shown in FIG. 20, when the instruction means P is not inserted in the information input area 3a, each of them will be described. The light intensity of the phototransistor 93 is “I =
i ₁ ″, the light intensity of the phototransistor 93 in the shielded optical path indicates “I = i ₀ ” when the optical path is blocked by inserting the indicating means P in the information input area 3 a. In this manner, the portion where the light intensity is “I = i ₀ ” is referred to as a dip.In addition, in FIG.20, the horizontal axis corresponds to the position of the phototransistor 93, and the optical output of the phototransistor 93 is actually sequentially calculated. The scanning time to read.

Then, the light receiving element array 9 in which the amount of received light is reduced
No. 4 phototransistor 93 and the phototransistor 93 of the light receiving element array 96, the dip position is detected, and the position coordinates (x, y) instructed by the instructing means P are detected.
To calculate. Actually, the time t ₁ from the reference position t = t ₀ until the dip position is detected and the waveform shown in FIG. 20 are loaded into the memory, and the memory address corresponding to the dip position for the data in the memory. As a result, the position of the dip will be detected. The calculation of the position coordinates (x, y) of the pointing means P is performed at a constant cycle (a time interval accompanying the sampling signal, for example, 20 ms).

The position coordinates (x, y) of the indicating means P calculated in this way are output to the computer 5 via the controller 10 and used for predetermined processing.

According to such an information input device 3F, in the information input area 3a, negligible difference, complete transparency,
It is possible to achieve a high sense of drawing.

G. Seventh Information Input Device Next, a seventh information input device 3G will be described with reference to FIGS. 21 to 22. This seventh information input device 3G
Is a so-called ultrasonic elastic wave type information input device.

FIG. 21 is a front view schematically showing the structure of the information input device 3G. As shown in FIG. 21, the information input device 3G has a transparent substrate 100 and
It is a transmitting means for transmitting a surface acoustic wave to one surface of the substrate 100 which is a writing surface (information input area) 3a for writing a character, a graphic or the like with an instruction means P (see FIG. 22) such as a fingertip or a pen. Transmitting transducer 102 and receiving transducer 103 which is a receiving means for receiving the surface acoustic wave transmitted from transmitting transducer 102.
And the surface acoustic wave transmitted from the transmitting transducer 102, respectively, and the receiving transducer 10
A reflection array 10 which is a reflection means for guiding the surface acoustic wave to
4, 105, similarly to the transmitting transducer 106 for transmitting surface acoustic waves, and the transmitting transducer 10.
6 for receiving the surface acoustic waves transmitted from 6 and a reflection array 10 for reflecting the surface acoustic waves transmitted from the transmitting transducer 106 and guiding the surface acoustic waves to the receiving transducer 107.
8 and 109. The information input area 3a has a size corresponding to the screen size of the PDP 2.

In FIG. 21, transmitting transducers 102, 106 and receiving transducers 103,
107 is a cable 110 and a connector 11 respectively.
It is connected to the controller 10 via 1. The cable 110 is preferably wired along the end of the substrate 100 so as to pass the shortest distance to the transmitting transducers 102 and 106 and the receiving transducers 103 and 107, but the illustration is omitted here.

As the substrate 100, any type of material such as glass and plastic may be used as long as it is transparent and can propagate surface acoustic waves. In addition, for example, when the substrate 100 is a glass substrate, the reflection arrays 104, 105, 108, and 109 are screen-printed with glass paste, and then the glass substrate 10 is used.
It is formed by firing 0 at a predetermined temperature.

Next, when the user touches the information input area 3a with the pointing means P such as a fingertip or a pen, the outline of the method for specifying the coordinates of the touched position will be described. Figure 2
FIG. 2 is an explanatory diagram for explaining the process of identifying the coordinates of the touch position. In FIG. 22, the transmitting transducer 102 and the receiving transducer 103 are used to detect the position of the touch position in the X-axis direction, and the transmitting transducer 106 and the receiving transducer 107 detect the position of the touch position in the Y-axis direction. It is used to Here, for convenience of description, the process of detecting the position in the X-axis direction will be mainly described.

The process of specifying the coordinates of the touch position is executed by the information input device 3G and the controller 10. The transmitting transducer 102 is the controller 1
An electric signal is input from 0, and the input electric signal is converted into mechanical vibration. As a result, the information input area 3a of the substrate 100
Surface acoustic waves that propagate along the surface or interface of the are generated.

The surface acoustic waves generated by the transmitting transducer 102 are sequentially reflected by the reflecting elements constituting the reflecting array 104 by 90 degrees from the side closer to the transmitting transducer 102 and propagate through the information input area 3a. It will be. That is, a part of the surface acoustic wave is reflected by each of the reflective elements that form the reflective array 104,
The phenomenon of a partial transmission is repeated, and the surface acoustic wave propagates over the entire surface of the information input area 3a. The surface acoustic wave reflected by each reflecting element of the reflecting array 104 propagates in the information input area 3a in parallel with the vertical direction of the information input area 3a and with a time difference based on the position of the reflected reflecting element. I will do it. Then, the reflection array 105 reflects the surface acoustic wave propagating through the information input area 3 a by 90 degrees and guides the reflected surface acoustic wave to the receiving transducer 103.

The receiving transducer 103 receives the surface acoustic wave, converts it into an electric signal, and inputs it to the controller 10. The controller 10 amplifies the input electric signal and then performs rectification and A / D conversion processing. And
The controller 10 causes the position in the X-axis direction in the information input area 3a to correspond to time by performing signal processing on the A / D converted signal along the time axis.

For example, as shown in FIG. 22, it is assumed that the user touches an arbitrary position of the information input area 3a with a fingertip (instructing means P). In this case, the surface acoustic wave propagating through the touch position is absorbed or scattered by the fingertip and is greatly attenuated. The position of the touch position in the X-axis direction can be specified by specifying the time point when the touch position is attenuated based on the result of the signal processing described above. Specifically, as shown in FIG. 22, the solid line crossing the information input area 3a is specified as the position of the touch position in the X-axis direction.

Regarding the position of the touch position in the Y-axis direction,
It can be specified by performing the same process as the process of specifying the position in the X-axis direction using the transmitting transducer 106, the receiving transducer 107, and the reflecting arrays 108 and 109. Specifically, as shown in FIG. 22, the dotted line crossing the information input area 3a is specified as the position of the touch position in the Y-axis direction. The position coordinates (x, y) of the pointing means P are calculated in a constant cycle (a time interval associated with the sampling signal, for example, 20 m).
s).

The position coordinates (x, y) of the pointing means P specified in this way are output to the computer 5 via the controller 10 and used for predetermined processing.

According to such an information input device 3G, in the information input area 3a, negligible difference, complete transparency,
It is possible to achieve a high sense of drawing.

As described above, as the information input device 3 applicable to the information input / output system 1 of the present embodiment, the information input device 3A of the retro-reflecting light shielding system and the information input device 3 of the retro-reflecting system.
B, information input device 3C of a retro-light shielding system having a rotary scanning system, information input device 3D of a retro-light reflection system having a rotary scanning system, information input device 3E of a camera imaging system, information input device 3F of an LED array system, The configuration and principle of the ultrasonic elastic wave type information input device 3G have been described. However, these are examples of the information input device 3 applicable to the information input / output system 1 of the present embodiment, and the present invention is It is needless to say that the present invention is not limited to these methods and is applied to all information input devices including an analog capacitive coupling method, a pressure sensitive method, and the like.

Now, in the computer 5 to which the coordinate data is input from the information input device 3, the processing executed by the CPU 12 of the computer 5 based on the device driver 23 will be briefly described with reference to the flowchart of FIG.

As shown in FIG. 23, when the coordinate data is input from the information input device 3 (Y in step S1), the coordinate data is touched (for the touch, the optical information input device 3 is used). It also includes the insertion state of the pointing member in the information input area 3a (the same applies hereinafter), and it is determined whether the coordinates are drag coordinates (step S2). here,
The touch coordinates are coordinates first detected by the instruction means for instructing the coordinates from the non-detection state, and the drag coordinates are continuous coordinates from the touch coordinates to the detach coordinates. The detached coordinates are coordinates in which the instruction means for instructing the coordinates is in a non-detection state. Whether it is the touch coordinate or the drag coordinate is configured by the coordinate data together with the position coordinate (x, y), and is determined by the coordinate status attached to the position coordinate (x, y).

If the input coordinate data is touch coordinates (Y in step S2), the process proceeds to step S3.
It is determined whether the touch operation is associated with the right click of the mouse operation. Whether the touch operation is associated with the right click of the mouse operation or the left click of the mouse operation is arbitrarily set on the driver control panel (not shown).

If the touch operation is associated with the right click of the mouse operation (Y in step S3), it is determined that the right click is performed as the mouse operation, and the position coordinate (x, y) is notified (step S4).

On the other hand, when the touch operation is associated with the left click of the mouse operation (N in step S3), it is determined that the left click is performed as the mouse operation, and the position coordinate ( (x, y) is notified (step S5).

If the input coordinate data is drag coordinates (N in step S2), step S6 is executed.
Then, it is determined whether or not the touch operation is associated with the right click of the mouse operation.

If the touch operation is associated with the right click of the mouse operation (Y in step S6), it is determined that the right click is performed as the mouse operation, and the position coordinate (x, y) is notified (step S7).

On the other hand, if the touch operation is associated with the left click of the mouse operation (N in step S6), it is determined that the left click is performed as the mouse operation, and the position coordinate ( (x, y) is notified (step S8).

On the other hand, when no coordinate data is input from the information input device 3 (N in step S1) and the instructing means for instructing the coordinate is in the non-detection state, that is, when the detachment occurs (in step S9). Y), proceeding to step S10, it is determined whether or not the touch operation is associated with the right click of the mouse operation.

When the touch operation is associated with the right click of the mouse operation (Y in step S10), it is determined that the mouse operation is completed, and the right button OFF is notified (step S11). In this case, the drag coordinates notified immediately before become the detach coordinates.

On the other hand, when the touch operation is associated with the left click of the mouse operation (N in step S10), it is determined that the mouse operation is completed, and the left button O
The FF is notified (step S12). In this case, the drag coordinates notified immediately before become the detach coordinates.

The CPU 12 of the computer 5 operates based on the various application programs 24 according to the mouse data such as the position coordinates (x, y) notified in this way. Although detailed description is omitted because it is a known technique, for example, in the character drawing mode of the overwriting software which is one of the application programs 24,
As shown in FIG. 24, touch coordinates (X0, Y0), drag coordinates (X1, Y1), (X2, Y2), detach coordinates (X3) are displayed in accordance with the notified mouse data such as position coordinates (x, y). , Y3) is the predetermined color set on the pen,
Draw a straight line with a predetermined thickness. Further, in the character erasing (eraser) mode of the overwriting software, as shown in FIG. 25, the rectangle set to the eraser with the touch coordinates as the center according to the mouse data such as the notified position coordinates (x, y). The part drawn in the area range Z is erased.

Next, the functions related to the characteristic functions of the overwrite software, which is one of the various application programs 24 executed in the information input / output system 1 of the present embodiment, will be briefly described below.

Here, FIG. 26 is a flow chart schematically showing the flow of the overwriting process in the overwriting software.
As shown in FIG. 26, when the overwriting software is activated, an overwriting toolbar T1 in which various buttons are arranged is displayed on the PDP 2 as shown in FIG. 27 (step S2).
1), initialization is executed (steps S22 to S2)
4).

Now, various buttons arranged on the overwrite toolbar T1 will be described. "Pen" button a
When is touch-operated, it becomes the overwritable state and the character drawing mode in which the character can be drawn by the drag operation with the color and thickness set in the pen is set. When the "eraser" button b is touch-operated, the character erase (eraser) mode in which the drawn character can be erased is set. "Page
When the “Up” button c is touch-operated, “Pag
The "eUp" key code is passed to the CPU 12 of the computer 5 to change the display page of various application programs (hereinafter referred to as APL) 24 such as word processor software, spreadsheet software, presentation software, etc. that have been activated. When the “Page Down” button d is touch-operated, the “Page Down” key code is passed to the CPU 12 of the computer 5, and the display page of the activated APL 24 is changed. When the “↑” button e is touch-operated, a vertically moving scroll bar (not shown) is moved upward to scroll up the display page of the activated APL 24. When the “↓” button f is touch-operated, a vertically moving scroll bar (not shown) is moved downward to scroll down the display page of the activated APL 24. When the "←" button g is touch-operated, the display page of the activated APL 24 is scrolled to the left by moving the left / right moving scroll bar (not shown) to the left. "→" button h
When is touch-operated, the left / right moving scroll bar (not shown) is moved to the right to scroll the display page of the activated APL 24 to the right. When the “list” button i is touch-operated, the overwrite page list dialog box DB (see FIG.
1) is displayed. When the “APL” button j is touch-operated, the mode is changed to the APL control mode and the APL2
Give the execution right to 4. Overwriting toolbar T as above
When any of the buttons a to i arranged in 1 is touch-operated, the mode is shifted to the overwrite mode.

The initialization operation in steps S22 to S24 is to set the status to the APL control mode (step S22), to clear the overwritten APL24 (step S23), and to set the operation mode to the character drawing mode. This is an operation (step S24).

When the execution right is given in this way, the CPU 12 of the computer 5 waits for the notification of the mouse data from the information input device 3 (step S25).

When the mouse data is notified from the information input device 3 (Y in step S25), it is determined whether or not the position coordinates (x, y) of the notified mouse data are on the overwrite toolbar T1. It is determined (step S26).

Position coordinates of the notified mouse data (x,
If y) is not on the overwrite toolbar T1 (N in step S26), if the operation mode is the character drawing mode (Y in step S27), the touch / drag / detach operation is performed similarly to the case of drawing a character with a pen. The drag locus is drawn with the color and thickness set in the pen to create overwriting data (overwriting image), which is overwritten and displayed on the APL screen (step S28: drawing means), and the operation mode is the character deletion (eraser) mode. If there is (N in step S27), the rectangular area range Z set in the eraser centered on the touch coordinates
Overwrite data by erasing the overwrite characters in (overwrite image)
(Step S29: drawing means).

On the other hand, the position coordinates (x, y) of the notified mouse data are on the overwrite toolbar T1 (Y of step S26), and the status is APL control mode.
If the execution right is given to 24 (step S3
(Y of 0), the APL 24 to which this execution right is given is automatically recognized and acquired as the immediately preceding APL information associated with the overwrite data drawn in step S28 or step S29 (step S31: overwrite image association means). . That is, as shown in FIG. 28, the APL 24 in which the window is active (for example, word processor software) is automatically recognized as the APL 24 to which the execution right is given, and is acquired as the immediately preceding APL information.

Then, it is judged whether or not the acquired immediately preceding APL information is a new overwrite operation target APL 24, and if it is a new overwrite operation target APL 24 (N in step S32), step S28 or step S29
APL24 associated with overwrite data drawn in
The type is changed (step S33). That is, FIG.
As shown in FIG. 9, when the APL 24 whose window is active is switched from the word processor software to the presentation software, the type of the APL 24 to be operated is changed. This is because the overwrite data is divided and stored for each type of the APL 24 to be operated.

Status is APL2 in APL control mode.
4 is not given the execution right (N in step S30), is not a new overwrite operation target APL 24 (Y in step S32), or is the operation target A.
After changing the type of PL24 (step S33),
In step S34, the overwrite toolbar control process is executed.

Now, the overwrite toolbar control processing will be described with reference to the flowchart of FIG. Figure 3
As shown in 0, the overwrite toolbar control process is as follows.
Based on the notified position coordinates (x, y) of the mouse data, the display of the button operated by touch is changed to that indicating "selected" (step S51), and the name of the button operated by touch is saved (step S51). S52).

Subsequently, when the mouse data is received from the touch of the overwrite toolbar T1 until the touch is detached (Y in step S53), if there is a drag operation after the button is touched and the button is other than the first touch button (step S54). N, N in step S55, N in step S56), the button is invalidated (step S57), and the button display is returned to the normal display (step S58).

On the other hand, when the received mouse data is the OFF notification, that is, when the detach is made (Y in step S54), if the button at the detach position is not invalid (N in step S59), the button display is normally performed. The display is returned (step S60), and the function set for the button at the detach position is executed. The functions set for the buttons will be described in detail below.

When the button is touched from the APL control mode (Y in step S61), the mode is shifted to the overwrite mode (step S62), and the overwrite image drawn when the APL control mode is shifted is redrawn (step S6).
3).

Then, the touch-operated button is "AP
If it is the “L” button j (Y in step S64),
The mode shifts to the APL control mode (step S65), the overwriting image is erased (step S66), and the execution right is given to the APL 24 (step S67).

If the touch-operated button is the "pen" button a (Y in step S68), the operation mode is set to the character drawing mode, and the color / color set in the pen is set as shown in FIG. Characters can be drawn by dragging with the thickness (step S69).

When the touch-operated button is the "eraser" button b (Y in step S70), the operation mode is set to the character erase (eraser) mode, and the drawn character is erased as shown in FIG. It is made possible (step S71).

When the touch-operated button is the "list" button i (Y in step S72), an overwrite page list dialog box is displayed and list display control is executed (step S73: overwrite image list display means). ).
FIG. 31 shows the overwrite page list dialog box DB1.
Is shown. The overwrite page list dialog box DB1 displays an overwrite page (overwrite image), and selectively displays a plurality of pages (see FIG. 31A) or one page (see FIG. 31B). It is possible. Here, the "Page" pull-down menu m is for selecting the number of pages to be displayed in a list, and "Delete" is selected.
The button k is for deleting the page selected by the touch operation, and the "return" button n is for returning the page deleted by mistake. That is, one required overwriting page can be easily selected from the overwriting pages displayed in the overwriting page list dialog box DB1 (see FIG. 31 (a)). It is possible to display the image with the overwrite image attached (see FIG. 31B).
Thereby, for example, after switching the page or the application program, the overwriting image can be displayed again in a state of being attached to the application image for confirmation. Here, the function of the overwrite image selection means and the function of the overwrite image redisplay means are executed.

Subsequently, the touch-operated buttons are the page control buttons (“PageUp” button c, “Page”).
It is determined which of the “Down” button d, the “↑” button e, the “↓” button f, the “←” button g, and the “→” button h). Handwritten characters that have been overwritten before page switching are meaningless even if they are displayed at the same position after page switching. Therefore, in the present embodiment, if there is an overwrite image (drawing) prior to the determination of the page control button (Y in step S74), the overwrite image (drawing).
RAM14 together with page-based application images
After being temporarily stored in (step S75), the overwrite image (drawing) is erased (step S76). That is,
The drawn overwrite image (drawing) is temporarily additionally stored in the RAM 14 together with the application image in page units each time the page turning of the APL 24 is executed. Thereby, when the application image of the APL 24 is moved (for example, page turning or scrolling),
Since the application image of the APL 24 and the overwritten image drawn on the application image can be surely associated with each other, the convenience can be further improved.

Then, the touch-operated button is "Pa
If it is the "geUp" button c (Y in step S77), the "PageUp" key code is passed to the CPU 12 of the computer 5 (step S78), and if the touch-operated button is the "PageDown" button d. (Y of step S79), the "Page Down" key code is passed to the CPU 12 of the computer 5 (step S80). As a result, the keyboard 15 "Pa
The same as pressing the "geUp" key or the "PageDown" key, the display page of the activated APL 24 is changed.

Furthermore, the touch-operated button is "↑".
If it is the button e (Y in step S81), the movement control to move up and down the scroll bar (not shown) is executed (step S82), and the touch-operated button is the "↓" button f. In the case (Y of step S83), the movement control to the bottom of the vertical movement scroll bar (not shown) is executed (step S84), and when the touch-operated button is the "←" button g ( Step S
(Y of 85), the left and right movement scroll bar (not shown) is controlled to move to the left (step S86), and when the touch-operated button is the “→” button h (Y of step S87). , Right and left movement scroll bar (not shown) movement control to the right is executed (step S8).
8). This enables scrolling of the display page of the activated APL 24.

By the way, as shown in FIG. 26, there is no notification of mouse data from the information input device 3 (step S2).
5 N), status is APL 24 in APL control mode
If the execution right is given to the APL 24 (Y in step S35), the completion of the APL 24 is monitored (step S3).
6). Then, when the APL 24 in which the overwrite data is temporarily stored in the RAM 14 ends (step S3
6 (Y in step S37) and the save dialog box DB2 (see FIG. 32) are displayed. As shown in FIG. 32, the save dialog box DB2 is for selecting a save format by a radio button, and is one of "no save", "overwrite character + page image save", and "overwrite character save". Can be selected. For example, when “overwrite character + save page image” is selected, the overwrite image is pasted to the application image in APL24 page units and saved in the hard disk 17, and when “overwrite character save” is selected. , Only the overwrite image is stored in the hard disk 17. This makes it possible to save the stroke data (coordinate data of the drawing locus) of only the overwrite image in a small size, or to paste the overwrite image in the application image and save it. Become. Here, the function of the storage method selection means is executed. When the "page list" button o of the save dialog box DB2 is touch-operated, the above-mentioned overwrite page list dialog box DB1 (see FIG. 31) is displayed to display the overwrite page list and unnecessary pages. It can be deleted.

Thereafter, according to the selected storage format, the storage control of the overwrite data to the hard disk 17 which is the storage unit is executed (step S38), and the immediately preceding APL information is cleared (step S39). This makes the AP
It becomes possible to prevent forgetting to save the overwrite image associated with the application image of L24 or APL24.

Here, the overwrite image drawn for the application image of the application program is
By being associated with the application program, the overwriting image is managed in units of application programs, and it becomes possible to easily identify which application program the overwriting image was drawn to, thus improving convenience. Can be achieved.

Although the controller 10 is provided separately from the computer 5 in the present embodiment, the present invention is not limited to this, and the controller 10 may be provided in the computer 5.
The computer 5 may be made to function as the controller 10 by incorporating it in the above.

Further, in the present embodiment, the information input device 3 is provided in the PDP 2 which is a display device, but the present invention is not limited to this, and a CRT (Cathode Ray Tube), LCD
(Liquid Crystal Display), a front projection type projector, a rear projection type projector or the like may be applied as the display device. Further, the display device is not limited to these display devices, and although not particularly shown, the display device may be provided on a blackboard or a whiteboard that functions as a writing board.

Further, in this embodiment, a flexible disk, a hard disk, an optical disk (CD-ROM, CD-R, CD-R, CD-ROM, etc.) is used as the storage medium 26 or storage medium 49 storing various program codes (control programs).
CD-RW, DVD-ROM, DVD-RAM, DVD
-R, DVD + R, DVD + RW, etc., a magneto-optical disk (MO), a memory card, etc. were applied, but the present invention is not limited to this, and the storage medium is not limited to a medium independent of a computer, but may be a LAN or the Internet. A storage medium in which the transmitted program is downloaded and stored or temporarily stored is also included.

[0151]

According to the information input / output system of the invention described in claim 1, a display device and an information input device for locating an information input by a predetermined object by locating an information input area on the display surface of the display device. A control device for executing an application program in response to an input from the information input device,
In an information input / output system including: a drawing unit that draws an overwrite image for an application image displayed on the display device based on the application program in response to information input by a predetermined object in the information input area; An overwrite image associating unit for associating the overwrite image drawn by the application program with the application program that was active when information was input by a predetermined object in the information input area, and the application image of the application program By managing the overwrite image in units of application programs by associating the drawn overwrite image with the application program, the overwrite image is drawn for which application program. It is possible either to easily identify what, it is possible to improve the convenience.

According to a second aspect of the present invention, in the information input / output system according to the first aspect, the overwrite image associating unit is configured to move the application image of the application program on a display surface of the display device. When the application image of the application program is moved (for example, page turning or scrolling) by associating the drawn overwrite image with the application image, the application image of the application program and the application image are drawn. Since the created overwritten image can be reliably associated with each other, the convenience can be further improved.

According to the third aspect of the invention, in the information input / output system according to the first or second aspect, the application program or the overwrite image associated with the application image of the application program is the application program. When is finished, by being stored in the storage unit, it is possible to prevent forgetting to save the application program or the overwrite image associated with the application image of the application program.

According to the invention described in claim 4, in the information input / output system according to any one of claims 1 to 3, the overwrite image associated with the application image of the application program is displayed on the display device. Overwrite image list displaying means for displaying a list, overwriting image selecting means for enabling selection of one of the overwriting images from the plurality of overwriting images listed by the overwriting image list displaying means, and selection by the overwriting image selecting means An overwrite image re-display unit that displays the overwritten image that is displayed together with the application image, and displays one overwriting image selected from a plurality of overwritten images that are displayed in a list together with the application image, for example, a page And confirm after switching application programs How overwrite image in order can be re-displayed.

According to the invention described in claim 5, in the information input / output system according to any one of claims 1 to 4, the overwrite image associated with the application image of the application program is:
By providing a saving method selecting means for selecting whether to save with the application image, save only the overwrite image, or not save the stroke image (coordinate data of drawing trajectory) of the overwrite image only. It is possible to save the size, paste the overwrite image on the application image, and save the image. Therefore, it is possible to save according to the purpose.

According to the program of the invention described in claim 6, various information is input based on the input information input from the information input device according to the position of the predetermined object which points the information input area provided in the information input device. Is a program for causing a computer to execute the control of step 1, and draws an overwrite image for an application image displayed on a display device based on the application program in response to information input by a predetermined object in the information input area. And an overwriting image associating function for associating the overwriting image drawn by the drawing function with the application program that was active when information was input by a predetermined object in the information input area. , Application program application By managing the overwrite image drawn by the application image in association with the application program, the overwrite image drawn for the application image can be easily managed for each application program. Since they can be identified, convenience can be improved.

According to the invention described in claim 7, in the program according to claim 6, the overwrite image associating function draws when the application image of the application program moves on the display surface of the display device. When the application image of the application program is moved (for example, page turning or scrolling) by associating the created overwrite image with the application image, the application image of the application program and the overwrite drawn on the application image. Since the image can be surely associated with each other, the convenience can be further improved.

According to the invention described in claim 8, in the program according to claim 6 or 7, the application program or the overwrite image associated with the application image of the application program is terminated by the application program. At this time, by being saved in the storage unit, it is possible to prevent forgetting to save the application program or the overwrite image associated with the application image of the application program.

According to the invention described in claim 9, in the program according to any one of claims 6 to 8, the overwrite images associated with the application images of the application program are displayed as a list on the display device. The overwrite image list display function, the overwrite image selection function that enables selection of one of the overwrite images from the plurality of overwrite images displayed by the overwrite image list display function, and the overwrite image selected by the overwrite image selection function. By allowing the computer to realize an overwrite image redisplay function of displaying an overwrite image together with the application image, and displaying one overwrite image selected from a plurality of overwrite images displayed in a list together with the application image, for example, Cut pages and application programs Overwrite image, such as for confirmation after was example can be re-displayed.

According to the invention of claim 10, claim 6
In the program according to any one of 1 to 9, the overwriting image associated with the application image of the application program is saved with the application image, only the overwriting image is saved, or not saved. By implementing the saving method selection function for selecting whether to save the stroke data (coordinate data of the drawing trajectory) of only the overwritten image in a small size or by pasting and saving the overwritten image on the application image, etc. Since it can be stored, it can be stored according to the intended use.

According to the computer-readable storage medium of the eleventh aspect of the present invention, the program according to any one of the sixth to tenth aspects is stored, and the computer stores the program stored therein. As a result, the same operational effect as the program according to any one of claims 6 to 10 can be obtained.

[Brief description of drawings]

FIG. 1 is an external perspective view schematically showing an information input / output system according to an embodiment of the present invention.

FIG. 2 is a block diagram showing an electrical connection of each unit incorporated in the information input / output system.

FIG. 3 is a block diagram showing an electrical connection of each unit built in the computer.

FIG. 4 is an explanatory diagram schematically showing a configuration of a first information input device.

FIG. 5 is a configuration diagram schematically showing the structure of an optical unit.

FIG. 6 is a block configuration diagram of a controller.

FIG. 7 is a front view showing an example in which one point in the information input area of the first information input device is pointed by the pointing device.

FIG. 8 is an explanatory diagram schematically showing the detection operation of the CCD.

FIG. 9 is a perspective view showing an instruction unit used in a second information input device.

FIG. 10 is a front view showing an example in which one point in the information input area of the second information input device is pointed by the pointing device.

FIG. 11 is an explanatory diagram schematically showing the detection operation of the CCD.

FIG. 12 is a plan view schematically showing an optical unit used in a third information input device.

FIG. 13 is a front view showing an example in which one point in the information input area of the third information input device is pointed by the pointing means.

FIG. 14 is a graph showing the relationship between light intensity and time.

FIG. 15 is a front view showing an example in which one point in the information input area of the fourth information input device is pointed by the pointing means.

FIG. 16 is a graph showing the relationship between light intensity and time.

FIG. 17 is a front view schematically showing the configuration of a fifth information input device.

FIG. 18 is a schematic front view for explaining the detecting operation.

FIG. 19 is a front view schematically showing a configuration of a sixth information input device.

FIG. 20 is a graph showing the relationship between light intensity and time.

FIG. 21 is a front view schematically showing the configuration of a seventh information input device.

FIG. 22 is an explanatory diagram illustrating a process of identifying coordinates of a touch position.

FIG. 23 is a flowchart showing processing by a device driver.

FIG. 24 is an explanatory diagram showing an operation based on mouse data in a character drawing mode of overwriting software in time series.

FIG. 25 is an explanatory diagram showing an operation based on mouse data in a character erasing (eraser) mode of overwriting software in time series.

FIG. 26 is a flowchart schematically showing the flow of overwrite processing in overwrite software.

FIG. 27 is an explanatory diagram showing an overwrite toolbar.

FIG. 28 is an explanatory diagram showing an active window.

FIG. 29 is an explanatory diagram showing how application software is switched.

FIG. 30 is a flowchart schematically showing the flow of an overwrite toolbar control process.

FIG. 31 is an explanatory diagram showing an overwrite page list dialog box.

FIG. 32 is an explanatory diagram showing a save dialog box.

[Explanation of symbols]

1 Information input / output system 2 display 2a Display surface 3 Information input device 3a Information input area 5 control device 61, P predetermined object 17 Memory 26 storage media

   ─────────────────────────────────────────────────── ─── Continued front page    F-term (reference) 2C071 CA02 CA04 DA03 DB02 DC04                 5B050 AA08 BA06 BA10 BA16 EA19                       FA02 FA03 GA08                 5B087 AA09 CC26 CC33 DD17 DJ01                 5E501 AA16 BA05 CA02 CB05 DA15                       EA02 FA14

Claims (11)

[Claims] 1. A display device, an information input device that positions an information input area on a display surface of the display device to detect information input by a predetermined object, and executes an application program in response to an input from the information input device. An information input / output system including: a control unit for performing a drawing unit that draws an overwrite image for an application image displayed on the display device based on the application program in response to information input by a predetermined object in the information input area. And overwriting image associating means for associating the overwriting image drawn by the drawing means with the application program that was active when information was input by a predetermined object in the information input area. Information input / output system. 2. The overwrite image associating means associates the drawn overwrite image with the application image when the application image of the application program moves on the display surface of the display device. The information input / output system according to claim 1. 3. The overwriting image associated with the application program or the application image of the application program is stored in a storage unit when the application program ends. The information input / output system described in 2. 4. An overwrite image list display unit for displaying a list of the overwrite images associated with the application images of the application program on the display device, and a plurality of the overwrites listed by the overwrite image list display unit. And a overwrite image re-displaying unit for displaying the overwrite image selected by the overwrite image selecting unit together with the application image. The information input / output system according to any one of claims 1 to 3. 5. A saving method for selecting whether to save the overwrite image associated with the application image of the application program together with the application image, save only the overwrite image, or not save the overwrite image. The information input / output system according to any one of claims 1 to 4, further comprising a selection unit. 6. A program for causing a computer to execute control of various information based on input information input from the information input device according to a position of a predetermined object that points to an information input area provided in the information input device. A drawing function of drawing an overwrite image for an application image displayed on a display device based on an application program in response to information input by a predetermined object in the information input area, and a drawing function of the drawing function. And an overwrite image associating function of associating the created overwrite image with the application program that was active when information was input by a predetermined object in the information input area. 7. The overwrite image associating function associates the drawn overwrite image with the application image when the application image of the application program moves on the display surface of the display device. The program according to claim 6. 8. The overwriting image associated with the application program or the application image of the application program is stored in a storage unit when the application program ends. 7. The program described in 7. 9. An overwrite image list display function of displaying a list of the overwrite images associated with the application images of the application program on the display device, and a plurality of the overwrites listed by the overwrite image list display function. The computer is made to realize an overwrite image selection function that makes it possible to select one of the overwrite images from the image, and an overwrite image redisplay function that displays the overwrite image selected by this overwrite image selection function together with the application image. The program according to any one of claims 6 to 8, characterized in that: 10. A saving method for selecting whether to save the overwrite image associated with the application image of the application program together with the application image, save only the overwrite image, or not save the overwrite image. 10. The computer according to claim 6, wherein the selection function is realized.
The program according to any one of. 11. A computer-readable storage medium, which stores the program according to any one of claims 6 to 10.