JPH06301486A - Pointing device and input-output unified information processor - Google Patents

Abstract

PURPOSE:To display a cursor at a position set on an extended line that is pointed by a pen or a finger. CONSTITUTION:An almost vertically extended projection point detecting means 15 detects the input coordinates Pv of a pressure contact type input tablet put on the display screen of a display device 4. A simple extended projecting point detecting means 16 detects the coordinates Pe of the point where the offset equivalent to the difference between the pressure contact position pointed by a pen, a finger, etc., in the (x) and (y) directions and the position set on an extended line pointed by a pen, a finger, etc., is given to the coordinates Pv. A cursor display means 3 displays a cursor including the position put on the coordinates Pe on the device 4. An almost extended projecting point control means 6 corrects the coordinates Pe as necessary.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION The present invention relates to a personal computer.
The present invention relates to a pointing device used for inputting position information in an information processing device such as a computer, and an input / output integrated information processing device in which a processing device including a pointing device and a display device is integrated.

[0002]

2. Description of the Related Art In recent years, information processing apparatuses that are being applied to various fields are being made smaller and lighter, and laptop type and notebook type information processing apparatuses are being commercialized. In order to reduce the size and weight of the notebook type information processing apparatus, an input / output integrated type information processing apparatus in which a pointing device such as an input tablet and a display device such as a liquid crystal display device are integrated is under development.

In such an input / output integrated information processing apparatus, generally, a cursor is displayed at a position overlapping with a position on the input tablet pointed by a pen or a finger, and a target position of the displayed cursor is displayed. Accepting designation.

However, in such an input / output integrated information processing apparatus, in order to prevent the display of the cursor from being obscured by the pen or finger, the pointing position by the pen or finger,
It is necessary to provide an offset with the display position of the cursor.

In view of this, in the technique disclosed in Japanese Patent Laid-Open No. 62-150422, there are three areas including a display area for displaying a cursor, a movement instruction area for instructing the movement of the cursor, and a confirmation instruction area for confirming the position of the cursor. The cursor is moved in accordance with the movement operation of the pen or finger that displays the area and indicates the position overlapping the movement instruction area for instructing the movement of the cursor.

[0006]

DISCLOSURE OF THE INVENTION Problems to be Solved by the Invention JP-A-62-15
According to the technique described in Japanese Patent No. 0422, the display of the cursor is not hidden by the finger or the like operating the cursor.
However, in order to move the cursor to an arbitrary position, it is necessary to move the cursor using the movement instruction area near the display area, and the operability is poor. That is, it is difficult to obtain a natural feeling that a finger or a pen tip directly points and operates a cursor, and thus a natural feeling that a finger or a pen tip directly points a target position.

Therefore, an object of the present invention is to provide an input / output integrated information processing apparatus capable of improving the operability of position information input using a finger or a pointing device such as a pen.

[0008]

In order to achieve the above object, the present invention provides a display device and a display device for outputting pointing coordinates, which are coordinates on an input surface pointed by a finger or an indicator. An integrated information processing apparatus having a substantially transparent input tablet on which the input surface is placed on a display surface, wherein a pointing coordinate output by the input tablet and a predetermined set value for offsetting the pointing coordinate And a display processing unit for displaying the point on the display surface of the display device corresponding to the obtained pointing direction extension point coordinates in a distinguishable manner. Provided is an input / output integrated information processing device.

Further, in such a device, further,
The display processing means displays a cursor on a display surface of the display device at a position corresponding to the obtained coordinates of the extension point in the designated direction. Further, the display device further comprises means for displaying a graphic for accepting the designation of the requested process, and processing means for executing a process according to the graphic instructed on the display surface by the cursor displayed on the display device. Be prepared.

[0010]

According to the input / output integrated information processing apparatus according to the present invention, the pointing direction extension point coordinates are obtained from the pointing coordinates output by the input tablet and a predetermined set value for offsetting the pointing coordinates, and this position The points on the display surface of the display device corresponding to are displayed in an identifiable manner.
Therefore, if the offset value is appropriately determined in advance, the cursor is positioned at a position where it is not hidden by a finger or an indicator, preferably a position on the display surface which is an extension of the direction indicated by the finger or the indicator. Etc. can be displayed, and various instructions can be accepted by this cursor or the like.

Therefore, the user can perform the position pointing operation with a natural feeling that the tip of the pointing device is extended, and the operability is improved.

[0012]

Embodiments of the input / output integrated information processing apparatus according to the present invention will be described below.

First, the first embodiment will be described.

FIG. 1 shows the configuration of an input / output integrated information processing apparatus according to this embodiment.

In the figure, 1 is a detection substantially extended projection point detecting means for detecting a substantially extended projection point, 2 is a substantially extended projection point position adjusting means for adjusting the position of the substantially extended projection point, and 4 is an adjusted substantially extended projection. Cursor display means 5 for controlling the display of the cursor in accordance with the position of the point is a display device such as a liquid crystal display for displaying the cursor.

The input / output integrated type information processing apparatus according to the first embodiment as described above is specifically realized by, for example, the configuration shown in FIG.

In FIG. 2, reference numeral 12 denotes a transparent input tablet, 1
1 is an indicator, 102 is an input controller, 103 is a CP
U and 104 are memories, 105 is a display memory, 106 is a display controller, and 107 is a display device. The input surface of the input tablet 12 is placed on the display surface of the display device 107.

In the present embodiment, the substantially extended projection point detecting means 1 is composed of the input tablet 12, the indicator 11 and the input controller 102.

FIG. 3 shows the structure of the substantially extended projected point detecting means 1.

In the figure, 11 is an indicator attached to a fingertip for emitting a laser beam or the like, and 12 is an input tablet having a phototransistor array in which phototransistors for detecting a light receiving position of the laser beam are arranged in a matrix.

In the figure, 111 is a light emitting diode for converting an electric signal into a laser beam or the like, 121 is a phototransistor for converting a laser beam or the like into an electric signal, 112
Indicates the laser light emitted from the light emitting diode.

Now, in such a configuration, the indicator 1
The in-one light emitting diode 111 outputs the laser light 112 on an extension line of the indicator 11. Input controller 102
Scans each column and row of the matrix of the phototransistor 121 of the input tablet 12 for the presence or absence of an electrical signal,
An extended projection point Pe of the indicator on the pointing surface is detected.

Next, the substantially extended projection point position adjusting means 2 is composed of the input controller 102.

That is, the input controller 102 uses the X and Y axis components (Pex, Pey) of the detected substantially extended projection point information Pe as the X and Y axes of the adjustment information K, as shown in Equation 1.
By subtracting the axis component (Kx, Ky), the X and Y axis components (Pex ', Pey') of the extended projection point information Pe 'are adjusted.

Pex ′ = Pex−Kx Pey ′ = Pey−Ky (Equation 1) As the adjustment information K, an appropriate value that changes depending on the coordinates of the detected substantially extended projection point information Pe is used. The adjustment information K is provided to correct an error caused by a characteristic of a user's instruction, a usage state, a pointing position, or the like.

The substantially extended projection point position adjusting means 2 is C
It may be realized by a program executed by the PU 103.

That is, the CPU 103 reads the coordinates of the extended projection point Pe obtained by the input controller 102,
This may be adjusted according to Equation 1.

Next, the cursor display means 4 is the CPU 10
It is composed of three.

The CPU 3 has a substantially extended projection point position adjusting means 2
Receives the extended projection point Pe 'adjusted by and adjusts Pe'
The display data in the display memory 105 is changed so as to display the cursor that is the designated point of the sol.

Next, the display device 5 comprises a display memory 105, a display controller 106 and a display device 107. The display data stored in the display memory 105 by the cursor display means 4 is displayed by the display controller 10.
6 is displayed on the display device 107.

FIG. 4 shows the cursor thus displayed. In the figure, T indicates the input surface of the substantially extended projection point detection means 1 and the display surface of the display device 5 which are placed in an overlapping manner. Reference numeral 11 is an indicator attached to the fingertip. Reference numeral 51 is a cursor displayed on the display device 6. Moreover, Pe 'is the adjusted extended projection point. As shown, the cursor 51 is displayed so as to substantially include the adjusted extended projection point Pe '.

The position of the extended projection point Pe 'is determined by the CPU
For the operating system and application executed on 103, the user recognizes it as the input position designated by the cursor. For example, the operating system or application executed on the CPU 103 has a menu or icon corresponding to the menu or icon displayed on the display device when the area overlapping the menu or icon is designated by the extended projection point Pe '. Is instructed. Further, without displaying the cursor, when the area overlapping the menu or icon displayed on the display device is designated by the extended projection point Pe ', the corresponding menu or icon is designated. May be set. In addition, not only the designation of icons and menus, but also the designation of position during drawing processing and the designation of editing position during document editing, etc.
Accepted by the extended projection point Pe '. It should be noted that the adjustment by the extended projection point adjusting means 2 may be omitted, and in this case, instead of Pe ', the Pe is directly accepted to accept the respective designations. In each of the following embodiments, the acceptance of such designation is similarly performed.

Since the distance from the input surface of the indicator 11 can be obtained from the magnitude of the output of the phototransistor array, the display of the cursor can be operated according to the obtained distance, if necessary. Good.

In this embodiment, the phototransistor array is used as the substantially extended projection point detecting means 1. However, instead of this, a photodiode array in which photodiodes are arranged in a matrix may be used.

The adjustment by the extended projection point adjusting means 2 may be omitted as described above. In this case, the cursor is displayed so as to substantially include the extended projection point Pe.

As described above, according to the first embodiment, according to the present embodiment, the substantially extended projection point of the indicator on the input surface is detected in the position indicating operation with the indicator such as a finger or a pen. And it can be adjusted, and since the extended projection point can be confirmed with the cursor, it is not affected by parallax,
In addition, since the position indicating operation can be performed with a natural sensation such that the substantially tip of the indicator extends to the input surface in response to the usage situation, the operability of the position indicating operation using the indicator such as a pen or a finger can be improved.

Further, according to the first embodiment, it is possible to detect the substantially extended projection point of the indicator on the substantially input surface regardless of whether the indicator is in contact or not on the substantially input surface. Furthermore, if the visible laser light is emitted from the indicator, the substantially extended line of the indicator and the substantially extended projection point of the indicator with respect to the input surface can be visualized regardless of contact / non-contact of the indicator with respect to the input surface. It is possible to further improve operability such as a position pointing operation using an indicator such as a pen or a finger.

According to the first embodiment, it is not necessary for the indicator to contact the input surface. Therefore, the visibility of the cursor is less deteriorated by being hidden by the indicator or the like, as compared with the case where the indicator needs to be in contact with the input surface. Therefore, depending on the circumstances, the light emitting diode in the indicator is installed in the indicator 11 so that the laser light is emitted from the tip of the indicator perpendicularly to the input surface. It is also possible to detect a substantially vertical projection point and process this point as the point Pe.

The second embodiment will be described below.

The second embodiment differs from the input / output integrated information processing apparatus according to the first embodiment only in the substantially extended projection point detecting means 1.

The substantially extended projection point detecting means 1 according to the second embodiment will be described below.

The substantially extended projection point detecting means 1 according to the second embodiment is also composed of the input tablet 12, the indicator 11 and the input controller 102, as in the first embodiment.

Input tablet 12 used in the second embodiment
As shown in FIG. 5, is composed of two photosensor arrays 141 and 142 which are sequentially mounted on the input surface 143 of the display device 5. Further, the indicator does not need any special one, unlike the first embodiment. In addition, it is possible to input directly with a finger, and in this case, an indicator is not required. In the second embodiment, reference numeral 13 indicates a finger or an indicator.

In FIG. 5, 13 is a finger or an indicator,
Reference numeral 14 is an optical sensor array for detecting a light-shielding position such as an indicator, 141 is a first optical sensor array, and 142 is a second optical sensor array.
, 143 is an input surface.

Each of the photosensors 141 and 142 has light emitting diode arrays 1411 and 1421 arranged on adjacent two sides for converting electric signals into laser light and the like, and two sides facing the side where the light emitting diode arrays are arranged. It has phototransistor arrays 1413 and 1423 for converting the arranged laser light into electric signals. 141 in the figure
Reference numerals 2 and 1422 represent laser light emitted from the light emitting diode.

Further, in FIG. 5, P1 and P2 indicate passing point information of the indicator on the sensor surface detected by the first and second optical sensor arrays, and Pe indicates extended projection point information of the indicator on the input surface, H1 and H2 indicate the distance between the first sensor surface and the second sensor surface and the distance between the second sensor surface and the input surface,
H1 and H2 are equal.

Now, as shown in the figure, the first photosensor array 141, the second photosensor array 142, and the input surface 1
43 are installed at equal intervals in the vertical direction with respect to the input surface. In addition, the first and second photosensor arrays 141, 14
2 is installed so that the laser beams 1412 and 1422 of the light emitting diode arrays 1411 and 1421 are emitted to the corresponding phototransistor arrays 1413 and 1423. When the laser beams 1412 and 1422 hit the phototransistor arrays 1413 and 1423, electric signals are generated in the corresponding photodiodes.

By the way, the input controller 102 scans each column and row of the photodiode arrays 1413 and 1423 for the presence or absence of an electric signal, and thereby, on the planes of the first and second photosensor arrays 141 and 142, The passing point information P1 and P2 of the indicator is detected.

Further, as shown in equation 2, the interval information H
Since 1 and H2 are equal, the variation of the passing point information P1 and the passing point information P2 is the passing point P2 information and the extended projection point information P.
The extension projection point information Pe is detected, paying attention to the fact that it is equal to the variation with e2.

Specifically, from the X and Y axis components (P2x, P2y) of the passing point information P2, the X and Y axis components (P1x, P1y) of the passing point information P1 and the X and Y axes of the passing point information P2 are obtained. By subtracting the variation from the component (P2x, P2y), the X and Y axis components (Pex, Pe) of the extended projection point information Pe.
y) is simply detected.

Pex = P2x− (P1x−P2x) Pey = P2y− (P1x−P2y) (∵H1 = H2) (Equation 2) It should be noted that the substantially extended projection point detecting means 1 is used as the input tablet 12
And indicator 11, input controller 102 and CPU 103
The input controller 102 is composed of (P1x, P
1y) Only (P2x, P2y) is obtained and passed to 103,
The CPU 103 executes the calculation of Expression 2 (Pex, Pe
y) may be obtained.

Further, instead of the combination of the light emitting diode array and the phototransistor array, a combination of the light emitting diode array and the photodiode array may be used for the photosensor arrays 141 and 142. Further, in the present embodiment, for the sake of simplification of description, it is described that the distance between the first sensor surface and the second sensor surface and the distance between the second sensor surface and the input surface are equal. It may be different. However, in this case, it is necessary to multiply the second term on the right side of each equation of Equation 2 by an appropriate coefficient.

As described above, according to the second embodiment, in the position pointing operation with the pointing device such as the finger or the pen,
The projected point of the indicator on the input surface can be detected, and the position pointing operation can be performed with a natural feel as if the tip of the indicator extended to the input surface. The operability of can be improved.

According to the second embodiment, it is also possible to detect the vertical tilt angle information of the indicator with respect to the input surface and the plane angle information of the indicator with respect to the input surface.

Also in the second embodiment, it is not necessary for the indicator to contact the input surface. Therefore, the visibility of the cursor is less deteriorated by being hidden by the indicator or the like, as compared with an indicator that needs to be in contact with the input surface. Therefore,
Depending on the circumstances, the detection position of the optical sensor array closest to the input surface may be detected as a substantially vertical projection point of the tip of the indicator with respect to the input surface, and this point may be processed as the point Pe.

The third embodiment of the present invention will be described below.

FIG. 6 shows the configuration of the input / output integrated information processing apparatus according to the third embodiment.

In the figure, 1 is a substantially extended projection point detecting means for detecting a substantially extended projection point, 2 is a substantially extended projection point position adjusting means for adjusting the position of the substantially extended projection point, and 4 is an adjusted substantially extended projection point. The cursor display means 5 for controlling the display of the cursor according to the position of the cursor 5 is a display device such as a liquid crystal display for displaying the cursor.

Further, the substantially extended projection point detection means 1 includes a substantially vertical projection point detection means 15 for detecting a substantially vertical projection point of the tip of the substantially indicator on the substantially input surface, and a substantially vertical projection detected by the substantially vertical projection point detection means. Point information, approximate diameter information of the tip of the approximate indicator,
It comprises a simplified extended projection point detecting means 16 for obtaining a substantially extended projection point of the indicator with respect to the substantially input surface by using information on the substantially vertical tilt angle of the indicator with respect to the substantially input surface.

The input / output integrated information processing apparatus according to the third embodiment is realized, for example, by the configuration shown in FIG. 2, similarly to the input / output integrated information processing apparatus according to the first embodiment. .

The contents of the substantially extended projection point position adjusting means 2, the cursor display means 4, and the display device 5 are the same as those in the first embodiment.

Therefore, the substantially extended projection point detecting means 1 different from the first embodiment will be described.

The substantially vertical projection point detection means 15 of the substantially extended projection point detection means 1 has an input tablet 12 and an input controller.
La 102. Further, the indicator does not need any special one, unlike the first embodiment. In addition, it is possible to input directly with a finger, and in this case, an indicator is not required. In the third embodiment, the reference numeral 1 is a finger or an indicator.
Shown at 51. In the following description, a finger is assumed.

Further, the input tablet 12 used in the third embodiment is a pressure sensitive tablet for detecting the pressure contact position with the finger, which is indicated by reference numeral 152 below. However,
Capacitive type, capacitive coupling type, instead of pressure sensitive type tablet,
An electromagnetic induction type or ultrasonic type tablet may be used.

The operation of the substantially vertical projection point detecting means 15 will be described below with reference to FIG.

In FIG. 7, D is the diameter of the finger or the tip of the indicator, α is the inclination angle of the indicator in the vertical direction with respect to the input surface, and β is the plane angle of the indicator with respect to the input surface. Initialize in consideration of the state. further,
Pv indicates a vertical projection point of the indicator tip on the input surface detected by the tablet, and Pe indicates an extended projection point of the indicator on the input surface.

The reference numeral 15 designates a substantially vertical projection point detecting means.
Reference numeral 6 indicates a simplified type extended projection point detecting means.

When the input tablet 152 is pressed by the finger 151, the input controller 102 detects and captures this coordinate, that is, the vertical projection point Pv (Pvx, Pvy).

The simplified extended projection point detection means 16 of the extended projection point detection means 1 is realized by a program executed by the input controller 102 or the CPU 103.
The following processing is performed.

That is, from the vertical projection point Pv detected by the substantially vertical projection point detecting means 15, the indicator inclination angle α and the indicator tip diameter D, the indicator plane angle β is obtained as shown in equation 3 (Equation 1). A direction indicator extension projection component (D ÷ cos α) is obtained, and further X and Y components (Pvx, P of the vertical projection point Pv are obtained.
vy), the X and Y axis components ((D ÷ cosα × cosβ), (D ÷ cosα ×) of the indicator extension projection component, respectively.
sin β)) is subtracted to simply detect the X and Y axis components (Pex, Pey) of the substantially extended projection point Pe of the indicator 151.

[0071]

[Equation 1]

In practice, the diameter information D at the tip of the indicator,
The vertical direction tilt angle information α and the plane angle information β may be fixed values, and in this case, the second term of each equation is a fixed value. Therefore, in this case, only a fixed value obtained directly by experiments may be initialized as the second term of each equation in advance.

The vertical tilt angle information α and the plane angle information β may be constant values for all input surfaces, but more preferably, they change depending on the coordinates of the vertical projection point Pv (Pvx, Pvy). Appropriate values (α (xy), β (xy)) are used. This is because these angles change depending on the designated position on the input surface.

Now, in this way, the substantially extended projection point information P
When e is obtained, the substantially extended projection point position adjusting means 2 adjusts the adjustment information to the X and Y axis components (Pex, Pey) of the detected substantially extended projection point information Pe according to the equation 1 as in the first embodiment. By subtracting the X and Y axis components (Kx, Ky) of K, the X and Y axis components (Pex ',
Pey '). If unnecessary, this process is omitted.

Pex ′ = Pex−Kx Pey ′ = Pey−Ky (Equation 1) After that, the cursor display means 4 is the same as in the first embodiment.
Is the extended projection point P adjusted by the extended projection point position adjusting means 2.
The display data of the display memory 105 is changed so as to display the cursor having e ′ as the pointer and Pe ′ as the pointer.

Then, in the display device 5 composed of the display memory 105, the display controller 106 and the display device 107, the display data stored in the display memory 105 by the cursor display means 4 is changed to the display controller.
It is displayed on the display device 107 by the laser 106.

FIG. 8 shows the cursor thus displayed.

As shown in the figure, according to the third embodiment,
The cursor is displayed on the extension line of the finger.

In the following, it will be shown that the cursor thus displayed can favorably indicate the target position.

FIG. 9 shows the method of the experiment conducted by the present inventors.

As shown in the figure, the present inventors first of all, in order to obtain an appropriate value as the value of the second term on the right side of the equation 3, according to the third embodiment, a cursor (for convenience, This was called "finger cursor"), and the time required for pointing the target figure (pointing time) was measured.

The test subjects were three inexperienced fingers, and a 10-inch display (640.times.480 dots) was installed on the display device at a tilt of 45.degree. After a desk keyboard. . Then, with respect to each test subject, the distance between the vertical projection point Pv and the substantially extended projection point Pe was changed for two target sizes of 4 × 4 dots and 16 × 16 dots, and each measurement was performed 20 times in succession. Was performed 3 times. The position of the substantially extended projection point information Pe is the position actually designated.

FIG. 11 shows the result.

As shown, a 16 × 16 dot pattern
For the get figure, the pointing time did not change so much even if the distance between the vertical projection point Pv and the substantially extended projection point information Pe was changed, but for the target figure of 4 × 4 dots, the pointing time was changed. A small area, a small variation area, and an increasing area were observed. In the area with little fluctuation, the distance between the vertical projection point Pv and the substantially extended projection point Pe is 20 to 40 dots, and the minimum value was obtained at 30 dots.

Therefore, the inventors of the present invention assume that the distance between the vertical projection point Pv and the substantially extended projection point information Pe is 20 to 40 dots, and the optimum distance is 30 dots.
The term is set so that the distance between the vertical projection point Pv and the substantially extended projection point information Pe is 30 dots, and 4 × 4 dots and 16 ×
For 16-dot two-size target figures,
According to the procedure shown in FIG. 9, the pointing time and the rate at which the target figure could be accurately indicated (hit rate) were measured. Further, conventional position input methods such as direct pointing of a target figure with a mouse, keyboard or finger, direct pointing of a target figure with a pen, etc. were similarly measured and compared. Direct designation of a target figure with a finger is shown in FIG. 10b.
As shown in, the target figure is indicated by the touch position Pv of the finger. The X and Y axis components (Kx, Ky) of the adjustment information K are (0, 0). The conditions of the subject, the display device, and the number of measurements are the same as those described above.

The results are shown in FIG.

As shown in the figure, the pointing time is
In the target figure with a size of 16 × 16 dots, no difference was observed depending on the input method, but with the target figure with a size of 4 × 4 dots, it was better than direct pointing with a pen or finger. It was equivalent to a mouse. Also, the hit rate is 16 × 16 dots in the target figure,
Although no difference was observed depending on the input method, the target figure with a size of 4 × 4 dots was better than direct pointing with a pen or finger, and was similar to a mouse.

Therefore, according to the third embodiment, it is considered that the operability is excellent as compared with the conventional input method using a finger or a pen type indicator.

As described above, according to the present embodiment, it is possible to detect and adjust the substantially extended projection point of the indicator with respect to the substantially input surface in the position indicating operation with the indicator such as a finger or a pen. Since the extended projection point can be confirmed with a cursor that looks like the indicator has extended, it can be positioned without being affected by parallax, and with the natural feeling that the approximate tip of the indicator has extended to the input surface in response to usage conditions. Since the pointing operation can be performed, the operability such as the position pointing operation with the pointing device such as a pen or a finger can be improved. Further, since the substantially extended projection point detecting means can be realized by a simple configuration, it is possible to reduce the size and weight of the entire system and reduce the cost.

In the above embodiments, the shape of the cursor is shown as a triangle, but it may be another shape such as an arrow shape. Further, the display method such as filling or blinking in the cursor may be arbitrary. Further, the width of the cursor may be about the same as or wider than the width of the finger or the indicator, or smaller than that. However, if the width of the cursor is made substantially equal to the tip end tip diameter, a more natural feeling can be obtained.

Further, the substantially extension point detecting means 1 of each of the embodiments, which also includes an input tablet and an input controller, or the substantially extension point detecting means 1 and the substantially extension point adjusting means 6 are integrated and independent. The input tablet device may be configured. In this case, the input tablet device is provided with output means for outputting the position information of the substantially extended projection point or the adjusted substantially extended projection point to the outside.

[0092]

As described above, according to the present invention, the fingers,
It is possible to provide an input / output integrated information processing device capable of improving the operability of position information input using a pointing device such as a pen.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of an input / output integrated information processing apparatus according to a first embodiment of the present invention.

FIG. 2 is a block diagram showing a specific configuration of the input / output integrated information processing apparatus according to the first embodiment of the present invention.

FIG. 3 is an explanatory diagram showing an operation of the substantially extended projected point detecting means according to the first embodiment of the present invention.

FIG. 4 is an explanatory diagram showing a display state of a cursor in the first embodiment of the present invention.

FIG. 5 is an explanatory diagram showing a structure of an input tablet according to a second embodiment of the present invention.

FIG. 6 is a block diagram showing a configuration of an input / output integrated information processing apparatus according to a third embodiment of the present invention.

FIG. 7 is an explanatory diagram showing the operation of the substantially extended projected point detecting means according to the third embodiment of the present invention.

FIG. 8 is an explanatory diagram showing a display state of a cursor in the third embodiment of the present invention.

FIG. 9 is a first explanatory diagram showing the contents of an experiment conducted by the present inventors.

FIG. 10 is a second explanatory diagram showing the contents of an experiment conducted by the present inventors.

FIG. 11 is an explanatory diagram showing a result of a first experiment.

FIG. 12 is an explanatory diagram showing a second experimental result.

[Explanation of symbols]

 1 Substantially Extended Projection Point Detection Means 2 Substantially Extended Projection Point Adjustment Means 3 Substantially Extended Projection Point Output Means 4 Cursor Display Means 5 Display Device 6 Substantially Extended Projection Point Adjustment Means

 ─────────────────────────────────────────────────── ─── Continuation of the front page (72) Inventor Michihiro Mese, 292 Yoshida-cho, Totsuka-ku, Yokohama, Kanagawa Pref., Hitachi, Ltd. Microelectronics Equipment Development Laboratory (72) Inventor, Yasumasa Matsuda Totsuka, Yokohama, Kanagawa 292 Yoshida-cho, Tokyo Inside the Hitachi, Ltd. Microelectronics Device Development Laboratory

Claims (19)

[Claims] 1. A display device and a substantially transparent input tablet on which the input surface is placed on the display surface of the display device for outputting pointing coordinates which are coordinates on the input surface pointed by a finger or an indicator. An integrated information processing device comprising: and pointing coordinates output by the input tablet,
Means for obtaining the pointing direction extension point coordinates from a predetermined set value that gives an offset to the pointing coordinates, and enabling the display device to identify the point on the display surface of the display device corresponding to the obtained pointing direction extension point coordinates. An input / output integrated information processing apparatus, comprising: a display processing unit for displaying. 2. The input / output integrated information processing apparatus according to claim 1, wherein the display processing means includes a point on the display surface of the display device, the point corresponding to the obtained coordinate in the pointing direction extension point. An input / output integrated information processing device characterized by displaying a cursor. 3. The input / output integrated information processing apparatus according to claim 2, wherein the display device includes means for displaying a graphic for accepting designation of a requested process, and the cursor displayed on the display device. An input / output integrated information processing apparatus, comprising: a processing unit that executes a process according to a graphic instructed on a display surface. 4. A pointing device for outputting input position coordinates, the input tablet outputting pointing coordinates which are coordinates on an input surface pointed by a finger or an indicator, and pointing coordinates output by the input tablet. ,
A pointing direction extension point detecting means for obtaining pointing direction extension point coordinates from a predetermined set value for offsetting the pointing coordinates; and means for outputting the obtained pointing direction extension point coordinates as input position coordinates. And pointing device. 5. An integrated information processing apparatus comprising: the pointing device according to claim 4; and a processing device that performs processing in accordance with input position coordinates output by the pointing device. 6. The input / output integrated information processing apparatus according to claim 1, 2, or 3, wherein the pointing direction extension point detecting means is set with information on a diameter of a set finger or a tip of the pointing device. An input / output integrated information input / output device, characterized in that the pointing direction extension point coordinates are obtained using information on the inclination angle of the finger or the pointing device in the vertical direction with respect to the input surface and the pointing coordinates. 7. The input / output integrated information processing apparatus according to claim 6, wherein the information on the inclination angle in the vertical direction is information on a plurality of inclination angles set in association with each coordinate of the input surface. The pointing direction extension point detecting means uses, as the information on the vertical tilt angle, information on the vertical tilt angle set in association with the coordinates of the input surface designated by the pointing coordinates. An input / output integrated information input / output device characterized in that the coordinates of the extension point of the indicated direction are obtained. 8. The input / output integrated information processing apparatus according to claim 6 or 7, wherein said pointing direction extension point detecting means has information on a set diameter of the finger or the tip of the pointing device, and the finger or pointing. In addition to information on the inclination angle of the device in the vertical direction with respect to the input surface and the pointing coordinates, information on the inclination angle of the set finger or indicator with respect to a predetermined reference line on the input surface in the input surface direction. An input / output integrated information input / output device, characterized in that the coordinates of the extension point of the designated direction are obtained by using. 9. The input / output integrated information processing apparatus according to claim 6, wherein the information of the information on the inclination angle in the input surface direction is a plurality of inclination angles set in association with each coordinate of the input surface. The pointing direction extension point detecting means, as the information of the tilt angle in the input surface direction, the tilt angle in the input surface direction set in association with the coordinates of the input surface designated by the pointing coordinates. An input / output integrated information input / output device, characterized in that the coordinates of the extension point of the designated direction are obtained using the information of (1). 10. A pointing device for outputting input position coordinates, comprising: an input tablet for outputting pointing coordinates, which are coordinates of a position on an extension of a direction indicated by a finger or an indicator on a detection surface, A pointing device comprising: means for outputting the pointing coordinates obtained by the input tablet as input position coordinates. 11. The pointing device according to claim 10, further comprising an indicator and a detector, wherein the indicator includes a light emitting unit that emits light in a direction indicated by the indicator. Is provided with a plurality of photodetection elements arranged in a matrix on the detection surface, and a control means for determining the pointing coordinates according to the photodetection status of the plurality of photodetection elements. Pointing device. 12. The pointing device according to claim 10, wherein the plurality of light emitting elements are arranged so that the optical paths are in a lattice pattern on one plane, and the plurality of light emitting elements detect the light emitted from each of the light emitting elements. Each of which is provided with a light detection element, a plurality of detectors, and a control means for determining the pointing coordinates according to the light detection situation of the plurality of detectors, each of the detectors, a grid-like optical path. Each composed plane is
A pointing device, which is sequentially placed above the detection surface so as to be parallel to the detection surface. 13. A pointing device for outputting input position coordinates, comprising: an indicator and a detector, wherein the indicator emits light in a specific direction relative to the indicator. Wherein the detector comprises a plurality of photo-detecting elements arranged in a matrix on a plane, and a control means for obtaining the pointing coordinates according to the photo-detecting conditions of the plurality of photo-detecting elements. Pointing device characterized by. 14. A pointing device for outputting input position coordinates, each of which detects a plurality of light emitting elements arranged so that an optical path is in a lattice shape on one plane and light emitted by each light emitting element. A pointing device comprising: a detector including a plurality of photodetector elements; and a control unit that obtains the pointing coordinates according to the light detection status of the plurality of detectors. 15. A processing device, and claim 10, 11, 12,
13. The pointing device according to 13 or 14, wherein the processing device includes a display device and a processing unit that performs a process according to input position coordinates output by the pointing device, and the pointing device displays the display of the display device. An integrated information processing device, wherein the detection surface is placed on a surface. 16. The pointing device according to claim 4, 10, 11, 12, 13 or 14, further comprising means for correcting the input position coordinates in accordance with the coordinate values. apparatus. 17. A display device and a substantially transparent input tablet having the input surface placed on the display surface of the display device for outputting pointing coordinates which are coordinates on the input surface pointed by a finger or an indicator. A method of accepting designation of a position in an integrated information processing device comprising: a step of capturing pointing coordinates output from the input tablet; and a step of capturing the pointing coordinates on the input surface or the display surface from the captured pointing coordinates. Alternatively, a position designation accepting method comprising: a step of estimating a position on an extension of the direction indicated by the indicator, and a step of performing a process according to the estimated position. 18. The input / output integrated information processing apparatus according to claim 2, wherein the display processing means is on a display surface of the display device and corresponds to a pointing coordinate output by the input tablet. And an input / output integrated information processing device, which displays a cursor having a shape substantially including a point corresponding to the obtained extension point coordinates of the designated direction. 19. The input / output integrated information processing apparatus according to claim 2, wherein said display processing means is a pointing coordinate output by said input tablet on a display surface of said display device. Is displayed on the display surface of the display device, the cursor having a shape having a straight line connecting the point corresponding to the point and the point corresponding to the obtained extension point coordinate of the indicated direction as the central axis. Output integrated information processing device.