JP2002082766A - Information processor with handwriting input function, hadwriting input method, and recording medium recorded with program for handwriting input - Google Patents

Abstract

PROBLEM TO BE SOLVED: To input desired handwriting without re-input due to misinput even in the case of a hand shake in an information processor having a function of inputting characters and graphics by handwriting on a screen by using a pen, etc. SOLUTION: This information processor has an acceleration sensor which detects the X-directional acceleration of the information processor and an acceleration sensor which detects the Y-directional acceleration. It is judged (S3-9) that a handshake is caused when the X-directional and Y-directional acceleration values that those acceleration sensors detect exceed predetermined thresholds and the X-directional and Y-directional movement distances of the information processor are calculated (S3-10) by integrating the detected X-directional and Y-directional acceleration values twice; and the quantity of deviation from the start position of the handwriting input is calculated (S3-11) by adding the calculated movement distance together, the input positions of the character and figure which have been shifted owing to the hand shake are corrected by the deviation quantity (S3-12), and rendering processing based upon the corrected input coordinates is carried out (S3-13).

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing apparatus having a handwriting input function, a handwriting input method, and a recording medium storing a handwriting input program, and more particularly to a display unit using a liquid crystal or the like and an input unit such as a touch panel. The present invention relates to a technique for correcting camera shake that occurs when a character or a figure is input by handwriting using a pen or the like on a display screen in which is combined.

[0002]

2. Description of the Related Art Heretofore, it has been possible to input characters and figures by hand on a display screen of a portable information processing device using a pen or the like. In addition, if the amount of movement of the pen per unit time is larger than a predetermined range, an erroneous input is taken, and measures against camera shake due to shaking of a bus or a train are taken.

[0003]

However, in the above-described conventional example, although erroneous input can be prevented, there is inconvenience and inconvenience that correct input must be performed again.

The present invention has been made in order to solve such a problem, and an object of the present invention is to eliminate the need for re-input due to erroneous input even if a camera shake occurs due to shaking of a bus or a train. It is an object of the present invention to provide an information processing apparatus having a handwriting input function capable of correctly inputting a desired handwriting, a handwriting input method, and a recording medium storing a handwriting input program.

[0005]

In order to achieve the above object, a first aspect of the present invention is to provide a handwriting input means for inputting characters and graphics on a display screen by hand using a pointing tool such as a pen. In an information processing apparatus comprising a hand shake detection means for detecting hand shake having an information processing apparatus when handwriting input is performed by an input means, it is determined whether or not a hand shake has occurred according to a detection output of the hand movement detection means. And a shift amount caused by a shake from a start position of the handwriting input is calculated based on a detection value detected by the shake detection means when the shake determination unit determines that the shake has occurred. A computing unit; and an input position correcting unit configured to correct an input position of the character or the figure by an amount deviated by the camera shake based on a calculation result of the calculating unit.

Here, the camera shake detecting means includes an acceleration sensor for detecting acceleration in the X direction of the information processing apparatus, and an acceleration sensor for detecting the acceleration.
An acceleration sensor for detecting an acceleration in a direction, wherein the camera shake determining means determines that camera shake has occurred when accelerations in the X direction and the Y direction detected by the camera shake detecting means exceed predetermined thresholds, and The means calculates the moving distance in the X direction and the Y direction of the information processing device by integrating the accelerations in the X direction and the Y direction detected by the camera shake detecting means, and adds the calculated moving distances to perform handwriting input. And calculating a shift amount caused by a camera shake from the start position.

The camera shake detecting means is a detecting means for detecting a moving distance of the information processing apparatus in the X direction and the Y direction, and the camera shake determining means is a moving distance in the X direction and the Y direction detected by the camera shake detecting means. Is determined to be larger than a predetermined threshold value, the calculating means adds the movement distances in the X direction and the Y direction detected by the camera shake detecting means, so that the camera shake from the start position of the handwriting input is obtained. The amount of deviation caused by the above is calculated.

[0008] The present invention is also characterized in that it is possible to input characters or figures by hand using a finger instead of the pointing device.

The image processing apparatus may further include drawing processing means for performing drawing processing based on the coordinates of the input position corrected by the input position correction means.

[0010] The information processing apparatus may be a portable information processing apparatus having a display unit in which a liquid crystal display unit and a touch panel are combined as the display screen. In order to achieve the above object, the invention of claim 7 provides:
Handwriting input means for handwriting input of characters and figures on a display screen using a pointing tool such as a pen, and handshaking detection means for detecting handshaking having an information processing device when handwriting input is performed with the handwriting input means. In a handwriting input method of an information processing apparatus provided with a camera shake determining step of determining whether or not camera shake has occurred according to a detection output of the camera shake detecting means, and when it is determined that camera shake has occurred in the camera shake determining step A calculating step of calculating a shift amount caused by a camera shake from a start position of handwriting input based on a detection value detected by the camera shake detecting means; and a shift caused by the camera shake based on a calculation result in the calculation step. And an input position correcting step of correcting the input position of the character or graphic by an amount.

[0011] In order to achieve the above object, an invention according to an eleventh aspect is a camera shake which detects a hand shake having an information processing apparatus when handwriting input of characters and figures on a display screen using a pointing tool such as a pen. What is claimed is: 1. A recording medium recording a program for performing a handwriting input process by a computer of an information processing apparatus provided with a detection unit, the program being executed by a computer to determine whether a camera shake has occurred according to a detection output of the camera shake detection unit. Is determined, and if it is determined that camera shake has occurred, the amount of shift caused by camera shake from the start position of handwriting input is calculated based on the detection value detected by the camera shake detection means. The input position of the character or graphic is corrected based on the displacement caused by the camera shake based on the movement.

(Operation) According to the present invention, an information processing apparatus having a function of handwriting input of characters and figures on a screen using a pen or the like and a function of detecting a camera shake using the pen or the like has the above configuration. If the hand shakes due to shaking, the input position (drawing position) is corrected by the amount of deviation from the start position of handwriting input, so even if shaking of the bus or train occurs, It is not necessary to perform re-input due to erroneous input, and a desired handwriting can be correctly input to the information processing apparatus.

[0013]

Embodiments of the present invention will be described below in detail with reference to the drawings.

FIG. 1 shows a schematic configuration of an information processing apparatus according to an embodiment of the present invention. In the figure, 1 is a CPU
(Central processing unit), 2 is a display unit such as an LCD (liquid crystal display), 3 is an input unit such as a touch panel or a keyboard, 4a is an acceleration sensor that detects acceleration in the X direction, and 4b is a acceleration sensor that detects acceleration in the Y direction. Acceleration sensor,
5 is an RO for storing items whose rewriting frequency is low.
A first memory such as M (read only memory), 6 is a second memory such as a flash memory for storing items whose rewriting frequency is higher than that of the first memory 5, and 7 is mainly stored in the second memory 6. And a third memory such as a RAM (random access memory) used for a work area of a program. These components are connected via a bus.

The character recognition dictionary file stored in the first memory 5 is a file composed of handwriting patterns required for character recognition of handwritten characters, and is mainly used by a character recognition engine.

The handwriting input function stored in the second memory 6 implements the present invention, and includes a handwriting input process in a flowchart of FIG. 3 described later. The character recognition engine stored in the second memory 6 includes an algorithm for character recognition of handwritten characters, and is mainly called from a handwriting input function.

In the present embodiment, the character recognition dictionary file in the first memory 5 and the character recognition engine in the second memory 6 are for correcting handwriting of handwritten characters and figures. This corresponds to a file necessary for the handwriting input function to recognize handwritten characters.

The work area secured in the third memory 7 is an area used by a handwriting input function, a character recognition engine, and the like for calculation processing and the like. (X, y) is an area for storing coordinate correction values of X coordinate value and Y coordinate value indicating input coordinates of handwritten characters and figures. (X _n , y _n ) are
This area stores X coordinate values and Y coordinate values indicating input coordinates and corrected coordinates of handwritten characters and figures. (X _d , y
_d ) is an area for storing the X-direction movement distance and the Y-direction movement distance indicating the distance the information processing apparatus has moved due to camera shake. s_flg is a start point flag indicating whether or not the start point of the stroke has already been input. When the start point has already been input, 1 is substituted. When the start point has not been input, 0 is substituted.

FIG. 2 schematically shows an example of a handwriting input screen in the present embodiment. Here, 2 is the display unit described with reference to FIG. 1, 8 is a pen for handwriting input of characters and graphics on the display unit 2, 9 is the starting point coordinates of the handwriting by the pen 8, 10 is the input coordinates of the handwriting by the pen 8, Reference numeral 11 denotes a handwriting actually moved by the pen, and reference numeral 12 denotes a corrected handwriting to which the present invention is applied.

FIG. 3 is a flowchart showing an example of the procedure of the handwriting input process in the present embodiment. In the present embodiment, the pen 8 is brought into contact with and moved on the screen of the display unit 2 to input characters and figures by hand, and
The acceleration sensor 4a in the direction and the acceleration sensor 4b in the Y direction detect the acceleration of the information processing apparatus in the X and Y directions, respectively. Then, the moving distance of the information processing apparatus in the Y direction is calculated, and the input coordinates of the handwriting of the pen 8 are corrected based on the calculated value, whereby the desired handwriting is correctly input. Hereinafter, these realizing methods will be described with reference to the flowchart of FIG.

First, in step S3-1, initialization is performed by substituting 0 for each of the coordinate correction values (x, y).

In a succeeding step S3-2, a start point flag s
The initialization is performed by substituting 0 into _flg.

Next, in step S3-3, stores the input coordinate (x _n, y _n) X coordinate value of the input point of handwriting by the respective pen 8 on the Y-coordinate values. Actually, step S
It is necessary to determine whether or not a handwriting has been input before step 3-3. However, in this embodiment, the description is omitted because it is not important. Steps S3-3 to S3-13
Up to this is a loop for handwriting input of one stroke.

In step S3-4, it is determined whether or not the handwriting input is pen-up. Although this determination method depends on the system, for example, FFF is used as the coordinate value.
When Fh is returned, pen up may be considered. In the case of pen-up, the flow proceeds to step S3-5, and in the case of normal handwriting input, the flow proceeds to step S-6.

In step S3-5, a pen-up process is performed. Although this processing depends on the system, it is conceivable to perform processing for setting the next input as the starting point of the stroke. One stroke is completed and terminated by pen-up.

In step S3-6, it is determined whether the input of the handwriting is the starting point of the stroke. This determination is made based on whether the start point flag of s_flg is 0 or 1, and when it is 0, the start point is determined. If it is the start point, the procedure goes to step S3-7, and if it is not the start point, the procedure goes to step S-8.

In step S3-7, since the starting point has been input, 1 is substituted for the flag of s_flg. As the subsequent processing does not require the processing of camera shake, step S
Go to 3-13 to perform drawing processing.

In step S3-8, the acceleration in the X direction and the acceleration in the Y direction applied to the information processing device are detected using the acceleration sensor 4a for detecting the acceleration in the X direction and the acceleration sensor 4b for detecting the acceleration in the Y direction. are doing.

In step S3-9, it is determined whether or not camera shake has occurred. When either or both accelerations in the X direction and the Y direction are detected, it is determined that the information processing apparatus has moved due to camera shake. If camera shake has occurred, the process proceeds to step S3-10, and if camera shake has not occurred, the process proceeds to step S3-12.

In step S3-10, step S3-
The acceleration detected in Step 8 is integrated twice, and the X direction and Y from the previous input coordinates (x _n-1 , y _n-1 ) are calculated using the integration result.
The moving distance in the X direction and the moving distance in the Y direction are calculated as x _d and y _{d in} the third memory 7, respectively.
Store in the area of. Incidentally, x _d, the value stored in y _d are + and - is with a code.

[0031] Step S3-11 previous coordinate correction value at (x, y) current moving distance obtained in step S3-10 to (x _d, y _d) by adding a current coordinate correction value (x , Y). Note that the values of x and y are provided with + and-signs.

In the next step S3-12, the actual input
Mark (x_n , Y_n ) Is the coordinate complement obtained in step S3-11.
By adding the positive values (x, y), the coordinates (x
_n , Y _n ) Is calculated. In step S3-9, the camera shakes.
If it is determined that this has not occurred, step S
At 3-12, the actual input coordinates (x_n , Y_n ) Until last time
By adding the coordinate correction values (x, y) of
Mark (x_n , Y_n ) Is calculated.

In step S3-13, step S3-1
The coordinates (x_n , Y _n ) Draw based on
Perform processing. Specifically, the coordinates (x_n , Y
_n ), Or draw the previous input coordinates (x_n-1 ,
y_n-1 ) And the current input coordinates (x _n , Y_n ) And a straight line
Is drawn on the display unit 2. After drawing
Returns to step S3-3, and starts again from acquisition of input coordinates.
Confuse.

By the above processing, the handwriting input processing for inputting one stroke is performed. In order to draw a character or one or more figures, the handwriting input process can be realized by looping or the like.

Therefore, in the present embodiment, by the above processing, handwriting input of characters and figures is performed by the pen, and the X direction and the Y direction are respectively input by the acceleration sensor 4a and the acceleration sensor 4b.
When the acceleration of the information processing device in the direction is detected and it is determined that camera shake has occurred, the moving distance of the information processing device due to the camera shake in the X direction and the Y direction is calculated from the detected acceleration, and the movement distance is calculated. Since the input coordinates of the handwriting with the pen are corrected, the desired handwriting can be correctly input to the information processing device.

Further, in the present embodiment, the moving distance of the information processing apparatus is obtained by using the acceleration sensor. However, this may be performed by any means.
It goes without saying that a position detecting means such as S (Global Positioning System) may be used. In this case, X detected by the position detecting means
When the moving distance in the direction and the Y direction exceeds a predetermined threshold, it is determined that camera shake has occurred, and the moving distance in the X direction and the Y direction detected by the position detecting means is added, so that the starting position of the handwriting input is calculated. Will be calculated.

(Other Embodiments) Even if the present invention is applied to a system composed of a plurality of devices (for example, a host computer, an interface device, a reader, a printer, etc.), an apparatus comprising one device (For example, a copying machine, a facsimile machine, etc.).

Another object of the present invention is to supply a recording medium (storage medium) recording a program code of software for realizing the functions of the above-described embodiments to a system or an apparatus, and a computer of the system or the apparatus. Needless to say, the present invention is also achieved when the CPU (or the CPU or the MPU) reads out and executes the program code stored in the recording medium.

In this case, the program code itself read from the recording medium implements the functions of the above-described embodiment, and the recording medium on which the program code is recorded constitutes the present invention.

As a recording medium for recording the program code and for recording variable data such as a table, for example, a floppy disk (FD), hard disk, optical disk, magneto-optical disk, CD-ROM (a type of optical disk), CD-ROM R (a type of optical disk), magnetic tape, memory card, ROM, or the like can be used.

When the computer executes the readout program code, not only the functions of the above-described embodiment are realized, but also the operating system (OS) running on the computer based on the instruction of the program code. It goes without saying that an operating system) may perform some or all of the actual processing, and the processing may realize the functions of the above-described embodiments.

[0042]

As described above, according to the present invention,
In an information processing apparatus having a function of handwriting input of characters and figures on a screen using a pen or the like and a function of detecting hand shake, if a hand shake occurs with the information processing apparatus, the start position of handwriting input is determined. The input position (drawing position) is corrected by the amount of deviation, so that even if hand shake due to shaking of a bus or a train occurs, there is no need to perform re-input due to erroneous input, and a desired handwriting is correctly input. It becomes possible.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration example of an information processing apparatus according to an embodiment of the present invention.

FIG. 2 is a schematic diagram illustrating an example of a handwriting input screen according to an embodiment of the present invention.

FIG. 3 is a flowchart illustrating a procedure of a handwriting input process according to an embodiment of the present invention.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 CPU 2 Display part 3 Input part 4a Acceleration sensor 4b Acceleration sensor 5 First memory 6 Second memory 7 Third memory 8 Pen 9 Start point coordinates 10 Input point coordinates 11 Pen handwriting 12 Handwriting after correction

Claims (14)

[Claims] 1. A handwriting input unit for inputting characters and figures on a display screen by handwriting using a pointing tool such as a pen, and a hand shake having an information processing device is detected when handwriting input is performed by the handwriting input unit. An information processing apparatus comprising: a camera shake detecting means; a camera shake determining means for determining whether or not camera shake has occurred in accordance with a detection output of the camera shake detecting means; and Calculating means for calculating an amount of shift caused by camera shake from the start position of the handwriting input based on the detection value detected by the camera shake detecting means; and an amount of shift caused by the camera shake based on the calculation result of the arithmetic means. And an input position correcting means for correcting an input position of the character or graphic. 2. The apparatus according to claim 1, wherein said camera shake detecting means includes an X
An acceleration sensor for detecting the acceleration in the Y direction, and an acceleration sensor for detecting the acceleration in the Y direction.
If the acceleration in the direction and the Y direction exceeds a predetermined threshold, it is determined that camera shake has occurred. The arithmetic means integrates the acceleration in the X direction and the Y direction detected by the camera shake detection means to perform information processing. The moving distance of the apparatus in the X direction and the Y direction is calculated, and the calculated moving distance is added to calculate a shift amount caused by a camera shake from a start position of the handwriting input. Information processing device. 3. The apparatus according to claim 2, wherein said camera shake detecting means is an X of the information processor.
Detecting means for detecting the movement distance in the direction and the Y direction, wherein the camera shake determining means detects the X detected by the camera shake detecting means.
When the movement distance in the direction and the Y direction exceeds a predetermined threshold, it is determined that camera shake has occurred, and the arithmetic unit adds the movement distance in the X direction and the Y direction detected by the camera shake detection unit, thereby performing handwriting. 2. The information processing apparatus according to claim 1, wherein a shift amount caused by a camera shake from a start position of the input is calculated. 4. The information processing apparatus according to claim 1, wherein a handwriting input of a character or a figure by a finger can be performed instead of the pointing device. 5. The information processing apparatus according to claim 1, further comprising a drawing processing unit that performs a drawing process based on the coordinates of the input position corrected by the input position correction unit. . 6. The information processing device according to claim 1, wherein the information processing device is a portable information processing device having a display unit combining a liquid crystal display unit and a touch panel as the display screen. Information processing device. 7. A handwriting input means for handwriting input of characters and figures on a display screen using a pointing tool such as a pen, and a hand shake having an information processing device is detected when handwriting input is performed by the handwriting input means. In a handwriting input method for an information processing apparatus including a camera shake detecting means, a camera shake determining step of determining whether a camera shake has occurred according to a detection output of the camera shake detecting means, and a camera shake occurring in the camera shake determining step When it is determined that the hand movement has been detected, a calculation step of calculating a shift amount caused by a camera shake from the start position of the handwriting input based on the detection value detected by the camera shake detection means, based on a calculation result in the calculation step An input position correcting step of correcting an input position of the character or graphic by an amount shifted by the camera shake. 8. The camera shake detecting means according to claim 1, wherein
An acceleration sensor for detecting the acceleration in the direction, and an acceleration sensor for detecting the acceleration in the Y direction. In the camera shake determination step, the acceleration in the X direction and the Y direction detected by the camera shake detection means exceeds a predetermined threshold. In this case, it is determined that camera shake has occurred. In the calculation step, X detected by the camera shake detection means is determined.
By calculating the integral of the acceleration in the direction and the acceleration in the Y direction, the moving distance in the X direction and the Y direction of the information processing apparatus is calculated, and by adding the calculated moving distances, the displacement caused by the hand shake from the start position of the handwriting input is calculated. The handwriting input method according to claim 7, wherein the amount is calculated. 9. The information processing apparatus according to claim 1, wherein
Detecting means for detecting the movement distance in the direction and the Y direction, wherein, in the camera shake determination step, if the movement distance in the X direction and the Y direction detected by the camera shake detection means exceeds a predetermined threshold, camera shake has occurred. In the calculating step, the X detected by the camera shake detecting means is determined.
8. The handwriting input method according to claim 7, wherein a shift amount caused by hand shake from a start position of the handwriting input is calculated by adding the moving distance in the direction and the moving direction in the Y direction. 10. The handwriting input method according to claim 7, further comprising a drawing processing step of performing a drawing processing based on the coordinates of the input position corrected in the input position correction step. . 11. A handwriting input process of an information processing apparatus having a hand shake detecting means for detecting a hand shake having an information processing apparatus when a character or a figure is handwritten on a display screen using a pointing tool such as a pen. Is a recording medium on which a program for performing a computer is recorded, the program causing the computer to determine whether or not camera shake has occurred according to the detection output of the camera shake detection means, and to determine that camera shake has occurred. In this case, the amount of shift caused by the shake from the start position of the handwriting input is calculated based on the detection value detected by the shake detection means, and based on the calculation result, the character or the character corresponding to the shift caused by the shake is calculated. A recording medium storing a program for handwriting input, wherein the program corrects the input position of a figure. 12. The camera shake detecting means comprises an acceleration sensor for detecting an acceleration of the information processing apparatus in the X direction and an acceleration sensor for detecting the acceleration in the Y direction of the information processing apparatus. When the detected accelerations in the X and Y directions exceed a predetermined threshold, it is determined that camera shake has occurred, and the X and Y accelerations detected by the camera shake detection means are integrated to calculate the information processing. 12. The handwriting according to claim 11, wherein the moving distances of the apparatus in the X direction and the Y direction are calculated, and the moving distances are added to calculate a shift amount caused by a camera shake from a start position of the handwriting input. A recording medium on which an input program is recorded. 13. The camera shake detection means is a detection means for detecting a moving distance of the information processing apparatus in the X direction and the Y direction, and the program instructs the computer to execute the X and Y directions detected by the camera shake detection means. When the moving distance exceeds a predetermined threshold, it is determined that a camera shake has occurred. The recording medium according to claim 11, wherein the shift amount is calculated. 14. The program according to claim 11, wherein said program causes a computer to perform a drawing process based on the corrected coordinates of the input position. The recording medium on which it was recorded.