WO2012163124A1

WO2012163124A1 - Spatial motion-based input method and terminal

Info

Publication number: WO2012163124A1
Application number: PCT/CN2012/072063
Authority: WO
Inventors: 赛斌; 郑伟
Original assignee: 中兴通讯股份有限公司
Priority date: 2011-05-31
Filing date: 2012-03-07
Publication date: 2012-12-06
Also published as: CN102810015A; CN102810015B

Abstract

The present invention relates to a spatial motion-based input method and system. The method comprises: an operator moving an input terminal in a space according to the shape of an object to be identified, the input terminal executing the following steps: collecting effective motion trail data, the motion trail data at least comprising three-dimensional spatial data; projecting the motion trail data respectively onto three two-dimensional planes that are orthogonal to one another, so as to obtain three groups of motion trail projection data; calculating an area occupied by a corresponding motion trail projection according to the motion trail projection data, determining the two-dimensional plane where the motion trail projection having the largest area locates as an effective plane; and identifying an input object according to the motion trail projection of the effective plane or a mirror image of the motion trail projection. The method and system in the present invention overcome the application limit of the conventional input method.

Description

Input method and terminal based on space motion

Technical field

The present invention relates to input technologies, and in particular, to a spatial motion based input method and terminal.

Background technique

With the rapid development of mobile communication technology and the increasing demand for user experience, mobile terminal products are increasingly diversified and personalized. Especially in terms of human-computer interaction, users are eager to use more convenient, more humane, and break through traditional methods. The traditional mobile terminal character input and function operation are realized by the keyboard. There is inconvenient operation of the key set. The Chinese character input needs to combine the input methods such as pinyin and five strokes, and the input speed is slow and not intuitive. The emerging touch screen human-computer interaction method requires the mobile terminal to have a stylus and a large touch screen. The input can only be realized when the touch screen is used, and the user's input or operation instruction cannot be responded to at any time and quickly. The application of technologies such as gravity sensing enables the terminal to recognize the simple actions of the user, but currently it is limited to a single application such as screen unlocking and simple game operation, and does not support flexible setting of certain actions and specific operational commands that need to be performed according to user habits. Correspondence does not support the input of characters or graphics through gravity sensing. The gravity sensing technology currently applied to mobile terminals cannot accurately capture the spatial position change of the terminal, and can only recognize simple directional motion, and the application range is limited.

Summary of the invention

The technical problem to be solved by the present invention is to provide a spatial motion based input method and system to solve the problem of limited application of the input method.

In order to solve the above technical problem, the present invention provides a spatial motion based input method in which an operator moves an input terminal in space according to the shape of an object to be recognized, and the input terminal performs the following steps:

Collecting effective motion trajectory data, the motion trajectory data including at least three-dimensional spatial data; Projecting the motion trajectory data onto three orthogonal two-dimensional planes to obtain three sets of motion trajectory projection data;

Calculating an area occupied by the corresponding motion trajectory projection according to the motion trajectory projection data, and determining a two-dimensional plane in which the motion trajectory with the largest area is projected as an effective plane;

The input object is identified based on the motion trajectory projection of the effective plane or the image of the motion trajectory projection.

Preferably, the three two-dimensional planes are a horizontal plane and two vertical planes orthogonal to the horizontal plane, respectively.

Preferably, if the image of the motion trajectory projection or the motion trajectory projection according to the effective plane cannot identify the input object, the method further comprises: rotating the effective plane by a specific angle with the intersection line of the other two planes as an axis. , rotating once every step, calculating the area of the motion trajectory projected on the new plane after the rotation, if the area projected by the motion trajectory on the new plane is smaller than the area projected by the motion trajectory of the effective plane, the rotation in this direction is stopped, and the direction is reversed. Step rotation; if the new plane works as the corrected effective plane, re-identify the image of the motion trajectory projection or motion trajectory projection on the modified effective plane. If it still cannot be recognized, continue to step in the direction. Rotate, repeat the above process until the preset stop condition can be recognized or reached.

Preferably, the image recognition input object according to the effective plane or the corrected motion trajectory projection or the motion trajectory projection comprises: identifying the input object according to the motion trajectory projection, and if not recognized, projecting the motion trajectory The horizontal axis or the vertical axis is mirrored, and the input object is identified according to the motion trajectory projection image.

Preferably, the input object is a Chinese character, and the motion trajectory data and the motion trajectory projection data further include time information and/or a stroke index, and the motion trajectory projection or motion trajectory according to the effective plane or the modified effective plane The projected image recognition input object includes:

Determining, according to the time information of the corresponding two-dimensional plane position, whether the motion trajectory projection of the effective plane conforms to the writing order of the Chinese characters, and if yes, identifying the input object according to the motion trajectory projection, otherwise projecting the motion trajectory Regarding the horizontal axis or the vertical axis as a mirror map, the input object is identified based on the motion trajectory projection image. Preferably, before determining the effective plane, the input terminal determines whether the time interval between valid motion track data is greater than a preset value, and if the time interval is greater than a preset value, the object to be identified is considered to be complete, according to the complete The motion trajectory corresponding to the object to be identified determines the effective plane, otherwise it continues to collect the next effective motion trajectory data.

Preferably, the input terminal has an input switch controlled by an operator, and the input switch is implemented by software or hardware, and the input terminal controls the start or stop of the motion data data collection according to the state of the input switch. The validity of the motion trajectory data; the input terminal uses a multi-directional gravity sensing technique, a gyroscope or an invisible light localization technique to collect motion trajectory data.

Preferably, the object to be identified is a Chinese character, a Chinese character stroke, a letter, a number, a symbol, a graphic or a custom shape representing a specific instruction.

Preferably, the area occupied by the motion trajectory projection on each two-dimensional plane is the maximum distance of the motion trajectory projected in the horizontal axis direction of the two-dimensional plane and the maximum of the motion trajectory projected in the longitudinal axis direction of the two-dimensional plane. The product of the spacing.

To solve the above technical problem, the present invention also provides an input terminal based on spatial motion, the input terminal comprising:

a data collection unit, configured to: collect data of an effective motion trajectory of the input terminal, the motion trajectory data includes at least three-dimensional spatial data, and the motion trajectory is an operator moving the input terminal in space according to the shape of the object to be identified traces of;

a plane projection unit, configured to: project the motion trajectory data onto three orthogonal two-dimensional planes to obtain three sets of motion trajectory projection data;

An effective plane determining unit is configured to: calculate an area occupied by the corresponding motion trajectory projection according to the motion trajectory projection data, and determine a two-dimensional plane in which the motion trajectory with the largest area is projected as an effective plane;

An input object recognition unit is configured to: identify an input object according to a motion trajectory projection of the effective plane or a mirror image of the motion trajectory projection.

Preferably, the input terminal further includes: The effective plane correction unit is configured to: after the input object recognition unit fails to identify, correct the effective plane, including: rotating the current effective plane by a certain angle with the intersection line of the other two planes as an axis, Rotate once per step, calculate the area of the motion trajectory projected on the new plane after the rotation. If the area projected by the motion trajectory on the new plane is smaller than the area projected by the motion trajectory of the effective plane, the rotation in this direction is stopped, and the direction is reversed. Step rotation; if the area projected by the motion trajectory on the new plane is larger than the area projected by the motion trajectory of the effective plane, the new plane is used as the corrected effective plane; the effective plane correction unit repeats the above process until the Until the preset stop condition is reached;

The input unit identification unit is further configured to: identify an input object according to a motion image of the corrected effective plane or a mirror image of the motion trajectory projection.

Preferably, the data collection unit is further configured to: the input object is a Chinese character, the motion trajectory data of the set and the motion trajectory projection data obtained by the planar projection unit further include time information and/or a stroke index;

The input object identification unit includes:

The writing sequence identification module is configured to: time information and/or a stroke index to determine whether the motion trajectory projection of the effective plane conforms to the writing order of the Chinese characters;

The projection recognition module is configured to: when the motion trajectory projection conforms to a writing order of a Chinese character, and identify the input object according to the motion trajectory projection;

The image mapping module is configured to: when the motion trajectory projection does not conform to the writing order of the Chinese characters, project the motion trajectory on the horizontal axis or the vertical axis; and

The mirror projection recognition module is configured to: identify the input object according to the motion trajectory projection image.

Preferably, the input terminal further includes an input switch and a data collection control unit, wherein: the input switch is implemented by software or hardware, and is controlled by an operator;

The data collection control unit is configured to: identify an input switch state, and control the data collection unit to collect the start and end of the motion trajectory data or determine the validity of the collected motion track data according to the input switch state.

Preferably, the input terminal further includes an input integrity identifying unit, configured to: determine that the validity is valid Whether the time interval between the motion track data is greater than a preset value, and if the time interval is greater than a preset value, it is considered that the object to be identified is completely input;

The effective plane determining unit is further configured to: determine an effective plane according to the motion track projection corresponding to the complete object to be identified.

Preferably, the input object recognition unit comprises a projection recognition module, a mirror image mapping module and a mirror projection recognition module, wherein:

The projection recognition module is configured to: identify the input object according to the motion trajectory projection; and the mirror image mapping module is configured to: when the motion trajectory projection is not recognized, project the motion trajectory about a horizontal axis or a vertical axis Do mirror mapping;

Preferably, the data collection unit is configured to: collect multi-dimensional spatial data of the motion trajectory by using a multi-directional gravity sensing technique, a gyroscope or an invisible light localization technique.

According to the input method and the input terminal of the spatial motion, the embodiment of the present invention projects the three-dimensional spatial data moved by the input terminal in any space onto the two-dimensional plane, and determines the effective value of the projected area on the two-dimensional plane according to the motion trajectory. The plane recognizes the input object according to the projection or projection image on the effective plane, thereby implementing the input of the corresponding character, graphic or operation instruction according to the terminal movement trajectory, overcoming the limitations of the existing input method. BRIEF abstract

1 is a schematic diagram of an embodiment of an input method based on spatial motion according to the present invention;

2 is a schematic diagram of still another embodiment of a spatial motion based input method according to the present invention;

3 is a schematic diagram of mapping of a terminal moving track to a 5-dimensional coordinate system; 4 is a schematic diagram of mirror image mapping processing on a character projection;

5 is a schematic diagram of an embodiment of a spatial motion based input terminal of the present invention;

6 is a schematic diagram of still another embodiment of a spatial motion based input terminal of the present invention. BEST MODE FOR CARRYING OUT THE INVENTION The main idea of the input method based on spatial motion and the input terminal of the present invention is to collect motion trajectory data including three-dimensional spatial data that the input terminal moves in an arbitrary space, and project it onto a two-dimensional plane, according to the motion. The maximum value of the projected area of the trajectory on the two-dimensional plane determines the effective plane, and recognizes the input object according to the projection or projection image on the effective plane, thereby realizing the input of the corresponding character, graphic or operation instruction according to the movement trajectory of the terminal, overcoming the present There are limitations on the input method.

Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict.

The invention is based on an input method of spatial motion, and the operator moves the input terminal in space according to the shape of the object to be recognized, according to specific input method types, such as pinyin input method, stroke input method, English input method, digital input method, symbol input method, The graphic input method, the object to be identified may be a Chinese character, a stroke of a Chinese character, a letter, a number, a symbol, a graphic or a custom shape representing a specific instruction, and the input terminal performs the steps shown in FIG. 1 :

Step 101: Collecting effective motion trajectory data, where the motion trajectory data includes at least three-dimensional spatial data;

Preferably, the input terminal has an input switch controlled by an operator, and the input switch is implemented by software or hardware, and the input terminal controls the start or stop of the motion data data collection according to the state of the input switch. The validity of the trajectory data.

The input terminal can collect motion trajectory data by using multi-directional gravity sensing technology, gyroscope or invisible light positioning technology.

Step 102: Project the motion trajectory data onto three orthogonal two-dimensional planes to obtain three sets of motion trajectory projection data. Preferably, the three two-dimensional planes are respectively horizontal and orthogonal to the horizontal plane. Two vertical faces;

Step 103: Calculate a corresponding motion trajectory projection according to the motion trajectory projection data The area is determined as an effective plane by the two-dimensional plane in which the motion track of the largest area is projected. Preferably, before determining the effective plane, the input terminal determines whether the time interval between the valid motion track data is greater than a preset value. If the time interval is greater than the preset value, it is considered that the object to be recognized is completely input, and the effective plane is determined according to the motion trajectory corresponding to the complete object to be identified, otherwise the next effective motion track data is continuously collected.

The area occupied by the motion trajectory projection on each two-dimensional plane is the product of the maximum distance of the motion trajectory projected in the horizontal axis direction of the two-dimensional plane and the maximum distance of the motion trajectory projected in the longitudinal axis direction of the two-dimensional plane. .

Step 104: Identify an input object according to a motion trajectory projection of the effective plane or an image of a motion trajectory projection.

In the specific implementation, the local database matching or moving image projection or motion trajectory projection image can be matched or matched by Chinese characters, Chinese characters, letters, numbers, symbols, graphics or custom shapes representing specific instructions.

Specifically, step 104 may have the following two preferred solutions according to the collected motion trajectory data: Option 1: Step 104 includes:

The input object is identified according to the motion trajectory projection. If not recognized, the motion trajectory projection is mirrored on the horizontal axis or the vertical axis, and the input object is recognized according to the motion trajectory projection image.

Scenario 2: The input object is a Chinese character, and the motion track data and the motion track projection data further include time information and/or a stroke index. Step 104 specifically includes:

Determining, according to the time information of the corresponding two-dimensional plane position, whether the motion trajectory projection of the effective plane conforms to the writing order of the Chinese characters, and if yes, identifying the input object according to the motion trajectory projection, otherwise projecting the motion trajectory Regarding the horizontal axis or the vertical axis as a mirror map, the input object is identified based on the motion trajectory projection image. After performing step 104, if it still cannot be recognized, the input terminal can prompt to re-enter and end the process.

Preferably, when the data is unrecognizable, the effective plane is corrected and re-identified, that is, after step 104, the following steps are performed: The effective plane (ie, the plane with the largest projected area selected according to step 103) is rotated in a stepwise manner (for example, 15°) with its intersecting line with the other two planes as an axis, preferably, with one revolution, The area projected by the motion trajectory on the new plane after the rotation, if the area projected by the motion trajectory on the new plane is smaller than the area projected by the motion trajectory of the effective plane, the rotation in this direction is stopped, and the rotation is performed in the reverse direction; The area projected by the motion trajectory is larger than the area projected by the motion trajectory of the effective plane, and the new plane is used as the corrected effective plane. According to the above step 104, the mirror image of the motion trajectory projection or the motion trajectory projection on the corrected effective plane is performed. Identification, if still not recognized, continue to rotate in this direction, repeat the above process until the preset stop condition (such as the rotation number threshold or the recognition time threshold) can be recognized or reached.

A specific input flow for collecting 5-dimensional motion trajectory data is given below with reference to the accompanying drawings. The core of this is to establish a 5-dimensional coordinate system, collect the spatial position, time and stroke index information of the mobile terminal from the start of the stroke to the end of the stroke in real time, and use this information to comprehensively judge and select an easy-to-recognize meaningful content. The projection plane completes the character recognition, and converts the track of the terminal movement into corresponding characters, graphics or operation instructions, and realizes input of characters, graphics or operation instructions. As shown in FIG. 2, and in conjunction with FIG. 3 and FIG. 4, the method described in this patent includes the following steps:

Step 201: Before inputting the first stroke of 1 character or 1 graphic, a 5-dimensional coordinate system is established inside the mobile terminal, and the starting coordinates (x, y, z, t, n) of the mobile terminal are initialized to be (xl, yl). , zl, tl, l) , where x, y, z are points on the spatial 3-dimensional xyz coordinate system, wherein the xy plane is the horizontal plane, the yz plane and the zx plane are vertical planes orthogonal to the xy plane, and t represents Time, n represents the nth stroke currently inputting the character or graphic, ie n is the stroke index;

Taking the input Chinese character "and" in Figure 3 as an example, before starting the input, the coordinate system is established, and the coordinates of the first pen starting point 301 are initialized to (xl, yl, zl, tl, l);

Step 202: Start input, the operator holds the mobile terminal to move the stroke of the character or the graphic as needed in any free space, so that the trajectory of the mobile terminal sliding in the free space is consistent with the stroke of the character or graphic to be input. ;

Taking the input Chinese character "and" in Fig. 3 as an example, the terminal slides in free space according to the stroke order of the bold solid line characters "and" in Fig. 3. The bold dotted line in the figure is the track in which the terminal slides in space. Yz, zx plane projection; Step 203: The mobile terminal determines whether the flag of the pen is detected, if it is detected, proceeds to step 204, otherwise returns to step 201;

In FIG. 3, the mobile terminal 313 has a black button 314. When a new one starts to input, the button is pressed immediately, and the button is kept pressed until the end of the pen input operation is released, that is, the button is pressed. Is a pen mark, and releasing the button is a stop pen mark;

The determination of the start and end time of each stroke is achieved by using a dedicated hardware switch for indicating the start and end time of the pen. When each stroke starts to start the pen, the hardware switch is pressed, and the switch remains held during the stroke writing process. Pressing the state, until the stroke of the stroke is finished, the switch is released; Step 204: The mobile terminal collects the position, time information and stroke index of the plurality of samples starting from the current stroke in real time, and saves as 5-dimensional coordinates (x, y, z, t, n);

The real-time collection of the spatial location of the mobile terminal can employ various technologies, such as multi-directional gravity sensing technology, gyroscope, invisible light positioning technology, and the like;

Step 205: The mobile terminal determines whether the stop pen flag is detected. If it is detected, step 206 is performed. Otherwise, step 204 is repeated. The detection of the pen stop flag also uses the button 314, and the button 314 is changed from pressed to The released action represents the stop pen mark;

Step 206: The mobile terminal determines whether the input action of all strokes of the currently input character or graphic is completed, if yes, proceed to step 207, otherwise return to step 203;

Whether the inputting action of all the strokes of the input character or the graphic before the judgment is completed can be realized by not detecting a new starting flag, a dedicated soft/hardware switch, etc. for a long time;

Step 207: The mobile terminal respectively projects all the 5-dimensional coordinate points of all the strokes of the character or graphic collected by the mobile terminal to the xy plane, the yz plane, and the zx plane of the xyz coordinate system, and the first 3 dimensions of the 5-dimensional coordinates when projecting ( x, y, z) is directly performed according to the geometric projection of the xyz coordinate system. The latter 2 dimensions (t, n) of the 5D coordinates are directly projected onto the xy plane, the yz plane, and the new coordinates after the zx plane without any transformation. The coordinates after projection become (x, y, t, n), ( y, z, t, n ), ( ζ, χ, ΐ, η);

For example, in the figure 3, the input "and" has a total of 8 strokes, and the first stroke point is 301.

(xl, yl, zl, tl, l), the coordinates of the first pen stop point 302 are (x2, y2, z2, t2, l), and the point 305 of the first pen point mapped to the yz plane is (yl' , zr, tl, l), the coordinates of point 309 mapped to the zx plane are ( χΓ ', ζΓ ', ΐΙ, Ι ), and the coordinates of point 306 of the first pen ending point mapped to the yz plane are ( y2 ', z2 ' ,t2,l ), The coordinates of the point 310 mapped to the zx plane are (x2", z2", t2, l); the coordinates of the eighth pen point 303 are (x3, y3, z3, t3, 8), and the coordinates of the eighth pen stop point 304 ( X4, y4, z4, t4, 8), the point 307 of the eighth pen point mapped to the yz plane is (y3', z3', t3, 8), and the point 311 mapped to the zx plane is (x3", Z3", t3, 8), the point 308 of the eighth pen point mapped to the yz plane is (y4', z4', t4, 8), and the point 312 mapped to the zx plane is (x4", z4" , t4, 8), in the coordinates of the above points, t4>t3>t2>tl. .

That is to say, the time coordinate and the stroke index coordinate in the projected coordinates remain unchanged, and it is still the time and stroke index of the coordinates collected before the projection.

Step 208: Calculate the maximum area occupied by the projection of the character or graphic in the xy plane, the yz plane, and the zx plane, respectively (also referred to as the area of the motion trajectory projection) S _xy , S _yz , S _zx , and find S _xy , s _The largest value of _yz and s _zx , and the plane where the maximum value is selected is the effective plane, and the projection on the plane where the maximum value is initially selected is the projection used for character recognition;

The maximum value of the area occupied by the projection in the xy plane is:

Sxy— I ( Xmax-Xmin ) I * I ( ymax_ymin ) |

In the above formula, S _xy represents the maximum area occupied by the projection of the character or graphic in the xy plane, and x _max and y _max respectively represent the maximum values of X and y in all the sample coordinates of the character or graphic projected on the xy plane. , x _mm and y _mm represent the minimum values of X and y in all the sample coordinates of the character or graphic projected on the xy plane, respectively;

Similarly, the maximum value of the area occupied by the projection in the yz plane is:

Syz— I ( ymax-Ymin ) I * I ( Z _max -Z _m i _n ) |

In the above formula, S _y ^ represents the maximum area occupied by the projection of the character or graphic in the yz plane, and y _max and z _max respectively represent the maximum of y and z in all the sample coordinates of the character or graphic projected on the yz plane. The values, y _mm and z _mm represent the minimum values of y and z, respectively, of all the sample coordinates projected by the character or graphic on the yz plane;

The formula for calculating the maximum area occupied by the zx plane projection is:

S _zx — I ( Z _max _Z _m i _n ) I * I ( Xmax_Xmin ) |

In the above formula, S _zx represents the maximum area occupied by the projection of the character or graphic in the zx plane, and z _max and x _max respectively represent the maximum values of z and X in all the sample coordinates of the character or graphic projected on the zx plane. , z _mm and x _mm represent the coordinates of all the sample points of the character or graphic projected on the ZX plane, respectively. And the minimum value of X;

In Fig. 3, from the sum of the "and," word projections, it can be seen that S _zx >S _yz > S _xy , where S _xy is 0, so the projection of the word "and" in the zx plane is initially selected as the character recognition. projection;

Step 209: According to the stroke index n of the coordinates of the projected sample points initially selected in step 208 and the horizontal and vertical coordinates of each stroke of the sample, the relative position between the strokes can be obtained, according to the relative index between the stroke index and the stroke. The position determines whether the projection conforms to the stroke order of the general characters from top to bottom and from left to right. If yes, directly uses the selected projection as the projection used for the final character recognition. If not, the projection is used. The coordinates of the projection are mirrored on the horizontal axis or the vertical axis in the plane, so that the projected projection conforms to the stroke order of the normal characters from top to bottom and from left to right, and the projection after the mirror mapping is used as the final The projection used for character recognition;

Judging whether the initially selected projection conforms to the stroke order of the general characters from top to bottom and from left to right, in addition to using the stroke index and the horizontal and vertical coordinates of each stroke, the time coordinate of the projection can also be utilized. t, make a more accurate judgment.

For example, in FIG. 3, the projection of the word "and" in the zx plane is initially selected as a projection of the character recognition according to step 208, and the first stroke of the projection is obtained by comparing the stroke index and the abscissa of all the projections of the projection. All the abscissas are smaller than the abscissa of the 8th pen, indicating that the 8th pen of the projection is on the left side of the 1st pen, which does not conform to the writing order of the general Chinese characters from top to bottom and left to right, in order to facilitate subsequent Character recognition, you need to mirror the projection on the z-axis according to the method of Figure 4. After the mirroring process, the first pen-start point of the projection becomes 309, ( -xl", zl", tl, l), the first stroke The pen point becomes 310, ( -x2", z2", t2, l ), the eighth pen point becomes 311 ' ( -x3", z3", t3, 8 ), and the eighth pen point becomes 312. ' ( -x4", z4", t4, 8 ) , the coordinates of all the samples of all the other strokes are also mirrored, and the projection after the mirroring is completed as the projection for the final character recognition and character recognition.

Step 210: The mobile terminal determines whether it is necessary to input a character, a graphic or an operation instruction, if it is an input operation instruction, the process proceeds to step 211, and if it is necessary to input characters and graphics, the process proceeds to step 212;

In practice, it is possible to indicate whether a character, a graphic, or an operation command needs to be input through a soft/hardware switch before starting the input action;

Step 211: The operation instruction that the mobile terminal presets and saves in its own memory Searching for the character or graphic identified in step 209 with the character or graphic correspondence table. If it finds that there is a corresponding instruction, the instruction is executed and then returns to step 201. If no corresponding instruction is found, the process returns directly to step 201;

Step 212: The mobile terminal inputs the character or graphic recognized in step 209, performs character recognition according to an algorithm similar to the two-dimensional plane handwriting recognition, and completes input of a character or an instruction, and returns to step 201 after input.

If some of the instructions in the mobile terminal are encoded into a specific character or graphic in advance, the method can be used to flexibly realize the identification and execution of various action instructions of the user.

As can be seen from the above description, the basic principle of effective plane selection is to make the projection area of characters in the plane as large as possible, thereby achieving fast and accurate recognition. If the final selected projection in step 212 is not recognized as a meaningful character, then preferably an effective plane correction procedure can be performed, exemplifying Figs. 3 and 4, preferably by setting the xz plane around the z-axis by 15. Rotating for the step angle, calculating the area of the motion trajectory on the new plane after the rotation after each step of rotation, if the area projected by the motion trajectory on the new plane is smaller than the area projected by the motion trajectory of the effective plane, the direction is stopped. Rotate, and rotate in the opposite direction in combination with Figure 3. If the rotation is in the negative half-axis direction of the y-axis, the projected area is reduced, and the rotation should be stopped to rotate in the positive half-axis direction of the y-axis; if the motion trajectory is projected on the new plane If the area is larger than the area of the motion trajectory projected by the effective plane, the image of the motion trajectory projection or the motion trajectory projection on the new plane is identified according to the above step 209, and if it is still not recognized, the step rotation is continued in the direction, and the image is repeated. The above process until the preset stop condition (such as the rotation number threshold or the recognition time threshold) can be recognized or reached.

In the method, the information of the 5-dimensional coordinates of the character samples collected by the 釆 can be more fully utilized, and the spatial position, time and stroke index of the sample point are used to calculate the acceleration and establish a mathematical model of the movement trajectory of the terminal. Character recognition.

By applying the input method based on the 5-dimensional coordinate positioning mobile terminal according to the present invention, accurate dynamic positioning of the spatial position of the mobile terminal can be realized and the motion track can be converted into characters and graphics, and characters and graphics without special media can be realized in a natural state. Input. Joint recognition based on spatial position and time signal set, record stroke index, xyz coordinate space projection, etc. The solution can greatly improve the recognition rate of the mobile terminal motion track as characters and graphics.

In addition, by presetting certain instruction codes in the mobile terminal to specific characters or graphics, the method described in this patent can be used to flexibly realize the recognition and execution of various action instructions of the user, thereby making the input method more convenient and more convenient. Humanization is also very helpful for people with visual impairments. It can also be used as an alternative input solution if the mobile terminal keyboard or touch screen suddenly fails, which is beyond the reach of other input methods.

Corresponding to the above method, the present invention further provides an embodiment of an input terminal based on spatial motion. As shown in FIG. 5, the input terminal includes:

a data collection unit, configured to collect data of an effective motion trajectory of the input terminal, where the motion trajectory data includes at least three-dimensional spatial data, and the motion trajectory is a trajectory of the operator moving the input terminal in space according to the shape of the object to be identified The object to be identified is a Chinese character, a stroke of a Chinese character, a letter, a number, a symbol, a graphic, or a custom shape representing a specific instruction.

a plane projection unit, configured to respectively project the motion trajectory data onto three orthogonal two-dimensional two-dimensional planes to obtain three sets of motion trajectory projection data, preferably, the three two-dimensional planes are respectively a horizontal plane and Two vertical faces orthogonal to the water level;

An effective plane determining unit, configured to calculate an area occupied by the corresponding motion track projection according to the motion trajectory projection data, and determine a two-dimensional plane in which the motion trajectory with the largest area is projected as an effective plane;

An input object identifying unit is configured to identify an input object according to a motion trajectory projection of the effective plane or a mirror image of the motion trajectory projection.

The projection recognition module is configured to identify the input object according to the motion trajectory projection; and the mirror image mapping module is configured to mirror the motion trajectory about a horizontal axis or a vertical axis when the motion trajectory projection is unrecognizable Mapping A mirror projection recognition module is configured to identify the input object according to the motion trajectory projection image. The data collection unit collects three-dimensional spatial data of the motion trajectory by using a multi-directional gravity sensing technique, a gyroscope or an invisible light localization technique.

Alternatively, the input object is a Chinese character, the motion trajectory data collected by the data collection unit and the motion trajectory projection data obtained by the planar projection unit further include time information and/or stroke index; another implementation of the input device For example, as shown in FIG. 6, it is different from the input device shown in FIG. 5 in that the input object recognition unit includes:

The writing sequence identification module is configured to determine whether the motion trajectory projection of the effective plane conforms to the writing order of the Chinese characters according to the time information and/or the stroke index;

The projection recognition module is configured to: when the motion trajectory projection conforms to a writing order of a Chinese character, identify the input object according to the motion trajectory projection;

The image mapping module is configured to perform mirror image mapping on the horizontal axis or the vertical axis when the motion trajectory projection does not conform to the writing order of the Chinese characters;

A mirror projection recognition module is configured to identify the input object according to the motion trajectory projection image. Further, the input terminal further includes an input switch and a data collection control unit, wherein: the input switch is implemented by software or hardware, and is controlled by an operator;

And a data collection control unit, configured to identify an input switch state, and control, according to the input switch state, the data collection unit to collect the start and end of the motion trajectory data or determine the validity of the collected motion trajectory data.

Preferably, the input terminal further includes an input integrity identifying unit, configured to determine whether a time interval between valid motion track data is greater than a preset value, and if the time interval is greater than a preset value, determining that the object to be identified is completely input; The effective plane determining unit is configured to determine an effective plane according to a motion trajectory corresponding to the complete object to be identified.

The present invention further provides an embodiment of the input terminal based on the spatial motion, which is different from the embodiment shown in FIG. 5 and FIG. 6 in that the input terminal further includes:

The effective plane correction unit is configured to correct the effective plane after the input object recognition unit fails to identify, and includes: dividing the current effective plane by a certain angle with the intersection line of the other two planes (for example, 15). Step rotation, rotate once per step, calculate the new plane after rotation The area projected on the motion trajectory, if the area projected by the motion trajectory on the new plane is smaller than the area projected by the motion trajectory of the effective plane, the rotation is stopped in the direction, and the rotation is reversed in the opposite direction;

Then, the new plane is used as the corrected effective plane; the effective plane correcting unit repeats the above process to directly recognize or reach a preset stop condition (such as a rotation number threshold or a recognition time threshold).

Preferably,

The intersecting line of the plane is rotated for the axis;

The input unit identification unit is further configured to identify an input object according to a mirror image of the motion trajectory projection or the motion trajectory projection of the modified effective plane.

The above description is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

INDUSTRIAL APPLICABILITY The embodiment of the present invention is based on a spatial motion input method and an input terminal, and projects a three-dimensional spatial data moving in an arbitrary input space onto a two-dimensional plane, and the maximum projected area on the two-dimensional plane according to the motion trajectory. The value determines the effective plane and identifies the input object based on the projected or projected image on the effective plane, thereby enabling input of corresponding characters, graphics, or operational commands based on the terminal movement trajectory, overcoming the limitations of existing input methods.

Claims

Claim

1. An input method based on spatial motion, the operator moves the input terminal in space according to the shape of the object to be identified, and the input terminal performs the following steps:

Collecting effective motion trajectory data, the motion trajectory data includes at least three-dimensional spatial data; and the motion trajectory data is respectively projected onto two orthogonal two-dimensional two-dimensional planes to obtain three sets of motion trajectory projection data;

2. The method of claim 1 wherein the three two-dimensional planes are a horizontal plane and two vertical planes orthogonal to the horizontal plane, respectively.

3. The method according to claim 1, wherein if the image of the motion trajectory projection or the motion trajectory projection according to the effective plane does not recognize the input object, the method further comprises: rotating each step by step, and calculating a new plane after the rotation The area projected by the motion trajectory, if the area projected by the motion trajectory on the new plane is smaller than the area projected by the motion trajectory of the effective plane, the rotation is stopped in the direction and rotated in the opposite direction; if the motion trajectory is projected on the new plane If the area is larger than the area projected by the motion trajectory of the effective plane, the new plane is used as the corrected effective plane, and the image of the motion trajectory projection or the motion trajectory projection on the corrected effective plane is re-identified, if still not recognized If it is out, continue to rotate in this direction and repeat the above process until the preset stop condition can be recognized or reached.

The method according to any one of claims 1 to 3, wherein the image recognition input object according to the effective plane or the corrected motion trajectory projection or motion trajectory projection comprises:

Identifying the input object according to the motion trajectory projection, if not recognized, mapping the motion trajectory to a horizontal axis or a vertical axis, and then identifying the input object according to the motion trajectory projection image.

The method according to any one of claims 1 to 3, wherein the input object is a Chinese character, the motion trajectory data and the motion trajectory projection data further include time information and/or stroke index, according to The image recognition input object of the motion trajectory projection or the motion trajectory projection of the effective plane or the modified effective plane includes:

Determining, according to the two-dimensional plane position corresponding to the time information, whether the motion trajectory projection of the effective plane conforms to the writing order of the Chinese characters, and if yes, identifying the input object according to the motion trajectory projection, otherwise projecting the motion trajectory The horizontal axis or the vertical axis is mirrored, and the input object is identified according to the motion trajectory projection image.

The method according to claim 1, wherein, before determining the effective plane, the input terminal determines whether a time interval between valid motion track data is greater than a preset value, and if the time interval is greater than a preset value, It is considered that the input of the object to be identified is complete, and the effective plane is determined according to the motion trajectory corresponding to the complete object to be identified, otherwise the next effective motion trajectory data is continuously collected.

7. The method according to claim 1, wherein the input terminal has an input switch controlled by an operator, the input switch is implemented by software or hardware, and the input terminal controls motion according to a state of the input switch. The start and end of the data data collection or the validity of the motion trajectory data of the set; the input terminal uses the multi-directional gravity sensing technique, the gyroscope or the invisible light localization technique to collect the motion trajectory data.

8. The method according to claim 1, wherein the object to be identified is a Chinese character, a stroke of a Chinese character, a letter, a number, a symbol, a graphic, or a custom shape representing a specific instruction.

9. The method according to claim 1, wherein an area occupied by the motion trajectory projection on each two-dimensional plane is a maximum pitch of the motion trajectory projected in a horizontal axis direction of the two-dimensional plane and the motion trajectory is projected The product of the maximum spacing of the two-dimensional plane in the direction of the longitudinal axis.

10. An input terminal based on spatial motion, the input terminal comprising:

a plane projection unit, configured to: project the motion trajectory data onto three orthogonal two-dimensional planes to obtain three sets of motion trajectory projection data; An effective plane determining unit is configured to: calculate an area occupied by the corresponding motion trajectory projection according to the motion trajectory projection data, and determine a two-dimensional plane in which the motion trajectory with the largest area is projected as an effective plane;

The input terminal according to claim 10, wherein the three two-dimensional planes are a horizontal plane and two vertical planes orthogonal to the horizontal plane, respectively.

The input terminal according to claim 10, wherein the input terminal further comprises: an effective plane correction unit, configured to: after the input object identification unit fails to identify, correct the effective plane, including: The effective plane is rotated step by step at a specific angle with its intersection line with the other two planes. Each step is rotated once, and the area of the motion trajectory projected on the new plane after the rotation is calculated, if the area of the motion trajectory projected on the new plane The area projected by the motion trajectory smaller than the effective plane stops rotating in the direction and rotates in the opposite direction; if the area projected by the motion trajectory on the new plane is larger than the area projected by the motion trajectory of the effective plane, the new plane is As the corrected effective plane; the effective plane correction unit repeats the above process until the preset stop condition can be recognized or reached;

The input terminal according to any one of claims 10 to 12, wherein the data collection unit is further configured to: the input object is a Chinese character, the collected motion trajectory data, and the motion obtained by the planar projection unit The trajectory projection data also includes time information and/or stroke index;

The input object identification unit includes:

The image mapping module is configured to: when the motion trajectory projection does not conform to the writing order of the Chinese characters, project the motion trajectory on the horizontal axis or the vertical axis; and The mirror projection recognition module is configured to: identify the input object according to the motion trajectory projection image.

14. The input terminal of claim 13, wherein the input terminal further comprises an input switch and a data collection control unit, wherein:

The input switch is implemented by software or hardware and controlled by an operator;

The input terminal according to claim 14, wherein the input terminal further comprises an input integrity identifying unit, configured to: determine whether a time interval between valid motion track data is greater than a preset value, if the time interval is greater than a pre- If the value is set, the object to be identified is considered to be complete;

The input terminal according to any one of claims 10 to 12, wherein an area occupied by the motion trajectory projection on each two-dimensional plane is a maximum pitch of the motion trajectory projected in a horizontal axis direction of the two-dimensional plane The product of the maximum trajectory of the motion trajectory projected in the direction of the longitudinal axis of the two-dimensional plane.

The input terminal according to claim 10, wherein the input object recognition unit comprises a projection recognition module, a mirror map module, and a mirror projection recognition module, wherein:

18. The input terminal according to claim 17, wherein the data collection unit is configured to: 釆 collect three-dimensional spatial data of the motion trajectory by using a multi-directional gravity sensing technique, a gyroscope or an invisible light localization technique.