WO2015127731A1

WO2015127731A1 - Soft keyboard layout adjustment method and apparatus

Info

Publication number: WO2015127731A1
Application number: PCT/CN2014/080319
Authority: WO
Inventors: 曾慧琼
Original assignee: 中兴通讯股份有限公司
Priority date: 2014-02-27
Filing date: 2014-06-19
Publication date: 2015-09-03
Also published as: CN104881200A

Abstract

Disclosed are a soft keyboard layout adjustment method and an apparatus. The method comprises: collecting finger movement information when a user performs soft keyboard input on a terminal, calculating a coordinate value set of finger tip movement of the user within preset time according to the finger movement information, and determining a displacement direction of a finger tip of the user on a soft keyboard according to the coordinate value set; and determining a target soft keyboard area to which the finger tip of the user will move according to pre-divided soft keyboard areas, the coordinate value set and the displacement direction, magnifying keys in the target soft keyboard area, minifying keys in other soft keyboard areas, and performing display.

Description

Soft keyboard layout adjustment method and device

The present invention relates to the field of computer technologies, and in particular, to a soft keyboard layout adjustment method and apparatus. Background technique

In the prior art, a mobile device equipped with a touch screen usually adopts a soft keyboard input mode, and the soft keyboard layout can select a full keyboard or a traditional 12-key keyboard. In a traditional 12-key keyboard, one button is shared by three to four letters, often multiple clicks to filter the target value. In the full keyboard layout, each letter has a separate button corresponding to it, and the target value can be obtained with a single click, which improves the input efficiency.

Limited by the width of the screen, the individual keys of the full keyboard are usually too narrow. In particular, portable electronic computing devices with limited width, such as mobile phones. The narrow button size is easy to cause the wrong button to be pressed, which improves the input error rate and reduces the input efficiency. Summary of the invention

In view of the problem of easy error input caused by the narrow keyboard keys in the prior art, the present invention has been made in order to provide a soft keyboard layout adjustment method and apparatus.

The embodiment of the invention provides a soft keyboard layout adjustment method, including:

The finger movement information when the user inputs the soft keyboard is collected, the coordinate value set of the finger movement of the user finger is calculated according to the finger movement information, and the displacement direction of the finger finger end of the user on the soft keyboard is determined according to the coordinate value set. ;

According to the pre-divided soft keyboard partition, the coordinate value set and the displacement direction, the target soft keyboard area to which the user's fingertip is to be moved is determined, and the keys in the target soft keyboard area are enlarged, and the keys in the remaining soft keyboard areas are reduced. And display it.

Preferably, the information about the finger movement when the user inputs the soft keyboard includes: Adjusting the terminal's own camera is capable of capturing the soft keyboard input angle, and taking the action of the user's fingertip when taking the soft keyboard input by the self-contained camera to form the finger movement information of the video data format.

Preferably, the coordinate value set of the finger movement of the user finger is calculated according to the finger movement information, and the displacement direction of the finger finger end of the user on the soft keyboard is determined according to the coordinate value set, specifically: calculating the video data by using a graphic processing algorithm The coordinate value of the user's finger pointing end of each frame of video data, and acquiring a coordinate value set of the user's finger finger movement within a predetermined time, and determining the displacement direction of the user's finger finger end on the soft keyboard according to the coordinate value set.

Preferably, according to the pre-divided soft keyboard partition, the coordinate value set, and the displacement direction, determining the target soft keyboard area to which the user's fingertip is to be moved specifically includes:

Determining, according to the coordinate value of the current user's fingertip in the coordinate value set, and the coordinate value of the pre-divided soft keyboard partition, determining the soft keyboard area where the current user's fingertip is located;

According to the soft keyboard area where the current user's fingertip is located, and the direction of displacement, the target soft keyboard area to which the user's fingertip is to be moved is determined.

Preferably, the above method further comprises: turning off or turning on the soft keyboard layout adjustment function of the terminal according to the operation of the user.

The embodiment of the invention further provides a soft keyboard layout adjusting device, comprising:

The collection module is configured to collect finger movement information when the user inputs the soft keyboard in the terminal; the calculation module is configured to calculate a coordinate value set of the movement of the fingertip of the user within a predetermined time according to the movement information of the finger, and determine according to the coordinate value set The direction of displacement of the user's finger on the soft keyboard;

The processing module is configured to determine, according to the pre-divided soft keyboard partition, the coordinate value set and the displacement direction, the target soft keyboard area to which the user's fingertip is to be moved, and enlarge the button in the target soft keyboard area, and the remaining soft keyboard area The button in the button is zoomed out and displayed.

Preferably, the collection module is specifically configured to: adjust the terminal self-contained camera to be able to capture the soft keyboard input angle, and take the action of the user's fingertip when the soft keyboard input is performed by the self-contained camera to form the finger movement information of the video data format.

Preferably, the calculating module is specifically configured to: calculate, by using a graphics processing algorithm, coordinate values of a user's fingertips of each frame of video data in the video data, and acquire coordinates of the fingertip movement of the user within a predetermined time The set of values, and the direction of displacement of the fingertip of the user on the soft keyboard is determined according to the set of coordinate values.

Preferably, the processing module is specifically configured to: determine, according to a coordinate value of a current user finger finger end in the coordinate value set, and a coordinate value of the pre-divided soft keyboard partition, determine a soft keyboard area where the current user finger finger end is located; according to the current user The soft keyboard area where the finger is pointed and the direction of displacement determine the target soft keyboard area to which the user's fingertip is to be moved.

Preferably, the device further includes: a selection module, configured to select to turn off or turn on the soft keyboard layout adjustment function of the terminal according to a user operation.

The beneficial effects of the embodiments of the present invention are as follows:

By determining the target soft keyboard area to which the fingertip of the user is to be moved and zooming according to the finger movement information when the user inputs the soft keyboard at the terminal, the error of the full keyboard input caused by the narrow key is solved in the prior art. The problem can reduce the probability of the user pressing the wrong key and improve the efficiency of the user's text input.

The above description is only an overview of the technical solutions of the present invention, and the technical means of the present invention can be more clearly understood, and can be implemented in accordance with the contents of the specification, and the above and other objects, features and advantages of the present invention can be more clearly understood. Specific embodiments of the invention are set forth below. DRAWINGS

Various other advantages and benefits will become apparent to those of ordinary skill in the art. The drawings are only for the purpose of illustrating the preferred embodiments and are not to be construed as limiting. Throughout the drawings, the same reference numerals are used to refer to the same parts. In the drawing:

1 is a flowchart of a method for adjusting a soft keyboard layout according to an embodiment of the present invention;

2 is a flowchart of detailed processing of a soft keyboard layout adjustment method according to an embodiment of the present invention; FIG. 3 is a schematic diagram of a soft keyboard partition according to an embodiment of the present invention;

4 is a schematic diagram showing the layout of the soft keyboard automatically adjusted to the left button in the embodiment of the present invention; FIG. 5 is a schematic diagram showing the layout of the soft keyboard automatically adjusted to the right button in the embodiment of the present invention; FIG. 6 is a soft keyboard according to an embodiment of the present invention; Schematic diagram of the layout adjustment device. detailed description

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While the exemplary embodiments of the present invention are shown in the drawings, it is understood that the invention may be embodied in various forms and not limited by the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be more fully understood and the scope of the disclosure can be fully conveyed by those skilled in the art.

In order to solve the problem of easy error input caused by the narrow keystroke of the full keyboard input in the prior art, the present invention provides a soft keyboard layout adjustment method and device. The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. . It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

10 method embodiments,

According to an embodiment of the present invention, a soft keyboard layout adjustment method is provided. FIG. 1 is a flowchart of a soft keyboard layout adjustment method according to an embodiment of the present invention, which includes the following processing:

Step 101: Collect finger movement information when the user inputs the soft keyboard, calculate a coordinate value set of the finger movement of the user finger within a predetermined time according to the finger movement information, and collect according to the coordinate value

15 judging the direction of displacement of the fingertip of the user on the soft keyboard;

In the embodiment of the present invention, the finger movement information of the user when performing the soft keyboard input specifically includes: adjusting the terminal self-contained camera to be able to capture the soft keyboard input angle, and photographing the user finger when performing the soft keyboard input by the self-contained camera The action of the fingertip forms the finger movement information in the video data format.

Of course, in addition to the above-mentioned camera movement information by the terminal's own camera, it can also be used.

!0 Other ways to collect. The above-described collection of finger movement information by the terminal's own camera is only a preferred embodiment of the present invention.

In step 101, the set of coordinate values of the fingertip movement of the user within a predetermined time is calculated according to the finger movement information, and the direction of displacement of the fingertip of the user on the soft keyboard according to the coordinate value set specifically includes:

!5 Calculate the coordinate value of the user's fingertip of each frame of video data in the video data through the graphics processing algorithm, and obtain the coordinate value set of the user's fingertip movement within a predetermined time, and judge according to the coordinate value set Break the direction of displacement of the user's finger on the soft keyboard.

Step 102: Determine, according to the pre-divided soft keyboard partition, the coordinate value set, and the displacement direction, the target soft keyboard area to which the user's fingertip is to be moved, and enlarge the button in the target soft keyboard area, and the remaining soft keyboard area The button is zoomed out and displayed.

In step 102, according to the pre-divided soft keyboard partition, the coordinate value set, and the displacement direction, determining the target soft keyboard area to which the user's fingertip is to be moved specifically includes:

Preferably, in the embodiment of the present invention, the soft keyboard layout adjustment function of the terminal may be turned off or on according to the operation of the user.

In the following, the technical solution of the embodiment of the present invention will be described in detail by taking the finger movement information when the user performs one-hand input on the soft keyboard through the terminal's own camera.

In the implementation of the present invention, the terminal must have at least the following components: a touch sensitive display (ie, a touch screen), a camera, and a computing control module. Preferably, the camera is located above the touch screen and can be rotated; if the camera is not rotatable, but the angle is fixed to an angle at which the touch screen can be captured. The above computing control module includes one or more calculators, controllers, and memories of the device. The technical solution of the embodiment of the present invention preliminarily judges the input intention by photographing the finger motion, and then dynamically adjusts the soft keyboard layout.

Specifically, when the user performs one-hand input through the full keyboard, the camera located above the touch screen collects video data that the finger moves on the keyboard. The video data of the finger movement collected by the 会 is sent to the calculation control module, and the coordinate value of the finger finger end in the single frame video is calculated by the graphics processing algorithm. The calculation control module calculates the recorded array of fingertip coordinate values, and calculates the displacement direction of the fingertip coordinates for a continuous period of time, thereby judging that the finger is moving in the direction of the screen. The calculation control module determines which area of the screen the fingertip is located by comparing the fingertip coordinate value with the screen partition coordinate value. And combined with the direction of the finger displacement obtained before, comprehensively determine which area of the screen the finger will move. Most After that, the calculation control module adjusts the layout of the soft keyboard, enlarges the button of the target area where the finger is moved, and the keys of the remaining areas are correspondingly reduced, and the adjusted layout is refreshed, and the new keyboard layout is displayed by the touch screen.

In the embodiment of the present invention, preferably, whether the keyboard layout is dynamically adjusted at the time of input can be selectively turned on or off by the user.

It should be noted that the soft keyboard dynamically adjusts the button size according to the pre-divided keyboard partition, and the sub-area is uniformly and dynamically adjusted, that is, the button size of the target area is uniformly enlarged, and the button size of other non-target areas is uniformly reduced. The partition can be determined based on the camera module's collection speed and the processor's calculation speed. Generally, the higher the processing speed of image collection and system, the more partitions can be divided, and the number of buttons in a single area is small. Therefore, the size of a single button can be enlarged. On the contrary, the number of partitions is small, and the number of buttons in a single area is large. The size that can be enlarged will be smaller. The design principle is to ensure that the keyboard partition is minimized and the burden of the computing system is reduced by ensuring that a single button is zoomed in to greatly reduce the false touch rate. In addition, in the embodiment of the present invention, there should be overlapping portions between the various areas of the keyboard to ensure that the keys in the critical range between the areas can be displayed normally.

The above embodiment is mainly described by taking one-handed input as an example. However, the technical solution of the embodiment of the present invention is also applicable to the two-hand input, and the processing steps are similar to the one-hand input, and details are not described herein again.

The above technical solutions of the embodiments of the present invention are described in detail below with reference to the accompanying drawings.

2 is a flowchart of detailed processing of a method for adjusting a soft keyboard layout according to an embodiment of the present invention. As shown in FIG. 2, the following specifically includes the following processing:

Step 201: The system detects that the text input box obtains focus, and starts the soft keyboard startup process. Turn the camera above the touch screen to a predetermined angle and turn on the camera. The predetermined angle is designed to ensure that the camera can capture the soft keyboard area below the screen.

Step 202, displaying a soft keyboard interface.

Step 203: The camera captures a finger motion image. The collected video data is sent to the processor for corresponding graphics algorithm calculation.

Step 204: Acquire coordinate values of the fingertips in the image by calculation and record them in an array. Steps 203 and 204 are executed cyclically, and the coordinate data of the finger end is continuously acquired and the coordinate value array is updated.

Step 205: Calculate the finger end displacement direction by using a plurality of coordinate points continuously recorded. Step 206: Determine whether the finger end horizontal coordinate is to the left of the screen horizontal center line and whether the current finger end displacement direction is to the left. If the result of the determination is true, then the process proceeds to step 207, and the result of the determination is otherwise to step 208.

Step 207: If the result of the determination in step 206 is true, the system determines that the user wants to click the button on the left side of the keyboard, and automatically adjusts the full keyboard layout.

FIG. 3 is a schematic diagram of a soft keyboard partition according to an embodiment of the present invention. As shown in FIG. 3, in the embodiment of the present invention, the keyboard is divided into two areas, left and right, which are respectively identified by black and white colors. The middle gray area is the area where the left and right areas overlap. In step 207, the buttons on the left white area and the middle gray area in the keyboard layout of Fig. 3 are widened, and the keys on the right black area are narrowed. The result is shown in Fig. 4. Then go back to step 205.

Step 208: Determine whether the finger end horizontal coordinate is on the right side of the screen horizontal center line and whether the current finger end displacement direction is to the right. If the result of the determination is true, the process goes to step 209, and the result of the determination is otherwise, and the process returns to step 205.

Step 209: If the result of the determination in step 208 is true, the system determines that the user wants to click the button on the right side of the keyboard, and automatically adjusts the full keyboard layout. In the keyboard layout of Figure 3, the buttons on the right black area and the middle gray area will be widened, and the buttons on the left white area will be narrowed. The result is shown in Figure 5. Then go back and repeat step 205.

In summary, the technical solution described in the embodiment of the present invention can pre-determine the intention of the user's button, and dynamically increase the local button of the keyboard according to the user's intention, widen the target button, and reduce the probability of the user pressing the wrong button. Improve the efficiency of text input.

Device embodiment

According to an embodiment of the present invention, a soft keyboard layout adjustment apparatus is provided, and FIG. 6 is a schematic structural diagram of a soft keyboard layout adjustment apparatus according to an embodiment of the present invention. As shown in FIG. 6, the soft keyboard layout adjustment according to an embodiment of the present invention is shown. The device includes: a collection module 60, a calculation module 62, and a processing module 64. The respective modules of the embodiments of the present invention are described in detail below.

The collection module 60 is configured to collect finger movement information when the user inputs the soft keyboard at the terminal; preferably, the collection module 60 is specifically configured to: adjust the terminal self-equipped camera to be able to capture the soft keyboard The input angle is used to capture the movement of the finger of the user in the video data format by taking the action of the user's fingertip when the soft keyboard is input.

The calculating module 62 is configured to calculate a coordinate value set of the fingertip movement of the user within a predetermined time according to the finger movement information, and determine a displacement direction of the finger finger end of the user on the soft keyboard according to the coordinate value set; 5 preferably, the calculation module 62 is specifically configured to: calculate a coordinate value of a user finger finger end of each frame of video data in the video data by using a graphics processing algorithm, and acquire a coordinate value set of the finger finger movement of the user within a predetermined time, and determine the user finger finger according to the coordinate value set; The direction of displacement on the soft keyboard.

The processing module 64 is configured to determine, according to the pre-divided soft keyboard partition, the coordinate value set, and the displacement direction, the target soft keyboard area to which the user's fingertip is to be moved, and press the 10 key in the target soft keyboard area to enlarge the rest. The buttons in the soft keyboard area are zoomed out and displayed.

Preferably, the processing module 64 is specifically configured to: determine, according to a coordinate value of a current user finger finger end in the coordinate value set, and a coordinate value of the pre-divided soft keyboard partition, determine a soft keyboard area where the current user finger finger end is located; The soft keyboard area where the user's fingertip is located, and the direction of displacement determine the target soft keyboard area to which the user's fingertip is to be moved.

Preferably, the apparatus according to the embodiment of the present invention further comprises: a selection module for selecting to disable or turn on the soft keyboard layout adjustment function of the terminal according to the user's operation.

The terminal has at least the following components, and the collection module can be a touch-sensitive display (ie, a touch screen) and a camera; the calculation module, the processing module, and the selection module can be one or more calculators, controllers, and Memory. Preferably, the camera is located above the touch screen and can be rotated; if the camera is not rotated, the angle is fixed to the angle at which the touch screen can be captured.

The detailed processing steps of the above-mentioned respective modules are understood by referring to the corresponding descriptions in the foregoing method embodiments, and details are not described herein again.

In summary, the technical solution of the embodiment of the present invention determines the target soft keyboard area to which the user's fingertip is to be moved according to the finger movement information when the user inputs the soft keyboard at the terminal, and performs the release of the target soft keyboard area. In the technology, the full keyboard input is easy to input and error caused by the narrow button, which can reduce the probability of the user pressing the wrong key and improve the efficiency of the user's text input. The spirit and scope of the Ming. Thus, it is intended that the present invention cover the modifications and the modifications of the invention

Claims

claims

1. A soft keyboard layout adjustment method, including:

Collect finger movement information when the user performs soft keyboard input on the terminal, calculate a coordinate value set of the user's finger tip movement within a predetermined time based on the finger movement information, and determine based on the coordinate value set whether the user's finger tip is in the The displacement direction on the soft keyboard;

According to the pre-divided soft keyboard partition, the coordinate value set and the displacement direction, determine the target soft keyboard area to which the user's finger tip will move, enlarge the keys in the target soft keyboard area, and move the remaining soft keyboard The keys in the area are reduced and displayed.

2. The method of claim 1, wherein collecting the user's finger movement information during soft keyboard input specifically includes:

The terminal's built-in camera is adjusted to be able to capture the input angle of the soft keyboard. The built-in camera captures the movements of the user's fingertips during soft keyboard input to form finger movement information in a video data format.

3. The method of claim 2, wherein: calculating a set of coordinate values for the movement of the user's finger tips within a predetermined time based on the finger movement information, and determining based on the set of coordinate values whether the user's finger tips are on the soft keyboard. The specific displacement directions include:

Calculate the coordinate value of the user's finger tip for each frame of video data in the video data through a graphics processing algorithm, obtain a coordinate value set of the user's finger tip movement within a predetermined time, and determine the user's finger tip based on the coordinate value set The displacement direction on the soft keyboard.

4. The method of claim 1, wherein determining the target soft keyboard area to which the user's finger tip will move based on the pre-divided soft keyboard partition, the coordinate value set and the displacement direction specifically includes:

Determine the soft keyboard area where the current user's finger tip is located according to the coordinate value of the current user's finger tip in the coordinate value set and the coordinate value of the pre-divided soft keyboard partition;

According to the soft keyboard area where the user's finger tip is currently located and the displacement direction, the target soft keyboard area to which the user's finger tip will move is determined.

5. The method according to claim 1, wherein the method further includes: turning off or turning on the soft keyboard layout adjustment function of the terminal according to the user's operation.

6. A soft keyboard layout adjustment device, including:

The collection module is configured to collect finger movement information when the user performs soft keyboard input on the terminal; the calculation module is configured to calculate a coordinate value set of the user's fingertip movement within a predetermined time based on the finger movement information, and calculate the coordinate value set based on the finger movement information. The coordinate value set determines the displacement direction of the user's finger tip on the soft keyboard;

The processing module is configured to determine the target soft keyboard area to which the user's finger tip will move based on the pre-divided soft keyboard partition, the coordinate value set and the displacement direction, and enlarge the keys in the target soft keyboard area. , reduce the keys in the remaining soft keyboard area and display them.

7. The device according to claim 6, wherein the collection module is configured to adjust the terminal's built-in camera to capture the input angle of the soft keyboard, and use the built-in camera to capture the user's fingers during soft keyboard input. The movements of the fingertips form finger movement information in video data format.

8. The device according to claim 7, wherein the calculation module is configured to calculate the coordinate value of the user's finger tip of each frame of video data in the video data through a graphics processing algorithm, and obtain the user's finger tip within a predetermined time A set of coordinate values for the movement of the finger tip, and the displacement direction of the user's finger tip on the soft keyboard is determined based on the set of coordinate values.

9. The device according to claim 6, wherein the processing module is configured to determine the current coordinate value according to the coordinate value of the current user's finger tip in the coordinate value set and the coordinate value of the pre-divided soft keyboard partition. The soft keyboard area where the user's finger tip is located; and the target soft keyboard area to which the user's finger tip is to be moved is determined based on the soft keyboard area where the user's finger tip is currently located and the displacement direction.

10. The device according to claim 6, wherein the device further includes: a selection module configured to select to turn off or turn on the soft keyboard layout adjustment function of the terminal according to the user's operation.