WO2019206280A1

WO2019206280A1 - Control method for virtual keyboard

Info

Publication number: WO2019206280A1
Application number: PCT/CN2019/084557
Authority: WO
Original assignee: 北京钛方科技有限责任公司
Priority date: 2018-04-28
Filing date: 2019-04-26
Publication date: 2019-10-31
Also published as: CN110413189B; CN110413189A

Abstract

A control method for a virtual keyboard. The control method contains: obtaining an elastic wave signal produced on a substrate according to touch, and converting the elastic wave signal into a voltage signal (S101); making a calculation according to the voltage signal to obtain touch information on the substrate, obtaining a touch intensity and a touch position according to the touch information, comparing the touch intensity and the touch position with a pre-set threshold and a predetermined area, and obtaining a touch instruction by a comparison result (S102); obtaining corresponding target input key information according to the touch instruction and the touch position in the touch information, and outputting a corresponding control signal according to the target input key information (S103). The control method for a virtual keyboard can provide accurate touch control recognition while effectively reducing the volume and weight of an existing keyboard, is closer to the usage habits of a user and facilitates effective promotion of the virtual keyboard.

Description

Virtual keyboard control method

Technical field

The invention relates to the field of digital interaction, in particular to a virtual keyboard control method.

Background technique

With the development of electronic technology, the thin and light portable electronic devices have become the primary research and development direction of electronic manufacturers. Users are paying more attention to the lighter and thinner electronic devices; in order to reduce the space occupied by portable electronic devices and reduce their weight, A large number of mechanical devices with large space are designated to be replaced, and the traditional keyboard is one of the above-mentioned components that need to be replaced by a reduction. As an alternative product, a "virtual keyboard" has emerged.

In the prior art, the virtual keyboard mainly determines the actual touch point of the user by collecting the voltage difference value and the like when the user uses the inductive component such as a capacitive screen, and then determines the input information of the user according to the touch points, the virtual A plurality of virtual keys adjacent to each other are disposed on the keyboard, and the user can touch the virtual keys through a control component (such as a finger). However, the virtual keys on the virtual keyboard are different from the physical keys set on the keyboard of the commonly used physical computer, and the user's finger touch is relatively different, for example, when the user's finger wants to touch a predetermined physical button, but the finger is deviated. When the touch position falls between the predetermined physical button and the adjacent physical button, the user's finger can generally clearly feel that the touch position does not accurately fall on the desired physical button, that is, In the operation of the actual button, the user can confirm whether the operation is correct according to the touch of the finger, and the virtual keyboard cannot provide the tactile sensation of the traditional keyboard, which causes the user to input the error occasionally; and the characteristics of the component such as the capacitive screen itself It also causes the user to use the conventional input habits, such as placing the hand on the keyboard for touch input, the virtual keyboard is difficult to detect the change of capacitance and voltage, and the user's true input intention cannot be accurately obtained, so that the user is It is extremely inconvenient to use.

To this end, how to provide a virtual keyboard that fits the user's usage habits and reduces the space and overall quality has become a major problem in the industry.

Summary of the invention

The object of the present invention is to provide a virtual keyboard with a small volume, a wide application range and a more accurate identification.

In order to achieve the above object, the present invention provides a virtual keyboard control method, the control method comprising: obtaining an elastic wave signal generated on a substrate according to a touch, converting the elastic wave signal into a voltage signal; Calculating the touch information on the substrate, obtaining the touch force and the touch position according to the touch information, comparing the touch force and the touch position with the preset threshold and the predetermined area, and obtaining a touch command by comparing the results; Corresponding target input button information is obtained according to the touch command and the touch position in the touch information, and a corresponding control signal is output according to the target input button information.

The present invention also provides a virtual keyboard control system, the control system includes a substrate, a touch collection module, a denoising module, and a calculation module; the touch collection module is configured to obtain an elastic wave signal generated on the substrate according to the touch, Converting the elastic wave signal into a voltage signal; the denoising module is configured to calculate touch information on the substrate according to the voltage signal, obtain a touch force and a touch position according to the touch information, and touch the touch The velocity and the touch position are compared with the preset threshold and the predetermined area, and the touch command is obtained by comparing the result; the calculating module is configured to obtain the corresponding target input button according to the touch command and the touch position in the touch information. Information, and outputting a corresponding control signal according to the target input key information.

The application also provides an electronic device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, the processor executing the method described above.

The application also provides a computer readable storage medium storing a computer program for performing the method described above.

The beneficial technical effect of the present invention is that the virtual keyboard control method provided by the present invention can effectively reduce the volume and weight of the existing keyboard, and provide accurate touch recognition, which is closer to the user's usage habits and facilitates the effective promotion of the virtual keyboard.

DRAWINGS

The drawings described herein are provided to provide a further understanding of the present application, and constitute a part of this application, and do not constitute a limitation of the application. In the drawing:

1 is a schematic flowchart of a virtual keyboard control method according to an embodiment of the present invention;

2 is a schematic structural diagram of a virtual keyboard control system according to an embodiment of the present invention;

FIG. 3 is a schematic diagram of installation of a virtual keyboard control system according to an embodiment of the present invention; FIG.

FIG. 4 is a schematic block diagram of a system configuration of an electronic device according to an embodiment of the present application.

detailed description

In order to make the objects, technical solutions and advantages of the embodiments of the present application more clear, the present application will be further described in detail below with reference to the embodiments and drawings. The illustrative embodiments of the present application and the description thereof are for explaining the present application, but are not intended to limit the application.

In the description of the present specification, the description of the terms "an embodiment", "a specific embodiment", "such as" and the like means that the specific features, structures, materials, or characteristics described in connection with the embodiments or examples are included in the present application. At least one embodiment or example. In the present specification, the schematic representation of the above terms does not necessarily mean the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in a suitable manner in any one or more embodiments or examples. The order of the steps involved in the embodiments is used to schematically illustrate the implementation of the present application, and the order of the steps is not limited, and may be appropriately adjusted as needed.

Referring to FIG. 1 , the present invention provides a virtual keyboard control method. The control method includes: S101 obtains an elastic wave signal generated on a substrate according to a touch, and converts the elastic wave signal into a voltage signal; S102 is The voltage signal is calculated to obtain touch information on the substrate, and the touch force and the touch position are obtained according to the touch information, and the touch force and the touch position are compared with a preset threshold and a predetermined area, and the comparison result is obtained. Touching the command; S103 obtaining corresponding target input button information according to the touch position and the touch position in the touch information, and outputting a corresponding control signal according to the target input button information. In this embodiment, the substrate comprises a glass plate, a wood board, a metal plate or the like which can generate an elastic wave signal, or an existing touch screen, a non-touch screen, etc., and in actual use, the substrate is mainly collected by a piezoelectric sensor. The elastic wave signal is obtained according to the analysis and calculation of the elastic wave signal to obtain the touch force and position when the user touches the substrate, and then judges whether the user is the real operation intention according to the touch strength and the position, and confirms that the operation is true to the user. After the intention, the actual operation instruction of the user is determined according to the comparison result between the touch position and the preset area on the substrate; for example, after the user hits the substrate, the strength of the tap is calculated according to the elastic wave signal generated by the tap at this moment. Position, confirm whether the user needs to input data by tapping the strength and/or position. After confirming, the control command corresponding to the tapping force and/or position can be judged by pre-stored threshold or area information, and then used. The device of the virtual keyboard can be given a corresponding output according to the control instruction; or, after the user taps the substrate, the device is first obtained. Touching the generated touch position, determining whether it is within the predetermined area according to the touch position, such as in the predetermined area, further obtaining the touch force within a predetermined time period, when the touch force is greater than a pre-stored At the threshold value, a corresponding control command is obtained, and then the device using the virtual keyboard can be given a corresponding output according to the control command. In the above embodiment, the predetermined threshold may be dynamically adjusted, for example, according to a user instruction, obtaining the touch force in a predetermined time period; and adjusting the preset threshold according to the touch strength. In this way, different users can set different preset thresholds according to their own usage habits in actual use, and provide users with more personalized setting schemes.

It is to be noted that, in the above embodiment, obtaining the touch force and the touch position according to the touch information may include: obtaining a touch position when the touch is performed by using a touch screen or other auxiliary structure, and then using the touch The information is the elastic wave signal to obtain the touch force of the touch, and then the touch position and the touch force are further processed by the follow-up; of course, the touch position can also be made by the elastic wave signal generated when the touch is made. And the simultaneous calculation of the touch force, wherein the manner of calculating the touch position by using the elastic wave signal can be realized by the existing identification method, and the present invention will not be explained too much here.

In the above embodiment, calculating the touch information on the substrate according to the voltage signal may include: calculating a fluctuation change value of the voltage signal according to the voltage signal, and calculating a touch generated according to the fluctuation change value. Touch the force. Of course, in order to more accurately determine the actual touch strength, the fluctuation value of the voltage signal may be calculated according to the voltage signal, and calculated according to the fluctuation variation value and the touch position of the elastic wave signal. The touch force generated by the touch. In this way, the distance value is further introduced, and the attenuation error of the elastic wave signal during the propagation process is further reduced according to the distance value. Of course, in the actual process, because the area of the virtual keyboard is small, when the accuracy of the force requirement is not high, The error is also negligible. The present invention is not limited herein; in this embodiment, the method for calculating the touch strength is mainly determined by the fluctuation value of the voltage signal, and when the fluctuation change value exceeds the reference data, It indicates that the touch force is large, and if it is smaller, it indicates that the touch force is small; for example, when the one or more piezoelectric sensors C ₁ to C _n respectively convert the respective received elastic wave signals into the same as they receive an elastic wave signal of the same frequency of the voltage signals D ₁ to D _n, each voltage signal is then calculated in accordance with values of the fluctuating voltage signals D ₁ to D _n are the energy values E ₁ through E _n, then the last energy value E ₁ E _n to one or more of the cumulative values, to obtain the final value of the elastic wave total energy, at which time the overall energy value of the elastic wave can be substrate at a reaction pressure of touch information generated by the state Thereby obtaining the actual velocity information; is worth noting that, in the above process, may be calculated through the following formula The method of calculation of the energy value of the voltage signal:

or

In the above formula, m is the number of signal points collected; n is the number of signal points determined by selecting the wavelength of the voltage signal of a predetermined length according to actual conditions, and those skilled in the art can select settings according to actual needs, and the present invention does not further limit here. ; E is the energy value of the voltage signal.

In an embodiment of the present invention, obtaining the touch information on the substrate according to the voltage signal in the step S102 may further include: calculating a signal characteristic value of the voltage signal according to the voltage signal, and using the signal The feature value is compared with the pre-stored reference feature value, and the touch position is obtained according to the comparison result. The calculating, by the voltage signal, the signal characteristic value of the voltage signal comprises: establishing a feature model by a machine learning algorithm and/or a depth learning algorithm according to the voltage signal obtained by touching the predetermined position, and according to the voltage signal And obtaining, by the feature model, a signal characteristic value of the voltage signal. In actual work, the staff can acquire the elastic wave signal generated by the touch at a specified position in advance, and convert the elastic wave signal into a voltage signal, and use the voltage signal as an input signal through a machine learning algorithm and/or a deep learning algorithm. Performing a training to obtain a feature model for extracting a signal characteristic value in the voltage signal, or manually analyzing a feature portion having a higher difference in the voltage signal to obtain a feature value corresponding to the voltage signal, where the feature value is The reference characteristic value corresponding to the voltage signal; the voltage signal can be used as an input at this time, and the reference feature value is used as an output, and the feature model is established by a deep learning algorithm or a machine learning algorithm; then when the actual user touches Then, the calculated obtained voltage signal can be calculated by the feature model analysis to obtain the corresponding signal characteristic value. Of course, in actual work, the voltage signal generated by the massive touch can also be collected, and the characteristic signal can be obtained by the machine learning algorithm and/or the deep learning algorithm by using the voltage signal, and the feature model can be passed later, and the user actually touches the The generated voltage signal is calculated to obtain the signal characteristic value of the touch, and then the true position is determined according to the similarity between the signal characteristic value and the reference feature value; of course, the characteristic value of the predetermined position in the voltage signal may also be extracted according to actual needs. , such as peaks in a specific wavelength range, fluctuation variation values or phase characteristics, and time difference characteristics, etc., and then comparing the extracted signal feature values with the feature values in the preset feature library, by averaging the two The variance and cosine correlation algorithm are used to obtain the similarity between the two, and then further confirm the reference feature value corresponding to the signal feature value according to the similarity. After confirming the closest reference feature value, Obtaining the corresponding touch position according to the reference feature value, thereby confirming the actual occurrence of the elastic wave generated by the substrate due to the touch The present invention is not specifically limited herein, and those skilled in the art can select and use according to actual needs.

In actual work, when the user uses the keyboard, the palm is placed on the keyboard more or less. At this moment, the elastic wave signal is generated when the palm moves slightly, but the signals are not intended by the user; for this reason, in order to avoid the In an embodiment of the invention, the touch force and the touch position are compared according to the touch information, and the touch force and the touch position are compared with a preset threshold and a predetermined area. Obtaining the touch command by comparing the results includes: comparing the touch force with a preset threshold, and comparing the touch position with the predetermined area when the touch force is greater than or equal to the preset threshold, Obtaining a touch command according to the comparison result, or comparing the touch position with a predetermined area, and when the touch position is within the predetermined area, comparing the touch force with a preset threshold, when A touch command is obtained when the touch force is greater than or equal to the preset threshold. In this way, the strength generated by the touch is used to distinguish whether the operation is the user's true intention, and the situation of preventing the accidental touch occurs; of course, when the user uses the virtual keyboard, since the virtual keyboard no longer has the touch of the traditional keyboard, the Providing the true tactile feedback directly, therefore, in order to avoid the erroneous input caused by the inaccurate tap position when the user inputs, in an embodiment of the invention, the method further includes: according to the touch position and the received user feedback signal, Adjusting the correspondence between the touch position and its corresponding target input button information. The adjusting the correspondence between the touch position and the corresponding target input button information according to the touch position and the received user feedback signal includes: using a machine learning algorithm according to the touch position and the user feedback signal The depth learning algorithm establishes a calibration model by which the correspondence between the touch position and its corresponding target input button information is adjusted. In this embodiment, the user feedback signal mainly includes information such as a deletion operation of the user and input data after the deletion operation; thereby, when the feedback signal is received, it indicates that the user input data is an erroneous input, and the feedback is When the frequency of the signal is high, the touch command representing the predetermined area does not match the touch command input by the user, and the corresponding relationship between the touch position and the corresponding target input button information can be adjusted at this time; The method for extracting the feedback signal is also different in rules or manners due to different situations. The present invention will not be described too much herein, and those skilled in the art may select and use according to actual needs.

In an embodiment of the present invention, the touch information on the substrate is calculated according to the voltage signal, and the touch force is obtained according to the touch information. Touching the position, comparing the touch force and the touch position with the preset threshold and the predetermined area, further comprising: obtaining an elastic wave signal outside the predetermined area on the substrate, converting the elastic wave signal into a voltage signal; The voltage signal obtains noise information; comparing the touch information and the noise information, the touch force and the touch position are compared with a preset threshold and a predetermined area according to the comparison result. In this embodiment, the elastic wave signals generated by the touches outside the predetermined area on the substrate are further pre-acquired, and the characteristic information of the voltage signals corresponding to the elastic wave signals is recorded and stored. When the virtual keyboard is actually used, Comparing with the feature information, it is determined whether the received elastic wave signal is noise information and is correspondingly processed. Of course, those skilled in the art can also use the above-mentioned machine learning method to train and obtain a noise signal judgment model, and then determine the validity of the received elastic wave signal according to the noise signal judgment model, and the specific method is no longer used herein. Detailed.

Referring to FIG. 2 and FIG. 3, the present invention further provides a virtual keyboard control system, where the control system includes a substrate 301, a touch collection module 302, a denoising module 303, and a calculation module 304; the touch collection module 302 is used to obtain an elastic wave signal generated on the substrate 301 according to the touch, and convert the elastic wave signal into a voltage signal; the denoising module 303 is configured to calculate, according to the voltage signal, the touch information on the substrate, according to The touch information obtains a touch force and a touch position, compares the touch force and the touch position with a preset threshold and a predetermined area, and obtains a touch command by comparing the result; the calculating module 304 is configured to use the The touch command and the touch position in the touch information obtain corresponding target input button information, and output corresponding control signals according to the target input button information. In the above embodiment, the denoising module 303 and the computing module 304 can be integrated into a whole processing chip, such as a CPU of an existing notebook computer, a processing chip of a mobile phone, etc., and the present invention does not Further limited. The touch collection module 302 can include one or more piezoelectric sensors, which can be piezoelectric ceramic sensors, piezoelectric thin film sensors, piezoelectric crystal sensors, or other sensors having piezoelectric effects; It may be a hard material that can generate elastic waves by touch, such as metal, glass, wood, or plastic.

In the above virtual keyboard control system, the denoising module further includes a velocity detecting unit and a position detecting unit, wherein the velocity detecting unit is configured to calculate a fluctuation variation value of the voltage signal according to the voltage signal, according to the fluctuation The change value calculation obtains the touch force generated by the touch; wherein the force detecting unit may further include: calculating a fluctuation change value of the voltage signal according to the voltage signal, and generating the elasticity according to the fluctuation change value The touch position of the wave signal is calculated to obtain the touch force generated by the touch. The position detecting unit is configured to calculate a signal characteristic value of the voltage signal according to the voltage signal, and compare the signal characteristic value with a pre-stored reference feature value, and obtain a touch position according to the comparison result; wherein The position detecting unit may further include: establishing a feature model by a machine learning algorithm and/or a depth learning algorithm according to the voltage signal obtained by touching the predetermined position, and calculating the voltage signal according to the voltage signal and the feature model Signal characteristic value.

In an embodiment of the invention, the denoising module further includes: comparing the touch force with a preset threshold, and when the touch force is greater than or equal to the preset threshold, the touch The position is compared with the predetermined area, and a touch command is obtained based on the comparison result. The denoising module may further include: obtaining an elastic wave signal outside a predetermined area on the substrate, converting the elastic wave signal into a voltage signal; obtaining noise information according to the voltage signal; comparing the touch The information and the noise information, based on the comparison result, compare the touch force and the touch position with a preset threshold and a predetermined area. In this embodiment, the characteristic waveform of the external noise signal is stored in advance, so that the user input data and the noise data can be effectively distinguished when the user actually inputs, and the irrelevant noise data is accurately and quickly filtered, thereby providing the user with more accurate. Enter the experience.

In an embodiment of the invention, the control system further includes an adjustment module, wherein the adjustment module is configured to adjust the touch position and the corresponding target input button information according to the touch position and the received user feedback signal. Correspondence relationship. The adjustment module may further include: establishing, by the machine learning algorithm and/or the deep learning algorithm, a calibration model according to the touch position and the user feedback signal, and adjusting the touch position and the corresponding target input button by using the calibration model Correspondence of information. The adjustment module can effectively improve the convenience of user input, and utilizes the user habits collected in the early stage to help the user use the virtual keyboard more quickly, and the user is given a customized input experience. In this embodiment, the control system may further include a threshold setting module, configured to obtain the touch force in a predetermined time period according to a user instruction; and adjust the sound according to the touch force Preset threshold.

The virtual keyboard control method provided by the invention can effectively reduce the size and weight of the existing keyboard to provide accurate touch recognition, and is closer to the user's usage habits, and is convenient for the effective promotion of the virtual keyboard.

The present application further provides an electronic device, which may be a desktop computer, a tablet computer, a mobile terminal, etc., and the embodiment is not limited thereto. In this embodiment, the electronic device may refer to the implementation of the foregoing method and the foregoing apparatus, and the contents thereof are incorporated herein, and the details are not described again.

FIG. 4 is a schematic block diagram of a system configuration of an electronic device 600 according to an embodiment of the present application. As shown in FIG. 4, the electronic device 600 can include a central processing unit 100 and a memory 140; the memory 140 is coupled to the central processing unit 100. It should be noted that the figure is exemplary; other types of structures may be used in addition to or in place of the structure to implement telecommunications functions or other functions.

In one embodiment, processes such as voltage signal analysis and subsequent control scheme output may be integrated into central processor 100. The central processing unit 100 may be configured to perform control of: obtaining touch information on the substrate according to the voltage signal, obtaining a touch force and a touch position according to the touch information, and touching the touch force and the touch Comparing the position with the preset threshold and the predetermined area, obtaining a touch command by comparing the result; obtaining corresponding target input button information according to the touch command and the touch position in the touch information, and inputting the button information according to the target The corresponding control signal is output.

The calculating the touch information on the substrate according to the voltage signal comprises: calculating a fluctuation change value of the voltage signal according to the voltage signal, and calculating a touch force generated by the touch according to the fluctuation change value.

The calculating the touch information on the substrate according to the voltage signal comprises: calculating, according to the voltage signal, a fluctuation change value of the voltage signal, according to the fluctuation change value and a touch position at which the elastic wave signal is generated. Calculate the touch force generated by the touch.

The calculating the touch information on the substrate according to the voltage signal comprises: calculating a signal characteristic value of the voltage signal according to the voltage signal, and comparing the signal characteristic value with a pre-stored reference feature value, according to the comparison. As a result, the touch position is obtained.

The calculating, by the voltage signal, the signal characteristic value of the voltage signal comprises: establishing a feature model by a machine learning algorithm and/or a depth learning algorithm according to the voltage signal obtained by touching the predetermined position, and according to the voltage signal And obtaining, by the feature model, a signal characteristic value of the voltage signal.

Comparing the touch force and the touch position with the preset threshold and the predetermined area, and obtaining the touch command by the comparison result includes: comparing the touch force with a preset threshold, when the touch force is greater than or When the preset threshold is equal to, the touch position is compared with a predetermined area, a touch command is obtained according to the comparison result, or the touch position is compared with a predetermined area, when the touch position is in the When the area is within the predetermined area, the touch force is compared with a preset threshold, and the touch command is obtained when the touch force is greater than or equal to the preset threshold.

The central processing unit 100 can also be configured to perform control to adjust a correspondence between the touch position and its corresponding target input button information according to the touch position and the received user feedback signal.

The adjusting the correspondence between the touch position and the corresponding target input button information according to the touch position and the received user feedback signal includes: adopting a machine learning algorithm according to the touch position and the user feedback signal, and/or The deep learning algorithm establishes a calibration model by which the correspondence between the touch position and its corresponding target input button information is adjusted.

Wherein, the touch information on the substrate is calculated according to the voltage signal, the touch force and the touch position are obtained according to the touch information, and the touch force and the touch position are compared with the preset threshold and the predetermined area, and further includes Obtaining an elastic wave signal outside a predetermined area on the substrate, converting the elastic wave signal into a voltage signal; obtaining noise information according to the voltage signal; comparing the touch information and the noise information, according to the comparison result The touch force and the touch position are compared with a preset threshold and a predetermined area.

The central processing unit 100 may be further configured to perform control of: obtaining the touch velocity within a predetermined time period according to a user instruction; and adjusting the preset threshold according to the touch strength.

As shown in FIG. 4, the electronic device 600 may further include: a communication module 110, an input unit 120, a piezoelectric sensor 130, a display 160, and a power source 170. It should be noted that the electronic device 600 does not necessarily have to include all the components shown in FIG. 4; in addition, the electronic device 600 may further include components not shown in FIG. 4, and reference may be made to the prior art.

As shown in FIG. 4, central processor 100, also sometimes referred to as a controller or operational control, can include a microprocessor or other processor device and/or logic device that receives input and controls each of electronic devices 600. The operation of the part.

The memory 140 may be, for example, one or more of a buffer, a flash memory, a hard drive, a removable medium, a volatile memory, a non-volatile memory, or other suitable device. The above-mentioned information related to the failure can be stored, and a program for executing the related information can be stored. And the central processing unit 100 can execute the program stored by the memory 140 to implement information storage or processing and the like.

Input unit 120 provides input to central processor 100. The input unit 120 is, for example, a substrate, a glass, a touch panel, or the like. The power source 170 is used to provide power to the electronic device 600. The display 160 is used to display a display object such as an image or a character. The display device 160 can be, for example, a touch device such as an LCD display. The input unit 120 can be integrated with the display device 160 to implement a touch display function, but is not limited thereto.

The memory 140 can be a solid state memory such as a read only memory (ROM), a random access memory (RAM), a SIM card, or the like. It is also possible to store a memory that can be selectively erased and provided with more data even when the power is turned off, and an example of the memory is sometimes referred to as an EPROM or the like. Memory 140 can also be some other type of device. Memory 140 includes a buffer memory 141 (sometimes referred to as a buffer). The memory 140 may include an application/function storage section 142 for storing an application and a function program or a flow for executing an operation of the electronic device 600 by the central processing unit 100.

The memory 140 may also include a data storage portion 143 for storing data such as contacts, digital data, pictures, sounds, and/or any other data used by the electronic device. The driver storage portion 144 of the memory 140 may include various drivers for the communication function of the electronic device and/or for performing other functions of the electronic device such as a messaging application, an address book application, and the like.

The communication module 110 is a transmitter/receiver 110 that transmits and receives signals via the antenna 111. A communication module (transmitter/receiver) 110 is coupled to the central processing unit 100 to provide an input signal and receive an output signal, which may be the same as in the case of a conventional mobile communication terminal, including but not limited to WIFI, 3G, 4G, 5G or GPRS network.

Based on different communication technologies, a plurality of communication modules 110, such as a cellular network module, a Bluetooth module, and/or a wireless local area network module, may be provided in the same electronic device. The communication module (transmitter/receiver) 110 also issues a designated signal after obtaining a corresponding command via the central processing unit 100, thereby implementing a general telecommunication function. Piezoelectric sensor 130 can include any suitable piezoelectric sensing element, such as a thin film piezoelectric sensor or the like.

Those skilled in the art will appreciate that embodiments of the present application can be provided as a method, system, or computer program product. Thus, the present application can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment in combination of software and hardware. Moreover, the application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the present application. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

The specific embodiments of the present invention have been described in detail with reference to the specific embodiments of the present application. It is to be understood that the foregoing description is only The scope of protection, any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of this application are intended to be included within the scope of the present application.

Claims

A virtual keyboard control method, characterized in that the control method comprises:

Obtaining an elastic wave signal generated on the substrate according to the touch, converting the elastic wave signal into a voltage signal;

Calculating the touch information on the substrate according to the voltage signal, obtaining the touch force and the touch position according to the touch information, comparing the touch force and the touch position with the preset threshold and the predetermined area, and comparing the results Get a touch command;

Corresponding target input button information is obtained according to the touch command and the touch position in the touch information, and a corresponding control signal is output according to the target input button information.
The virtual keyboard control method according to claim 1, wherein the obtaining the touch information on the substrate according to the voltage signal comprises: calculating, according to the voltage signal, a fluctuation change value of the voltage signal, according to the The fluctuation change value is calculated to obtain the touch force generated by the touch.
The virtual keyboard control method according to claim 1, wherein the obtaining the touch information on the substrate according to the voltage signal comprises: calculating, according to the voltage signal, a fluctuation change value of the voltage signal, according to the The fluctuation change value and the touch position at which the elastic wave signal is generated are calculated to obtain the touch force generated by the touch.
The virtual keyboard control method according to claim 1, wherein the obtaining the touch information on the substrate according to the voltage signal comprises: calculating a signal characteristic value of the voltage signal according to the voltage signal, and The signal characteristic value is compared with the pre-stored reference feature value, and the touch position is obtained according to the comparison result.
The virtual keyboard control method according to claim 4, wherein calculating the signal characteristic value of the voltage signal according to the voltage signal comprises: using a machine learning algorithm according to a voltage signal obtained by touching a predetermined position. Or a deep learning algorithm establishes a feature model, and calculates a signal characteristic value of the voltage signal according to the voltage signal and the feature model.
The virtual keyboard control method according to claim 1, wherein the touch force and the touch position are compared with a preset threshold and a predetermined area, and the obtaining of the touch command by the comparison result comprises: The preset threshold is compared, when the touch force is greater than or equal to the preset threshold, the touch position is compared with a predetermined area, and a touch command is obtained according to the comparison result; or the touch position is Comparing the predetermined area, comparing the touch force with a preset threshold when the touch position is within the predetermined area, and obtaining a touch when the touch strength is greater than or equal to the preset threshold instruction.
The virtual keyboard control method according to claim 1, wherein the control method further comprises: adjusting the touch position and the corresponding target input button information according to the touch position and the received user feedback signal. Correspondence relationship.
The virtual keyboard control method according to claim 7, wherein the adjusting the correspondence between the touch position and the corresponding target input button information according to the touch position and the received user feedback signal comprises: The touch position and the user feedback signal establish a calibration model through a machine learning algorithm and/or a deep learning algorithm, and the correspondence relationship between the touch position and its corresponding target input button information is adjusted by the calibration model.
The virtual keyboard control method according to claim 1, wherein the touch information on the substrate is calculated according to the voltage signal, and the touch force and the touch position are obtained according to the touch information, and the touch force and the touch force are Comparing the touch position with the preset threshold and the predetermined area further includes: obtaining an elastic wave signal outside the predetermined area on the substrate, converting the elastic wave signal into a voltage signal; obtaining noise information according to the voltage signal; The touch information and the noise information compare the touch force and the touch position with a preset threshold and a predetermined area according to the comparison result.
The virtual keyboard control method according to claim 1, wherein the control method further comprises: obtaining the touch force in a predetermined time period according to a user instruction; and adjusting the preset according to the touch force Threshold.
An electronic device comprising a memory, a processor, a piezoelectric sensor, and a computer program stored on the memory and operable on the processor, wherein

The piezoelectric sensor is configured to obtain an elastic wave signal generated on a substrate according to a touch, and convert the elastic wave signal into a voltage signal;

The processor performs a method of: obtaining touch information on the substrate according to the voltage signal, obtaining a touch force and a touch position according to the touch information, and the touch force and the touch position and the preset threshold and The predetermined area is compared, and the touch command is obtained by comparing the results; the corresponding target input button information is obtained according to the touch command and the touch position in the touch information, and the corresponding control signal is output according to the target input button information.
The electronic device according to claim 11, wherein the processor is further configured to calculate a fluctuation change value of the voltage signal according to the voltage signal, and calculate a touch generated by the touch according to the fluctuation change value. Touching force; or: calculating a fluctuation change value of the voltage signal according to the voltage signal, and calculating a touch force generated by the touch according to the fluctuation change value and a touch position at which the elastic wave signal is generated.
The electronic device according to claim 11, wherein the processor is further configured to calculate, according to the voltage signal, a signal characteristic value of the voltage signal, and the signal characteristic value and a pre-stored reference feature value. Comparing, obtaining a touch position according to the comparison result; or establishing a feature model by a machine learning algorithm and/or a depth learning algorithm according to the voltage signal obtained by touching the predetermined position, and calculating the obtained according to the voltage signal and the feature model The signal characteristic value of the voltage signal.
The electronic device according to claim 11, wherein the processor is further configured to adjust a correspondence between the touch position and its corresponding target input button information according to the touch position and the received user feedback signal. .
A computer readable storage medium storing a computer program for performing the method of claim 1.