CN110413189B - Virtual keyboard control method and system - Google Patents
Virtual keyboard control method and system Download PDFInfo
- Publication number
- CN110413189B CN110413189B CN201810403058.9A CN201810403058A CN110413189B CN 110413189 B CN110413189 B CN 110413189B CN 201810403058 A CN201810403058 A CN 201810403058A CN 110413189 B CN110413189 B CN 110413189B
- Authority
- CN
- China
- Prior art keywords
- touch
- voltage signal
- signal
- obtaining
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0414—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using force sensing means to determine a position
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Position Input By Displaying (AREA)
- Electronic Switches (AREA)
Abstract
The invention provides a virtual keyboard control method and a system, wherein the control method comprises the following steps: obtaining an elastic wave signal generated on a substrate according to touch, and converting the elastic wave signal into a voltage signal; calculating to obtain touch information on the substrate according to the voltage signal, obtaining touch force and touch position according to the touch information, comparing the touch force and the touch position with a preset threshold value, and obtaining a touch instruction according to a comparison result; and obtaining corresponding target input key information according to the touch instruction and the touch position in the touch information, and outputting a corresponding control signal according to the target input key information. The virtual keyboard control method and the virtual keyboard control system provided by the invention can provide accurate touch identification on the premise of effectively reducing the volume and weight of the conventional keyboard, are closer to the use habit of a user, and are convenient for effective popularization of the virtual keyboard.
Description
Technical Field
The present invention relates to the field of digital interaction, and in particular, to a method and system for controlling a virtual keyboard.
Background
With the development of electronic technology, the lightness and thinness of portable electronic devices have become the primary research and development directions of electronic manufacturers, and users have come to pay more attention to the lightness and thinness of electronic devices; in order to reduce the space occupied by the portable electronic device and the weight thereof, a large number of mechanical devices occupying a larger space are instead designated, and the conventional keyboard is one of the above-mentioned elements which need to be replaced by a reduced size, and is produced as a substitute product, namely a virtual keyboard.
In the prior art, a virtual keyboard mainly acquires data such as a voltage difference value and the like when a user uses the virtual keyboard through an inductive element such as a capacitive screen and the like to judge actual touch points of the user, and then determines input information of the user according to the touch points, wherein a plurality of virtual keys which are adjacent to each other are distributed on the virtual keyboard and used for the user to touch and press the virtual keys through a control element (such as a finger). However, the virtual keys on the virtual keyboard are different from the physical keys on the general physical computer keyboard, and the touch feeling of the fingers of the user is also relatively different, for example: when a user's finger is about to touch a predetermined physical key, but the touch position falls between the predetermined physical key and an adjacent physical key due to the deviation of the finger, the user's finger can generally clearly feel that the touch position is not accurately fallen on the desired predetermined physical key, that is, in the operation of the actual key, the user can confirm whether the operation is correct according to the touch of the finger, and the virtual keyboard cannot provide the touch of the traditional keyboard, so that the situation of wrong input of the user occurs; moreover, due to the characteristics of the components such as the capacitive screen, when a user adopts a conventional input habit, for example, when a hand is placed on a keyboard for touch input, the detection of capacitance and voltage changes by the virtual keyboards is difficult, and the real input intention of the user cannot be accurately known, so that the user is very inconvenient to use.
Therefore, how to provide a virtual keyboard which is suitable for the use habit of a user and can reduce the occupied space and the overall quality becomes a great problem to be solved urgently in the industry.
Disclosure of Invention
The invention aims to provide a virtual keyboard which is smaller in size, wider in application range and more accurate in identification.
To achieve the above object, the present invention provides a virtual keyboard control method, including: obtaining an elastic wave signal generated on a substrate according to touch, and converting the elastic wave signal into a voltage signal; calculating to obtain touch information on the substrate according to the voltage signal, obtaining touch force and touch position according to the touch information, comparing the touch force and the touch position with a preset threshold value, and obtaining a touch instruction according to a comparison result; and obtaining corresponding target input key information according to the touch instruction and the touch position in the touch information, and outputting a corresponding control signal according to the target input key information.
In the virtual keyboard control method, preferably, the obtaining touch information on the substrate by calculating from the voltage signal includes: and calculating to obtain a fluctuation change value of the voltage signal according to the voltage signal, and calculating to obtain touch force generated by touch according to the fluctuation change value.
In the virtual keyboard control method, preferably, the obtaining touch information on the substrate by calculating from the voltage signal includes: and calculating to obtain a fluctuation change value of the voltage signal according to the voltage signal, and calculating to obtain touch force generated by touch according to the fluctuation change value and a touch position generating the elastic wave signal.
In the virtual keyboard control method, preferably, the obtaining touch information on the substrate by calculating from the voltage signal includes: and calculating to obtain a signal characteristic value of the voltage signal according to the voltage signal, comparing the signal characteristic value with a pre-stored reference characteristic value, and obtaining a touch position according to a comparison result.
In the above virtual keyboard control method, preferably, the obtaining of the signal characteristic value of the voltage signal by calculating from the voltage signal includes: according to the voltage signal obtained by touching the preset position, a characteristic model is established through a machine learning algorithm and/or a deep learning algorithm, and a signal characteristic value of the voltage signal is obtained through calculation according to the voltage signal and the characteristic model.
In the above virtual keyboard control method, preferably, the comparing the touch force and the touch position with a preset threshold, and the obtaining of the touch instruction according to the comparison result includes: and comparing the touch force with a preset threshold, comparing the touch position with a preset area when the touch force is greater than or equal to the preset threshold, and obtaining a touch instruction according to a comparison result.
In the above virtual keyboard control method, preferably, the control method further includes: and adjusting the corresponding relation between the touch position and the corresponding target input key information according to the touch position and the received user feedback signal.
In the above virtual keyboard control method, preferably, adjusting the correspondence between the touch position and the corresponding target input key information according to the touch position and the received user feedback signal includes: and establishing a calibration model through a machine learning algorithm and/or a deep learning algorithm according to the touch position and the user feedback signal, and adjusting the corresponding relation between the touch position and the corresponding target input key information through the calibration model.
In the above virtual keyboard control method, preferably, the step of obtaining touch information on the substrate by calculation according to the voltage signal, obtaining touch strength and touch position according to the touch information, and comparing the touch strength and touch position with a preset threshold further includes: obtaining an elastic wave signal outside a preset area on the substrate, and converting the elastic wave signal into a voltage signal; obtaining noise information according to the voltage signal; and comparing the touch information with the noise information, and comparing the touch strength and the touch position with a preset threshold value according to a comparison result.
In the above virtual keyboard control method, preferably, the control method further includes: acquiring the touch force in a preset time period according to a user instruction; and adjusting the preset threshold value according to the touch force.
The invention also provides a virtual keyboard control system, which comprises a substrate, a touch acquisition module, a denoising module and a calculation module; the touch acquisition module is used for acquiring an elastic wave signal generated on the substrate according to touch and converting the elastic wave signal into a voltage signal; the de-noising module is used for calculating and obtaining touch information on the substrate according to the voltage signal, obtaining touch force and touch position according to the touch information, comparing the touch force and the touch position with a preset threshold value, and obtaining a touch instruction according to a comparison result; the computing module is used for obtaining corresponding target input key information according to the touch instruction and the touch position in the touch information, and outputting a corresponding control signal according to the target input key information.
In the virtual keyboard control system, preferably, the denoising module further includes a force detection unit, and the force detection unit is configured to calculate a fluctuation variation value of the voltage signal according to the voltage signal, and calculate a touch force generated by a touch according to the fluctuation variation value.
In the above virtual keyboard control system, preferably, the strength detecting unit includes: and calculating to obtain a fluctuation change value of the voltage signal according to the voltage signal, and calculating to obtain touch force generated by touch according to the fluctuation change value and a touch position generating the elastic wave signal.
In the above virtual keyboard control system, preferably, the denoising module further includes a position detection unit, and the position detection unit is configured to calculate and obtain a signal characteristic value of the voltage signal according to the voltage signal, compare the signal characteristic value with a pre-stored reference characteristic value, and obtain a touch position according to a comparison result.
In the virtual keyboard control system, preferably, the position detecting unit includes: according to the voltage signal obtained by touching the preset position, a characteristic model is established through a machine learning algorithm and/or a deep learning algorithm, and a signal characteristic value of the voltage signal is obtained through calculation according to the voltage signal and the characteristic model.
In the virtual keyboard control system, preferably, the denoising module further includes: and comparing the touch force with a preset threshold, comparing the touch position with a preset area when the touch force is greater than or equal to the preset threshold, and obtaining a touch instruction according to a comparison result.
In the above virtual keyboard control system, preferably, the control system further includes an adjusting module, and the adjusting module is configured to adjust a corresponding relationship between the touch position and the corresponding target input key information according to the touch position and the received user feedback signal.
In the virtual keyboard control system, preferably, the adjusting module further includes: and establishing a calibration model through a machine learning algorithm and/or a deep learning algorithm according to the touch position and the user feedback signal, and adjusting the corresponding relation between the touch position and the corresponding target input key information through the calibration model.
In the virtual keyboard control system, preferably, the denoising module further includes: obtaining an elastic wave signal outside a preset area on the substrate, and converting the elastic wave signal into a voltage signal; obtaining noise information according to the voltage signal; and comparing the touch information with the noise information, and comparing the touch strength and the touch position with a preset threshold value according to a comparison result.
In the virtual keyboard control system, preferably, the control system further includes a threshold setting module, and the threshold setting module is configured to obtain the touch force within a predetermined time period according to a user instruction; and adjusting the preset threshold value according to the touch force.
The invention has the beneficial technical effects that: the virtual keyboard control method and the virtual keyboard control system provided by the invention can provide accurate touch identification on the premise of effectively reducing the volume and weight of the conventional keyboard, are closer to the use habit of a user, and are convenient for effective popularization of the virtual keyboard.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the principles of the invention. In the drawings:
fig. 1 is a schematic flowchart of a virtual keyboard control method according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a virtual keyboard control system according to an embodiment of the present invention;
fig. 3 is an installation diagram of a virtual keyboard control system according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the present invention is described in further detail below with reference to the embodiments and the accompanying drawings. The exemplary embodiments and descriptions of the present invention are provided to explain the present invention, but not to limit the present invention.
In the description herein, reference to the term "an embodiment," "a particular embodiment," "for example," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. The sequence of steps involved in the embodiments is for illustrative purposes to illustrate the implementation of the present application, and the sequence of steps is not limited and can be adjusted as needed.
Referring to fig. 1, the present invention provides a virtual keyboard control method, including: s101, obtaining an elastic wave signal generated by touch on a substrate, and converting the elastic wave signal into a voltage signal; s102, calculating according to the voltage signal to obtain touch information on the substrate, obtaining touch force and touch position according to the touch information, comparing the touch force and the touch position with a preset threshold value, and obtaining a touch instruction according to a comparison result; s103, obtaining corresponding target input key information according to the touch instruction and the touch position in the touch information, and outputting a corresponding control signal according to the target input key information. In the embodiment, the substrate comprises materials such as a glass plate, a wood plate and a metal plate which can generate elastic wave signals, or an existing touch screen and a non-touch screen, and when the substrate is in actual use, the elastic wave signals on the substrate are mainly collected through a piezoelectric sensor, the touch force and the position of a user touching the substrate are obtained through analysis and calculation according to the elastic wave signals, then whether the user is a real operation intention is judged according to the touch force and the position, and when the operation is confirmed to be the real intention of the user, an actual operation instruction of the user is determined according to a comparison result of the touch position and a preset area on the substrate; for example, after the user taps the substrate, the tapping force and position are calculated according to the elastic wave signal generated by tapping, whether the user needs to input data is determined through the tapping force and/or position, after the determination, the control instruction corresponding to the tapping force and/or position can be judged through the pre-stored information such as a threshold value or an area, and then the device using the virtual keyboard can give corresponding output according to the control instruction. In the above embodiments, the predetermined threshold may be dynamically adjusted, for example: acquiring the touch force in a preset time period according to a user instruction; and adjusting the preset threshold value according to the touch force. Therefore, different users can set different preset thresholds according to own use habits in actual use, and more personalized setting schemes are provided for the users.
It should be noted that, in the above embodiment, obtaining the touch strength and the touch position according to the touch information specifically includes: acquiring a touch position during touch by using a touch screen or other auxiliary structures, acquiring touch force of the touch through the touch information, namely the elastic wave signal, and then handing the touch position and the touch force for further processing; of course, the touch position and the touch force can also be calculated simultaneously by the elastic wave signal generated during the touch, wherein the manner of calculating the touch position by using the elastic wave signal can be realized by the existing identification method, and the invention is not explained in more detail here.
In the above embodiment, the calculating the touch information on the substrate according to the voltage signal may include: and calculating to obtain a fluctuation change value of the voltage signal according to the voltage signal, and calculating to obtain touch force generated by touch according to the fluctuation change value. Of course, in order to determine the actual touch force more accurately, the fluctuation value of the voltage signal may be calculated according to the voltage signal, and the touch force generated by the touch may be calculated according to the fluctuation value and the touch position where the elastic wave signal is generated. Therefore, a distance value is further introduced, attenuation errors existing in the elastic wave signal in the propagation process are further reduced according to the distance value, and certainly in the actual process, because the area of the virtual keyboard is small, the errors can be ignored under the condition that the accuracy required by the strength is not high, and the invention is not limited herein; in the embodiment, the method for calculating the touch strength is mainly determined by a fluctuation change value of the voltage signal, when the fluctuation change value exceeds the reference data too much, the touch strength is larger, and if the fluctuation change value exceeds the reference data less, the touch strength is smaller; for example, when passing one or more piezoelectric sensors C1To CnRespectively converting the respectively received elastic wave signals into voltage signals D with the frequencies consistent with those of the elastic wave signals received by the elastic wave signals1To DnAccording to the voltage signals D1To DnRespectively calculating the energy value E of each voltage signal1To EnAnd finally, the energy value E is used1To EnOne or more ofAccumulating the values to obtain a final elastic wave total energy value, wherein the elastic wave total energy value can reflect the pressure information generated by the substrate in a touch state, so that actual force information is obtained; it should be noted that, in the above process, the method for calculating the energy value according to the voltage signal can be mainly calculated by the following formula:
or
In the above formula, m is the number of collected signal points; n is the number of signal points determined by selecting the wavelength of the voltage signal with the preset length according to the actual situation, and related technicians in the field can select the setting according to the actual needs, and the invention is not further limited herein; e is the energy value of the voltage signal.
In an embodiment of the invention, the step S102 of obtaining touch information on the substrate according to the voltage signal further includes: and calculating to obtain a signal characteristic value of the voltage signal according to the voltage signal, comparing the signal characteristic value with a pre-stored reference characteristic value, and obtaining a touch position according to a comparison result. Wherein, calculating and obtaining the signal characteristic value of the voltage signal according to the voltage signal comprises: according to the voltage signal obtained by touching the preset position, a characteristic model is established through a machine learning algorithm and/or a deep learning algorithm, and a signal characteristic value of the voltage signal is obtained through calculation according to the voltage signal and the characteristic model. In actual work, a worker can collect an elastic wave signal generated by touching a designated position in advance, convert the elastic wave signal into a voltage signal, train the voltage signal as an input signal through a machine learning algorithm and/or a deep learning algorithm to obtain a feature model for extracting a signal feature value in the voltage signal, and manually analyze a feature part with higher difference in the voltage signal to obtain a feature value corresponding to the voltage signal, wherein the feature value is a reference feature value corresponding to the voltage signal; at the moment, the voltage signal is used as input, the reference characteristic value is used as output, and a characteristic model is established through a deep learning algorithm or a machine learning algorithm; and when the actual user touches the touch screen, the voltage signal obtained by calculation can be analyzed and calculated by the characteristic model to obtain the corresponding signal characteristic value. Certainly, in actual work, a feature model can be obtained by collecting a large number of voltage signals generated by touch and utilizing the voltage signals through a machine learning algorithm and/or a deep learning algorithm, a signal feature value of the touch can be obtained through the feature model and the voltage signals generated by actual touch of a user in a later period, and then a real position is determined according to the similarity between the signal feature value and a reference feature value; of course, the characteristic value of the predetermined position in the voltage signal, such as the peak value, the fluctuation variation value or the phase characteristic and the time difference characteristic in the specific wavelength range, may also be extracted according to the actual requirement, and then the extracted signal characteristic value is compared with the characteristic values in the preset characteristic library, and the similarity between the two is obtained through the comparison algorithm of averaging variance, cosine correlation, etc., and then it is further determined which reference characteristic value corresponds to the signal characteristic value according to the similarity, and after the most similar reference characteristic value is determined, the corresponding touch position can be obtained according to the reference characteristic value, so as to determine the actual occurrence position of the elastic wave generated by the substrate due to the touch; the invention is not limited in detail, and those skilled in the art can select the application according to the actual needs.
In actual work, when a user uses a keyboard, a palm is placed on the keyboard more or less, elastic wave signals are generated when the palm moves slightly, but the signals are not the operation intention of the user; to avoid that these signals interfere with subsequent operations, in an embodiment of the present invention, the obtaining the touch force and the touch position according to the touch information, comparing the touch force and the touch position with a preset threshold, and obtaining the touch command according to the comparison result includes: and comparing the touch force with a preset threshold, comparing the touch position with a preset area when the touch force is greater than or equal to the preset threshold, and obtaining a touch instruction according to a comparison result. Therefore, whether the operation is the real intention of the user or not is distinguished through the force generated during touch, and the situation of mistaken touch is prevented; certainly, when the user uses the virtual keyboard, in view of that the virtual keyboard does not have the touch sense of the conventional keyboard any more, and cannot directly provide real touch feedback, in order to avoid the erroneous input caused by the inaccurate tapping position during the user input, in an embodiment of the present invention, the method further includes adjusting the corresponding relationship between the tapping position and the corresponding target input key information according to the tapping position and the received user feedback signal. Wherein, the adjusting the corresponding relationship between the touch position and the corresponding target input key information according to the touch position and the received user feedback signal comprises: and establishing a calibration model through a machine learning algorithm and/or a deep learning algorithm according to the touch position and the user feedback signal, and adjusting the corresponding relation between the touch position and the corresponding target input key information through the calibration model. In this embodiment, the user feedback signal mainly includes information such as a deletion operation of the user and input data after the deletion operation; therefore, when the feedback signal is received, the previous input data of the user is input by mistake, when the frequency of the feedback signal is higher, the touch instruction representing the preset area is not consistent with the touch instruction input by the user, and at the moment, the corresponding relation between the touch position and the corresponding target input key information can be adjusted; in actual operation, the extraction mode of the feedback signal is also regular or different according to different situations, and the present invention is not described herein too much, and those skilled in the art can select and use the feedback signal according to actual needs.
In order to prevent unnecessary interference caused by external collision to the virtual keyboard, in an embodiment of the present invention, the calculating and obtaining touch information on the substrate according to the voltage signal, obtaining touch strength and touch position according to the touch information, and comparing the touch strength and the touch position with a preset threshold further includes: obtaining an elastic wave signal outside a preset area on the substrate, and converting the elastic wave signal into a voltage signal; obtaining noise information according to the voltage signal; and comparing the touch information with the noise information, and comparing the touch strength and the touch position with a preset threshold value according to a comparison result. In this embodiment, elastic wave signals generated by touches outside the predetermined area on the substrate are further collected in advance, characteristic information of voltage signals corresponding to the elastic wave signals is recorded and stored, and when the virtual keyboard is actually used, the characteristic information is compared with the characteristic information to judge whether the received elastic wave signals are noise information and perform corresponding processing. Of course, those skilled in the art can also train and obtain the noise signal judgment model by using the above machine learning method, and then distinguish the validity of the received elastic wave signal according to the noise signal judgment model, and the detailed method of the present invention is not described herein.
Referring to fig. 2 and fig. 3, the present invention further provides a virtual keyboard control system, which includes a substrate 301, a touch capture module 302, a de-noising module 303 and a calculating module 304; the touch acquisition module 302 is used for acquiring an elastic wave signal generated by touch on the substrate 301 and converting the elastic wave signal into a voltage signal; the denoising module 303 is configured to calculate and obtain touch information on the substrate according to the voltage signal, obtain touch force and touch position according to the touch information, compare the touch force and the touch position with a preset threshold, and obtain a touch instruction according to a comparison result; the calculating module 304 is configured to obtain corresponding target input key information according to the touch instruction and the touch position in the touch information, and output a corresponding control signal according to the target input key information. In the above embodiments, the denoising module 303 and the calculating module 304 may be integrated into a whole processing chip, such as a CPU of a conventional notebook computer, a processing chip of a mobile phone, and the like, which is not further limited herein. The touch acquisition module 302 may include one or more piezoelectric sensors, which may be piezoelectric ceramic sensors, piezoelectric film sensors, piezoelectric crystal sensors, or other sensors having piezoelectric effect; the substrate may be a hard material capable of generating elastic waves by touch, such as metal, glass, wood or plastic.
In the virtual keyboard control system, the denoising module further comprises a force detection unit and a position detection unit, wherein the force detection unit is used for calculating a fluctuation change value of the voltage signal according to the voltage signal and calculating a touch force generated by touch according to the fluctuation change value; wherein, the strength detecting unit may further include: and calculating to obtain a fluctuation change value of the voltage signal according to the voltage signal, and calculating to obtain touch force generated by touch according to the fluctuation change value and a touch position generating the elastic wave signal. The position detection unit is used for calculating and obtaining a signal characteristic value of the voltage signal according to the voltage signal, comparing the signal characteristic value with a pre-stored reference characteristic value and obtaining a touch position according to a comparison result; wherein the position detection unit may further include: according to the voltage signal obtained by touching the preset position, a characteristic model is established through a machine learning algorithm and/or a deep learning algorithm, and a signal characteristic value of the voltage signal is obtained through calculation according to the voltage signal and the characteristic model.
In an embodiment of the present invention, the denoising module further includes: and comparing the touch force with a preset threshold, comparing the touch position with a preset area when the touch force is greater than or equal to the preset threshold, and obtaining a touch instruction according to a comparison result. Wherein the denoising module may further include: obtaining an elastic wave signal outside a preset area on the substrate, and converting the elastic wave signal into a voltage signal; obtaining noise information according to the voltage signal; and comparing the touch information with the noise information, and comparing the touch strength and the touch position with a preset threshold value according to a comparison result. In the embodiment, the characteristic waveform of the external noise signal is stored in advance, so that the user input data and the noise data can be effectively distinguished at the later stage when the user actually inputs the data, irrelevant noise data can be accurately and quickly screened out, and more accurate input experience of the user is provided.
In an embodiment of the present invention, the control system further includes an adjusting module, and the adjusting module is configured to adjust a corresponding relationship between the touch position and the corresponding target input key information according to the touch position and the received user feedback signal. Wherein, the adjusting module can also comprise: and establishing a calibration model through a machine learning algorithm and/or a deep learning algorithm according to the touch position and the user feedback signal, and adjusting the corresponding relation between the touch position and the corresponding target input key information through the calibration model. The convenience of user input can be effectively improved through the adjusting module, the user habit collected in the earlier stage is utilized, the user can be helped to use the virtual keyboard more quickly, and input experience conforming to customization of the user is given to the user. In this embodiment, the control system may further include a threshold setting module, where the threshold setting module is configured to obtain the touch force within a predetermined time period according to a user instruction; and adjusting the preset threshold value according to the touch force.
The virtual keyboard control method and the virtual keyboard control system provided by the invention can provide accurate touch identification on the premise of effectively reducing the volume and weight of the conventional keyboard, are closer to the use habit of a user, and are convenient for effective popularization of the virtual keyboard.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The above-mentioned embodiments are intended to illustrate the objects, technical solutions and advantages of the present invention in further detail, and it should be understood that the above-mentioned embodiments are only exemplary embodiments of the present invention, and are not intended to limit the scope of the present invention, and any modifications, equivalent substitutions, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.
Claims (16)
1. A virtual keyboard control method is characterized in that the control method comprises the following steps:
obtaining an elastic wave signal generated on a substrate according to touch, and converting the elastic wave signal into a voltage signal;
calculating to obtain touch information on the substrate according to the voltage signal, obtaining touch force and touch position according to the touch information, comparing the touch force and the touch position with a preset threshold value, and obtaining a touch instruction according to a comparison result;
acquiring corresponding target input key information according to the touch instruction and the touch position in the touch information, and outputting a corresponding control signal according to the target input key information;
the control method further comprises:
according to the touch position and the received user feedback signal, adjusting the corresponding relation between the touch position and the corresponding target input key information, including: and establishing a calibration model through a machine learning algorithm and/or a deep learning algorithm according to the touch position and the user feedback signal, and adjusting the corresponding relation between the touch position and the corresponding target input key information through the calibration model.
2. The method of claim 1, wherein calculating touch information on the substrate according to the voltage signal comprises: and calculating to obtain a fluctuation change value of the voltage signal according to the voltage signal, and calculating to obtain touch force generated by touch according to the fluctuation change value.
3. The method of claim 1, wherein calculating touch information on the substrate according to the voltage signal comprises: and calculating to obtain a fluctuation change value of the voltage signal according to the voltage signal, and calculating to obtain touch force generated by touch according to the fluctuation change value and a touch position generating the elastic wave signal.
4. The method of claim 1, wherein calculating touch information on the substrate according to the voltage signal comprises: and calculating to obtain a signal characteristic value of the voltage signal according to the voltage signal, comparing the signal characteristic value with a pre-stored reference characteristic value, and obtaining a touch position according to a comparison result.
5. The virtual keyboard control method of claim 4, wherein calculating the signal characteristic value of the voltage signal according to the voltage signal comprises: according to the voltage signal obtained by touching the preset position, a characteristic model is established through a machine learning algorithm and/or a deep learning algorithm, and a signal characteristic value of the voltage signal is obtained through calculation according to the voltage signal and the characteristic model.
6. The virtual keyboard control method of claim 1, wherein comparing the touch strength and the touch position with a preset threshold, and obtaining the touch command according to the comparison result comprises: and comparing the touch force with a preset threshold, comparing the touch position with a preset area when the touch force is greater than or equal to the preset threshold, and obtaining a touch instruction according to a comparison result.
7. The method of claim 1, wherein the calculating of the voltage signal includes obtaining touch information on a substrate, obtaining touch strength and touch position according to the touch information, and comparing the touch strength and touch position with a preset threshold further includes: obtaining an elastic wave signal outside a preset area on the substrate, and converting the elastic wave signal into a voltage signal; obtaining noise information according to the voltage signal; and comparing the touch information with the noise information, and comparing the touch strength and the touch position with a preset threshold value according to a comparison result.
8. The virtual keyboard control method of claim 1, wherein the control method further comprises: acquiring the touch force in a preset time period according to a user instruction; and adjusting the preset threshold value according to the touch force.
9. The virtual keyboard control system is characterized by comprising a substrate, a touch acquisition module, a denoising module and a calculation module;
the touch acquisition module is used for acquiring an elastic wave signal generated on the substrate according to touch and converting the elastic wave signal into a voltage signal;
the de-noising module is used for calculating and obtaining touch information on the substrate according to the voltage signal, obtaining touch force and touch position according to the touch information, comparing the touch force and the touch position with a preset threshold value, and obtaining a touch instruction according to a comparison result;
the computing module is used for acquiring corresponding target input key information according to the touch instruction and the touch position in the touch information, and outputting a corresponding control signal according to the target input key information;
the control system further comprises an adjusting module, wherein the adjusting module is used for adjusting the corresponding relation between the touch position and the corresponding target input key information according to the touch position and the received user feedback signal, and the adjusting module comprises: and establishing a calibration model through a machine learning algorithm and/or a deep learning algorithm according to the touch position and the user feedback signal, and adjusting the corresponding relation between the touch position and the corresponding target input key information through the calibration model.
10. The virtual keyboard control system of claim 9, wherein the de-noising module further comprises a force detection unit, the force detection unit is configured to obtain a fluctuation variation value of the voltage signal according to the voltage signal, and obtain a touch force generated by a touch according to the fluctuation variation value.
11. The virtual keyboard control system of claim 10, wherein the force detection unit further comprises: and calculating to obtain a fluctuation change value of the voltage signal according to the voltage signal, and calculating to obtain touch force generated by touch according to the fluctuation change value and a touch position generating the elastic wave signal.
12. The virtual keyboard control system of claim 9, wherein the de-noising module further comprises a position detection unit, and the position detection unit is configured to calculate a signal characteristic value of the voltage signal according to the voltage signal, compare the signal characteristic value with a pre-stored reference characteristic value, and obtain a touch position according to a comparison result.
13. The virtual keyboard control system of claim 12, wherein the position detection unit comprises: according to the voltage signal obtained by touching the preset position, a characteristic model is established through a machine learning algorithm and/or a deep learning algorithm, and a signal characteristic value of the voltage signal is obtained through calculation according to the voltage signal and the characteristic model.
14. The virtual keyboard control system of claim 9, wherein the denoising module further comprises: and comparing the touch force with a preset threshold, comparing the touch position with a preset area when the touch force is greater than or equal to the preset threshold, and obtaining a touch instruction according to a comparison result.
15. The virtual keyboard control system of claim 9, wherein the denoising module further comprises: obtaining an elastic wave signal outside a preset area on the substrate, and converting the elastic wave signal into a voltage signal; obtaining noise information according to the voltage signal; and comparing the touch information with the noise information, and comparing the touch strength and the touch position with a preset threshold value according to a comparison result.
16. The virtual keyboard control system of claim 9, further comprising a threshold setting module, wherein the threshold setting module is configured to obtain the touch strength within a predetermined time period according to a user instruction; and adjusting the preset threshold value according to the touch force.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810403058.9A CN110413189B (en) | 2018-04-28 | 2018-04-28 | Virtual keyboard control method and system |
| PCT/CN2019/084557 WO2019206280A1 (en) | 2018-04-28 | 2019-04-26 | Control method for virtual keyboard |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810403058.9A CN110413189B (en) | 2018-04-28 | 2018-04-28 | Virtual keyboard control method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110413189A CN110413189A (en) | 2019-11-05 |
| CN110413189B true CN110413189B (en) | 2021-12-10 |
Family
ID=68295852
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810403058.9A Active CN110413189B (en) | 2018-04-28 | 2018-04-28 | Virtual keyboard control method and system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN110413189B (en) |
| WO (1) | WO2019206280A1 (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112327783A (en) * | 2020-11-17 | 2021-02-05 | 深圳Tcl新技术有限公司 | Device control method, device, terminal and computer readable storage medium |
| CN112925417B (en) * | 2021-02-25 | 2022-04-12 | 吉林大学 | Virtual keyboard key touch transmission method for information identification |
| CN113179094B (en) * | 2021-04-14 | 2024-05-17 | 燕山大学 | Capacitive piezoelectric touch virtual key and design method thereof |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1838048A (en) * | 2005-03-23 | 2006-09-27 | 富士通株式会社 | Touch panel device and control method and device for eliminating noises in touch panel device |
| CN101673163A (en) * | 2008-09-08 | 2010-03-17 | 统宝光电股份有限公司 | A sensing circuit used in a capacitance touching control panel |
| CN102184069A (en) * | 2011-06-01 | 2011-09-14 | 汉王科技股份有限公司 | Electromagnetic handwriting device and noise elimination method thereof |
| CN102298462A (en) * | 2011-05-31 | 2011-12-28 | 汉王科技股份有限公司 | Electronic device based on vibration induction and control method thereof |
| CN103186261A (en) * | 2011-12-27 | 2013-07-03 | 汉王科技股份有限公司 | Touch control method and device |
| CN106687967A (en) * | 2014-09-25 | 2017-05-17 | 齐科斯欧公司 | Method and apparatus for classifying contacts with a touch sensitive device |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9733745B1 (en) * | 2007-12-31 | 2017-08-15 | Cypress Semiconductor Corporation | Pressure detection system for touch-sense devices |
| US20160266720A1 (en) * | 2011-12-19 | 2016-09-15 | Egalax_Empia Technology Inc. | Touch method and touch processor |
| CN102880347B (en) * | 2012-09-20 | 2016-11-02 | 敦泰科技有限公司 | A kind of touch panel device and processing method thereof |
| CN103279223B (en) * | 2013-05-27 | 2016-11-23 | 深圳市金立通信设备有限公司 | A kind of method of touch information feedback, equipment and system |
| CN107357498A (en) * | 2017-05-16 | 2017-11-17 | 陆培杰 | A kind of touch control method to touch-control equipment |
| CN107506092B (en) * | 2017-09-30 | 2021-02-19 | 联想(北京)有限公司 | Input control method and terminal |
-
2018
- 2018-04-28 CN CN201810403058.9A patent/CN110413189B/en active Active
-
2019
- 2019-04-26 WO PCT/CN2019/084557 patent/WO2019206280A1/en active Application Filing
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1838048A (en) * | 2005-03-23 | 2006-09-27 | 富士通株式会社 | Touch panel device and control method and device for eliminating noises in touch panel device |
| CN101673163A (en) * | 2008-09-08 | 2010-03-17 | 统宝光电股份有限公司 | A sensing circuit used in a capacitance touching control panel |
| CN102298462A (en) * | 2011-05-31 | 2011-12-28 | 汉王科技股份有限公司 | Electronic device based on vibration induction and control method thereof |
| CN102184069A (en) * | 2011-06-01 | 2011-09-14 | 汉王科技股份有限公司 | Electromagnetic handwriting device and noise elimination method thereof |
| CN103186261A (en) * | 2011-12-27 | 2013-07-03 | 汉王科技股份有限公司 | Touch control method and device |
| CN106687967A (en) * | 2014-09-25 | 2017-05-17 | 齐科斯欧公司 | Method and apparatus for classifying contacts with a touch sensitive device |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019206280A1 (en) | 2019-10-31 |
| CN110413189A (en) | 2019-11-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20240231601A1 (en) | Force sensing system and method | |
| CN101702107B (en) | Systems and methods for adaptive interpretation of input from a touch-sensitive input device | |
| TWI484380B (en) | Determinative method and device of touch point movement | |
| TWI605359B (en) | Gesture identification method and apparatus applied in a touchpad | |
| US8730187B2 (en) | Techniques for sorting data that represents touch positions on a sensing device | |
| CN110132458B (en) | Dynamic or quasi-dynamic force detection device and method | |
| JP5332519B2 (en) | Touch panel, operation detection method, and electronic device | |
| US20100214253A1 (en) | Drift compensation apparatus of capacitive touch panel and drift compensation method thereof | |
| US20090051667A1 (en) | Method and apparatus for providing input feedback in a portable terminal | |
| CN110413189B (en) | Virtual keyboard control method and system | |
| US20120007816A1 (en) | Input Control Method and Electronic Device for a Software Keyboard | |
| WO2019206279A1 (en) | Smart device control method | |
| US7804490B2 (en) | Method for multiple gesture detection and verification on a touchpad | |
| CN103164067A (en) | Method for judging touch input and electronic device | |
| CN103324410A (en) | Method and apparatus for detecting touch | |
| US7710404B2 (en) | Method for gesture detection on a touchpad | |
| US7855719B2 (en) | Touch input method and portable terminal apparatus | |
| CN105867684A (en) | Object controlling method and device | |
| US8049647B2 (en) | Capacitive keyboard device with a keystroke triggering threshold adaptively adjustable capability | |
| US11515875B2 (en) | Device comprising force sensors | |
| CN105824565A (en) | Terminal control method and terminal | |
| CN105867814A (en) | Terminal unlocking method and terminal | |
| US7982717B2 (en) | Method for gesture detection on a touchpad | |
| CN105892801A (en) | Desktop icon processing method and terminal | |
| CN110321020A (en) | A kind of piezo-electric sensor signals noise remove method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |